AI Agent Operations Specialist, Support

At Vanta, our mission is to help businesses earn and prove trust. We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it. At Vanta, our mission is to secure the internet and protect consumer data. We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it. Our goal is to provide best-in-class Technical Support to our customers. Our team's mission: "We transform complexity into clarity in every interaction, with empathy, earning the trust of our customers" We build strong partnerships with our customers through trust and transparency, which is why our Technical Support Metrics are public. As the AI Agent Operations Specialist ,You'll own Ask-Ilma, Vanta's customer-facing AI agent, built on Fin by Intercom, and the first point of contact for customers seeking support.. You're accountable for whether customers get the right answer, how the experience feels, and how smoothly Fin hands off to our support engineers when it should. Our customers rely on Vanta to get compliance right, so a fast answer only counts if it's also a correct one. This is a hands-on role for someone who treats an AI agent like a product: something to measure, tune, test, and improve every week. What you’ll do as a AI Optimization Specialist, Support at Vanta: Performance: Own how well Fin works An AI agent's performance drifts without a clear owner, and that owner is you. You'll have a bias for action, shipping improvements quickly and learning from the results. You'll also decide with frameworks, so the team always understands why one fix came before another. Review Fin conversations weekly to find wrong answers, self-service gaps, and avoidable escalations. Make changes in Fin yourself (guidance, content, workflows). Treat most as two-way doors: ship, measure, adjust. Keep a ranked list of improvements based on customer impact, volume, and risk. Set and document Fin's guardrails: what it must never answer, when it asks a clarifying question, and when it escalates. Knowledge: Own what Fin knows Fin is only as accurate as what it knows. Our customers trust Vanta to get compliance right, and we do what it says on the tin, so Fin's knowledge has to be correct and current. Own the knowledge Fin draws from: snippets, internal content, and our help center. Set the governance: every topic has an owner and a review cadence, and outdated or conflicting content gets retired. When a support engineer answers something Fin couldn't, turn it into reusable knowledge so we only answer it once. Set AI-ready content standards, and partner with Customer Educatio