AI Operations Specialist

ABOUT BRETTON AI Bretton AI is the leading AI agent platform for financial services. Companies like Robinhood, Mercury, and Gusto trust us to automate mission-critical work, starting with anti-money laundering (AML) and counter-terrorist financing investigations. We've raised over $95M from Greylock, Y Combinator, Thomson Reuters Ventures, and other top-tier investors. We're based in downtown San Francisco and our team comes from world-class organizations like SpaceX, Google, Netflix, Stripe, Plaid, and more. THE ROLE We're looking for a detail-oriented, analytically-minded person to join our AI Operations team. You'll be on the front lines of ensuring our AI agents are performant for banks and fintechs fighting financial crime at scale — monitoring quality, testing new features, and working directly with engineering and customers to keep our platform running at its best. This is a rare opportunity to learn how cutting-edge AI systems work in production while making a real impact on global financial security. WHAT YOU'LL DO - Conduct quality reviews of AI agents to ensure they meet the highest standards for compliance teams at banks and fintechs - Test new features and custom logic before they go live for customers - Analyze case data to identify patterns, issues, and opportunities for improvement - Work directly with engineering to understand and measure the impact of system changes - Learn state-of-the-art AI monitoring techniques including performance drift detection, human scoring pipelines, and dataset preparation - Support our largest customers by providing operational insights and recommendations - Partner with product and engineering to translate operational findings into platform improvements WHAT SUCCESS LOOKS LIKE - Month 1: Master our AI platform and learn complex compliance workflows. Shadow experienced team members and begin conducting your first case reviews. - Month 2: Take ownership of operational support for major customer deployments. Conduct detailed quality assessments and partner with engineering to improve system performance. - Ongoing: Become the go-to expert for AI operations, conducting critical reviews that directly shape product development and customer success. WHAT WE'RE LOOKING FOR - 1–3 years of professional experience or equivalent internship experience - Strong analytical and critical thinking skills with exceptional attention to detail - Ability to review complex information and identify patterns or issues - Comfortable learning new technical systems independently - Strong written and verbal communication skills - Excited to work in a fast-paced startup environment BONUS POINTS - Exposure to financial services, fintech, or regulated industries - Experience at a fast-paced startup - Familiarity with coding/scripting — SQL, dashboards, quick scripts - Customer-facing experience in any capacity - Genuine interest in AI/ML systems and how they're deployed in the real world COMPENSATION & BENEFITS - $90k – $105k base salary + equity - Comprehensive healthcare, 401k matching, commuter benefits - 15 days PTO + holidays, unlimited sick days - Flexible leave options - Working late? We’ve got you covered with DoorDash and an Uber home