Senior Product Manager - Gen AI & LLMs

GenAI is about to be productised by Flo, empowering our users to take control of their health. We help women harness the power of their body signals through a conversational approach, providing personalised and detailed answers to their questions. With our conversational approach and cutting-edge LLM-based technologies, we are opening a new era in this journey. You will create and manage chatbots that offer personalised conversations using cutting-edge machine learning.

You will be the product manager for the ‘Ai Foundation’ team at Flo Health - the team consists of machine learning engineers & data scientists and work closely with the Chatbots engineering team on a daily basis on deploying, adjusting models for LLM based features, setting up systems, evaluation tools to establish the team for success. You will also work extremely collaboratively with the medical, data privacy, security and legal teams to ensure LLMs deployed to production are safe and secure. 

You’ll manage the roadmap, contribute to the company’s goals and make data-informed decisions.

Your goal will be to productionise LLM based chatbots, build the technical infrastructure to expand the work such as integrations with 3rd parties, evaluation and analytics pipelines, monitoring frameworks and then develop the strategy into 2025.

Your Experience

Must have:

• 3+ years of experience in product management including experience working in a technical, data, AI or machine learning PM role. Must have a strong technical background
• Has launched Gen AI or ML based features into production running a team of engineers including ML engineers/ data scientists
• Good knowledge of Gen AI trends, tools and technical landscape and a genuine interest in the domain
• Experience of running experiments
• A track record of fast-paced delivery of features and an iterative test-and-learn approach. 
• Demonstrated ability to handle ambiguity and work collaboratively with cross-functional teams
• Excellent stakeholder management ideally having worked in regulated environments and can easily work with clinical, legal, data privacy, and security teams.
• Excellent written and oral communication, interpersonal, and negotiation skills, technically conversant, and able to collaborate easily with engineers and designers

Nice to have:

• Prior experience working in healthcare
• A background in STEM e.g data science, analyst, maths. 

What you'll be doing

You'll be responsible for:

• Running the day-to-day of the AI Foundation team - organising sprint work, running refinements, working with engineers including ML engineers, to write epics and stories, managing roadmap. Ability to work independently to unblock engineers and problem-solve. 
• Working with 3rd parties developing Gen AI foundations and eco-system integrated into our architecture. 
• Overseeing all specific work around prompt improvements, 
• Building core foundations for LLM based products including evaluation frameworks, monitoring, analytics, ML pipelines,  model APIs and integrations, system evaluation tools.
• Collaborating with a product designer, content designer and UX researcher - designing & delivering new features.
• Leading the team in establishing initiatives that are set and measured as part of the company OKR process
• Uncovering the user needs and problems, prioritising them using quantitative and qualitative data
• Managing clear, thoughtful product requirements and feature descriptions to help teams work efficiently and effectively
• Defining and monitoring product success metrics using data-driven goals

#LI-CC1