Staff Product Manager, Machine Learning Evaluation

Etsy is the global marketplace for unique and creative goods. We build, power, and evolve the tools and technologies that connect millions of entrepreneurs with millions of buyers around the world. As an Etsy Inc. employee whether a team member of Etsy, Reverb, or Depop you will tackle unique, meaningful, and large-scale problems alongside passionate coworkers, all the while making a rewarding impact and Keeping Commerce Human

What’s the role?

We are looking for a Staff Product Manager to join our ML Enablement team and drive the platform vision and strategy for our ML evaluation capabilities at Etsy.

Our Staff Product Manager will be responsible for defining and implementing strategy for the evaluation services at Etsy. ML evaluation is a critical component for the success of a machine learning model in production to deliver outstanding customer experiences. Every team that uses ML at Etsy will be impacted by the capabilities developed by the Evaluation team. Do you find joy in big picture thinking and playing long term while driving business critical metrics? If so, this could be the perfect match!

This is a full-time position reporting to the Product Director, ML Enablementand the base salary range will be 172,000 - 224,000 USD per year. In addition to salary, you will also be eligible for an equity package, an annual performance bonus, and our competitive benefits that support you and your family as part of your total rewards package at Etsy.  For this role, we are considering candidates based in the United States. You will have the option to work office-based, flex or remotely. Candidates living within commutable distance of the Etsy Brooklyn Hub, or within the San Francisco area, may be the first to be considered. Etsy offers different work modes to meet the variety of needs and preferences of our team. Learn more about our Flex and Office-based work modes and workplace safety policies here.

What’s this team like at Etsy?

At Etsy, the ML Evaluation team builds end to end evaluation capabilities such as features, models, online/offline parity, latency etc to help customers assess performance of their ML systems. We are on a mission to grow ML adoption at Etsy. We sit at the focal point of several business-critical applications such as Search, Ads, Recommendations, Trust and Safety, and more. We balance several sets of requirements, solving near-term problems while making progress towards a long term strategic vision.

What does the day-to-day look like?

• Play a central role in building the evaluation capabilities that will empower multiple business critical ML workloads at Etsy.
• Build insights into Etsy use-cases, strategize where AI/ML technologies can be applied to drive business impact and use these insights to build and champion the roadmap for ML Evaluation at Etsy.
• Closely partner with outstanding talent across engineering and ML teams, and drive tight integration with other ML systems to build a strong evaluation platform that supports multiple modalities.
• Define clear OKRs that can help the team ensure progress towards our goal of driving ML adoption.
• Define the right telemetry to enable insights for both Product Management & ML Scientist teams.
• Of course, this is just a sample of the kinds of work this role will require! You should assume that your role will encompass other tasks, too, and that your job duties and responsibilities may change from time to time at Etsy's discretion.

Qualities that will help you thrive in this role are:

• Experience in platform product management, defining roadmap and driving team progress to goals.
• A Comfort in crafting roadmaps and strategy for internal facing technical platforms.
• Excellent problem-solving, interpersonal skills, and product intuition with the ability to evolve product strategy based on research, data and industry trends.
• Ability to partner with multiple teams, build insight into their scenarios and infer technical requirements.
• Experience in building ML evaluation tools for features, model inference, or experimentation is preferred but not required.

What's Next

If you're interested in joining the team at Etsy, please share your resume with us and feel free to include a cover letter if you'd like. As we hope you've seen already, Etsy is a place that values individuality and variety. We don't want you to be like everyone else -- we want you to be like you! So tell us what you're all about.

Our Promise

At Etsy, we believe that a diverse, equitable and inclusive workplace furthers relevance, resilience, and longevity. We encourage people from all backgrounds, ages, abilities, and experiences to apply. Etsy is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. If, due to a disability, you need an accommodation during any part of the interview process, please let your recruiter know. While Etsy supports visa sponsorship, sponsorship opportunities may be limited to certain roles and skills.

For U.S. roles only:

Many Etsy roles are open to remote candidates, and you'll be able to identify which ones within the location header of each job description. We're open to remote hires from all U.S. states except Hawaii and Alaska.