Added Today : 1457
Expired Today : 26
Amazon
Join the Seller AI team where you'll lead benchmarking and evaluation of AI models that enhance the seller experience across Amazon's global marketplace. You'll manage a team dedicated to validating, testing, and improving Artificial Intelligence (AI) and Large Language Models (LLMs) that power innovative seller tools. This role combines strategic leadership with hands-on technical oversight, requiring exceptional communication skills, team management, and stakeholder engagement.
In this position, you'll drive the development and implementation of comprehensive benchmarking methodologies to evaluate AI model performance across accuracy, robustness, bias, and reliability metrics. Your expertise will be crucial in translating technical findings into actionable insights that improve Seller Assistant's performance and contribute to the growth of Amazon's seller community worldwide.
Key job responsibilities
1. Plan and execute benchmarking exercises for AI models, defining test plans, metrics, and acceptance criteria across accuracy, robustness, bias, and reliability dimensions
2. Lead a team responsible for validating data based on specific annotation guidelines, ensuring accuracy and quality while escalating potential regulatory risks
3. Prepare comprehensive audit and benchmarking reports, including error ratings, root-cause analysis, and recommendations for senior stakeholders
4. Drive process efficiencies and explore automation opportunities to enhance the productivity of data generation initiatives
5. Mentor team members and help develop their skills while managing overall schedules, proactively mitigating risks, and keeping project scope under control.
A day in the life
Your day begins with prioritizing benchmarking tasks for your team based on current business requirements. You'll review progress on ongoing audits, provide guidance where needed, and ensure deliverables meet quality standards. Throughout the day, you'll analyze performance data from Seller Assistant tools, identifying patterns and insights that could improve AI model effectiveness. You'll wrap up by preparing detailed presentations that showcase your team's findings and recommendations to leadership, highlighting opportunities to enhance the seller experience.
About the team
The Seller AI team within International Seller Services is dedicated to creating Gen-AI/LLM powered tools and agentic solutions that accelerate business growth for Amazon sellers worldwide. We focus on handling annotations for training, measuring, and improving Artificial Intelligence and Large Language Models to deliver superior seller experiences. Our team combines technical expertise with a deep understanding of seller needs to develop innovative solutions that simplify complex tasks and drive business growth.
By joining us, you'll play a pivotal role in shaping the future of selling on Amazon, working with cutting-edge AI technologies that directly impact millions of sellers across global marketplaces.- Bachelor's degree, or MBA in business, data science, public administration, finance, engineering, human resources or related field
- - Min. 5 to 8 years of exp. as a People Manager with good communication skills
KPMG
Senior - Azure Data Engineering
KI Professional
Bangalore, Karnataka
Last Date: March 4, 2026
KPMG
Senior - Oracle Fusion HCM technical
KI Professional
Bangalore, Karnataka
Last Date: March 11, 2026
KPMG
Assistant Manager - Snowflake
KI Professional
Bangalore, Karnataka
Last Date: March 4, 2026
Capgemini
Software Asset Management
Experienced Professionals
Bangalore, Karnataka
Last Date: March 4, 2026
KPMG
Senior - TPRM-Advisory Services
KI Professional
Bangalore, Karnataka
Last Date: March 11, 2026
KPMG
Assistant Manager - Azure Data Engi…
KI Professional
Bangalore, Karnataka
Last Date: March 4, 2026
KPMG
Azure Data Engineer - Manager
KI Professional
Bangalore, Karnataka
Last Date: March 4, 2026
Accolite
ServiceNow Business Analyst – SAM
5 - 8 Years Exp.
Bangalore, Karnataka
Last Date: March 14, 2026
Capgemini
Windows Device Driver Engineer
Experienced Professionals
Bangalore, Karnataka
Last Date: March 11, 2026
Capgemini
Release & Deployment Manager
Experienced Professionals
Bangalore, Karnataka
Last Date: March 11, 2026
KPMG
Technology Consulting-DT IT Audit A…
KI Professional
Bangalore, Karnataka
Last Date: March 4, 2026
Capgemini
Software Integration and Embedded T…
Experienced Professionals
Bangalore, Karnataka
Last Date: March 11, 2026
Amazon
Program Manager II
Freshers/Experienced
Bengaluru, Karnataka
Last Date: March 17, 2026
Amazon
Program Manager II, ResQ, SPTO
Freshers/Experienced
Bengaluru, Karnataka
Last Date: March 3, 2026
Amazon
Senior Program Manager, RBS BQA
Freshers/Experienced
Chennai, Tamil Nadu
Last Date: March 17, 2026
Amazon
Team Lead, Sort Center
Freshers/Experienced
Pune, Maharashtra
Last Date: March 17, 2026
Amazon
Transportation Spc - Portuguese , C…
Freshers/Experienced
Virtual, Virtual
Last Date: March 17, 2026
Amazon
Head of Customer Excellence , Amazo…
Freshers/Experienced
Bengaluru, Karnataka
Last Date: March 17, 2026
Amazon
Sr. Administrator, BXT, Benefits, S…
Freshers/Experienced
Hyderabad, Telangana
Last Date: March 17, 2026
Amazon
Corporate Telecom Billing Analyst
Freshers/Experienced
Bengaluru, Karnataka
Last Date: March 17, 2026
Amazon
Software Development Engineer II, A…
Freshers/Experienced
Hyderabad, Telangana
Last Date: March 3, 2026
Amazon
Software Development Engineer, Ale…
Freshers/Experienced
Hyderabad, Telangana
Last Date: March 10, 2026
Amazon
Tax Compliance Analyst I, Tax & Tra…
Freshers/Experienced
Bengaluru, Karnataka
Last Date: March 10, 2026
Amazon
Software Development Engineer
Freshers/Experienced
Hyderabad, Telangana
Last Date: March 3, 2026