AI Benchmarking Specialist, SP Support - Italian, International Seller Growth
Last Date to Apply: March 31, 2026
ApplyAdded Today : 203
Expired Today : 1483
Amazon
The Seller AI team within International Seller Services organization is focused on helping sellers with the right set of Gen-AI/LLM powered tools and agentic solutions that can enable them to accelerate business growth on Amazon. Our primary focus lies in handling annotations for training, measuring, and improving Artificial Intelligence (AI) and Large Language Models (LLMs), enabling Amazon to deliver a superior seller experience to our sellers worldwide. The AI Benchmarking Associate supports the evaluation of AI systems by designing and executing benchmarking and audit activities to assess model quality, compliance, robustness, and fairness. The role combines elements of AI auditing, quality assurance, and traditional audit-style documentation and stakeholder communication. By joining us, you will play a pivotal role in shaping the future of selling on Amazon for sellers worldwide.
Key job responsibilities
As part of your role, you will have the opportunity to,
• Assist in planning and executing benchmarking exercises for AI models, including defining test plans, metrics, and acceptance criteria across accuracy, robustness, bias, and reliability
• Support content accuracy, relevancy, and privacy checks by reviewing datasets, model outputs, and data handling practices, escalating potential regulatory risks.
• Validate data based on specific annotation guidelines, ensuring the accuracy and quality of the collected information
• Prepare clear audit and benchmarking reports, including error ratings, root-cause analysis, and recommendations, and contribute to presentations for senior stakeholders
Maintain organized audit documentation, evidence, and benchmarking datasets to support internal review
• You will work closely with your team members and managers to drive process efficiencies and explore opportunities for automation
• You will strive to enhance the productivity and effectiveness of the data generation by contributing to the development and continuous improvement of AI audit methodologies, checklists, and test frameworks as regulations and best practices evolve
We are open to hiring candidates to work out of:
Bengaluru, Karnataka, IND
About the team
There are millions of small and medium businesses across international stores such as India, LatAm, Europe, Middle East, Japan etc. who sign up as sellers on Amazon. Our primary focus lies in handling annotations for training, measuring, and improving Artificial Intelligence (AI) and Large Language Models (LLMs), enabling Amazon to deliver a superior seller experience to our sellers worldwide. - Speak, write, and read fluently in Italian
Amazon
Senior Vendor Manager, AWIPL
Freshers/Experienced
Bengaluru, Karnataka
Last Date: March 24, 2026
Amazon
Senior Product Manager, Retail Busi…
Freshers/Experienced
Bengaluru, Karnataka
Last Date: March 24, 2026
Amazon
Sr Program Manager (Discovery), FIX…
Freshers/Experienced
Bengaluru, Karnataka
Last Date: March 24, 2026
Oracle
Senior AI Applications Engineer
Professional
Bengaluru, Karnataka
Last Date: April 13, 2026
Amazon
Startup Sales Head - India Greenfie…
Freshers/Experienced
Bengaluru, Karnataka
Last Date: March 24, 2026
Oracle
Senior Member of Technical Staff
Professional
Bengaluru, Karnataka
Last Date: April 12, 2026
Amazon
Software Dev Engineer II, UTR Tech
Freshers/Experienced
Bengaluru, Karnataka
Last Date: March 31, 2026
Amazon
Software Dev Engineer II, Transport…
Freshers/Experienced
Bengaluru, Karnataka
Last Date: March 31, 2026
Oracle
Senior Software Development Engineer
Professional
Bengaluru, Karnataka
Last Date: March 29, 2026
Oracle
Data Integration Engineer
Professional
Bengaluru, Karnataka
Last Date: June 8, 2026
Oracle
Senior Member Technical Staff
Professional
Bengaluru, Karnataka
Last Date: Aug. 16, 2026
Amazon
Data Center Manager, Data Center Op…
Freshers/Experienced
Mumbai, Maharashtra
Last Date: March 24, 2026
Amazon
ID-LB Cabling Infrastructure Tech, …
Freshers/Experienced
Hyderabad, Telangana
Last Date: March 24, 2026
Amazon
ML Data Associate I
Freshers/Experienced
Chennai, Tamil Nadu
Last Date: March 24, 2026
Amazon
ML Data Associate I, V-CARE
Freshers/Experienced
Chennai, Tamil Nadu
Last Date: March 24, 2026
Amazon
Seasonal My HR Live Support Associa…
Freshers/Experienced
Hyderabad, Telangana
Last Date: March 24, 2026
Amazon
Transportation Representative, Amaz…
Freshers/Experienced
Virtual, Virtual
Last Date: March 31, 2026
Amazon
Business Intel Engineer, GRAM-T Tech
Freshers/Experienced
Bengaluru, Karnataka
Last Date: March 24, 2026
Amazon
Advertising Ops Analyst, Amazon
Freshers/Experienced
Bengaluru, Karnataka
Last Date: March 31, 2026
Amazon
Support Engineer, LMAQ-DE
Freshers/Experienced
Hyderabad, Telangana
Last Date: March 24, 2026
Amazon
Multi-lingual Escalation Specialist…
Freshers/Experienced
Bengaluru, Karnataka
Last Date: March 31, 2026
Amazon
Sr Buyer, Global Procurement Centra…
Freshers/Experienced
Hyderabad, Telangana
Last Date: March 31, 2026
Amazon
Manager, ML Data Operation, Quick
Freshers/Experienced
Chennai, Tamil Nadu
Last Date: March 24, 2026