Virtusa
Gen AI Assurance Architect
Job Description
| GenAI Assurance Architect Responsibilities • Identify the most effective architectures and models to solve complex data problems around Quality Engineering using GenAI • Apply GenAI in automating different aspects of STLC such as Test artefact generation, defect prediction, defect triaging, failure analysis, test optimization and self-healing. • GenAI systems validation including RAG based LLMs for Q&A, generated content and recommendations • Validate performance, security, finetuning and feedback function for LLM based applications • Build solutions to ensure fairness and trustworthiness of GenAI systems by performing automated tests for prompt safety, response accuracy, relevancy, toxicity, biasness and explainability • Lead, mentor, and advise the team members in deploying LLMs and AI models for specified use cases • Document, summarize and present findings and recommendations for Continuous improvement of AI/GenAI implementations across Quality Assurance & Quality Engineering Skills / Qualification • Bachelor’s degree in Statistics, Computer Science, or Engineering • At least 4 years experience in analytics, data science, ML Engineering in SDLC • Experience with building a range of AI /GenAI based models into production for use cases like Test case generation, Defect classification & prediction, Root cause analysis (RCA), auto script generation, Model Based Testing (MBT), Test case optimization, Self-healing etc • At least 1-2 years of experience in building & deploying LLM based solutions from leading vendors like OpenAI – GPT, Google Gemini Pro or AWS Bedrock • Extensive Python experience required with libraries like LangChain, Ragas, Truelens etc • Able to communicate technical issues in AI/GenAI with technical & non-technical stakeholders • Ability to quickly implement POCs on GenAI assurance use cases based on client data |
Jobs at Pune
Capgemini
Group HR process Excellence Head | …
Experienced Professionals
Pune, Maharashtra
Last Date: Oct. 9, 2024
Capgemini
Java Full Stack Engineer
Experienced Professionals
Pune, Maharashtra
Last Date: Oct. 9, 2024
Virtusa
Data Engineering Architect (ATC)
Full Time
Pune, Maharashtra
Last Date: Dec. 15, 2024
Amazon
Packaging Lab incharge
Freshers/Experienced
Pune, Maharashtra
Last Date: Oct. 8, 2024
Capgemini
Vision Plus Developer
Experienced Professionals
Pune, Maharashtra
Last Date: Oct. 9, 2024
Virtusa
Java Micro Services (Backend )tech …
Full Time
Pune, Maharashtra
Last Date: Dec. 31, 2024
Infosys
SAP FICO Consultant
5 - 7 Years Exp.
Pune, Maharashtra
Last Date: Sept. 30, 2024
More Jobs at Virtusa
Virtusa
Data Engineer - Azure Databrick, Sn…
Full Time
Chennai, Tamil Nadu
Last Date: Dec. 31, 2024
Virtusa
Snowflake lead developer
Full Time
Hyderabad, Telangana
Last Date: Dec. 31, 2024
Actively Recruiting Companies at Pune, Maharashtra