Associate Lead - Testing (QA + MLOps)

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth. If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with […]!

Role: Lead/Associate Lead – QA + MLOps & Generative AI Experience: 10+ years Location: Mumbai/Bangalore (Hybrid) Key

AI/ML & GenAI Testing Strategy (AWS Ecosystem) Define testing approaches for AI systems built on AWS services such as: Amazon SageMaker Amazon Bedrock AWS Lambda Amazon API Gateway Amazon Kinesis AWS Glue Amazon S3 Amazon CloudWatch Design validation frameworks covering: Model accuracy & performance validation Data drift & concept drift detection Hallucination detection for LLMs Prompt robustness testing RAG validation (retrieval accuracy + grounding) Bias & fairness validation Safety & toxicity testing MLOps Quality Engineering (AWS-Centric) Validate the end-to-end ML lifecycle including: Data ingestion & feature pipelines Model training & hyperparameter tuning Model versioning & registry Deployment validation Canary & blue/green release validation Work with AWS-native services such as: SageMaker Pipelines SageMaker Model Monitor SageMaker Feature Store Bedrock model evaluation workflows CloudWatch-based observability Implement CI/CD qua