Senior Quality Assurance (AI/ML)
Oversees the end-to-end testing of AI/ML solutions, ensuring model accuracy, data integrity, and system reliability Collaborates with data scientists and engineers to develop robust quality standards and automated test frameworks.
Responsibilities
- Design comprehensive test strategies for AI/ML products, covering data validation, model performance, and system integration
- Develop and maintain automated testing frameworks to streamline model evaluations and regression testing
- Collaborate with data scientists to identify edge cases, potential biases, and data-quality issues
- Execute exploratory and stress testing on AI pipelines to confirm resiliency and scalability
- Set up and track key QA metrics (precision, recall, F1-score) for machine learning models
- Review model deployments in production, ensuring real-time monitoring and alerting for performance drifts
- Lead defect triages, root-cause analyses, and resolution tracking for AI-related issues
- Mentor junior QA engineers on AI/ML best practices, test design, and automation techniques
Required Skills
- Bachelor’s degree in Computer Science, Engineering, or related field
- 5+ years of QA experience with a focus on AI/ML or data-intensive systems
- Proficiency in Python or similar languages for test automation
- Understanding of machine learning workflows, data preprocessing, and model evaluation metrics
- Experience with CI/CD pipelines (Jenkins, GitLab, or similar)
- Strong analytical thinking and communication skills
- Proven track record implementing automated tests for complex data pipelines and model deployments
Preferred Qualifications
- Master’s degree in a technical field or specialization in AI/ML
- Familiarity with cloud-based ML platforms (AWS Sagemaker, GCP AI Platform, Azure ML)
- Exposure to containerization/orchestration (Docker, Kubernetes) for testing distributed AI systems
- Certification in QA methodologies (e.g., ISTQB) or advanced machine learning frameworks
compensationAndBenefits
- Innovation: Embrace cutting-edge tools and procedures for quality in AI/ML
- Collaboration: Partner with data scientists, engineers, and stakeholders to deliver robust solutions
- Integrity: Commit to unbiased model testing, ensuring ethical and reliable AI outcomes
- Excellence: Maintain high standards of quality, performance, and efficiency