Note: The job is a remote job and is open to candidates in USA. MCI is one of the fastest-growing tech-enabled business services companies in the USA, specializing in customer experience and business process outsourcing solutions. They are seeking an AI Tester / AI QA Analyst to ensure the quality and effectiveness of AI-powered products, focusing on validating AI functionality and ensuring compliance with business requirements.
Responsibilities
- Ensure AI systems perform as expected across multiple use cases
- Design and execute AI testing strategies and test cases
- Validate model outputs against expected outcomes
- Assess system reliability, consistency, and performance
- Identify defects, anomalies, and areas for improvement
- Support the delivery of high-quality AI solutions
- Conduct functional, regression, and user acceptance testing
- Verify compliance with business and regulatory requirements
- Maintain testing documentation and evidence
- Support release readiness assessments
- Provide insights into AI system effectiveness
- Analyze testing results and identify trends
- Develop reports and recommendations
- Track quality metrics and performance indicators
- Support root cause analysis activities
- Work closely with technical and business teams
- Collaborate with AI engineers and product managers
- Participate in requirements and solution reviews
- Provide feedback throughout the development lifecycle
- Support continuous quality improvement initiatives
- Help advance AI testing practices across the organization
- Evaluate new AI testing methodologies and tools
- Recommend enhancements to quality frameworks
- Stay informed about AI and Generative AI developments
- Contribute to best practices and standards
Skills
- Bachelor's Degree in Information Technology, Computer Science, Quality Assurance, Engineering, or a related field
- Minimum 3 years of software testing, QA, or technology-related experience
- Experience creating and executing test plans and test cases
- Strong analytical and troubleshooting skills
- Experience documenting defects and test outcomes
- Understanding of software development lifecycle methodologies
- Familiarity with AI, machine learning, or Generative AI concepts
- Strong attention to detail
- Ability to analyze large volumes of information and identify patterns
- Strong written and verbal communication skills
- Experience working within Agile environments
- Ability to collaborate effectively with technical teams
- Experience testing AI or machine learning solutions
- Knowledge of chatbot testing and conversational AI evaluation
- Experience with QA automation tools
- Familiarity with prompt engineering concepts
- Understanding of AI governance and compliance requirements
- Experience within SaaS, technology, or BPO environments
- Certifications in software testing or quality assurance
- Exposure to AI evaluation frameworks
Company Overview