Automation Quality Analyst
Location
On-site
Type
Full Time
Overview
We are seeking an experienced Automation Quality Analyst to design, develop, and execute automated test frameworks for AI-driven applications. The ideal candidate will have expertise in automation testing, AI-based test strategies, and a strong understanding of software testing methodologies. You will work closely with AI engineers and software developers to ensure the quality and reliability of AI-powered products.
Key Responsibilities
Design and execute automated testing strategies for AI, ML-based, and other applications
Design and execute test scripts using automation frameworks such as Selenium, Cypress, or Appium
Perform API testing using Postman, RestAssured, or similar tools
Identify, document, and track bugs to closure using tools like Jira, TestRail, or Bugzilla
Conduct performance, security, and scalability testing for AI-driven applications
Collaborate with developers, data scientists, and DevOps teams to ensure smooth integration and deployment
Work with CI/CD pipelines to enable automated testing and continuous delivery
Validate AI models for accuracy, fairness, and reliability
Ensure compliance with data privacy, security, and regulatory requirements
Provide detailed test reports, defect analysis, and quality metrics to stakeholders
Collaborate with product managers, client coordinators, and business analysts to gather and analyze project requirements
Provide insights and recommendations to enhance product functionality and AI-driven solutions
repare and present reports on key performance metrics, system improvements, and issue resolutions
Required Skills & Qualifications
Bachelor's or Master’s degree in Computer Science, IT, or a related field
3+ years of experience in automation testing, preferably in AI-driven applications
Proficiency in automation testing frameworks (Selenium, TestNG, Cypress, Appium, etc.)
Strong scripting skills in Python, Java, or JavaScript for test automation
Hands-on experience with API testing using Postman, Rest Assured, or Karate
Knowledge of AI testing techniques, including model validation and bias detection
Experience with CI/CD tools (Jenkins, GitHub Actions, and Azure DevOps) for test automation
Become familiar with cloud platforms (AWS, Azure, GCP) for AI deployments
Excellent analytical, problem-solving, and communication skills
Exposure to AI/ML testing methodologies and AI model explainability
Experience with performance testing tools like JMeter or Gatling
Understanding of ethical AI principles and bias detection in AI models
ISTQB or relevant testing certifications