All fields marked * are required
About the Role
We are looking for a highly skilled and experienced Senior QA Engineer with strong expertise in GenAI, VoiceAI, Telephony, and IVR testing. The ideal candidate will be responsible for ensuring high-quality delivery of next-generation AI-driven voice and conversational systems, including robust guardrail validations, performance testing, and end-to-end functional assurance.
Key Responsibilities
· Conduct functional, regression, integration, and system testing for GenAI and VoiceAI-based applications.
· Perform IVR testing, including call flows, speech recognition, prompts, routing, and fallback handling.
· Validate telephony-related components, including SIP (Session Initiation Protocol), call events, call transfers, call queue logic, and agent workflows.
· Ensure AI guardrails (content moderation, safety filters, hallucination checks) are thoroughly tested and validated.
· Test conversational flows, voice prompts, LLM responses, ASR (Automatic Speech Recognition), and TTS (Text-to-Speech) output quality.
· Develop and maintain test strategy, test plans, test cases, and automation frameworks.
· Work closely with product owners, architects, and engineering teams to review requirements and define acceptance criteria.
· Ensure adherence to QA best practices and contribute to continuous improvement of processes.
· Leverage automation tools for IVR and telephony testing (e.g., BlueJay, Cyara, Empirix, custom automation).
· Write and execute automation scripts.
· Analyze logs from AI services, telephony servers, call routers, and backend systems.
· Document defects, track them to closure, and communicate quality risks proactively.
· Provide clear test reports, dashboards, and quality metrics to stakeholders.
Required Skills & Experience
Technical Skills
· 8–12 years of experience in software testing.
· Hands-on experience in GenAI / LLM testing, prompt validation, response evaluation, and guardrail testing.
· Strong experience in VoiceAI systems, ASR/TTS validation, voice bot testing, and multimodal testing.
· Proven experience in Telephony and IVR testing—SIP, call flows, routing, voice apps, VXML, CCaaS platforms.
· Experience testing cloud-based communication platforms.
· Familiarity with conversational design, NLP/NLU testing, and VoiceBot frameworks.
· Experience with API testing tools (Postman, REST Assured), log analysis, and debugging.
· Good understanding of automation frameworks and scripting languages (Python, Java, or similar).
Soft Skills
· Strong communication and analytical skills.
· Ability to work with cross-functional teams.
· Self-driven, detail-oriented, and capable of working in fast-paced environments.
Preferred Qualifications
· Experience working on AI-driven contact center solutions or conversational AI platforms.
· Immediate joiners.
· Exposure to safety/guardrail frameworks in LLM or VoiceAI systems.
· Certifications in testing, cloud platforms, or telephony systems (ISTQB, AWS, etc.).
Required
Preferred
All fields marked * are required
About the Role
We are looking for a highly skilled and experienced Senior QA Engineer with strong expertise in GenAI, VoiceAI, Telephony, and IVR testing. The ideal candidate will be responsible for ensuring high-quality delivery of next-generation AI-driven voice and conversational systems, including robust guardrail validations, performance testing, and end-to-end functional assurance.
Key Responsibilities
· Conduct functional, regression, integration, and system testing for GenAI and VoiceAI-based applications.
· Perform IVR testing, including call flows, speech recognition, prompts, routing, and fallback handling.
· Validate telephony-related components, including SIP (Session Initiation Protocol), call events, call transfers, call queue logic, and agent workflows.
· Ensure AI guardrails (content moderation, safety filters, hallucination checks) are thoroughly tested and validated.
· Test conversational flows, voice prompts, LLM responses, ASR (Automatic Speech Recognition), and TTS (Text-to-Speech) output quality.
· Develop and maintain test strategy, test plans, test cases, and automation frameworks.
· Work closely with product owners, architects, and engineering teams to review requirements and define acceptance criteria.
· Ensure adherence to QA best practices and contribute to continuous improvement of processes.
· Leverage automation tools for IVR and telephony testing (e.g., BlueJay, Cyara, Empirix, custom automation).
· Write and execute automation scripts.
· Analyze logs from AI services, telephony servers, call routers, and backend systems.
· Document defects, track them to closure, and communicate quality risks proactively.
· Provide clear test reports, dashboards, and quality metrics to stakeholders.
Required Skills & Experience
Technical Skills
· 8–12 years of experience in software testing.
· Hands-on experience in GenAI / LLM testing, prompt validation, response evaluation, and guardrail testing.
· Strong experience in VoiceAI systems, ASR/TTS validation, voice bot testing, and multimodal testing.
· Proven experience in Telephony and IVR testing—SIP, call flows, routing, voice apps, VXML, CCaaS platforms.
· Experience testing cloud-based communication platforms.
· Familiarity with conversational design, NLP/NLU testing, and VoiceBot frameworks.
· Experience with API testing tools (Postman, REST Assured), log analysis, and debugging.
· Good understanding of automation frameworks and scripting languages (Python, Java, or similar).
Soft Skills
· Strong communication and analytical skills.
· Ability to work with cross-functional teams.
· Self-driven, detail-oriented, and capable of working in fast-paced environments.
Preferred Qualifications
· Experience working on AI-driven contact center solutions or conversational AI platforms.
· Immediate joiners.
· Exposure to safety/guardrail frameworks in LLM or VoiceAI systems.
· Certifications in testing, cloud platforms, or telephony systems (ISTQB, AWS, etc.).
Required
Preferred