Senior Test Lead

Job description

We are looking for an experienced AI/GenAI Test Engineer to design and execute testing strategies for LLM-powered applications, AI agents, and conversational AI solutions . The role requires strong expertise in validating AI-generated responses, prompt behavior, agent workflows, and end-to-end application functionality using Playwright and JavaScript . The candidate should combine traditional automation testing skills with emerging GenAI/LLM testing techniques , ensuring AI solutions are accurate, reliable, safe, and consistent. Key Responsibilities Design and execute test strategies for LLM-based applications and AI agents .Perform Agent Testing covering multi-step workflows, tool/function interactions, context handling, memory behavior, error recovery, and response consistency.Validate LLM responses for relevance, correctness, groundedness, hallucination, consistency, and completeness .Design and maintain structured test datasets and evaluation scenarios for GenAI applications.Perform Prompt Engineering and Prompt Testing , including: • System and user prompt validation • Prompt variations and edge cases • Context-window testing • Prompt regression testing • Adversarial and negative scenarios Establish evaluation criteria and measurable acceptance thresholds for LLM outputs.Develop automated functional and regression test suites using Playwright and JavaScript .Automate testing of web applications integrating conversational AI/LLM capabilities.Validate API integrations, agent tool calls, structured outputs, and downstream system interactions .Perform end-to-end testing covering UI → Agent → LLM → Tools/APIs → Response flows.Identify AI-specific failure scenarios such as hallucinations, inconsistent responses, incorrect tool selection, malformed output, and loss of context.Integrate automated test suites with CI/CD pipelines and support continuous regression testing.Analyze defects, perform root-cause analysis, and collaborate with developers, AI engineers, architects, and product teams.Define and maintain AI/LLM quality metrics, test reports, defect dashboards, and release-quality criteria . Skill Requirements Good understanding of Prompt Engineering and Prompt Testing .Knowledge of LLM validation techniques covering: • Groundedness and factual correctness • Hallucination detection • Relevance • Response consistency • Context retention • Instruction adherence Strong automation experience with Playwright .Strong programming/scripting skills in JavaScript .Experience with API testing and JSON-based request/response validation.Good understanding of functional, regression, integration, negative, and exploratory testing.Experience working in Agile/Scrum and CI/CD environments . Other Requirements Experience with RAG-based application testing , including retrieval relevance and grounded response validation.Exposure to LLM evaluation frameworks or observability tools such as Ragas, DeepEval, LangSmith, or promptfoo .Understanding of agentic AI concepts such as tool calling, orchestration, memory, planning, and multi-agent workflows .Experience with LLM APIs and platforms such as Azure OpenAI/OpenAI .Familiarity with Git, Azure DevOps, Jenkins, or GitHub Actions .Knowledge of AI security testing, including prompt injection and sensitive-data handling. Apply now Information at a Glance Why HCLTech? At HCLTech, you'll supercharge your potential. You'll find your career. And you'll find your spark. All at a place that knows that helping its customers stay on top starts by putting its people first. HCLTech is a global technology company, home to more than 230,000 people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending September 2026 totaled $14.8 billion. • Disclaimer • Privacy Statement • Terms of use • Sitemap • Raise a Grievance • We use cookies on our site. Please read more about cookies policy here. • Opens in a new tab. • Opens in a new tab. • Opens in a new tab. • Opens in a new tab. • Opens in a new tab. • Opens in a new tab. Copyright © 2026 HCL Technologies Limited Cookie Consent Manager When you visit any website, it may store or retrieve information on your browser, mostly in the form of cookies. Because we respect your right to privacy, you can choose not to allow some types of cookies. However, blocking some types of cookies may impact your experience of the site and the services we are able to offer. Required Cookies These cookies are required to use this website and can't be turned off. Required Cookies Required Cookies Provider Description Enabled SAP as service provider We use the following session cookies, which are all required to enable the website to function: • "route" is used for session stickiness • "careerSiteCompanyId" is used to send the request to the correct data center • "JSESSIONID" is placed on the visitor's device during the session so the server can identify the visitor • "Load balancer cookie" (actual cookie name may vary) prevents a visitor from bouncing from one instance to another Cookies from provider SAPasserviceprovider are required and cannot be turned off Functional Cookies These cookies provide a better customer experience on this site, such as by remembering your login details, optimizing video performance, or providing us with information about how our site is used. You may freely choose to accept or decline these cookies at any time. Note that certain functionalities that these third-parties make available may be impacted if you do not accept these cookies. Consent to all Functional Cookies Functional Cookies Provider Description Enabled Vimeo Vimeo is a video hosting, sharing, and services platform focused on the delivery of video. Opting out of Vimeo cookies will disable your ability to watch or interact with Vimeo videos. Cookie Policy Privacy Policy Terms and Conditions Consent to cookies from provider Vimeo YouTube YouTube is a video-sharing service where users can create their own profile, upload videos, watch, like, and comment on videos. Opting out of YouTube cookies will disable your ability to watch or interact with YouTube videos. Cookie Policy Privacy Policy Terms and Conditions Consent to cookies from provider YouTube Advertising Cookies These cookies serve ads that are relevant to your interests. You may freely choose to accept or decline these cookies at any time. Note that certain functionality that these third parties make available may be impacted if you do not accept these cookies. Consent to all Advertising Cookies Advertising Cookies Provider Description Enabled Google Analytics Google Analytics is a web analytics service offered by Google that tracks and reports website traffic. Cookie Information Privacy Policy Terms and Conditions Consent to cookies from provider GoogleAnalytics Google Tag Manager Google Tag Manager is a tag management system for conversion tracking, site analytics, remarketing, and more. Privacy Policy Terms and Conditions Consent to cookies from provider GoogleTagManager LinkedIn LinkedIn is an employment-oriented social networking service. We use the Apply with LinkedIn feature to allow you to apply for jobs using your LinkedIn profile. Opting out of LinkedIn cookies will disable your ability to use Apply with LinkedIn. Cookie Policy Cookie Table Privacy Policy Terms and Conditions Consent to cookies from provider LinkedIn