Senior Technical Lead

Job description

Senior Data Engineer Role purpose We are looking for an experienced hands-on Senior Data Engineer to support the migration of existing PBWM PEGA-related data pipelines away from legacy SAS and Teradata processing and onto the AWS-based data platform. The engineer will pick up work already progressed earlier this year, complete the remaining SAS-to-PySpark migration, and implement the producer-side changes required to supply data into the agreed PEGA integration pattern. Key Responsibilities Key responsibilities Understand the existing SAS/Teradata pipelines supporting PBWM PEGA data provisioning and baseline the remaining migration scope. Convert remaining SAS transformation and business logic into production-quality PySpark. Develop and enhance batch data pipelines using Python/PySpark and AWS, particularly Glue and S3. Maintain equivalent business logic and data structures where appropriate to support a controlled migration. Reconcile PySpark outputs against the existing SAS/Teradata processes and support parallel-run/data validation. Work with PBWM, EDT Simplification, architecture and downstream PEGA engineering teams to resolve integration dependencies. Support testing, deployment, release and productionisation of the migrated pipelines. Document the solution and provide an effective handover to the permanent engineering team. Skill Requirements Essential skills Strong Python and PySpark AWS data engineering, particularly S3 and AWS Glue SQL and complex data transformation Experience migrating legacy ETL/data-processing workloads to cloud platforms Experience translating or reverse-engineering SAS workloads into Python/PySpark Batch data pipeline development Data reconciliation, testing and validation Git-based development and CI/CD Experience working in controlled enterprise production environments Desirable SAS development experience Snowflake, Airflow/MWAA or EMR Teradata migration experience PEGA / Customer Decision Hub exposure Previous NatWest engineering experience would be advantageous PEGA expertise isn't essential. The primary requirement is a strong Data Engineer who can take unfamiliar SAS code, understand the existing processing, reproduce it safely in PySpark, validate the results and take the solution through to production. Other Requirements Apply now Information at a Glance Why HCLTech? At HCLTech, you'll supercharge your potential. You'll find your career. And you'll find your spark. All at a place that knows that helping its customers stay on top starts by putting its people first. HCLTech is a global technology company, home to more than 230,000 people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending September 2026 totaled $14.8 billion. Disclaimer Privacy Statement Terms of use Sitemap Raise a Grievance We use cookies on our site. Please read more about cookies policy here. Opens in a new tab. Opens in a new tab. Opens in a new tab. Opens in a new tab. Opens in a new tab. Opens in a new tab. Copyright © 2026 HCL Technologies Limited Cookie Consent Manager When you visit any website, it may store or retrieve information on your browser, mostly in the form of cookies. Because we respect your right to privacy, you can choose not to allow some types of cookies. However, blocking some types of cookies may impact your experience of the site and the services we are able to offer. Required Cookies These cookies are required to use this website and can't be turned off. Required Cookies Required Cookies Provider Description Enabled SAP as service provider We use the following session cookies, which are all required to enable the website to function: "route" is used for session stickiness "careerSiteCompanyId" is used to send the request to the correct data center "JSESSIONID" is placed on the visitor's device during the session so the server can identify the visitor "Load balancer cookie" (actual cookie name may vary) prevents a visitor from bouncing from one instance to another Cookies from provider SAPasserviceprovider are required and cannot be turned off Functional Cookies These cookies provide a better customer experience on this site, such as by remembering your login details, optimizing video performance, or providing us with information about how our site is used. You may freely choose to accept or decline these cookies at any time. Note that certain functionalities that these third-parties make available may be impacted if you do not accept these cookies. Consent to all Functional Cookies Functional Cookies Provider Description Enabled Vimeo Vimeo is a video hosting, sharing, and services platform focused on the delivery of video. Opting out of Vimeo cookies will disable your ability to watch or interact with Vimeo videos. Cookie Policy Privacy Policy Terms and Conditions Consent to cookies from provider Vimeo YouTube YouTube is a video-sharing service where users can create their own profile, upload videos, watch, like, and comment on videos. Opting out of YouTube cookies will disable your ability to watch or interact with YouTube videos. Cookie Policy Privacy Policy Terms and Conditions Consent to cookies from provider YouTube Advertising Cookies These cookies serve ads that are relevant to your interests. You may freely choose to accept or decline these cookies at any time. Note that certain functionality that these third parties make available may be impacted if you do not accept these cookies. Consent to all Advertising Cookies Advertising Cookies Provider Description Enabled Google Analytics Google Analytics is a web analytics service offered by Google that tracks and reports website traffic. Cookie Information Privacy Policy Terms and Conditions Consent to cookies from provider GoogleAnalytics Google Tag Manager Google Tag Manager is a tag management system for conversion tracking, site analytics, remarketing, and more. Privacy Policy Terms and Conditions Consent to cookies from provider GoogleTagManager LinkedIn LinkedIn is an employment-oriented social networking service. We use the Apply with LinkedIn feature to allow you to apply for jobs using your LinkedIn profile. Opting out of LinkedIn cookies will disable your ability to use Apply with LinkedIn. Cookie Policy Cookie Table Privacy Policy Terms and Conditions Consent to cookies from provider LinkedIn