Technical Lead

Job description

We are looking for a Senior GCP Data Engineer with 6–8 years of experience and strong hands-on expertise in GCP, BigQuery, Airflow, Astronomer, SQL, Python, GitHub, and CI/CD . The candidate should have deep technical understanding of GCP data services and be capable of independently designing, developing, optimizing, and supporting scalable cloud-based data solutions. Key Responsibilities Design, develop, and maintain scalable data pipelines and ETL/ELT solutions on GCP .Develop complex, production-grade Apache Airflow DAGs from scratch , including dependencies, scheduling, retries, error handling, monitoring, and alerting.Build, deploy, and manage Airflow workloads using Astronomer .Design and optimize BigQuery datasets, tables, views, stored procedures, and complex SQL transformations .Drive BigQuery performance optimization through partitioning, clustering, query optimization, and efficient data modelling .Develop reusable and maintainable data engineering components using Python and SQL .Demonstrate strong technical understanding of GCP architecture and services , selecting appropriate services based on scalability, performance, security, and maintainability requirements.Work with GCP services such as BigQuery, Cloud Storage, Pub/Sub, Dataflow, Cloud Run, Cloud Functions, Secret Manager and IAM .Own and maintain GitHub repositories , branching strategies, pull requests, code reviews, versioning, and release processes.Design and maintain CI/CD pipelines for automated build, testing, validation, and deployment of data engineering components.Implement engineering best practices around code quality, automated testing, logging, monitoring, data validation, and failure recovery .Troubleshoot and perform root cause analysis for complex BigQuery, Airflow, Python, SQL, GCP, and production pipeline issues .Implement secure GCP solutions using appropriate IAM roles, service accounts, secrets management, and access control mechanisms .Participate in solution design and technical discussions, providing guidance on data architecture, pipeline design, performance, and engineering standards .Conduct code reviews and technical reviews and provide guidance to junior data engineers.Collaborate with architects, BI teams, analysts, business stakeholders, and other engineering teams to translate requirements into scalable technical solutions.Maintain technical documentation covering architecture, data flows, DAGs, transformation logic, dependencies, deployment, and operational procedures Skill Requirements 6–8 years of experience in Data Engineering, with significant hands-on experience in GCP-based data solutions .Strong technical expertise across the Google Cloud Platform ecosystem and good understanding of cloud-based data architectures.Advanced hands-on expertise in Google BigQuery , including:Advanced and complex SQLData modellingViews and materialized viewsStored proceduresPartitioning and clusteringQuery optimization and performance tuningLarge-scale data processingStrong expertise in Apache Airflow , including the ability to design and develop complex DAGs from scratch .Strong hands-on experience with Astronomer for Airflow development, deployment, and management.Advanced SQL skills with strong understanding of query performance and optimization.Strong hands-on Python skills for data engineering, automation, API integration, and pipeline development.Strong understanding of GCP services including BigQuery, Cloud Storage, Pub/Sub, Dataflow, Cloud Run, Cloud Functions, Secret Manager, IAM , and related services.Strong hands-on expertise with GitHub , including:Repository managementGit workflows and branching strategiesPull requests and code reviewsMerge/conflict managementVersioning and release managementGitHub Actions or similar CI/CD toolingStrong understanding of CI/CD principles and automated deployment across development, testing, and production environments.Good understanding of ETL/ELT, data warehousing, data modelling, data quality, orchestration, and cloud architecture .Experience with Terraform/IaC and Docker is highly desirable.Good knowledge of GCP IAM, service accounts, security, secrets management, and access controls .Strong troubleshooting and analytical skills with the ability to independently resolve complex technical problems.Ability to provide technical guidance, conduct code reviews, establish development standards, and mentor junior engineers . Other Requirements Apply now Information at a Glance Why HCLTech? At HCLTech, you'll supercharge your potential. You'll find your career. And you'll find your spark. All at a place that knows that helping its customers stay on top starts by putting its people first. HCLTech is a global technology company, home to more than 223,000 people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending June 2026 totaled $14.8 billion. Disclaimer Privacy Statement Terms of use Sitemap Raise a Grievance We use cookies on our site. Please read more about cookies policy here. Opens in a new tab. Opens in a new tab. Opens in a new tab. Opens in a new tab. Opens in a new tab. Opens in a new tab. Copyright © 2026 HCL Technologies Limited Cookie Consent Manager When you visit any website, it may store or retrieve information on your browser, mostly in the form of cookies. Because we respect your right to privacy, you can choose not to allow some types of cookies. However, blocking some types of cookies may impact your experience of the site and the services we are able to offer. Required Cookies These cookies are required to use this website and can't be turned off. Required Cookies Required Cookies Provider Description Enabled SAP as service provider We use the following session cookies, which are all required to enable the website to function: "route" is used for session stickiness "careerSiteCompanyId" is used to send the request to the correct data center "JSESSIONID" is placed on the visitor's device during the session so the server can identify the visitor "Load balancer cookie" (actual cookie name may vary) prevents a visitor from bouncing from one instance to another Cookies from provider SAPasserviceprovider are required and cannot be turned off Functional Cookies These cookies provide a better customer experience on this site, such as by remembering your login details, optimizing video performance, or providing us with information about how our site is used. You may freely choose to accept or decline these cookies at any time. Note that certain functionalities that these third-parties make available may be impacted if you do not accept these cookies. Consent to all Functional Cookies Functional Cookies Provider Description Enabled Vimeo Vimeo is a video hosting, sharing, and services platform focused on the delivery of video. Opting out of Vimeo cookies will disable your ability to watch or interact with Vimeo videos. Cookie Policy Privacy Policy Terms and Conditions Consent to cookies from provider Vimeo YouTube YouTube is a video-sharing service where users can create their own profile, upload videos, watch, like, and comment on videos. Opting out of YouTube cookies will disable your ability to watch or interact with YouTube videos. Cookie Policy Privacy Policy Terms and Conditions Consent to cookies from provider YouTube Advertising Cookies These cookies serve ads that are relevant to your interests. You may freely choose to accept or decline these cookies at any time. Note that certain functionality that these third parties make available may be impacted if you do not accept these cookies. Consent to all Advertis