Senior Developer

Job description

We are looking for a Junior GCP Data Engineer with 3–5 years of experience who has strong hands-on expertise in Google Cloud Platform (GCP), BigQuery, SQL, Python, Apache Airflow, and Astronomer . The ideal candidate should be technically strong in designing and developing cloud-based data pipelines, building Airflow DAGs from scratch , implementing data transformation logic, and working with large-scale datasets in BigQuery.The candidate should have a solid understanding of GCP data services, data engineering best practices, CI/CD, orchestration, monitoring, and production support . This role requires someone who can independently develop data engineering components, troubleshoot complex data and pipeline issues, and contribute to the design and optimization of scalable data solutions on GCP Key Responsibilities Design, develop, test, and maintain data pipelines and ETL/ELT workflows on GCP .Develop Apache Airflow DAGs from scratch , including task dependencies, scheduling, parameterization, error handling, retries, monitoring, and alerting.Build and manage production-grade Airflow workflows using Astronomer .Develop and optimize complex BigQuery SQL queries, views, tables, stored procedures, and transformation logic .Design efficient BigQuery solutions with focus on performance, scalability, maintainability, and query optimization .Develop reusable data processing and automation components using Python and SQL .Integrate data from multiple upstream systems and make curated datasets available for downstream applications, analytics, and reporting.Work with relevant GCP services for data ingestion, storage, transformation, orchestration, and monitoring.Build and maintain CI/CD pipelines for automated deployment of DAGs, SQL, Python code, and other data engineering components across environments.Implement appropriate logging, monitoring, exception handling, data validation, and pipeline failure recovery mechanisms.Perform root cause analysis and troubleshoot data quality, pipeline, performance, and production issues .Follow coding standards, Git-based version control, peer review, testing, and deployment best practices.Collaborate with data engineers, analysts, BI developers, architects, and business teams to translate requirements into scalable technical solutions.Prepare and maintain technical documentation covering pipelines, DAGs, datasets, dependencies, transformation logic, and deployment procedures. Skill Requirements 3–5 years of overall experience in Data Engineering, Cloud Data Engineering, or similar roles.Strong hands-on experience with Google Cloud Platform (GCP) and its data engineering ecosystem.Excellent hands-on knowledge of Google BigQuery , including:Advanced SQLComplex joins and transformationsViews and materialized viewsStored proceduresPartitioning and clusteringQuery performance optimizationData modelling and analytical datasetsStrong experience with Apache Airflow , with demonstrated ability to design and write DAGs from scratch .Hands-on experience with Astronomer for developing, deploying, and managing Airflow workloads.Strong proficiency in SQL with the ability to write and optimize complex queries independently.Good hands-on programming experience in Python , particularly for data processing, automation, APIs, and pipeline development.Good understanding of relevant GCP services such as Cloud Storage, Pub/Sub, Dataflow, Cloud Run, Cloud Functions, Secret Manager and IAM .Hands-on understanding of CI/CD concepts and automated deployment pipelines , preferably using Git-based development workflows.Experience with Git, branching strategies, pull requests, code reviews, and version control .Good understanding of ETL/ELT architecture, data warehousing, data modelling, data quality, and pipeline orchestration .Ability to troubleshoot complex technical issues across SQL, Python, BigQuery, Airflow, and GCP services .Understanding of cloud security, IAM/service accounts, secrets management, and environment-specific configurations .Exposure to Terraform/IaC, Docker, APIs, and containerized deployments would be an added advantage.Strong problem-solving mindset with the ability to work independently on technical development while collaborating effectively within an Agile delivery team. Other Requirements Apply now Information at a Glance Why HCLTech? At HCLTech, you'll supercharge your potential. You'll find your career. And you'll find your spark. All at a place that knows that helping its customers stay on top starts by putting its people first. HCLTech is a global technology company, home to more than 223,000 people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending June 2026 totaled $14.8 billion. Disclaimer Privacy Statement Terms of use Sitemap Raise a Grievance We use cookies on our site. Please read more about cookies policy here. Opens in a new tab. Opens in a new tab. Opens in a new tab. Opens in a new tab. Opens in a new tab. Opens in a new tab. Copyright © 2026 HCL Technologies Limited Cookie Consent Manager When you visit any website, it may store or retrieve information on your browser, mostly in the form of cookies. Because we respect your right to privacy, you can choose not to allow some types of cookies. However, blocking some types of cookies may impact your experience of the site and the services we are able to offer. Required Cookies These cookies are required to use this website and can't be turned off. Required Cookies Required Cookies Provider Description Enabled SAP as service provider We use the following session cookies, which are all required to enable the website to function: "route" is used for session stickiness "careerSiteCompanyId" is used to send the request to the correct data center "JSESSIONID" is placed on the visitor's device during the session so the server can identify the visitor "Load balancer cookie" (actual cookie name may vary) prevents a visitor from bouncing from one instance to another Cookies from provider SAPasserviceprovider are required and cannot be turned off Functional Cookies These cookies provide a better customer experience on this site, such as by remembering your login details, optimizing video performance, or providing us with information about how our site is used. You may freely choose to accept or decline these cookies at any time. Note that certain functionalities that these third-parties make available may be impacted if you do not accept these cookies. Consent to all Functional Cookies Functional Cookies Provider Description Enabled Vimeo Vimeo is a video hosting, sharing, and services platform focused on the delivery of video. Opting out of Vimeo cookies will disable your ability to watch or interact with Vimeo videos. Cookie Policy Privacy Policy Terms and Conditions Consent to cookies from provider Vimeo YouTube YouTube is a video-sharing service where users can create their own profile, upload videos, watch, like, and comment on videos. Opting out of YouTube cookies will disable your ability to watch or interact with YouTube videos. Cookie Policy Privacy Policy Terms and Conditions Consent to cookies from provider YouTube Advertising Cookies These cookies serve ads that are relevant to your interests. You may freely choose to accept or decline these cookies at any time. Note that certain functionality that these third parties make available may be impacted if you do not accept these cookies. Consent to all Advertising Cookies Advertising Cookies Provider Description Enabled Google Analytics Google Analytics is a web analytics service offered by Google that tracks and rep