Azure Senior Data Lead

Job description

Job Description We are looking for an experienced Databricks Data Engineer to design, develop, and maintain scalable data engineering solutions on the Azure cloud platform. The candidate should have strong hands-on experience with Azure Databricks, Apache Spark, PySpark, SQL, Delta Lake, and Azure Data Factory (ADF) , with a solid understanding of modern data lakehouse architectures. Key Responsibilities • Design and develop scalable data pipelines using Azure Databricks, PySpark, Spark SQL, and Python . • Build and maintain ETL/ELT pipelines for batch and large-scale data processing. • Develop data ingestion and transformation workflows using Azure Data Factory (ADF) . • Design and implement Delta Lake / Lakehouse solutions. • Work with Azure Data Lake Storage Gen2 (ADLS Gen2) for data ingestion, storage, and processing. • Develop optimized PySpark and SQL transformations for large datasets. • Implement Delta tables , schema management, data quality checks, and performance optimization. • Work with Databricks Workflows/Jobs for pipeline orchestration and scheduling. • Implement data governance and access controls using Unity Catalog . • Monitor pipelines, troubleshoot failures, and optimize Spark workloads. • Implement CI/CD processes using Azure DevOps and Git . • Collaborate with Data Architects, Data Analysts, BI teams, and business stakeholders. • Support downstream reporting and analytics solutions such as Power BI . Key Responsibilities Good to Have • Databricks SQL • Structured Streaming • Kafka or Event Hubs • Power BI • Terraform • CI/CD automation • Data modeling • Data quality frameworks • Microsoft Fabric exposure Skill Requirements Experience • 9+ years of overall Data Engineering experience. • 4+years of hands-on Databricks/Spark experience preferred. • Experience delivering cloud-based data platforms on Microsoft Azure . Other Requirements Primary Skill: Azure Databricks / Data Engineering Secondary Skills: PySpark, SQL, Python, Azure Data Factory, Delta Lake, ADLS Gen2 Maximum Salary (US): 148000 Minimum Salary (US): 100000 Apply now Information at a Glance Why HCLTech? At HCLTech, you'll supercharge your potential. You'll find your career. And you'll find your spark. All at a place that knows that helping its customers stay on top starts by putting its people first. HCLTech is a global technology company, home to more than 223,000 people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending June 2026 totaled $14.8 billion. Compensation and Benefits A candidate’s pay within the range will depend on their skills, experience, education, and other factors permitted by law. This role may also be eligible for performance-based bonuses subject to company policies. In addition, this role is eligible for the following benefits subject to company policies: medical, dental, vision, pharmacy, life, accidental death & dismemberment, and disability insurance; employee assistance program; 401(k) retirement plan; 10 days of paid time off per year (some positions are eligible for need-based leave with no designated number of leave days per year); and 10 paid holidays per year. • Disclaimer • Privacy Statement • Terms of use • Sitemap • Raise a Grievance • We use cookies on our site. Please read more about cookies policy here. • Opens in a new tab. • Opens in a new tab. • Opens in a new tab. • Opens in a new tab. • Opens in a new tab. • Opens in a new tab. Copyright © 2026 HCL Technologies Limited Cookie Consent Manager When you visit any website, it may store or retrieve information on your browser, mostly in the form of cookies. Because we respect your right to privacy, you can choose not to allow some types of cookies. However, blocking some types of cookies may impact your experience of the site and the services we are able to offer. Required Cookies These cookies are required to use this website and can't be turned off. Required Cookies Required Cookies Provider Description Enabled SAP as service provider We use the following session cookies, which are all required to enable the website to function: • "route" is used for session stickiness • "careerSiteCompanyId" is used to send the request to the correct data center • "JSESSIONID" is placed on the visitor's device during the session so the server can identify the visitor • "Load balancer cookie" (actual cookie name may vary) prevents a visitor from bouncing from one instance to another Cookies from provider SAPasserviceprovider are required and cannot be turned off Functional Cookies These cookies provide a better customer experience on this site, such as by remembering your login details, optimizing video performance, or providing us with information about how our site is used. You may freely choose to accept or decline these cookies at any time. Note that certain functionalities that these third-parties make available may be impacted if you do not accept these cookies. Consent to all Functional Cookies Functional Cookies Provider Description Enabled Vimeo Vimeo is a video hosting, sharing, and services platform focused on the delivery of video. Opting out of Vimeo cookies will disable your ability to watch or interact with Vimeo videos. Cookie Policy Privacy Policy Terms and Conditions Consent to cookies from provider Vimeo YouTube YouTube is a video-sharing service where users can create their own profile, upload videos, watch, like, and comment on videos. Opting out of YouTube cookies will disable your ability to watch or interact with YouTube videos. Cookie Policy Privacy Policy Terms and Conditions Consent to cookies from provider YouTube Advertising Cookies These cookies serve ads that are relevant to your interests. You may freely choose to accept or decline these cookies at any time. Note that certain functionality that these third parties make available may be impacted if you do not accept these cookies. Consent to all Advertising Cookies Advertising Cookies Provider Description Enabled Google Analytics Google Analytics is a web analytics service offered by Google that tracks and reports website traffic. Cookie Information Privacy Policy Terms and Conditions Consent to cookies from provider GoogleAnalytics Google Tag Manager Google Tag Manager is a tag management system for conversion tracking, site analytics, remarketing, and more. Privacy Policy Terms and Conditions Consent to cookies from provider GoogleTagManager LinkedIn LinkedIn is an employment-oriented social networking service. We use the Apply with LinkedIn feature to allow you to apply for jobs using your LinkedIn profile. Opting out of LinkedIn cookies will disable your ability to use Apply with LinkedIn. Cookie Policy Cookie Table Privacy Policy Terms and Conditions Consent to cookies from provider LinkedIn