SME AzureMSSQL DBA, Microsoft Azure

Job description

We are looking for an experienced Azure Databricks Data Engineer to design, build, optimize, and support scalable enterprise data platforms. The professional will work across the complete data engineering lifecycle, including source onboarding, ingestion, transformation, data quality, lakehouse modelling, orchestration, security, monitoring, and production support. The role requires strong hands-on expertise in Databricks and the Azure data ecosystem, along with the ability to translate business requirements into reliable and cost-effective data solutions. Key Responsibilities Design and implement scalable batch and streaming data pipelines using Azure Databricks, Apache Spark, PySpark, and SQL. • Build lakehouse solutions using Delta Lake and medallion architecture patterns across Bronze, Silver, and Gold layers. • Develop reusable ingestion frameworks for structured, semi-structured, and unstructured data from databases, files, APIs, event streams, and SaaS platforms. • Implement orchestration and scheduling using Azure Data Factory, Databricks Workflows, and related Azure services. • Design dimensional models, curated data products, and consumption-ready datasets for analytics and reporting platforms such as Power BI. • Apply data quality checks, schema enforcement, lineage, metadata management, auditability, and error-handling standards. • Optimize Spark workloads, cluster configurations, storage layouts, SQL queries, and Delta tables for performance and cost. • Implement secure access using Microsoft Entra ID, managed identities, service principals, Azure Key Vault, Unity Catalog, and role-based access controls. • Build CI/CD pipelines and infrastructure automation using Azure DevOps or GitHub, Git, Databricks Asset Bundles, and Terraform where applicable. • Monitor production pipelines, troubleshoot failures and performance issues, perform root-cause analysis, and contribute to operational support and continuous improvement. • Collaborate with architects, analysts, data scientists, source-system owners, and business stakeholders to refine requirements and deliver fit-for-purpose solutions. • Prepare technical designs, mapping specifications, runbooks, deployment documentation, and knowledge-transfer material. Skill Requirements 5–8 years of overall experience in data engineering, data warehousing, or large-scale data platform delivery. • At least 3 years of strong hands-on experience with Azure Databricks and Apache Spark. • Advanced proficiency in PySpark and SQL, with practical experience in performance tuning and debugging. • Strong understanding of Delta Lake, lakehouse architecture, medallion patterns, partitioning, file optimization, and incremental data processing. • Hands-on experience with Azure Data Lake Storage Gen2, Azure Data Factory, Azure Key Vault, and Azure DevOps or GitHub. • Experience implementing ETL/ELT pipelines, change data capture, slowly changing dimensions, data reconciliation, and rerun or recovery mechanisms. • Working knowledge of Databricks governance and security capabilities, preferably Unity Catalog. • Experience with REST APIs, JSON, Parquet, CSV, relational databases, and common enterprise integration patterns. • Good understanding of dimensional modelling, data warehouses, data marts, and analytics consumption requirements. • Experience working in Agile delivery teams and participating in design reviews, code reviews, testing, release, and production support. Other Requirements Experience with Databricks SQL, Delta Live Tables or Lakeflow Declarative Pipelines, Auto Loader, structured streaming, and Databricks Workflows. • Knowledge of Azure Event Hubs, Azure Functions, Synapse Analytics, Microsoft Fabric, or Power BI. • Hands-on experience with Terraform, automated testing, observability, and deployment across multiple environments. • Understanding of data governance, data privacy, retention, masking, and regulatory controls. • Exposure to Python software-engineering practices, including modular design, unit testing, logging, and packaging. • Databricks or Microsoft Azure certifications are desirable. Apply now Information at a Glance Why HCLTech? At HCLTech, you'll supercharge your potential. You'll find your career. And you'll find your spark. All at a place that knows that helping its customers stay on top starts by putting its people first. HCLTech is a global technology company, home to more than 223,000 people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending June 2026 totaled $14.8 billion. Disclaimer Privacy Statement Terms of use Sitemap Raise a Grievance We use cookies on our site. Please read more about cookies policy here. Opens in a new tab. Opens in a new tab. Opens in a new tab. Opens in a new tab. Opens in a new tab. Opens in a new tab. Copyright © 2026 HCL Technologies Limited Cookie Consent Manager When you visit any website, it may store or retrieve information on your browser, mostly in the form of cookies. Because we respect your right to privacy, you can choose not to allow some types of cookies. However, blocking some types of cookies may impact your experience of the site and the services we are able to offer. Required Cookies These cookies are required to use this website and can't be turned off. Required Cookies Required Cookies Provider Description Enabled SAP as service provider We use the following session cookies, which are all required to enable the website to function: "route" is used for session stickiness "careerSiteCompanyId" is used to send the request to the correct data center "JSESSIONID" is placed on the visitor's device during the session so the server can identify the visitor "Load balancer cookie" (actual cookie name may vary) prevents a visitor from bouncing from one instance to another Cookies from provider SAPasserviceprovider are required and cannot be turned off Functional Cookies These cookies provide a better customer experience on this site, such as by remembering your login details, optimizing video performance, or providing us with information about how our site is used. You may freely choose to accept or decline these cookies at any time. Note that certain functionalities that these third-parties make available may be impacted if you do not accept these cookies. Consent to all Functional Cookies Functional Cookies Provider Description Enabled Vimeo Vimeo is a video hosting, sharing, and services platform focused on the delivery of video. Opting out of Vimeo cookies will disable your ability to watch or interact with Vimeo videos. Cookie Policy Privacy Policy Terms and Conditions Consent to cookies from provider Vimeo YouTube YouTube is a video-sharing service where users can create their own profile, upload videos, watch, like, and comment on videos. Opting out of YouTube cookies will disable your ability to watch or interact with YouTube videos. Cookie Policy Privacy Policy Terms and Conditions Consent to cookies from provider YouTube Advertising Cookies These cookies serve ads that are relevant to your interests. You may freely choose to accept or decline these cookies at any time. Note that certain functionality that these third parties make available may be impacted if you do not accept these cookies. Consent to all Advertising Cookies Advertising Cookies Provider Description Enabled Google Analytics Google Analytics is a web analytics service offered by Google that tracks and reports website traffic. Cookie Information Privacy Policy Terms and Conditions Consent to cookies from provider GoogleAnalytics Google Tag Manager Google Tag Manager is a tag man