ActiveJobs
Capco

Senior Azure Data Engineer (Databricks)

Capco · UK - London

Full-timeHybridPosted 20 November 2026
Continue to Capco's application →

Applications are made on Capco's own site. We never sit in the middle.

Job description

Senior Azure Data Engineer (Databricks) Location: London (Hybrid) | Practice Area: Technology & Engineering | Type: Permanent Build scalable Azure and Databricks data platforms that transform how financial services organisations use data. The Role As a Senior Azure Data Engineer (Databricks) at Capco, you'll play a hands-on role in designing, building and deploying scalable, secure data engineering pipelines using the Databricks platform on Azure. You'll partner with clients to understand their data needs and develop solutions that drive business transformation. Taking ownership of complex engineering deliverables, you'll contribute to technical design decisions, solve challenging data problems and build reliable, maintainable solutions that deliver practical value for clients. Working with cross-functional teams, you'll contribute to engineering best practices and continuous improvement. You'll combine strong technical expertise with sound engineering judgement, constructive collaboration and a commitment to delivering production-ready data platforms that meet both technical and business objectives. What You'll Do • Design and develop robust data pipelines using Delta Lake, Spark Structured Streaming, Unity Catalog and Azure-native services, taking ownership of implementation quality, reliability and maintainability. • Build real-time, event-driven solutions using technologies such as Kafka and Azure Event Hubs, applying sound engineering judgement to performance, scalability and operational resilience. • Develop and maintain CI/CD pipelines using Azure DevOps, Jenkins, GitHub Actions and modern DevOps practices to support reliable deployments. Use approved AI-assisted development tools and automation, where appropriate, to support activities such as test generation, code review preparation and technical documentation, improving delivery efficiency while maintaining human validation, security controls and escalation of potential risks. • Collaborate with clients and multidisciplinary teams to translate business requirements into scalable, production-ready data solutions, constructively challenging assumptions, evaluating technical trade-offs and recommending practical engineering approaches. • Champion clean code, data lifecycle optimisation and engineering best practices, supporting colleagues through knowledge sharing, constructive code reviews and continuous improvement to deliver high-quality client outcomes. What We're Looking For • Strong hands-on engineering capability, with experience taking ownership of complex technical deliverables and building reliable, production-ready data solutions. • Sound technical judgement and problem-solving skills, with the ability to assess engineering trade-offs, identify delivery risks and balance performance, security, scalability and maintainability. • A collaborative engineering mindset, with the confidence to contribute to technical discussions, challenge assumptions constructively and work effectively with multidisciplinary teams. • A commitment to engineering quality, responsible technology adoption and continuous improvement, ensuring that delivery efficiency does not compromise security, governance or accountability. • Strong communication and stakeholder engagement skills, with the ability to translate business requirements into practical technical solutions, explain engineering decisions clearly and build effective client relationships. Technical Skills & Experience • Strong hands-on experience with at least one OOP language such as Python, Scala or Java. • Technical skills in spark, or  experience working with other distributed data processing frameworks . • Proven hands-on experience with the Databricks platform, including orchestration and enterprise-scale Azure data engineering solution

Other jobs you might want

Browse all jobs on ActiveJobs →