Director of Software Engineering - Distributed Systems, Serverless - Elasticsearch

Job description

Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale — unleashing the potential of businesses and people. The Elastic Search AI Platform, used by more than 50% of the Fortune 500, brings together the precision of search and the intelligence of AI to enable everyone to accelerate the results that matter. By taking advantage of all structured and unstructured data — securing and protecting private information more effectively — Elastic’s complete, cloud-based solutions for search, security, and observability help organizations deliver on the promise of AI. What is The Role We are on the lookout for a Director of Software Engineering to lead our Elasticsearch Distributed Systems organisation which focuses on how Elasticsearch provides scale, performance, and resilience, especially in the context of our Serverless offering. As Director of Software Engineering, you will be leading an organisation of approximately 40 engineers and managers to tackle the deep distributed systems challenges that allow Elasticsearch to excel at scale. Your customers are every Elasticsearch user and each solution team which builds upon Elasticsearch. Our company is distributed by intention. We hire the best engineers we can find wherever they are, whoever they are. As a result, our team is diverse and distributed across continents. We collaborate every day over email, GitHub, Zoom, and Slack. The ability to lead a distributed team is critical. What You Will Be Doing Develop and execute a long-term engineering strategy for Elasticsearch's distributed systems, aligning technical priorities with product direction and business objectives. Drive improvements in performance, scalability, reliability and cost efficiency, including foundational capabilities supporting Serverless Elasticsearch. Lead the evolution of Elasticsearch's core distributed architecture, including cluster coordination, data allocation, indexing, replication and recovery. Provide technical leadership and oversight for complex engineering initiatives and programs, helping engineering managers and technical leaders navigate architectural decisions and competing priorities. Own engineering outcomes across your organisation, balancing technical complexity, customer impact, reliability, operational requirements and long-term maintainability. Lead, mentor, hire and develop engineering managers and senior technical leaders, establishing high performance standards and building a strong pipeline of future leaders, fostering an inclusive culture of collaboration and technical excellence. Take ownership of organisational planning, staffing and resource allocation, ensuring teams have the capabilities and support needed to deliver on strategic priorities. Partner with Product Management, engineering leaders and other teams across Elastic to define priorities and deliver complex initiatives spanning multiple engineering organisations. Act as a senior escalation point for critical technical and operational challenges, working closely with engineering, Support and SRE teams to drive effective resolution. Communicate engineering strategy, organisational priorities and progress to senior executives, influencing decisions that have a significant impact on Elastic and its customers. Run performance management with consistency (promotions, development plans, and managing underperformance through to resolution) and working with your managers to do the same. What You Bring A proven track record of leading large-scale engineering organisations, including experience managing engineering managers and developing senior technical leaders. Previous hands-on software engineering experience, with strong computer science fundamentals and substantial technical depth in distributed systems. Extensive experience designing, building or operating complex, large-scale distributed systems, ideally involving database engines, distributed storage or large-scale data processing. Strong understanding of distributed systems concepts, including concurrency, consistency, replication, fault tolerance, recovery and performance optimisation. Experience establishing engineering strategy, making architectural trade-offs and delivering complex initiatives involving multiple teams and significant technical dependencies.<