Director, Data Engineering

Job description

About Us Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid. At Visa, you'll have the opportunity to create impact at scale — tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world. Join Visa and do work that matters – to you, to your community, and to the world. Progress starts with you. Job Description Role Summary: The Director, Data Engineering leads the design, development, and deployment of scalable and secure data pipelines, platforms, and ML/AI infrastructure, leveraging cloud-native technologies and big data frameworks. This role oversees the integration of structured and unstructured data sources to support advanced analytics, machine learning, and AI initiatives, and champions new tools and technologies to improve productivity, scalability, and effectiveness of data engineering efforts. The Director establishes and enforces data engineering best practices, technical standards, governance, and quality standards, ensuring continuous improvement and technical excellence, while ensuring data security, privacy, compliance, system performance, scalability, and availability across all data engineering projects and platforms. All roles require digital fluency, including the ability to work with emerging technologies such as Generative AI tools (e.g. ChatGPT, Microsoft Copilot) to support everyday work. Key Responsibilities: Lead the design, development, and deployment of scalable and secure data pipelines, platforms, and ML/AI infrastructure. Oversee integration of structured and unstructured data sources to support advanced analytics, machine learning, and AI initiatives. Evaluate, implement, and champion new tools and technologies to improve productivity, scalability, and effectiveness of data engineering efforts. Establish and enforce data engineering best practices, technical standards, governance, and quality standards. Ensure data security, privacy, compliance, system performance, scalability, and availability across all data engineering projects and platforms. Define, monitor, and report on key performance indicators (KPIs) to measure the success and impact of data engineering activities. Lead incident response, root cause analysis, and resolution for data platform issues, ensuring high availability and reliability. Collaborate with cross-functional teams to deliver robust data-driven business solutions and define technical roadmaps. Mentor, coach, and grow a high-performing team of data engineers, fostering a culture of innovation, excellence, and continuous learning. Partner with senior leadership to define, execute, and communicate the enterprise data strategy. Visa requires at least 3 days in office, expectations of these days will be confirmed by your Hiring Manager. Qualifications Basic Qualifications: 10+ years of relevant work experience with a bachelor’s degree, or 13+ years of relevant work experience. Preferred Qualifications: 12 or more years of work experience with a Bachelor’s Degree or 8-10 years of experience with an Advanced Degree(e.g. Masters, MBA, JD, MD) or 6+ years of work experience with a PhD. Experience in leading large-scale data engineering teams and projects in a complex enterprise environment. Experience in data architecture, ETL/ELT pipelines, data warehousing, and real-time data processing. Experience with big data technologies (e.g., Spark, Kafka, Hadoop). Experience in data modeling, data governance, and data quality frameworks. Experience delivering high-impact data solutions that drive business outcomes. Experience working with Data and AI, designing, and building ML infrastructure to train or serve models. Experience with open-source data engineering tools or communities. Hands – on development experience in building real time & streaming infrastructure and DevOps excellence.Distributed Streaming Platforms: Advanced architectural experience with large-scale event-driven systems using Apache Kafka, Apache Pulsar, AWS Kinesis, or Google Cloud Pub/Sub. Stream Processing Engine Architecture: Hands-on mastery or architectural oversight of real-time processing frameworks like Apache Flink, Apache Spark Streaming, Kafka Streams, and Ray. Data Storage & Query Engines: Deep knowledge of low-latency storage systems, column-oriented databases, and OLAP query engines (e.g., Apache Pinot, Apache Iceberg, ClickHouse, Cassandra, Redis). Multi-Tenant System Design: Experience building multi-tenant streaming platforms with strong isolation, rate limiting, dynamic resource allocation, and zero-downtime schema evolution (Protobuf, Avro). Observability & Reliability: Demonstrated success implementing SLOs, SLAs, error budgets, and high-cardinality distributed tracing and monitoring systems (e.g., Prometheus, Grafana, Datadog, OpenTelemetry). Excellent problem solving and analytics skills. Capable of forming and advocating an independent viewpoint Foster a GenAI-first culture by empowering engineers to seamlessly integrate generative AI into daily workflows, turning technological potential into scalable, transformative business. Experience in financial services, payments, or a highly regulated industry. Experience in mentoring and developing talent within engineering teams. Masters, PhD in Computer Science or related technical discipline. Experience in working on large open-source projects, preferably with ClickHouse, Redis, Flink, Kafka, and Ray. Experience in contributions to open-source data engineering tools or communities. Experience in driving operational excellence and standard methodologies in an engineering environment. Experience in working with Data and AI, designing, and building ML infrastructure to train or serve models. Information for US Applicants For roles located in the US, the estimated salary range for this position is $197,200.00 to $ 315,700.00 USD per year, which may include potential sales incentive payments (if applicable). Salary may vary depending on job-related factors which may include knowledge, skills, experience, and location. In addition, this position may be eligible for bonus and equity.Visa has a comprehensive benefits package for which this position may be eligible that includes Medical, Dental, Vision, 401(k), FSA/HSA, Life Insurance, Paid Time Off, and Wellness Program. Work Hours Varies upon the needs of the department. Travel Requirements This position requires travel 5-10% of the time. Mental/Physical Requirements This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, frequently operate standard office equipment, such as telephones and computers. Visa is an EEO Employer Qualified applicants will receive consideration for employment without regard to race, color religion, sex, national origin, sexual orientation, gender identity, disability or protect veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with the EEOC guidelines and applicable local law.