Senior Data Engineer (TOP Organization)

Job description

Job Location HYDERABAD OFFICE APAC PSC GDOP Job Description P&G was founded over 180 years ago as a simple soap and candle company. Today, we're the world’s largest consumer goods company and home to iconic, trusted brands that make life a little bit easier in small but meaningful ways. We've spanned three centuries thanks to three simple ideas: leadership, innovation and citizenship. The insight, innovation and passion of hardworking teams have helped us grow into a global company that is governed responsibly and ethically, that is open and visible, and that supports good causes and protects the environment. This is a place where you can be proud to work and do something that matters. Dedication from Us: You'll be at the core of breakthrough innovations, be given exciting assignments, lead initiatives, and take ownership and responsibility, in creative workspaces where new insights thrive. All the while, you'll receive outstanding training to help you become a leader in your field. It is not just about what you'll do, but how you'll feel: encouraged, valued, purposeful, challenged, heard, and inspired. What we Offer: Continuous mentorship – you will collaborate with peers and receive both formal training as well as day-to-day mentoring from your manager dynamic and encouraging work environment– employees are at the center, we value every individual and support initiative, promoting agility and work/life balance. P&G's corporate function IT organization is seeking a Senior Data Engineer, located at the Hyderabad IT Hub. Specifically, this position works within a Data & AI group that supports the Modern IT Service & Asset Management team. Responsibilities: Leading design and development of data and analytics cloud-based platform. Crafting integrated systems, implementing ELT/ ETL jobs to fulfil business deliverables. Performing sophisticated data operations such as data orchestration, transformation, and visualization with large datasets. You will be working with product managers to ensure superior product delivery to drive business value & transformation. Demonstrating standard coding practices to ensure delivery excellence and reusability. Data Ingestion: Develop and maintain data pipelines to extract data from various sources and load it into Azure and Databricks environments. Data Transformation: Design and implement data transformation processes, including data cleansing, normalization, and aggregation, to ensure data quality and consistency. Data Modeling: Develop and maintain data models and schemas to support efficient data storage and retrieval in Azure and Databricks platforms. Data Warehousing: Design and build data warehouses or data lakes using Azure services such as Azure Data Lake Storage, Databricks DeltaLake Data Integration: Integrate data from multiple sources, both on-premises and cloud-based, using Azure Data Factory or other relevant tools. Data Governance: Implement data governance practices, including data security, privacy, and compliance, to ensure data integrity and regulatory compliance. Performance Optimization: Optimize data pipelines and queries for improved performance and scalability in Azure and Databricks environments. Monitoring and Troubleshooting: Monitor data pipelines, identify and resolve performance issues, and troubleshoot data-related problems in collaboration with other teams. Data Visualization: Build BI reports to enable faster decision making. Collaboration: Work with product managers to ensure superior product delivery to drive business value & transformation Documentation: Document data engineering processes, data flows, and system configurations for future reference and knowledge sharing. Job Qualifications Experience: Bachelor's or master's degree in computer science, data engineering, or a related field, along with 4+ year work experience in data engineering and cloud platforms. Azure and Databricks: Strong proficiency in Azure services such as Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Data Lake Storage, and Azure Synapse Analytics. ETL Tools: Experience with ETL (Extract, Transform, Load) tools and frameworks, such as Apache Spark, Databricks Delta, or Azure Data Factory, for data integration and transformation. Programming: Proficiency in programming languages such as PySpark, Python, SQL, or Scala for data manipulation, scripting, and automation. Data Modeling: Knowledge of data modeling techniques and experience with data modeling tools. Database Technologies: Familiarity with relational databases (e.g., SQL Server) for data storage and retrieval. Data Warehousing: Understanding of data warehousing concepts, dimensional modeling, and experience with data warehousing technologies such as Azure Synapse Analytics or Azure SQL Data Warehouse or Azure Databricks DeltaLake Data Governance: Knowledge of data governance principles, data security, privacy regulations, and experience implementing data governance practices. Data Visualization: Experience of working with Microsoft Power BI to build semantic data model & BI reports/dashboards. Cloud Computing: Familiarity with cloud computing concepts and experience working with cloud platforms, particularly Microsoft Azure. Problem-Solving: Strong analytical and problem-solving skills to identify and resolve data-related issues. Proficiency in DevOps Tools and CICD tools (e.g. Azure DevOps, Chef, Puppet, Github) About us We produce globally recognized brands, and we grow the best business leaders in the industry. With a portfolio of trusted brands as diverse as ours, it is paramount our leaders are able to lead with courage the vast array of brands, categories and functions. We serve consumers around the world with one of the strongest portfolios of trusted, quality, leadership brands, including Always®, Ariel®, Gillette®, Head & Shoulders®, Herbal Essences®, Oral-B®, Pampers®, Pantene®, Tampax® and more. Our community includes operations in approximately 70 countries worldwide. Visit http://www.pg.com to know more. We are an equal opportunity employer and value diversity at our company. We do not discriminate against individuals on the basis of race, color, gender, age, national origin, religion, sexual orientation, gender identity or expression, marital status, citizenship, disability, HIV/AIDS status, or any other legally protected factor Job Schedule Full time Job Number R000157842 Job Segmentation Experienced Professionals