
Data Engineer
ADI Resourcing
Applications are made on ADI Resourcing's own site. We never sit in the middle.
Job description
About the job Data Engineer Responsibilities: • Building data processing based on jointly defined requirements along the data pipelineunder the concern of quality and having alert in place. • Works closely with both the backend developers as well as the IT data architecture group. Work with Product Owners to help them leverage data solutions in their products. • Providing guidance on suitable options, designing, and creating data pipeline for the analytical solutions data lake / data warehouses to specific micro services. • Supporting the bug fixing and performance analysis along the data pipeline. • Bring experience of Data Ware Houses, and Data Lakes to development team. • Be a strong advocate for a culture of process and data quality across development teams. • Follow an agile development methodology. Qualifications: • BS/MS degree in Computer Science, Engineering, Mathematics, Statistics or related subject. • 3 - 5 years of experience working on Big Data platform like Hadoop (Hortonworks is preferred), HBase, Couch DB, Hive, Pig etc. • Experience working in start-up environment or organizations with an agile culture. Professional attitude and service orientation; superb team player. • Experienced with data modeling, design patterns, building highly scalable and secured analytical solutions. • Experience with data processing, ETL and workflow and messaging queue like Kafka. Used SQL, PL/SQL, Spark, Spark SQL and similar languages. • Has programming skills such as Python, Java, Scala, Spark Streaming, Hive. • Basic knowledge of Linux and shell scripting. • Telecom industry and data model knowledge is required. • Strong analytical and problem-solving skills. Or refer someone • • • • • • •