Madrid Senior Data & AI Engineer (mfd)

Job description

Building data and AI pipelines for document processing in our (micro-)batch architecture Collaborating with subject matter experts to understand requirements Designing and implementing data extraction and retrieval solutions, leveraging modern AI methods where appropriate Introducing new technologies to deliver reliable and cost-efficient services Contributing to the evolution of our AI-powered search and knowledge platforms, including multimodal retrieval and knowledge extraction capabilities Working in an international (team language English) and agile team (Scrum) QUALIFICATIONS A degree in computer science, software engineering, mathematics or similar experience Strong problem‑solving skills with the ability to break down complex data and system challenges into pragmatic, scalable solutions Ownership mindset: takes responsibility end‑to‑end, from design and implementation to production support and continuous improvement Experience building and operating production‑grade big data pipelines on Databricks Experience applying AI/ML and NLP techniques for information extraction, retrieval or knowledge discovery Experience with modern LLM-based RAG architectures, embeddings and vector search Hands-on expertise with Apache Spark (PySpark/Scala), including performance tuning, data skew handling, and efficient cluster usage Solid Python programming skills Experience with ElasticSearch / OpenSearch Experience working in cloud‑based DevOps environments, including Azure cloud, Azure DevOps, and CI/CD pipelines Fluent communication in English is required Nice to have Experience working with Azure Data Factory (ADF) Experience working with Kubernetes Experience in cloud environments (Storage Accounts, ADLS2) Experience with multimodal document processing (text, images, scanned documents) Experience evaluating and benchmarking LLMs for enterprise search and knowledge management WHAT WE OFFER A secure work environment because your health, safety and wellbeing is always our top priority. Flexible work schedule and Home-office options, so that you can balance your working life and private life. Learning and development opportunities 23 holiday days per year 5 additional days (readjustment) 2 cultural days A collaborative, trustful and innovative work environment Being part of an international team and work in global projects Relocation assistance to Madrid provided At BASF, the chemistry is right Because we are counting on innovative solutions, sustainable actions, connected thinking and on you, become a part of our formula for success and develop the future with us - in a global team that embraces diversity and equal opportunities irrespective of gender, age, origin, sexual orientation, disability or belief.At BASF, we are committed to upholding and ensuring compliance with company standards related to quality, environment, health, safety, and energy, in line with our global guidelines.We actively promote a culture of prevention and continuous improvement, encouraging collaboration in initiatives related to quality, environmental protection, health, safety, and energy performance.We foster responsible energy use, promoting efficiency in daily operations and supporting the identification of improvement projects and energy-saving opportunities Apply now Madrid, ESP BASF Digital Solutions S.L. Digitalization Permanent 145660 IT and Digitalization Spain Work model: Hybrid Credits Data protection Contact Follow us Opens in a new tab. Opens in a new tab. Opens in a new tab. Opens in a new tab. Copyright © BASF SE 2019