Python Azure Cloud Coumputing Kafka Machine Learning

ABOUT US At BASF Digital Hub Madrid we develop innovative digital solutions for BASF, create new exciting customer experiences and business growth, and drive efficiencies in processes, helping to strengthen BASF´s position as the digital leader in the...
ABOUT US

At BASF Digital Hub Madrid we develop innovative digital solutions for BASF, create new exciting customer experiences and business growth, and drive efficiencies in processes, helping to strengthen BASF´s position as the digital leader in the chemical industry. We believe the right path is through creativity, trial and error and great people working and learning together. Become part of our team and develop the future with us - in a global team that embraces diversity and equal opportunities.

We believe the right path is through creativity, trial and error and great people working and learning together. Become part of our team and develop the future with us - in a global team that embraces diversity and equal opportunities. We are committed to fostering an inclusive workplace and strongly encourage applications from individuals with disabilities. We value diversity and believe that varied perspectives enhance our team´s effectiveness. Our hiring practices are designed to ensure equal opportunity for all candidates.

WHAT YOU CAN EXPECT

We are currently seeking a talented Data Engineer to join our team at BASF´s Agricultural Solutions department Digital Factory.

RESPONSIBILITIES

- Assist in the design and development of scalable and efficient cloud-based data pipelines using Databricks and Azure Data Factory.
- Support the integration of real-time streaming solutions with Event Hubs and Kafka for data ingestion and processing.
- Help optimize data storage and transformation using Azure Data Lake Storage Gen2 (ADLS Gen2).
- Write clean and efficient code in Python and PySpark to process and analyze datasets.
- Collaborate with cross-functional teams to gather data requirements and implement solutions that align with business goals.
- Monitor and troubleshoot cloud-based data platforms and pipelines, contributing to performance improvements.
- Ensure adherence to data quality, governance, and security standards across data solutions.

REQUIREMENTS OF THE POSITION

- Basic knowledge of Databricks and Azure Data Factory for building data pipelines and workflows.
- Familiarity with Event Hubs and Kafka for real-time data streaming and messaging.
- Understanding of Azure Data Lake Storage Gen2 (ADLS Gen2) for data management and storage optimization.
- Proficiency in programming with Python and PySpark for data engineering tasks.
- Awareness of data integration, transformation, and optimization best practices in cloud environments.
- Experience or coursework in large-scale data processing and real-time streaming architectures is a plus.
- Familiarity with Azure cloud services and related tools is advantageous.
- Strong analytical and problem-solving skills with a focus on performance and scalability.

NICE TO HAVE

- Relevant coursework or certifications in Azure data engineering, cloud platforms, or related technologies.
- Exposure to CI/CD pipelines for cloud data solutions is a plus.
- Basic knowledge of machine learning concepts and integration within data pipelines (optional).

WHAT WE OFFER

- A secure work environment because your health, safety and wellbeing is always our top priority.
- Flexible work schedule and Home-office options, so that you can balance your working life and private life.
- Learning and development opportunities
- 23 holiday days per year
- 5 additional days (readjustment)
- 2 cultural days
- A collaborative, trustful and innovative work environment
- Being part of an international team and work in global projects
- Relocation assistance to Madrid provided

No et perdis res!

Uneix-te a la comunitat de wijobs i rep per email les millors ofertes d'ocupació


Mai no compartirem el teu email amb ningú i no t'enviarem correu brossa

Subscriu-te ara

Darreres ofertes d'ocupació de Enginyer/a de Dades a Madrid

Swiss Re

Madrid, ES

About the Team and our Scope At L&H Solutions, we build and commercialize cloud-native (Azure-based) SaaS/PaaS solutions...

Davidson consulting

Madrid, ES

Davidson Consulting España nace en el año 2014. Formamos parte del grupo Davidson, multinacional francesa de servicios...

Santander

Madrid, ES

Data Engineer - SDS Country: Spain COMIENZA AQUÍ Santander está evolucionando de una marca global de alto impacto a una...

Prima

Are you looking for a new challenge? Fancy helping us shape the future of motor insurance? Prima could be the place for...

CIPEx - Consejo de Ingenieros Peruanos en el EXterior

Madrid, ES

Senior PowerBI Data Engineer - 12 meses - Madrid***En RED Global estamos buscando, en nombre de uno de nuestros...

DATA ENGINEER

2 de nov.

Inetum

Madrid, ES

Mission We are seeking a highly motivated and technically proficient Data Platform Support Specialist to provide...

Coca-Cola Europacific Partners

Madrid, ES

Lead Machine Learning Engineer About Coca-Cola Europacific Partners (CCEP) CCEP is the world’s largest independent...

Randstad ES

Madrid, ES

¿Te interesa seguir desarrollando tu carrera como Jr. Devops Cloud Engineer en proyectos estables? nuestro cliente...

Grupo NS

Desde Grupo Ns estamos buscando perfiles DevOps Engineer de al menos 4 años de experiencia con Red Hat Openshift on AWS...

Cloud Engineer

31 d’oct.

CAS TRAINING

Seleccionamos para proyecto que se desarrolla en remoto, un profesional con mínimo 5 años de experiencia como Cloud...