Python Azure Cloud Coumputing Kafka

ABOUT US At BASF Digital Hub Madrid we develop innovative digital solutions for BASF, create new exciting customer experiences and business growth, and drive efficiencies in processes, helping to strengthen BASF´s position as the digital leader in the...
ABOUT US

At BASF Digital Hub Madrid we develop innovative digital solutions for BASF, create new exciting customer experiences and business growth, and drive efficiencies in processes, helping to strengthen BASF´s position as the digital leader in the chemical industry. We believe the right path is through creativity, trial and error and great people working and learning together. Become part of our team and develop the future with us - in a global team that embraces diversity and equal opportunities.

JOIN THE TEAM

We are currently seeking a talented Solutions Architect to join our team at BASF´s Agricultural Solutions department Digital Factory.

RESPONSIBILITIES

- Design and develop scalable and efficient cloud-based data integration architectures using Databricks and Azure Data Factory.
- Integrate real-time streaming solutions with Event Hubs and Kafka to manage high-throughput data ingestion and processing.
- Optimize data storage, transformation, and access using Azure Data Lake Storage Gen2 (ADLS Gen2).
- Write clean, efficient, and reusable code in Python and PySpark to process and analyze large-scale datasets
- Collaborate with cross-functional teams to understand data requirements and implement solutions that align with business goals
- Monitor, troubleshoot, and improve the performance of cloud-based data platforms and pipelines
- Ensure data quality, governance, and security standards are met across all data solutions
- Review and approve the developments of the team.
- Communicate with the business stakeholders.

REQUIREMENTS

- Proven expertise in Databricks and Azure Data Factory for building data pipelines and workflows.
- Strong experience with Event Hubs and Kafka for real-time data streaming and messaging.
- Proficiency in working with Azure Data Lake Storage Gen2 (ADLS Gen2) for data management and storage optimization.
- Advanced programming skills in Python and PySpark for data engineering tasks.
- Solid understanding of data integration, transformation, and optimization best practices in cloud environments
- Experience working with large-scale data processing and real-time streaming architectures.
- Familiarity with Azure cloud services and related tools
- Strong analytical and problem-solving skills with a focus on performance and scalability.

NICE TO HAVE

- Strong understanding of IT solutions design principles, methodologies, and best practices.
- Ability to conduct requirement analyses by gathering, analyzing, and translating business needs into technical solution designs.

BENEFITS

- Responsibility from day one in a challenging work environment and "on-the-job" training as part of a committed team.
- Adequate compensation according to your qualifications and experience • A secure work environment because your health, safety and wellbeing is always our top priority.
- Flexible work schedule and Home-office options, so that you can balance your working life and private life.
- Learning and development opportunities
- 23 holidays per year
- Another 5 days (readjustments days) and 2 days (cultural days)
- A collaborative, trustful and innovative work environment
- Being part of an international team and work in global projects
- Relocation assistance to Madrid provided

No et perdis res!

Uneix-te a la comunitat de wijobs i rep per email les millors ofertes d'ocupació


Mai no compartirem el teu email amb ningú i no t'enviarem correu brossa

Subscriu-te ara

Darreres ofertes d'ocupació de Informàtica i IT a Madrid

Fiet

Madrid, ES

BUSCAMOS COORDINADOR/A JURÍDICO/A DEL ÁREA DE ATENCIÓN INTEGRAL (SUSTITUCIÓN POR BAJA DE MATERNIDAD) Fiet, es una oenegé...

Talgo

Rozas de Madrid, Las, ES

En Talgo apostamos por el talento, incentivando permanentemente el crecimiento personal y profesional de nuestro equipo...

Plenergy

Madrid, ES

¿Te gustaría participar en la primera fase de la construcción de estaciones de servicio automatizadas? ¿Te encuentras en...

Roots Real Estate

Tres Cantos, ES

Somos una empresa innovadora en el sector inmobiliario, comprometida con conectar proyectos con espacios que se ajusten a...

ARQUIMEA

Madrid, ES

Somos una empresa tecnológica que opera a nivel global. Si te apasiona la tecnología y crees en su capacidad para...

The Adecco Group

Madrid, ES

¿Eres una persona organizada, multitarea y con ganas de asumir nuevos retos? ¿Tienes experiencia gestionando la...

BESO by LLYC

Somos una firma global de Corporate Affairs y Marketing . Trabajamos como partner de nuestros clientes en creatividad...

Sopra Steria

Madrid, ES

¡Porque trabajar en Sopra Steria, también es sentir Sopra Steria! Somos un reconocido líder europeo en consultoría...

Arktic

Madrid, ES

Arktic es una firma de consultoría de negocio con experiencia y foco en la industria financiera: bancos, gestoras...

NielsenIQ

Madrid, ES

Job Description SA&I is a department of NielsenIQ working on special analyses based on consumer and retailer data. In...