Python TSQL Azure Cloud Coumputing Scala Git AWS DevOps Big Data

ClearPeaks is a specialist consulting firm delivering services and solutions in "Everything Data" - Business Intelligence, Advanced Analytics, Big Data & Cloud, and Web & Mobile Applications. Founded in 2000, we have been a trusted partner to our...

ClearPeaks is a specialist consulting firm delivering services and solutions in "Everything Data" - Business Intelligence, Advanced Analytics, Big Data & Cloud, and Web & Mobile Applications. Founded in 2000, we have been a trusted partner to our customers in over 15 industry verticals and functional areas, with operations spanning Europe, Middle East, the United States, and Africa.


ClearPeaks is part of a strategic alliance with synvert, a group of six successful full-service Data & Analytics (D&A) consulting firms, with a clear goal to become one of EMEA's largest D&A consulting companies.


Our services are based on the latest market-leading enterprise technology platforms, and delivered by a dynamic team of expert consultants. Our strength lies in our ability to efficiently deliver customer insight and value, gained through our decades of experience with real-world challenges.


As a Data Engineer, you will be responsible securely transfer the data between different network domains and environments. Besides that, you will be improving the performance and enhancing the structure of the data pipelines and data models.


At ClearPeaks, there are endless opportunities to get involved in different projects bringing innovative ideas while being part of leading-edge teams who are always innovating and evolving in the Data Management field.


Responsibilities


  • Develop, deploy and manage data pipelines following CI/CD practices
  • Orchestrate data pipelines with tools such as Airflow, Oozie, Azure Data Factory, etc.
  • Develop Python scripts or Scala code for data processing
  • Collect and analyse pipeline requirements
  • Consult about best architectural and design principles in developing pipelines



Requirements


  • A degree in Statistics, Computer Science or Telecommunication Engineering, Informatics or related degree.
  • Proven experience with Python or Scala
  • Experience with orchestration tools like Airflow or Oozie
  • Ability to use CI/CD & DevOps tools such as Git, AWS CI/CD Pipelines, Azure DevOps, etc.
  • Knowledge on SQL
  • KNIME knowledge is nice to have
  • Ability in solutioning covering data ingestion, data cleansing, ETL, data mart creation and exposing data for consumers.
  • Technology expertise of solutioning in cloud data platforms in AWS, Azure or GCP


Our offer to you!


  • Work with leading edge technologies that will enable you to accelerate your career development.
  • Enjoy an excellent work environment where people love what they do.
  • Be part of an international and ambitious team whilst having fun.
  • Attractive salary and flexible compensation

¡No te pierdas nada!

Únete a la comunidad de wijobs y recibe por email las mejores ofertas de empleo


Nunca compartiremos tu email con nadie y no te vamos a enviar spam

Suscríbete Ahora

Últimas ofertas de empleo de Ingeniero/a de Datos en Barcelona

Aristocrat

Barcelona, ES

We’re seeking an ML/AI Engineer who’s excited by the opportunity to turn data into action and help shape the future of...

CAS TRAINING

Barcelona, ES

🚀 Buscamos un/a Senior Data Engineer con alta especialización en Python y AWS para un proyecto crítico en el sector...

HP UK

Sant Cugat del Vallès, ES

Description - Junior Machine Learning Engineer (GenAI Modelling) The AI Lab (under the well-known Technology and...

Cloud Engineer

12 ago.

EPAM

Barcelona, ES

We are looking for a Cloud Engineer to join our new Enterprise AI platform team. This is an exciting opportunity to be...

Hopla! Software

🚀 Únete a HOPLA! y transforma el futuro con nosotros 🚀 En HOPLA! no solo ayudamos a las empresas a modernizar sus...

Barcelona Supercomputing Center

Barcelona, ES

Reference:406_25_ES_CES_RE1 Job title:Machine Learning Engineer (RE1-2) – AI Factory (Earth Sciences Department) About...

Michael Page

Barcelona, ES

Perfil buscado (Hombre/Mujer) Design and build robust, scalable batch and streaming data pipelines Help shape our...

New Work SE

About The Job This position is open either in Barcelona or in Valencia. About Us: Join our dynamic international team of...