Build the data processing pipelines for data preparation and transformation, including raw data ingestion and curated data. Be also responsible for implementing the data products which contain the KPIs and key analysis defined by the business.
Key Objectives
- Develop the data ingestion processes to stream the data in the Data lake.
- Creation and structure the curated layer.
- Create the data products which will cover the KPIs defined by business.
- Focus on the development of the target architecture following the design set up by the Data Architect.
- Participate in the events with the team ceremonies: Iteration planning, Retrospectives, Daily or stand up meetings..
- Communicate with Scrum Master to escalate impediments or improvement for the team.
- Work closely with the Product Owner to execute the task assigned to achieve the goal of the team.
- Provide your tech point of view when a new product is designed, helping the Data Architect to refine the data model.
- Design and implement data ingestion, transformation and virtualization projects.
- Take advantage of AI tools to speed up the development processes and testing.
- Develop, maintain and document complex data models, views, and integration flows.
- Performance tune data access and query performance to meet service level agreements.
- Troubleshoot and resolve data ingestion, transformation and virtualization issues in a timely manner.
- Address questions and solve complex issues related to data visualization and reporting.
- Provide recommendations on best practices for data visualization tool usage, ensuring data security and scalability within the platform.
- Collaborate with cross-functional teams to gather requirements and deliver solutions.
This is you!
- You are enthusiastic to work in an European team (fluent in English language) to develop the technical capabilities in a common European Data Platform.
- You have an Agile mind-set and you are open to new ideas and creative ways to work.
- You are organized and get things done!
- Must have:
- SQL.
- Python.
- Data modeling knowledge.
- BI tool: Tableau.
- AWS Cloud Services (Glue, Athena, S3, DynamoDB, RDS, SNS, CloudWatch,).
- Denodo.
- Airflow.
- Git.
- Generative and Agentic AI tools.
- Nice to have:
- Databricks.
- Snowflake.
- dbt.
- AWS Cloud Services (EC2, IAM, SQS, ECS, ECR, CloudFront, Kinesis, RedShift...).
- PySpark.
- Gitflow.
- Jupyter Notebook.
Ver más
¡No te pierdas nada!
Únete a la comunidad de wijobs y recibe por email las mejores ofertas de empleo
Nunca compartiremos tu email con nadie y no te vamos a enviar spam
Suscríbete AhoraÚltimas ofertas de empleo de Desarrollo de Software en Sevilla
GRUPO NS
Atlantic International Technology, S.L.
Sevilla, ES
Scopely
Sevilla, ES