Ofertes d'ocupació per a Hadoop

• Flexibilitat horàriaSi
• Nivell d'experiència---
• Tipus de contracteA temps complert
• Publicada4 d’oct.

. Java MongoDB Python TSQL Azure NoSQL Jenkins Cloud Coumputing Jira Hadoop OpenShift AWS DevOps PostgreSQL Spring Docker Kafka Couchbase Spark Big Data SQL Server

Who are we?

We are part of the Alkemy Group, specializing in driving growth through our technological expertise, tackling complex challenges, and fostering operational excellence.

• We are digital natives and technology-neutral thanks to our rapid adaptation capabilities and problem-solving skills in any business situation.
• We are passionate about technology challenges that have a significant impact on business. To address these, we have high-performance teams and the ability to quickly and effectively combine technologies.
• We support our clients in their digital evolution to achieve maximum efficiency in their businesses, leveraging our extensive multi-sector experience.
  
  

• Design and develop scalable data pipelines and data services using Python and other relevant technologies, following software engineering best practices.
• Build and maintain robust, automated ETL/ELT processes, focusing on clean, modular, reusable, and maintainable code.
• Integrate data from multiple sources, including APIs, databases, files, and third-party systems, designing reliable and fault-tolerant integrations.
• Develop APIs and data ingestion services when required to expose, consume, or orchestrate data across different systems.
• Apply software engineering best practices, including version control, code reviews, testing, CI/CD, logging, monitoring, error handling, and documentation.
• Optimize the performance and scalability of data ingestion and transformation processes, identifying bottlenecks and improving both code and infrastructure.
• Work closely with Data Science, BI, Product, and Software Engineering teams to translate business and technical requirements into robust data solutions.
• Design solutions with security, data quality, governance, and regulatory compliance in mind, following AWS and industry best practices.
• Contribute to technical decisions and architecture, helping evolve our data platform and development standards.
• Document technical solutions, APIs, pipelines, and processes, ensuring maintainability and knowledge sharing across the team.
  
  

• Strong experience developing in Python, particularly for data processing, transformation, integration, and analytics.
• Experience designing, developing, and consuming APIs and data integration services.
• Solid software development practices, including clean and maintainable code, version control, code reviews, automated testing, and CI/CD.
• Hands-on experience with containers and OpenShift environments.
• Strong knowledge of relational databases (PostgreSQL, SQL Server, or similar) and NoSQL databases (MongoDB, Couchbase, or similar).
• Hands-on experience with cloud platforms and cloud-based data services (AWS, Azure, or GCP).
• Solid understanding of Data Lakes, Data Warehouses, and modern data architectures.
• Experience with Python data engineering and analytics libraries, such as Pandas, NumPy, and PySpark and Spark.
• Hands-on experience with Databricks, including data engineering, analytics, and development of scalable data processing solutions.
• Knowledge of Big Data technologies, such as Spark or Hadoop.
• Experience developing and maintaining ETL/ELT pipelines and data ingestion processes.
  
  

• Experience with data streaming technologies, such as Kafka.
• Experience with data governance, security, and regulatory requirements.
• Experience with data visualization tools, such as Matplotlib, Seaborn, or Plotly.
• Previous experience in the financial sector or other regulated environments.
• Experience with Java and Spring Boot development.
• Strong technical English skills.
• Experience with DevOps and development tools, including Bitbucket, Jira, Jenkins, and testing frameworks such as PyTest.