[W032] - Data Engineer Spark/Scala

Mission

Join Our DATA Team at INETUM!

Are you ready to take your career to the next level? We are looking for a talented Data Engineer to join our dynamic team in Madrid with a hybrid work model!

What You'll Do:

As a Data Engineer, you will play a crucial role in developing and managing our data pipelines. Your expertise will help us leverage cutting-edge technologies to drive data-driven decisions.

Profile Key Requirements: Proficiency in Spark on Scala for legacy data pipeline development.Experience with Spark as a service on Scala for data pipeline development.Strong background in designing and developing streaming processes using Spark Streaming, Spark Structured Streaming, and Apache Kafka.Management of legacy big data storage solutions (HDFS).Experience with modern big data storage solutions (IBM Cloud Object Storage and parquet format).Implementation of SQL/NoSQL database schemas, queries, and views (MongoDB, Oracle, Postgres).Shell scripting skills and experience with Airflow as a data pipeline scheduling solution.Familiarity with Dremio as a data virtualization tool.Knowledge of Dataiku as a data preparation tool is a plus!High or native level of English is required. Organization Why INETUM?

We are an international, agile digital consultancy. In the post-digital transformation era, we strive to ensure that each of our 28,000 professionals can continuously renew themselves.

Each of them can design their professional journey according to their preferences, collaborate with their clients to practically build a more positive world, innovate in each of the 27 countries, and balance their professional career with their personal well-being.

Our 28,000 digital athletes are proud to have been certified as a Top Employer Europe 2024.
#J-18808-Ljbffr