Data Engineer

Our client, a leading multinational information technology services and consulting company, is recruiting a Data Engineer to join their project in Spain.Position Title:Data EngineerPosition Type:PermanentStart Date:ASAPLocation:Madrid, SpainContact:Franci Hernandez | +34 (0) 66 58 90 947Responsibilities:Develop and maintain Scala/Spark jobs for data transformation and aggregation.Design, implement, and manage data processing pipelines.Create and manage efficient data storage solutions for metadata management, data discovery and data governance.Develop and maintain workflows and jobs for transformations of large datasets using NiFi and Jenkins.Optimize applications for performance.Ensure high-quality code by implementing testing strategies (unit, integration, and system tests).Troubleshoot and resolve technical challenges across the stack.Collaborate with designers, product managers, and other developers to deliver technical solutions.Maintain up-to-date technical documentation for projects.Stay updated with the latest trends and technologies Scala/Spark, Python, Datahub and application development in general.Qualifications: Experience with the following tools: PowerBI, Spark, Scala, Python, JavaScripts and Datahub.Good to know: Angular, Apache NiFi, JenkinsDatabase expertise: MySQL, PostgreSQL or MongoDB.Experience with other reporting tools such as MicroStrategy, Tableau, QlikView, or OBIEE, Looker is desirable.Spanish & English professional level speaking.