Atradius, a globally recognized leader in credit insurance and risk management, is currently looking for a skilled Data Engineer to join our dynamic Data Platform & MI team.As a member of the team, you will report to the Lead Data Engineer and work on a cloud-based LakeHouse platform where your expertise in Apache Spark will be a game-changer. The ideal candidate should have at least three years of hands-on experience in PySpark, experience in Databricks, and a proven track record of success in developing big data applications. This is a fantastic opportunity for anyone with the required skillset! Key Responsibilities: Development of reusable and standardized components to efficiently process, automate and optimize data engineering end-to-end solutions using PySpark.Build and maintain data ingestion pipelines to integrate various raw data sources (internal and external) into our cloud-based platform using Oracle GoldenGate.Design, maintain and operate Databricks workflows by ensuring the expected run behavior and results.Ensure data quality, accuracy, and reliability throughout the entire Medallion architecture. Collaborate seamlessly with cross-functional teams (Platform engineers, Data Modelers, Data Architects and Power BI engineers) to comprehend data requirements and interpret business needs, translating them into technically feasible developments.Support the Lead Data Engineer with solution design, decision making and implementation phase.Contribute to the team by proactively suggesting new ideas for improvement in the data engineering domain. Stay up to date on trends and best practices.Apply testing methodologies (TDD) and code quality rules in your developments to ensure robust and maintainable data solutions. Requirements: Bachelor's or Master's degree in Computer Science, Engineering, or a related field.Fluent spoken and written EnglishMinimum of 3 years of hands-on experience as a Data Engineer. Proficiency in Spark/PySpark and SQLHands-on experience with Databricks, particularly with Medallion architecture, to build and manage scalable data pipelines from bronze to gold layer.Source repository management and version control (Git), CI/CD knowledge (Azure DevOps) Excellent problem-solving skills and attention to detail. Strong communication and collaboration skills.Takes responsibility and feels accountable for own and team.Proven ability to work with speed and accuracy to deadlines is essential.Nice-to-have: Data Modeling experience in Medallion architecture, especially Gold layer read optimizations.Cluster tuning and optimization of Spark applications.Experience in Azure Cloud data-related services such as ADF or Azure Functions.Databricks native optimization features knowledge.Previous experience working in an international team environment. What do we offer?A dynamic, international and challenging work environmentTraining and support to reach your full potential including the opportunity for continuous professional developmentAttractive terms and conditions, including competitive salary, pension package and a range of flexible benefits and rewardsChallenging tasks with individual development and training opportunitiesEqual opportunities for allThe success of our organisation stands with the quality of our people and the ideas they have. Insights and innovative solutions for our customers are the result of an interplay of cultures, knowledge and experience. That is why diversity is extremely important to Atradius. To ensure that all colleagues within Atradius can develop their qualities, we promote an inclusive culture in which everyone feels involved and valued. We encourage and welcome everyone to apply to our positions.Do you have any questions about our offer?Estrella RAMIREZ, Human Resources, is available by e-mail at ****** am Atradius! - Do you want to know who we are?Get to know Atradius colleagues in this video: https://www.youtube.com/watch?v=NnsgT04OpTU&t=4s Atradius is a global provider of credit insurance, bond and surety, collections and information services, with a strategic presence in over 50 countries. The products offered by Atradius protect companies around the world against the default risks associated with selling goods and services on credit. Atradius is a member of Grupo Catalana Occidente (GCO.MC), one of the largest insurers in Spain and one of the largest credit insurers in the world. You can find further information on our website: https://group.atradius.com Country: Netherlands, Amsterdam, Spain, Madrid Have you applied for a job or created a job agent? Login below to show/change your preferences. Please fill in your email address if you have forgotten your password. We will send you an email with a link to create a new password. This link will be valid for 24 hours. Link to renewing your password has expired request a new link by entering your email below Link to renewing your password is sent to your email. We have sent a security code to your e-mail. If you delete, all related data will be lost. #J-18808-Ljbffr
