Senior Data Engineer

Detalles de la oferta

Work model: fully remote from Romania Type of collaboration: B2B or CoE For our client, a full-lifecycle digital engineering firm offering digital advisory through scaled engineering services, we are looking for Senior Data Engineers . The company serves their customers across 11 innovation hubs in the US, Eastern Europe, and India. Combining their core competence in engineering with the latest in digital strategy and technology, they seamlessly manage Digital Transformation journeys from strategy through execution to help businesses thrive in the digital economy. Requirements and responsibilities We are looking for a self-motivated, enthusiastic, and passionate software engineer to develop technology solutions for the company's marketplace product. The ideal candidate thrives in a highly technical role and will design and develop software using cutting-edge technologies consisting of web applications, data pipelines, big data, machine learning, and multi-cloud. The development is already underway so the candidate would be expected to get up to speed very quickly start contributing. What you can expect: An unmatched experience in handling huge volumes of data, analytics, visualisation, and services over cloud technologies along with appreciation in product development life cycle to convert an idea into revenue generating stream. What you'll do Design Build ingestion pipelines using ELT and schema on read in Databricks Delta lake Design Develop "Transformations" aspects using ELT framework to modernise the Ingestion pipelines and build data transformations at scale Provide technical expertise in the areas of design and implementation of Ratings Data Ingestion pipelines with modern AWS cloud and other technologies such as S3, Hive, Databricks, Scala, Python, and Spark Build and maintain a data environment for speed, accuracy, consistency, and "up" time Work closely with other data teams Data Science team and participate in the development of Ingestion pipelines Ensure data governance principles are adopted, data quality checks and data lineage are implemented in each hop of the data Be in tune with emerging trends Big data and cloud technologies and participate in the evaluation of new technologies Ensure compliance through adopting enterprise standards and promoting best practice/guiding principles aligned with organisation standards. What you'll bring A minimum of 4 years of significant experience in application development Development, design, and architecture exposure the ability to ensure quality across various technology components that are developed by geographically diversified software engineers with superior knowledge of system architecture, object-oriented design, and design patterns Expertise with streaming pipelines especially around Kafka and Spark structured streaming. Proficient with software development lifecycle (SDLC) methodologies like Agile and test-driven development Experience working with high-volume data and computationally intensive systems Garbage collection friendly programming experience - tuning Java garbage collection performance is a must Proficiency in the development environment, including IDE, web application server, GIT, Continuous Integration, unit-testing tools, and defect management tools. Domain knowledge in the Financial Industry and Capital Markets is a plus Excellent communication skills are essential, with strong verbal and writing proficiencies Mentor teams, innovate and experiment, give a face to business ideas, and present to key stakeholders.


Salario Nominal: A convenir

Fuente: Adzuna_Ppc

Requisitos

Commercial Architect (W/M/D)

Grow Your Career with NTT DATA Die Commercial Architects sind in der kommerziellen Unterstützung des Vertriebs von nationalen und internationalen IT-Projekte...


Ntt Data - Otra

Publicado 17 days ago

Selezione Figure Senior Telecomunicazioni

Società per Azioni Italiana operante nel mondo delle TLC integrate , SELEZIONA FIGURE SENIOR sui territori della Valle D'Aosta, Piemonte, Lombardia e Liguria...


Hrspecialist Italia - Otra

Publicado 17 days ago

Network And Client Management – Belgium & Netherlands

Management Events is the premier platform connecting top-tier business leaders with exclusive networking opportunities, cutting-edge insights, and world-clas...


Management Events - Otra

Publicado 17 days ago

Qa Technical Lead

Centro de Servicios a Tienda y Desarrollo de Negocio , nuestras oficinas centrales: Donde cuidar y acompañar a todos los colaboradores es el día a día. La me...


Leroy Merlin España - Otra

Publicado 17 days ago

Built at: 2024-11-19T19:18:42.464Z