Our team is accelerating the application of advanced analytics and modeling in the Intelligence Transportation System sector.
Our team is seeking a Senior Data Engineer to help us develop and maintain our data platform and data pipelines.
Key responsibilities of the role include:
Design, build, and optimize our data platform and infrastructure to support both batch processing and real-time ingestion, ensuring we monitor operational quality and process raw data for modeling and analytics.
Design, build, and maintain efficient data pipelines to integrate data from multiple sources into data warehouses and data lakes.
Design, build, and maintain big-data solutions to process large amounts of data. Deploy these solutions both on-premise as well as cloud.
Optimize database schemas and queries to ensure performance and scalability.
Collaborate closely with Data Analysts, Data Scientists, and Software Engineers to ensure data quality, availability, and democratization.
Keep detailed data governance, security, and scalability documentation up to date.
WHAT DO WE NEED IN OUR TEAM?
For these reasons, we are seeking experts with the following qualifications:
Demonstrated experience with Data Warehouse concepts, database schema design, and performance optimization, with proficiency in at least one popular SQL engine such as Microsoft SQL Server or PostgreSQL.
Proficiency in at least one programming language or framework, such as Python, C# / .NET, or PySpark, to build efficient ETL processes.
Familiarity with the Python data stack (Pandas, Numpy, Scikit-learn, Pytorch, etc.).
Hands-on experience with modern data orchestration frameworks, such as Airflow, Prefect, or Luigi.
Expertise in containerization and container management with Docker and Kubernetes is highly valued.
Experience with big data and observability frameworks, such as Spark, Hive, Hadoop, and Elasticsearch.
Experience with at least one cloud provider (AWS, Azure, or GCP) is a plus.
WHAT DO WE OFFER?
Hybrid working model and 8 weeks per year of teleworking outside your usual geographical area.
Flexible start and finish times, and intensive working hours on Fridays and in summer.
Personalized career plan development, training, and language learning support.
National and international mobility. Do you come from another country? We can offer you a relocation package.
Competitive compensation with ongoing reviews, flexible compensation, and discounts on brands.
Wellbeing program: Health, dental and accident insurance; free fruit and coffee, physical, mental and financial health training, and much more!
#J-18808-Ljbffr