Capitole Consulting keeps growing and we want to do it with you!Are you a passionate Senior Python Developer (3+ years) with experience in Databricks?
We have an exciting opportunity to lead and empower a multicultural team!We are seeking a Python Developer with Databricks to work on a critical project involving the migration of calculation logic into Databricks using Python.This role requires expertise in Python development, to adapt and extend existing Python code, experience with distributed data processing frameworks, knowledge of the Databricks environment and a close collaboration with a number of stakeholders.
KEY RESPONSABILITIES1.
Code Adaptation and Development:a) Refactor and adapt existing Python code to handle the new data schema and transformations.
Part of the code is already available in Python, however however it would need to be adjusted and/or extended (new data fields, new data sources,…)b) Develop new modules to process, transform, and load data using PySpark or Python-based frameworks.c) Implement data validation and error handling mechanisms.2.
Databricks Platform Support (would be nice):a) Support in initial configuration of Databricks (including library installations and resource optimization)b) Integrate Databricks with cloud storage and data sources (on Azure and/or Databricks)c) Automatisation of Jobs in Databricks or Azure Data Factory3.
CI/CD, Testing and Quality Assurance:a) Set up CI/CD pipelines for code and configuration deploymentb) Write and execute unit tests, integration tests, and performance tests for data pipelines.c) Debug and troubleshoot issues in a distributed environment.4.
Collaboration and Documentation:a) Work closely with data engineers, analysts, and cloud architects to ensure seamless integration and operation.b) Document code, workflows, and platform configurations for transparency and future referenceTECHNICAL SKILLS:1.
Strong programming skills in Python2.
Hands-on experience with Databricks, including cluster setup, Jobs, Workflows, and Delta Lake.3.
Experience with Azure4.
Nice to have: SAS know how or at least familiarity with financial processes We're great, but with you we'll be even better!For this you will have:- Budget of 1.200€ in individual training for you to use it in whatever you want (technological events, books, trainings, certifications, etc.
).- Follow-up with your team every month for continuous feedback.- Teleworking.- Flexible working hours to help you reconcile your professional / family life.- Private medical insurance paid in full by Capitole.- Flexible remuneration (restaurant tickets, transport and/or childcare).- Andjoy (Gymforless).- Discounts on major brands for employees (Club Capitole).Get to know the whole family:- Team Buildings every two months - don't miss the summer party or the Christmas dinner!- Football team sponsored by Capitole.- Technological communities for you to share your knowledge and ideas with the other teams, sharing internal knowledge is essential!!!
!- Last but not least, a TEAM!
Don't you know us yet?
Discover us!!!
https://capitole-consulting.com/See what people are saying about us https://www.glassdoor.es/Opiniones/Capitole-Consulting-Opiniones-E2060890.htmlDon't hesitate to send us your profile, we are looking forward to meeting you!