Capitole Consulting keeps growing and we want to do it with you Are you a passionate Senior Python Developer (3 years) with experience in Databricks ? We have an exciting opportunity to lead and empower a multicultural team We are seeking a Python Developer with Databricks to work on a critical project involving the migration of calculation logic into Databricks using Python. This role requires expertise in Python development, to adapt and extend existing Python code, experience with distributed data processing frameworks, knowledge of the Databricks environment and a close collaboration with a number of stakeholders. KEY RESPONSABILITIES 1. Code Adaptation and Development: a) Refactor and adapt existing Python code to handle the new data schema and transformations. Part of the code is already available in Python, however however it would need to be adjusted and/or extended (new data fields, new data sources,…) b) Develop new modules to process, transform, and load data using PySpark or Python-based frameworks. c) Implement data validation and error handling mechanisms. 2. Databricks Platform Support (would be nice): a) Support in initial configuration of Databricks (including library installations and resource optimization) b) Integrate Databricks with cloud storage and data sources (on Azure and/or Databricks) c) Automatisation of Jobs in Databricks or Azure Data Factory 3. CI/CD, Testing and Quality Assurance: a) Set up CI/CD pipelines for code and configuration deployment b) Write and execute unit tests, integration tests, and performance tests for data pipelines. c) Debug and troubleshoot issues in a distributed environment. 4. Collaboration and Documentation: a) Work closely with data engineers, analysts, and cloud architects to ensure seamless integration and operation. b) Document code, workflows, and platform configurations for transparency and future reference TECHNICAL SKILLS: 1. Strong programming skills in Python 2. Hands-on experience with Databricks, including cluster setup, Jobs, Workflows, and Delta Lake. 3. Experience with Azure 4. Nice to have: SAS know how or at least familiarity with financial processes We're great, but with you we'll be even better For this you will have: - Budget of 1.200€ in individual training for you to use it in whatever you want (technological events, books, trainings, certifications, etc.). - Follow-up with your team every month for continuous feedback. - Teleworking. - Flexible working hours to help you reconcile your professional / family life. - Private medical insurance paid in full by Capitole. - Flexible remuneration (restaurant tickets, transport and/or childcare). - Andjoy (Gymforless). - Discounts on major brands for employees (Club Capitole). Get to know the whole family: - Team Buildings every two months - don't miss the summer party or the Christmas dinner - Football team sponsored by Capitole. - Technological communities for you to share your knowledge and ideas with the other teams, sharing internal knowledge is essential - Last but not least, a TEAM Don't you know us yet? Discover us https://capitole-consulting.com/ See what people are saying about us https://www.glassdoor.es/Opiniones/Capitole-Consulting-Opiniones-E2060890.html Don't hesitate to send us your profile, we are looking forward to meeting you