Data Engineer
Empresa:

Sdi Digital Group


Detalles de la oferta

.Our opportunityThe profile must have experience in the implementation, integration and industrialisation of Python code, with special emphasis on the industrialisation of solutions developed by our Data Scientist team, so knowledge in ML and data modelling with Databricks and other technologies will be important.Your roleAs a Data Engineer, your main responsibilities will involve :Analyze data models and derive logical conclusions.Processes modeling.Hands on development and monitoring of the Azure cloud Platform and various associated components for data ingestion, transformation and processing.Effectively diagnose, isolate, and resolve complex problems pertaining to data infrastructure, including performance tuning and optimization.Designs and writes programs according to functional and non-functional requirements.Develops and maintains technical documentation.Follows established configuration / change control processes.Your Skills and ExperienceAs a Data Engineer, your skills and experience will ideally include :University level education or equivalent2+ years of experience working as a Data EngineerKnowledge of design patternsAbility to write complex SQL queriesA good understanding of distributed computationExperience with Azure cloud.Experience with Databricks.5+ years Python1+ years of experience in Apache Spark 2.02+ years of experience working as a Software EngineerExperience with containerization of solutions (Docker, Kubernetes).Nice to have :Experience with Python Poetry framework1+ Experience in functional programming (preferably Scala - big plus)Experience in R programmingExperience with Hadoop technologies (i.E. Sqoop, Hive, Flume etc.)Continuous Integration / Continuous Deployment (Azure DevOps)Experience in data exploration using notebooks (Databricks notebooks).Experience with experiment tracking and model registry (MLflow).Understanding of how to deploy, operationalize, and monitor ML models.Experience with Python libraries like pandas, numpy, and scikit-learn.Experience in automation of regular tasks(e.G. data refreshes) using bash and python scripting.What we offer?As well as a competitive salary and a yearly bonus we offer :Option to work remotely up to 100% of the time.300 euros net to set up your home office and additional monthly home office allowance.Wide range of internal and external trainings, including free English, German and Spanish classes depending on the needsTicket restaurant or flexibility to exchange it for other benefits.Life, accident, and Health InsuranceCollective Life Retirement Plan2000 referral bonus if you bring other talented people like you.Special banking and insurance conditions plus Exclusive Employees discountsFunctional diversity benefitsEvents : summer and Christmas party, different activities like hiking, investment, beach volley club and many moreNo dress code


Fuente: Jobtome_Ppc

Requisitos

Data Engineer
Empresa:

Sdi Digital Group


Senior Data Scientist

Clarivate is looking to expand its data science team with a talented Senior Data Scientist to join us in Barcelona.If you're passionate about shaping the fut...


Desde Clarivate Analytics - Barcelona

Publicado a month ago

Senior Salesforce Administrator

Email Manage global Salesforce.com business application across Sales, Marketing, Finance, Services, and other organizations by resolving production support t...


Desde Dynatrace - Barcelona

Publicado a month ago

Information Security Consultant

Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Select how often (in days) to receive an alert: As an Information S...


Desde Zurich 56 Company Ltd - Barcelona

Publicado a month ago

E-Commerce Excellence Hub Specialist (Eehs), German / Deutsch

Full-timeCompany DescriptionBosch Service Solutions is a leading global supplier of Business Process Outsourcing for complex business processes and services....


Desde Robert Bosch Group - Barcelona

Publicado a month ago

Built at: 2024-07-03T22:58:24.868Z