.Our opportunityWe are seeking a Data Engineer to join our DBI organization within the Data Engineering team. We are looking for a proactive person who is eager to learn new technologies, bring knowledge and experience to the team, and who likes to apply good practices in the work they do, given that we are the reference in this aspect for the rest of the organisation.Your roleAs a Data Engineer, your main responsibilities will involve:Analyze data models and derive logical conclusions.Hands-on development and monitoring of the Azure cloud Platform and various associated components for data ingestion, transformation, and processing.Effectively diagnose, isolate, and resolve complex problems pertaining to data infrastructure, including performance tuning and optimization.Design and write programs according to functional and non-functional requirements.Develop and maintain technical documentation.Your Skills and ExperienceAs a Data Engineer, your skills and experience will ideally include:University level education or equivalent.2+ years of experience working as a Data Engineer.Knowledge of design patterns.Ability to write complex SQL queries.A good understanding of distributed computation.Experience with Azure cloud.Experience with Databricks.5+ years Python.1+ years of experience in Apache Spark 2.0.2+ years of experience working as a Software Engineer.Experience with containerization of solutions (Docker, Kubernetes).Nice to have:Experience with Python Poetry framework.1+ years of experience in functional programming (preferably Scala - big plus).Experience in R programming.Experience with Hadoop technologies (i.E. Sqoop, Hive, Flume etc.).Experience in data exploration using notebooks (Databricks notebooks).Experience with experiment tracking and model registry (MLflow).Understanding of how to deploy, operationalize, and monitor ML models.Experience with Python libraries like pandas, numpy, and scikit-learn.Experience in automation of regular tasks (e.G. data refreshes) using bash and python scripting.What we offer?As well as a competitive salary and a yearly bonus we offer:Option to work remotely up to 100% of the time.300 euros net to set up your home office and additional monthly home office allowance.Wide range of internal and external trainings, including free English, German and Spanish classes depending on the needs.Ticket restaurant or flexibility to exchange it for other benefits.Life, accident, and Health Insurance.Collective Life Retirement Plan.2000 referral bonus if you bring other talented people like you.Special banking and insurance conditions plus Exclusive Employees discounts.Functional diversity benefits.Events: summer and Christmas party, different activities like hiking, investment, beach volley club and many more.No dress code.Primary work location is Barcelona, Poblenou. Please apply with your CV in English
