.Senior Data Engineer with Spark/ScalaYou love working with data of all sorts, small and big. You enjoy helping clients push the boundaries of extracting business insights and value from the data automatically and efficiently.The opportunityWe are looking for a top-notch technology savvy specialist willing to move our projects on a new track! You will use the most advanced technology stack and have an opportunity to implement new solutions while working with top leaders in their industries. As a part of our global team, you will participate in national or international projects mostly based and implemented on major three cloud providers (Azure, GCP, AWS). As a member of our team in the EY GDS Spain office in Malaga, you'll have a chance to extend your knowledge & experience by working on interesting projects with the newest technologies and approaches. You'll support clients in choosing the most suitable business solution and take part in digital transformation.Your key responsibilitiesAs a Senior Data Engineer with Spark/Scala, you are responsible for building software that enables our clients and business partners to make efficient decisions with ease. You can design robust solutions on state-of-the-art compute engines such as Databricks, Presto, and modern data warehousing solutions (Synapse, BigQuery, Redshift or Snowflake).Skills and attributes for success6+ years of data engineer experienceProficiency in SQL, Scala and SparkStrong background in data pipelining, distributed data processing, software engineering components, and data modeling concepts - SparkBasic knowledge on Elastic or KibanaBasic understanding of IntelliJExperience in enterprise-class solution implementationsExperience with version control system (GIT, Azure DevOps, SVN)To qualify for the role, you must have:Solving complex business problems on a large scaleParticipating in cross-functional initiatives and collaborating across various domainsGood command of EnglishIdeally, you'll also have:Knowledge of data formats: Parquet, ORC, Avro, as well as emerging concepts like Deltalake/Apache Hudi/IcebergHands-on experience with workflow/pipeline tools like Airflow/Luigi/OozieContainerisation: Docker, Kubernetes, DevOps principlesExperience in using Agile methodologies (Scrum, Kanban, etc)Experience in Cloud Azure/AWS/GCPUnix Shell ScriptingGood understanding of ETL processSpark Data structures (Datasets, Data frames and RDD)Concept of Entity ResolutionCleansing and ParsingUnderstanding of UIGood command of Spanish is valuable, though not mandatoryWhat we look forAs a member of our team in the EY GDS Spain office in Malaga, you'll have the chance to extend your knowledge & experience by working on interesting projects with the newest technologies and approaches. You'll support clients in choosing the most suitable business solution and take part in digital transformation