Data Engineer On Gcp

Job Responsibilities:Design, implement, and manage data pipelines on Google Cloud using Apache Nifi, Dataproc, BigQuery, Dataflow, and other GCP services.Develop Spark and Hadoop workflows to process large datasets in Dataproc, ensuring data reliability and efficiency.Integrate Dataproc workflows with other GCP data services like Cloud Storage, BigQuery, and Pub/Sub.Troubleshoot data quality issues and optimize pipeline performance in Dataproc clusters.Advanced proficiency with SQL and Python/Spark/Scala for data processing.Document data pipelines, ETL processes, and data architecture.Datahub knowledge is an additional benefit.Job Types:Full-time, Permanent
Pay:From 40,000.00€ per year
Experience:Apache Nifi, Dataproc, BigQuery, Dataflow & GCP: 1 year (Required)Data pipelines on Google Cloud: 1 year (Required)Develop Spark and Hadoop workflows: 1 year (Required)Integrate Dataproc: 1 year (Required)SQL and Python/Spark/Scala: 1 year (Preferred)Language:Spanish (C1/C2) (Required)English (C1/C2) (Required)Work Location:In person

#J-18808-Ljbffr