Data Engineer with Azure Job Title: Data Engineer Azure Data Lake Solutions
Location: Porto (mostly remote, office presence required 2-4 days a month)
Type: 12 months B2B Contract with possibility of extension
Job Overview:
We are seeking a skilled Data Engineer to design, build, and manage robust data lake solutions using Microsoft Azure technologies.
The ideal candidate will have a passion for working with complex datasets, enabling data-driven decisions and delivering scalable solutions that meet organizational goals.
Key Responsibilities: Data Lake Development: Design, implement, and optimize data lake architectures to support data storage, processing, and analytics needs.Azure Ecosystem: Develop and manage solutions using Azure services such as Azure Data Lake, Azure Data Factory, Databricks, and Synapse Analytics.Data Integration: Create ETL/ELT pipelines to extract, transform, and load data from various structured and unstructured sources.Data Governance: Implement and maintain data quality, metadata management, and security standards in the data lake.Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand business needs and translate them into technical solutions.Performance Optimization: Monitor and fine-tune system performance for data processing workflows and ensure high availability.Documentation: Maintain comprehensive documentation of data architecture, processes, and workflows.Qualifications: Education: Bachelor's degree in Computer Science, Information Technology, or related field.
Master's degree is a plus.
Experience:
• Proven experience in data engineering roles with a focus on Azure-based solutions.
• Hands-on experience with Azure services such as Data Lake Storage, Data Factory, Synapse Analytics, and Databricks.
• Strong understanding of data lake architectures and principles.
Technical Skills:
• Proficiency in programming languages like Python, Scala, or Java.
• Expertise in SQL and database management.
• Familiarity with big data frameworks such as Hadoop or Spark.
• Experience with data modeling and building data pipelines.
• Knowledge of version control tools (e.g., Git) and CI/CD pipelines.
Soft Skills:
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills.
• Ability to work in a fast-paced, dynamic environment.
Keywords: Azure, Data Lake, Azure Data Factory, SQL
#J-18808-Ljbffr