Data Engineer with AzureJob Title: Data Engineer Azure Data Lake SolutionsLocation: Porto (mostly remote, office presence required 2-4 days a month)Type: 12 months B2B Contract with possibility of extensionJob Overview:We are seeking a skilled Data Engineer to design, build, and manage robust data lake solutions using Microsoft Azure technologies.
The ideal candidate will have a passion for working with complex datasets, enabling data-driven decisions and delivering scalable solutions that meet organizational goals.Key Responsibilities:Data Lake Development: Design, implement, and optimize data lake architectures to support data storage, processing, and analytics needs.Azure Ecosystem: Develop and manage solutions using Azure services such as Azure Data Lake, Azure Data Factory, Databricks, and Synapse Analytics.Data Integration: Create ETL/ELT pipelines to extract, transform, and load data from various structured and unstructured sources.Data Governance: Implement and maintain data quality, metadata management, and security standards in the data lake.Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand business needs and translate them into technical solutions.Performance Optimization: Monitor and fine-tune system performance for data processing workflows and ensure high availability.Documentation: Maintain comprehensive documentation of data architecture, processes, and workflows.Qualifications:Education: Bachelor's degree in Computer Science, Information Technology, or related field.
Master's degree is a plus.Experience:
- Proven experience in data engineering roles with a focus on Azure-based solutions.
- Hands-on experience with Azure services such as Data Lake Storage, Data Factory, Synapse Analytics, and Databricks.
- Strong understanding of data lake architectures and principles.Technical Skills:
- Proficiency in programming languages like Python, Scala, or Java.
- Expertise in SQL and database management.
- Familiarity with big data frameworks such as Hadoop or Spark.
- Experience with data modeling and building data pipelines.
- Knowledge of version control tools (e.G., Git) and CI/CD pipelines.Soft Skills:
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration skills.
- Ability to work in a fast-paced, dynamic environment.Keywords: Azure, Data Lake, Azure Data Factory, SQL#J-18808-Ljbffr