Capitole Consulting keeps growing and we want to do it with you We are seeking a Data Engineer with AWS .
Language : English and Spanish Location: FULL REMOTE (Spain) ? Timetable : flexible.
Responsibilities: - Analysis and Design: Collaboration with multidisciplinary teams to understand system requirements and design robust ETL solutions.
- ETL Development: Implementation of ETL processes, including full and incremental loads.
Use of technologies like Python and Spark to transform and clean data.
- Deployment and Maintenance: Automation and deployment of ETL pipelines in production environments using orchestration tools and cloud services.
- Documentation: Creation of detailed technical documentation in markdown to ensure the maintainability and scalability of developed solutions.
Technologies and Tools Used: - AWS: S3, Glue, Athena, Lambda, SQS, Step Functions, EventBridge, Lake Formation, CloudWatch.
- Azure: Data Factory, Pipeline, and Trigger Runs.
- Programming Languages: Python, Spark, Bash.
- Version Control: Git, Github (including Github Actions).
- Project Management: Jira.
- Development Environments: VS Code, PyCharm, Jupyter Notebooks.
We are great, but with you we will be even more For this you will have: Budget of €1,200 for individual training so you can use it for whatever you want (technological events, books, training, certifications, etc.).
Follow up with your team every month to have continuous feedback .
Full Remote.
Time flexibility to help you balance your professional/family life.
Private medical insurance paid entirely by Capitole Flexible remuneration (restaurant, transportation and/or daycare tickets).
Andjoy (Gymforless) Discounts on big brands for employees (Club Capitole) So you can meet the whole family: Team Buildings every two months.
You can't miss the summer party or Christmas dinner Soccer team sponsored by Capitole.
Technological communities so you can share your knowledge and ideas with other teams.
Sharing internal knowledge is essential Last but not least, a GREAT TEAM Don't you know us yet?
Discover us https://capitole-consulting.com/ See what they think of us https://www.glassdoor.es/Opiniones/Capitole-Consulting-Opiniones-E2060890.htmlE2060890.html The employee will adhere to the information security policies: - He/she will have access to confidential information relating to Capitole and the project he/she is working on.
- Will have to comply with the security policies and internal policies of the company and client.
- You will have to sign an NDA.