Big Data Engineer – Data Lake – Openbank (Openhub México)

.Big Data Engineer – Data Lake – Openbank (Openhub México) page is loaded Big Data Engineer – Data Lake – Openbank (Openhub México) Apply posted on Posted Today job requisition id Req1332249 Big Data Engineer – Data Lake – Openbank (Openhub México)Country:Open Digital Services is a tech company with a unique culture, dedicated to creating innovative products for Santander Group Affiliates. Open Digital Services is part of the Retail & Commercial Division of Santander Group, one of the world's largest financial institutions and the Eurozone's leader, we're committed to being the best Digital Bank with Branches in the industry. Our mission at ODS is to design and support an advanced digital and omnichannel platform, ensuring the best customer experience using cutting-edge technology. Openbank, our flagship partner, is where we develop our most advanced concepts. Be part of our Best-in-Class tech team and help us create unique value for our customers! Join us to tackle exciting tech challenges in an agile environment, benefiting from learning, growth, and local and international career opportunities in a modern, diverse setting. Responsibilities : Design and implement production big data environments using modern technologies. Build, validate, and optimize large-scale, big data solutions in heterogeneous data environments. Develop and manage ETLs in batch (Spark and Scala), and streaming (Apache Flink). To be successful in the role you must have 3+ years of experience working with Scala, Spark, software design patterns, and TDD. Experience working with big data - Spark is a must - Hadoop, Hive, and/or Kafka would be a plus. Experience with different database structures, including SQL (Postgres, MySQL), and NOSQL (DynamoDB, DocumentDB, Redis, Elasticsearch). Experience and expertise across data integration and data management with high data volumes. Experience with Cloud ecosystems, AWS ecosystem (EMR, EC2, IAM, GLUE, ATHENA, S3, CloudFormation, LakeFormation, Redshift, DynamoDB, RDS, ECS & ECR) would be a great plus! Experience working in agile continuous integration/DevOps paradigm and tool set (Git, Jenkins, Sonar, Nexus, Jira, and Splunk). Bachelor's Degree in Computer Science, Information Systems, Mathematics, or other STEM, and related fields, or equivalent work experience. Professional working proficiency in English. Nice to have Experience with data warehousing, apache iceberg, and visualisation tools. Experience with NRT applications: Apache Flink, spark streaming. What do we offer? Joining a dynamic and agile environment, with plenty of opportunities to grow, and have impact! Working in a start-up mode with the support of Santander Group in a growing and expansion project. Competitive remuneration and attractive benefits package. Collaboration in international projects with peers from all around the globe. Excellent work environment, social clubs, and frequent events