Senior Data Engineer

Detalles de la oferta

At Kantox we are looking for a Data Engineer to join our Data team to design, improve and enhance our current data architecture. Kantox is a growing organisation with growing data needs, therefore scalable, reliable and efficient data architecture and orchestration of data pipelines are fundamental for our business.
This is an exciting full-time job with great challenges, as you will help build and automate our streaming data architecture and help us grow our Data team. You will be joining a vibrant and passionate group of software engineers that hail from all parts of the world.
The Kantox Engineering ManifestoKantox is a team sport. Our engineering culture is devoid of egos yet we take great pride in our work. We believe in constructively challenging each other pushing our knowledge, code, processes to the absolute limit. Our processes are based around continual self improvement, continuous code integration and deployment.
About the teamYou will collaborate closely with data science, business intelligence, and cloud engineering teams to develop and manage data products across multiple domains. Your efforts will ensure the delivery of data that supports internal decision-making and provides clients with scalable and reliable visibility.
Your future role at KantoxAs a Data Engineer, you will play a pivotal role in enhancing and optimising our data systems to support our Data Lake/Data Mesh infrastructure and meet our data processing requirements. Your work will enable the creation of high-performance, scalable data products company-wide, while ensuring proper data governance. You will also leverage and improve our existing AWS-based data platform, utilising a tech stack that includes Dagster for managing data assets, Deltalake for data storage, Kafka/RabbitMQ for streaming, dbt/DuckDB for transformations, and Terraform, Kubernetes, and ArgoCD for infrastructure management.
This is a unique opportunity to join a rapidly growing company in a dynamic phase, offering a stimulating role with significant growth potential.
What you will do Collaborate with a talented and diverse team to develop and enhance our data platform, enabling efficient data collection, processing, accessibility, usability, and monitoring. Automate the self-service platform and create tools for generating data products. Build highly scalable and reliable data assets using Python, Scala, and Spark/PySpark. Integrate new and existing data sources into our ETL and reverse ETL pipelines. Design a data strategy that leverages the appropriate tools for data governance, cataloguing, and discovery, while ensuring secure access. Ensure data quality and reliability by implementing standardised monitoring, CI/CD, and testing practices. Continuously explore and adopt new technologies and best practices to enhance our data infrastructure. Work within the Tech Team, adhering to agile methodologies. Gain a deep understanding of the business to identify the data needs of various internal and external stakeholders, applying this insight to design optimal solutions. Who you are Over 4 years of professional experience as a Data Engineer, with proven expertise in delivering efficient data solutions in production environments. Experience building data systems with real-time data streams, preferably using Kafka, and batch processing systems with Apache Spark/PySpark. Skilled in ingesting data from various sources, including relational databases, NoSQL databases, unstructured data, and data streams. Proficient in Python programming (knowledge of Scala is a plus). Experience with orchestration tools such as Dagster, Airflow, and Prefect. Familiar with AWS services like S3 and Redshift. Knowledgeable in infrastructure tools such as Terraform, Kubernetes, and ArgoCD. Experience with data quality tools like Great Expectations, Soda, or data contracts. Solid understanding of software engineering practices, including version control, CI/CD, testing, and documentation. Familiarity with Data Lifecycle Management, including development, storage, and access. Experience with agile methodologies and collaboration tools like Jira and Confluence. Strong team player with the ability to communicate effectively across multiple teams and stakeholders, both internal and external. Adaptable to dynamic environments, committed to continual improvement, and quick to embrace change and adopt new technologies. Fluent in English. Permission to work within the EU is a plus. What we offer: Competitive salary Sponsored learning budget Free private health insurance Free Spanish, English, French and Catalan lessons Relocation package if needed Flexible working hours + short Fridays Hybrid work model 29 days of annual vacations Gym discounts and free sports activities Restaurant Ticket with monthly credit and regular cross-team lunches Fresh fruit and unlimited coffee ? Pizza Fridays Beautiful office with incredible 360-degree views of Barcelona ? About KantoxKantox is a leading fintech company developing sophisticated Currency Management Automation software solutions that help companies to automate their foreign exchange processes and leverage currencies for growth.
We are a 200-person strong team, split between London and Barcelona. So far, we've raised over €30 million and became profitable in 2018. Thanks to our clients, we continue to grow at a fast pace. Clients in 75 countries have already exchanged more than USD $18 billion with us!
In October 2022, BNP Paribas signed an agreement for the acquisition of Kantox. Kantox will continue to operate as an independent company, now with the experience and market power of BNP Paribas behind it. The acquisition is subject to regulatory approvals and is expected to be completed in the coming months.
Our Commitment to Diversity, Equity & InclusionKantox is deeply committed to diversity, equity and inclusion both in our hiring practices and in our experiences as a Kantox employee.
We're proud to be an equal opportunity employer, and encourage all applicants regardless of race, religion, or belief (if any), colour, nationality, ethnic or national origin, gender, gender identity, pregnancy and maternity, sexual orientation, age, marital and civil partnership status, or disability status.

#J-18808-Ljbffr


Salario Nominal: A convenir

Fuente: Jobleads

Requisitos

Expert, Web Performance And Technical Seo Specialist

.Expert, Web Performance and Technical SEO Specialist Do you dare to lead the digital transformation to create a more sustainable world? At Schneider Electri...


Schneider Electric Global - Barcelona

Publicado a month ago

Principal Product Manager, Privacy & Consent

.When we launched as a flight comparison site back in 2003, we changed the game by helping travellers feel smart, like they were in on a secret, that promise...


Skyscanner - Barcelona

Publicado a month ago

Android Software Engineer – Travel Things – (Hybrid)

.As you contemplate your future, you might be asking yourself, what's the next step? Start your journey with us!We're seeking an experienced Android Software...


Edreams Odigeo - Barcelona

Publicado a month ago

Technical Support For Lighting Products In Lisbon (French Speaker)

Your responsibilities and impact as Technical Support for Lighting Products will be: Provide support to customers by responding to inbound requests and docum...


Blu Selection - Barcelona

Publicado a month ago

Built at: 2024-12-15T05:57:34.216Z