Company DescriptionNIQ is the world's leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach.
Founded in Barcelona in 2001, Netquest is the data collection provider of choice for the Market Research Industry. A tech-driven company built on a robust and engaged panel and a strict quality standard (ISO 20252). We make possible a truly 360 degrees view of today's consumers collecting behavioral and declarative data from a single source, our panelists, in 23 countries across the globe. Leveraging our data, savvy researchers better define winning strategies based on an in-deep understanding of consumers' preferences and behaviors.
Job DescriptionAs a Data team, we cover the three main specialties in the data field: Data Science, Data Analytics, and Data Engineering. We are looking for a boost in the Data Engineering part by adding a person who provides us experience and knowledge about doing things in the right direction.
Technologies and standards Proficiency in Python and SQLAwareness of scheduling tools, like Apache AirflowInterest in Big Data solutions, like Apache SparkIn-depth understanding of Data Engineering techniquesAbility to maintain and extend processes and functionalitiesDeep understanding of application packaging and delivery mechanisms, including CD/CI best practices and security concernsThe ability to integrate partial solutions and R&D results into production-ready data pipelinesThe ability to build and operate infrastructure (e.g., for testing purposes)The ability to support operational questions for environments in productionUnderstanding of cloud infrastructure and services available for setting up and maintaining data pipelines (e.g., AWS)Ability to advise on data transformation workflow designs and optimizations with the dimensions of cost, performance, and delivery mechanisms (streams/increments/etc.)QualificationsThe ability to design and implement an entire data pipeline from scratchThe ability to decide which problems to solve with scale-up and which ones to tackle with scale-out approaches and how to combine them in data pipelinesKnowledge about Data ArchitectureAwareness of Data GovernanceAn economic view on questions of operability of crafted data pipelinesMaintenance of data integrity in cases of reprocessingUnderstanding of whether or how (internal or external) customer data deliveries are affected by changes to the softwareAwareness of data design patterns in the organization and best practices in generalDeep understanding of data modeling, data schemas, and evolution thereofAwareness of best practices of data transformation design patternsAn advanced focus on data integrity when crafting data pipelines, by building in means to monitor data health and state of intermediate data and alerting mechanismsDesigning Quality Control/Validation processes / Quality GatesAdditional InformationThe accountabilities of a data engineer include the accountabilities of a data engineer but increased norms apply, meaning a senior data engineer is expected to accomplish their tasks in less time, to a higher standard (total understanding and excellent adherence to applicable standards and guidelines) and be able to solve more complex problems.
The senior data engineer is expected to look beyond their primary team scope and strive for harmonization and improvement of solutions across the CSG or even beyond.
The senior data engineer is also accountable to pro-actively pass on their knowledge to other engineers when the opportunity arises during the course of their work:
During pair programming/pair workWhen sought for adviceDuring code reviewsBy participating in Communities of PracticeThe senior data engineer is accountable for bringing together technical assets from different disciplines within their cross-functional team and for fostering a common solution approach between team members with different technical backgrounds.
Flexible working environmentVolunteer time offOur commitment to Diversity, Equity, and Inclusion NIQ is committed to reflecting the diversity of the clients, communities, and markets we measure within our own workforce. We exist to count everyone and are on a mission to systematically embed inclusion and diversity into all aspects of our workforce, measurement, and products. We enthusiastically invite candidates who share that mission to join us. We are proud to be an Equal Opportunity/Affirmative Action-Employer, making decisions without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability status, age, marital status, protected veteran status or any other protected class.
#J-18808-Ljbffr