Lead Data Engineer

OPIS, a Dow Jones company, is one of the world's most comprehensive sources for petroleum pricing and news information. OPIS provides real-time and historical spot, wholesale/rack and retail fuel prices for the refined products, renewable fuels and natural gas and gas liquids (LPG) industries. We deliver award-winning news, market intelligence and transparency to the entire refined energy marketplace and companies looking to go carbon neutral. At its core, OPIS uses a set of complex IT systems and tools, handling huge amounts of data in a reliable way, and providing customers with business applications to use this data as efficiently as possible.
Your Role
We are looking for a Lead Data Engineer that will design, develop and maintain database architecture and code initiatives supporting internal and third-party software solutions, delivering excellent products in scope and on time, and meeting current and long-term business needs for the business area. This role is pivotal in delivering high-quality, performant, and compliant data solutions that meet the business's current and future needs, particularly for our energy commodities and pricing business units. Participate in an agile team of motivated, driven, high-energy engineers, building trust and confidence with team members and business stakeholders. Lead, mentor, and coach other data engineers to build stronger and faster teams.
Your Responsibilities
As a solution-oriented Lead Data Engineer, you will lead efforts in Data Governance, focusing on data ingestion into Snowflake, master and reference data management, and data quality automation for our price reporting teams. You will deploy, administer, and enhance data models for metadata and master data systems, collaborating closely with product teams to deliver timely, effective, high-performance solutions. This role involves designing scalable data architectures and automated pipelines for efficient data ingestion and quality assurance. By delivering solutions for business data requirements, identifying data needs, and sourcing relevant data, you will enable architectures that support product enhancements and revenue generation. As a leader, you will coach and mentor team members, driving individual and team development. Future opportunities include thought leadership for using AI to automate internal processes.
Your Expertise
Degree in computer science, related technical field, or equivalent experience
Minimum of 4 years database developer experience (SQL Server or equivalent)
Ability to design and create advanced data models for the integration of multiple data sets and systems
Ability to write SQL queries and statements to explore source data and data issues
Working knowledge of cloud data technologies and architecture
Working knowledge of Python for data analysis and automation
Working knowledge of building CI/CD pipelines for code deployment
Proficiency in BI tooling, Power BI preferred
Deep knowledge of ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes, with expertise in designing, developing, and optimizing pipelines (i.e., Glue, Airflow) for Snowflake
Experience with Snowflake-specific SQL, including schema design, data modeling, and query optimization to ensure efficient performance
Familiarity with data-specific unit testing frameworks
Knowledge of metadata management, reference data management, master data management and data quality
Must speak and write in English fluently; Effective communicator
Does this sound like you?
A strong analytical thinker with a love for planning and organization who can manage competing demands with minimal supervision
A self-starter with a never-ending curiosity to learn and solve problems
A critical thinker, with mad problem-solving skills
A team player with great interpersonal and communication skills
A structured developer, with good time-management skills
If these things strike a chord with you, we should talk.
We'd also love to hear about your experiences with any of the following:
Degrees, Certifications, and/or awards/recognition that you have achieved
Knowledge of SDLC, Agile methodology and/or SCRUM
Experience working with scripts under source control (Git/TFVC/Mercurial/Svn/etc)
Experience being part of a continuous integration and deployment process
Experience using database monitoring tools (like tools from SolarWinds or RedGate)
Pension Scheme: Company contributes up to 8% of your salary with matching contributions.
Healthcare Coverage: Comprehensive health plan with unlimited coverage, including outpatient care, dental, and maternity.
Life & Disability Insurance: Coverage from day one, including life insurance at 2X salary and accident coverage up to 4X salary.
Wellness Programs: Access to wellness platforms, mindfulness apps, and free fitness classes.
Meal & Teleworking Allowance: Monthly meal card and teleworking allowance.
Flexible Working: Ability to work from home 2 days per week with the option to work remotely for 1 week per quarter.
Family Care Support: Up to 4 weeks of paid compassionate leave and a generous reimbursement for emergency care.
Referral Bonus: Earn a bonus for recommending great talent to join us.
Inclusion and diversity are critical to the success of Dow Jones, and we actively encourage applications from people of all backgrounds. We are committed to providing equal employment opportunity without regard to race, color, religion, sex, sexual orientation, gender identity, age, national origin, disability, status as a protected veteran, or any other protected category. For more information on the many ways in which we enthusiastically support inclusion and diversity efforts for both candidates and employees.
Current Colleagues
If you are currently employed by Dow Jones, please apply internally via the Workday internal careers site.
Reasonable accommodation: Dow Jones, Making Careers Newsworthy - We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, disability status, genetic information, protected veteran status, or any other characteristic protected by law.EEO/AA/M/F/Disabled/Vets. Dow Jones is committed to providing reasonable accommodation for qualified individuals with disabilities, in our job application and/or interview process. If you need assistance or accommodation in completing your application, due to a disability, email us at ******. Please put "Reasonable Accommodation" in the subject line and provide a brief description of the type of assistance you need. This inbox will not be monitored for application status updates.
Business Area: Dow Jones - OPIS
Job Category: Data Analytics/Warehousing & Business Intelligence
Union Status:
Non-Union role
Since 1882, Dow Jones has been finding new ways to bring information to the world's top business entities. Beginning as a niche news agency in an obscure Wall Street basement, Dow Jones has grown to be a worldwide news and information powerhouse, with prestigious brands including The Wall Street Journal, Dow Jones Newswires, Factiva, Barron's, MarketWatch and Financial News.
This longevity and success is due to a relentless pursuit of accuracy, depth and innovation, enhanced by the wisdom of past experience and a solid grasp on the future ahead. More than its individual brands, Dow Jones is a modern gateway to intelligence, with innovative technology, advanced data feeds, integrated solutions, expert research, award-winning journalism and customizable apps and delivery systems to bring the information that matters most to customers, when and where they need it, every day.
If you are a current employee at Dow Jones, do not apply here. Please go to the Career section on your Workday homepage and view "Find Jobs - Dow Jones." Thank you.

#J-18808-Ljbffr