.Context And Mission In the Barcelona Supercomputing Center, scientists from different groups rely on a shared data archive curated by the Data and Diagnostics Team (DDT, composed of around 20 members), which is in charge, among other activities, of downloading, standardizing, checking, and curating model and observational data from external sources, as well as to develop common tools for the data analysis tools.
Most of the tools for the data pipelines are written in Python and use the community standards of NetCDF and GRIB.
The successful candidate will join the Data and Diagnostics Team to develop a new Python suite to create a data pipeline to manage and update the BSC storage containing reanalysis and seasonal forecasts data from the ECMWF Climate Data Store (CDS, ).
The successful candidate, with the support of the department's data managers, will study different ways to access the CDS, efficiently download and format the data by exploring different community libraries, and integrate this into a workflow using the workflow manager developed in the department (Autosubmit, ).
In a second time, the work will consist of generalizing this tool for other data platforms (NMME and other reanalysis).
Key Duties Develop a Python suite to download and format climate data from the climate data store and other similar platforms.
Study the efficiency of the different options of the suite.
Integrate the suite into a data pipeline workflow.
Develop an automatic data checker in the data pipeline.
Requirements Education: Having a Bachelor in Computer Science, Telecommunications, Physics or related discipline.
Essential Knowledge and Professional Experience: Good development skills and experience with UNIX/LINUX environments.
Experience in Python programming and scripting languages.
Additional Knowledge and Professional Experience: Fluency in English, both speaking and writing.
Knowledge of climate formats and tools (netcdf, grib, cdo, xarray,…) will be valued but are not mandatory.
Competences: This is a specialized position so the successful candidate is expected to have a demonstrated learning capacity and the motivation to maintain a learning progression during the contract.
Capacity to interact and build strong relations with both climate and computer scientists.
Excellent written and verbal communication skills.
Ability to work both independently and within a team.
Conditions The position will be located at BSC within the Earth Sciences Department.
We offer a full-time contract (37.5h/week), a good working environment, a highly stimulating environment with state-of-the-art infrastructure, flexible working hours, extensive training plan, restaurant tickets, private health insurance, support to the relocation procedures.
Duration: Open-ended contract due to technical and scientific activities linked to the project and budget duration.
Holidays: 23 paid vacation days plus 24th and 31st of December per our collective agreement