Data Engineer
Job Details
Hiring Process
Time to Answer
2 open days
Process
1 Phone Call
1 Onsite Interview
Days to get an Offer
4 Days after Interview
Overview
Data Engineer with strong experience in developing and maintaining data solutions within enterprise environments. Responsible for designing and delivering data solutions using Python, PySpark, Databricks, and AWS, with a strong focus on data processing, ETL development, data management, and production support. The role contributes to the industrialisation and securing of business processes within the Downstream IT application landscape, supporting costing processes, exposure management, and forecasting activities for gas and power. Works closely with multidisciplinary teams and stakeholders to deliver scalable, reliable, and high-quality data solutions while following architectural and data management best practices.
Job Responsibilities
- Develop and maintain solutions within the data framework.
- Design and implement scalable data processing and transformation solutions.
- Develop data pipelines using Python and PySpark.
- Build and execute ETL processes using Databricks.
- Work with Apache Spark and manage Spark clusters.
- Develop and optimise SQL queries for efficient data processing.
- Work with relational databases and data warehouses.
- Write and maintain technical specifications.
- Write and execute unit tests to ensure solution quality.
- Participate in architecture discussions and contribute to technical solution design.
- Apply and implement best practices around data management.
- Ensure data solutions comply with agreed technical and architectural standards.
- Ensure deliveries are completed within agreed timelines and quality standards.
- Perform production monitoring and maintenance.
- Analyse and resolve production issues affecting data solutions.
- Collaborate with multidisciplinary teams and stakeholders.
- Understand customer requirements and translate them into effective technical solutions.
-
Contribute to the continuous improvement of data engineering processes and solutions.
Must Have Skills
- Proven experience as a Data Engineer or in a similar data development role.
- Strong hands-on experience with Python V3.
- Strong experience with PySpark.
- Strong experience with Databricks.
- Strong experience with AWS.
-
Solid understanding of:
- SQL
- Relational databases
- Data warehouses
- Experience with ETL development and data transformation.
-
Experience with Databricks, including:
- Creating and executing ETL tasks.
- Managing Spark clusters.
- Optimising SQL queries.
- Experience writing technical specifications.
- Experience writing unit tests.
- Good understanding of data management best practices.
- Ability to participate in architecture and solution design activities.
- Strong analytical and problem-solving skills.
- Ability to work independently and proactively.
- Strong communication and interpersonal skills.
- Ability to work effectively in a multidisciplinary environment.
- Ability to understand customer requirements and deliver appropriate data solutions.
-
Experience with production monitoring and maintenance.
Nice to have
- Experience with Apache Airflow.
- Experience with Azure DevOps / TFS / VSTS.
- Experience with Terraform.
- Experience with Insomnia / Postman.
- Knowledge of CI/CD practices.
- Knowledge of C#.
- Knowledge of the energy market industry.
- Knowledge of portfolio management.
- Knowledge of risk management.
- Knowledge of Trading.
- Knowledge of energy forecasting activities.
- Experience with Web APIs.
- Knowledge of Agile methodology.
-
Experience within the energy trading or energy forecasting domain.
What's great in the job?
- Work on strategic data engineering initiatives within the energy sector.
- Contribute to the industrialisation and securing of critical business processes.
- Work with modern technologies including Python, PySpark, Databricks, AWS, and Apache Spark.
- Contribute to scalable and reliable data solutions supporting gas, power, costing, exposure management, and forecasting.
- Collaborate with multidisciplinary teams across Data, IT, Architecture, and Business.
- Participate in architecture discussions and contribute to data engineering best practices.
- Work in a dynamic and fast-paced environment focused on innovation and continuous improvement.
-
Opportunity to contribute to the evolution of the Downstream IT application landscape.
Travailler chez yechte
Nous sommes un cabinet de conseil numérique indépendant avec des objectifs ambitieux et une présence mondiale. Nous accompagnons un large éventail d'entreprises, en constituant des équipes numériques et en fournissant des solutions numériques innovantes. Notre personnel multiculturel et diversifié, composé de « citoyens du monde », reflète cette inclusivité.
Nous accordons une grande importance à l'équilibre entre vie professionnelle et vie privée et nous nous efforçons de répondre aux attentes d'une équipe en pleine croissance, en investissant dans les personnes, car elles constituent notre plus grand atout. Notre croissance constante témoigne de cet engagement.
Venez travailler chez yechte, une entreprise en pleine expansion qui offre d'excellents avantages sociaux, des opportunités de développement personnel et la possibilité d'apprendre auprès de leaders accomplis. Nous sommes toujours à la recherche de professionnels exceptionnels pour rejoindre notre équipe.
Ce que nous offrons
Chaque employé a la possibilité de voir l'impact de son travail. Vous travaillez sur de véritables projets numériques et apportez une contribution tangible à l'entreprise. Nous voulons offrir à chacun la possibilité de s'épanouir sur le plan personnel, professionnel et social.
Flexibilité
Votre bien-être nous tient à cœur. Chez yechte, nous proposons des horaires flexibles et des modalités de travail hybrides à domicile/au bureau, améliorant ainsi l'équilibre entre vie professionnelle et vie privée et la productivité des employés.
Avantages attractifs
Votre confort nous tient à cœur. Chez yechte, nous proposons des plans de mobilité économiques et écologiques, des indemnités alimentaires et une couverture santé complète, afin d'améliorer la satisfaction de nos employés.
Développement personnel
Votre épanouissement nous tient à cœur. Chez yechte, nous vous proposons de stimuler votre développement personnel grâce à des formations et des certifications informatiques sur mesure, favorisant une culture d'agilité et d'expertise technologique.
