Data Engineer
Job Details
Hiring Process
Time to Answer
2 open days
Process
1 Phone Call
1 Onsite Interview
Days to get an Offer
4 Days after Interview
Overview
Data Engineer with strong experience in developing and maintaining data solutions within enterprise environments. Responsible for designing and delivering data solutions using Python, PySpark, Databricks, and AWS, with a strong focus on data processing, ETL development, data management, and production support. The role contributes to the industrialisation and securing of business processes within the Downstream IT application landscape, supporting costing processes, exposure management, and forecasting activities for gas and power. Works closely with multidisciplinary teams and stakeholders to deliver scalable, reliable, and high-quality data solutions while following architectural and data management best practices.
Job Responsibilities
- Develop and maintain solutions within the data framework.
- Design and implement scalable data processing and transformation solutions.
- Develop data pipelines using Python and PySpark.
- Build and execute ETL processes using Databricks.
- Work with Apache Spark and manage Spark clusters.
- Develop and optimise SQL queries for efficient data processing.
- Work with relational databases and data warehouses.
- Write and maintain technical specifications.
- Write and execute unit tests to ensure solution quality.
- Participate in architecture discussions and contribute to technical solution design.
- Apply and implement best practices around data management.
- Ensure data solutions comply with agreed technical and architectural standards.
- Ensure deliveries are completed within agreed timelines and quality standards.
- Perform production monitoring and maintenance.
- Analyse and resolve production issues affecting data solutions.
- Collaborate with multidisciplinary teams and stakeholders.
- Understand customer requirements and translate them into effective technical solutions.
-
Contribute to the continuous improvement of data engineering processes and solutions.
Must Have Skills
- Proven experience as a Data Engineer or in a similar data development role.
- Strong hands-on experience with Python V3.
- Strong experience with PySpark.
- Strong experience with Databricks.
- Strong experience with AWS.
-
Solid understanding of:
- SQL
- Relational databases
- Data warehouses
- Experience with ETL development and data transformation.
-
Experience with Databricks, including:
- Creating and executing ETL tasks.
- Managing Spark clusters.
- Optimising SQL queries.
- Experience writing technical specifications.
- Experience writing unit tests.
- Good understanding of data management best practices.
- Ability to participate in architecture and solution design activities.
- Strong analytical and problem-solving skills.
- Ability to work independently and proactively.
- Strong communication and interpersonal skills.
- Ability to work effectively in a multidisciplinary environment.
- Ability to understand customer requirements and deliver appropriate data solutions.
-
Experience with production monitoring and maintenance.
Nice to have
- Experience with Apache Airflow.
- Experience with Azure DevOps / TFS / VSTS.
- Experience with Terraform.
- Experience with Insomnia / Postman.
- Knowledge of CI/CD practices.
- Knowledge of C#.
- Knowledge of the energy market industry.
- Knowledge of portfolio management.
- Knowledge of risk management.
- Knowledge of Trading.
- Knowledge of energy forecasting activities.
- Experience with Web APIs.
- Knowledge of Agile methodology.
-
Experience within the energy trading or energy forecasting domain.
What's great in the job?
- Work on strategic data engineering initiatives within the energy sector.
- Contribute to the industrialisation and securing of critical business processes.
- Work with modern technologies including Python, PySpark, Databricks, AWS, and Apache Spark.
- Contribute to scalable and reliable data solutions supporting gas, power, costing, exposure management, and forecasting.
- Collaborate with multidisciplinary teams across Data, IT, Architecture, and Business.
- Participate in architecture discussions and contribute to data engineering best practices.
- Work in a dynamic and fast-paced environment focused on innovation and continuous improvement.
-
Opportunity to contribute to the evolution of the Downstream IT application landscape.
Work at yechte
We are an independent digital consultancy with ambitious goals and a global presence. We support a diverse range of companies, building digital teams and delivering innovative digital solutions. Our multicultural and diverse workforce, comprised of ‘Global Citizens’, reflects this inclusivity.
We care about work-life balance and meeting the expectation of a growing team, investing in people because they are our greatest asset. Our consistent growth is a testament to this commitment.
Come work at yechte, a company on the rise, offering excellent benefits, opportunities for personal development, and the chance to learn from accomplished leaders. We are always looking for exceptional professionals to join our team.
What We Offer
Each employee has a chance to see the impact of his work. You work on real digital projects and make tangible contributions to the company. We want to provide to each individual personal, professional and social growth.
Flexibility
We care about your wellbeing. At yechte we offer flexi-hours and hybrid home/office work arrangements, enhancing employee work-life balance and productivity.
Attractive Benefits
We care about your comfort. At yechte we offer cost-effective and eco-friendly mobility plans, food allowances, and comprehensive healthcare support, enhancing employee satisfaction.
Personal Development
We care about your growth. At yechte we offer to boost your personal growth through tailored IT trainings and certifications, fostering a culture of agility and tech-driven expertise.
