Data Engineer – International Energy Trading Firm

We are working with an international energy trading firm to recruit for a Data Engineer to lead the development of scalable data platforms for energy trading. This role will drive the creation of robust pipelines in Azure’s cloud environment, emphasizing automation, governance, and innovation. You’ll shape greenfield projects and establish data foundations for AI applications, working in a challenging yet outcome-focused culture where your expertise directly impacts business operations and strategic decisions.

Description

As a Data Engineer, you’ll design end-to-end data pipelines using ADF, Databricks, Spark, and Python while creating reusable Delta Table components. You’ll manage CI/CD workflows through Azure DevOps and deliver trusted data infrastructure. Your responsibilities include implementing governance, security, and compliance best practices while collaborating with business users, data scientists, and engineers. You’ll establish architecture standards for greenfield initiatives that will shape the technical direction moving forward.

Requirements

Candidates should have a Bachelor’s in Computer Science or related field, with around 5 years of professional experience. Required skills include expertise in Azure technologies (ADF, Databricks, Synapse, Data Lake), proficiency in Python, Spark, and Delta Lake. Beneficial additional skills include Power BI, containerization knowledge, and experience with data cataloging and monitoring solutions.

Apply

To apply, please submit your resume to Yien Quek at yq@kerryconsulting.com. We regret to inform that only successful shortlisted candidates will be notified.

Licence No: 16S8060 | Registration no: R1109830