---

Job description

Working to develop and support Energia’s Customer Data Platform. The Customer Data Platform is an Azure cloud native technology solution utilising Azure Databricks, Azure Data Factory and Azure Synapse. You will be responsible for expanding and optimising our data and data pipeline architecture, as well as optimising data flow and collection for cross-functional teams. You will lead the technical delivery of the Customer Platform and act as mentor for Data Engineers. You’ll focus on the practical applications of data collection and analysis, providing the mechanism for collecting and validating the information that our data scientists and data analysts use to answer questions. You will also support software developers, database architects, data analysts and data scientists on data initiatives, ensuring optimal data delivery architecture is consistent throughout ongoing projects. You’ll have a strong foundation in SQL and Application Support which will help you contribute to the organisation’s success. .

Responsibilities

• Lead and mentor the team from a technical perspective alongside the team Lead
• Compilation and installation of database systems, scaling to multiple machines, writing complex queries
• Creating data set processes used in modelling, mining, acquisition, and verification
• Creation and maintenance of optimal data pipeline architecture

Skills and Qualifications

Essential Skills

• Advanced working knowledge of SQL and experience working with relational databases, query authoring (SQL), stored procedures as well as working experience with a variety of databases in an IT working environment
• Technical knowledge/understanding of Python or PySpark
• Solid experience building and optimising big data data pipelines, architectures and data sets
• Solid experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
• A successful history of manipulating, processing and extracting value from large, disconnected data sets
• Experience of solution design within a data platform

Desirable Skills

• Knowledge of agile delivery practices
• Experience of HVR from Fivetran
• Azure Data certification
• Experience of deploying solutions through development pipeline.

Further Information

Work time: 9am-5pm to be confirmed. Data is everywhere and in recent years, the amount of data being generated and collected by businesses has grown exponentially. The arrival of big data i.e., large volumes of varied data generated at velocity has created new opportunities for Energia Group to generate valuable insights to inform our decision making.