Lead Data Architect / Lead Data Engineer - Azure Databricks | Energy Trading

\n
• ownership of the architecture, design and technical leadership of an enterprise
\n
• helping define best practice whilst remaining hands-on across complex data engin
\n
• Experience within Energy & Utilities, particularly Energy Trading, is ideal
\n

Interim Inside IR35 day-rate contract role:We're recruiting for an experienced Lead Data Architect / Lead Data Engineer to join a major Energy & Utilities transformation programme. This is an opportunity to take ownership of a modern Azure Databricks platform, leading architecture whilst remaining technically hands-on across enterprise-scale data engineering initiatives. You'll work alongside senior stakeholders, engineering teams and architects to design scalable Lakehouse solutions supporting critical business data. What you'll be doing\n

\n
• Leading Azure Databricks architecture
\n
• Designing enterprise Lakehouse solutions
\n
• Building scalable Spark and Delta Lake pipelines
\n
• Designing streaming and batch data platforms
\n
• Driving engineering best practice
\n
• Mentoring engineers
\n
• Working closely with senior business stakeholders
\n
• Defining future-state data architecture
\n

Technical Environment\n

\n
• Azure Databricks
\n
• Apache Spark / PySpark
\n
• Delta Lake
\n
• Azure Data Factory
\n
• Azure Data Lake Gen2
\n
• Azure Event Hubs
\n
• Azure Synapse
\n
• Python
\n
• SQL
\n
• Terraform
\n
• CI/CD
\n
• Medallion Architecture
\n

We're looking for Expert Databricks experience Strong Azure Data Platform experience Enterprise Data Architecture Hands-on technical capability Leadership experience Excellent stakeholder engagement Previous Energy, Utilities or Energy Trading experience would be highly desirable.Contract\n

\n
• £600-675 per day
\n
• Inside IR35
\n
• 9-12 months
\n
• Fully remote with occasional London workshops
\n
• UK-based applicants only
\n