Senior Data Engineer

We're seeking an experienced Senior Data Engineer to join a leading global organisation on a contract basis, helping to design and deliver scalable, enterprise-grade data solutions.

This role will focus on building and optimising modern data platforms using Python, Databricks and Spark, enabling advanced analytics, reporting and data-driven innovation across the business.

Client Details

Our client is a leading international financial institution with a long-established presence across major global markets. Serving a diverse client base that includes corporates, financial institutions and investors, the organisation delivers a broad range of banking, financing and capital markets services.

With significant investment in digital transformation and data-led innovation, the organisation is modernising its technology estate and expanding its enterprise data capabilities. Data plays a critical role in supporting business operations, regulatory obligations, analytics and strategic decision-making, making this an exciting opportunity to contribute to large-scale, business-critical data initiatives within a complex global environment.

Description

\n
• Design, build and maintain scalable data pipelines using Python and Databricks
\n
• Develop and optimise ETL/ELT processes leveraging Spark and Delta Lake
\n
• Create robust data models and data architectures within modern Lakehouse environments
\n
• Implement and manage data workflows across the Databricks ecosystem
\n
• Ensure data quality, governance, reliability and performance across platforms
\n
• Optimise distributed data processing workloads at scale
\n
• Collaborate closely with data scientists, analysts and stakeholders to support analytics and machine learning initiatives
\n
• Implement monitoring, logging and alerting capabilities across data solutions
\n
• Champion engineering best practices and mentor less experienced team members
\n

Profile

You will bring:

\n
• 10+ years' experience in Data Engineering
\n
• Experience delivering data engineering solutions within Banking, Financial Services, Capital Markets, Insurance, or other highly regulated enterprise environments.
\n
• Strong hands-on expertise in Python
\n
• Proven experience with Databricks, including notebooks, workflows, jobs and Delta Lake
\n
• Strong knowledge of Apache Spark / PySpark
\n
• Experience designing and delivering large-scale ETL/ELT pipelines
\n
• Advanced SQL skills and experience with relational databases
\n
• Experience working with cloud technologies such as AWS, Azure or GCP
\n
• Knowledge of modern data warehousing platforms such as Snowflake, Redshift or BigQuery
\n
• Understanding of data modelling principles and Lakehouse architecture
\n
• Excellent communication, stakeholder management and problem-solving skills
\n

Desirable experience includes:

\n
• Databricks certifications
\n
• Streaming technologies such as Kafka or Structured Streaming
\n
• CI/CD and DevOps practices
\n
• Docker and Kubernetes
\n
• Exposure to machine learning pipelines
\n

Job Offer

\n
• Competitive day rate of £550-£880 Inside IR35 (Umbrella)
\n
• Initial 6-month contract
\n
• Hybrid working model with flexibility
\n
• Opportunity to work on cutting-edge data engineering projects
\n
• Exposure to modern cloud and data technologies
\n
• Collaborative and high-performing engineering environment
\n
• Chance to make a tangible impact on enterprise-scale data transformation initiatives
\n