AWS Data Engineer

Senior Data Engineer | Kafka | AWS Aurora | SQL | Kubernetes | Hybrid | Inside IR35

Location: UK (Hybrid)

Contract: Initial 3–4 Months (Likely Extension)

IR35: Inside IR35

Senior Data Engineer

We're recruiting for an experienced Senior Data Engineer to join a leading organisation on an exciting data transformation programme. This is an excellent opportunity to play a key role in designing and delivering modern, cloud-native data platforms that power business-critical digital services. Working within a collaborative Agile environment, you'll lead the development of scalable data solutions, real-time streaming platforms, enterprise data warehouses, and API-driven integrations while mentoring junior engineers and driving engineering best practices.

Role Purpose

As a Senior Data Engineer, you will lead the design, build, and operation of scalable, secure, and high-performance data platforms. You'll own end-to-end data pipelines, streaming platforms, and enterprise data stores, ensuring they meet business requirements, DDaT standards, and non-functional requirements. You will also provide technical leadership, mentor junior engineers, and contribute to the continuous improvement of engineering standards.

Key Responsibilities

\n
• Design and deliver robust data architectures covering data ingestion, streaming, storage, processing, and consumption.
\n
• Architect, develop and support real-time data pipelines using Apache Kafka.
\n
• Design and optimise relational databases using AWS Aurora (Postgres).
\n
• Build and maintain enterprise-grade data warehouse solutions and analytical data models.
\n
• Deploy, manage and optimise containerised data services using Docker and Kubernetes.
\n
• Design and implement scalable API-based data ingestion solutions integrating operational systems, SaaS platforms, and partner applications.
\n
• Define conceptual, logical and physical data models while ensuring data quality, governance, and lineage.
\n
• Collaborate with development and integration teams to define API contracts, schemas, versioning strategies, and resilient integration patterns.
\n
• Optimise SQL performance, pipeline throughput, reliability, and scalability.
\n
• Implement monitoring, alerting, and operational support for data platforms.
\n
• Mentor junior engineers and provide technical leadership across the engineering team.
\n
• Produce and maintain high-quality technical documentation aligned with DDaT standards.
\n

Essential Skills

\n
• Expert SQL development and performance tuning
\n
• Strong hands-on experience with Apache Kafka
\n
• AWS Aurora (Postgres)
\n
• Enterprise Data Warehousing
\n
• Dimensional and Transactional Data Modelling
\n
• Docker
\n
• Kubernetes
\n
• REST API Integration
\n
• JSON and Schema Validation
\n
• API resilience including retries, timeouts and idempotency
\n
• Strong analytical, troubleshooting and problem-solving skills
\n

Desirable Skills

\n
• Experience with API Gateways or Integration Platforms
\n
• OpenAPI / Swagger
\n
• OAuth2 and token-based authentication
\n
• Event-driven architectures combining APIs and Kafka
\n
• Data observability and monitoring tools
\n
• Experience working within Public Sector or regulated environments
\n
• Knowledge of data governance, security and privacy principles
\n
• Exposure to analytics and reporting platforms
\n

Experience Required

\n
• Significant experience in Senior Data Engineering roles
\n
• Proven experience delivering scalable cloud-native data platforms
\n
• Strong background in enterprise data architecture and engineering
\n
• Experience leading technical delivery and mentoring engineers
\n
• Experience working within Agile multidisciplinary teams
\n
• Experience working within UK delivery environments
\n

Ways of Working

\n
• Agile, collaborative and multidisciplinary environment
\n
• Strong ownership mindset with a focus on continuous improvement
\n
• Active contribution to engineering standards and communities of practice
\n

Security Clearance

Candidates must be eligible to obtain BPSS or SC Clearance, depending on client requirements.

Why Apply?

\n
• Opportunity to work on a high-profile data transformation programme
\n
• Modern technology stack including Kafka, AWS Aurora, Docker and Kubernetes
\n
• Collaborative engineering culture with opportunities to influence technical decisions
\n
• Initial 3–4 month contract with a strong likelihood of extension
\n
• Hybrid working arrangement
\n

If you're an experienced Senior Data Engineer looking to make an impact on large-scale cloud data platforms, we'd love to hear from you.

Apply today with your latest CV.