Software Developer - SC Cleared

We're looking for a skilled Software Developer to join a public sector delivery team working on data-driven services. You'll design, build, and maintain robust, secure, and scalable data pipelines and applications, working closely with data engineers, analysts, and platform teams.

Day to day duties

\n
• Developing and maintaining data pipelines and processing jobs using Apache Spark and Python
\n
• Orchestrating workflows with Apache Airflow
\n
• Provisioning and managing cloud infrastructure on AWS using Terraform (Infrastructure as Code)
\n
• Containerising applications and services with Docker
\n
• Managing source control, CI/CD pipelines, and deployments through GitLab
\n
• Integrating automated security scanning into the development pipeline to ensure code and dependencies meet public sector security standards
\n
• Using Jupyter Notebooks for data exploration, prototyping, and analysis
\n
• Building and maintaining integrations with DWP Integration Team products and services
\n
• Collaborating with cross-functional teams in an Agile environment, contributing to design reviews, code reviews, and documentation
\n

Essential Skills & Experience

\n
• Strong hands-on experience with Python
\n
• Experience with Apache Spark for large-scale data processing
\n
• Practical knowledge of AWS services (eg S3, Lambda, EC2, Glue, RDS - adjust as relevant)
\n
• Experience writing and maintaining Terraform for infrastructure as code
\n
• Experience with Apache Airflow for workflow orchestration
\n
• Familiarity with Docker and containerised deployments
\n
• Experience using GitLab for version control and CI/CD
\n
• Understanding of security scanning tools/agents and secure coding practices
\n
• Experience using Jupyter Notebooks
\n
• Experience integrating with government/departmental systems, ideally DWP Integration Team products (or similar public sector integration frameworks)
\n

Desirable

\n
• Experience working within public sector or government digital service standards
\n
• Understanding of data protection and information security requirements in a public sector context
\n
• Experience working in Agile/Scrum delivery teams
\n

Applicants must have active SC Clearance to be considered.