Lead Data Engineer

Lead Data EngineerThe RoleAs a Lead Data Engineer, you will play a key role in building and enhancing a secure, scalable data platform for a high-profile government programme. You will work with both batch and real-time data, leveraging modern cloud technologies and frameworks.This role involves ingesting data from multiple sources, transforming it into the correct formats, ensuring alignment with defined data models and enabling reliable access for downstream users.Key ResponsibilitiesDesign, develop, test and document data pipelines aligned to business requirementsPerform logical and physical database designEnhance data platform capabilities to address evolving data and analytics challengesAnalyse data workflows and identify opportunities for optimisation and improvementEnsure consistency between data models and overall architecture, including entity definitions and relationshipsConduct root cause analysis on data issues to support business decision-making and continuous improvementSkills and ExperienceEssentialExperience building data pipelines using modern data processing frameworksFamiliarity with Agile or rapid application development methodologiesStrong understanding of data modelling and different data structures, including when to apply themHands-on experience with public cloud platforms, ideally including services such as compute, storage, serverless and data processing toolsExperience configuring and tuning relational and NoSQL databases, including query optimisationProficiency in programming or scripting languages such as PythonExperience working with Test Driven Development practices and supporting toolsDesirableFamiliarity with CI tools such as Jenkins or DroneKnowledge of configuration management tools such as Ansible or PackerExperience using Infrastructure as Code tools, for example TerraformWorking knowledge of Linux and Windows environmentsWays of WorkingThe organisation promotes a collaborative and delivery-focused culture. Team members are encouraged to take ownership, experiment, solve complex problems and support each other in achieving shared goals. Open, timely communication and accountability are key values.Reasonable Adjustments:Respect and equality are core values to us. We are proud of the diverse and inclusive community we have built, and we welcome applications from people of all backgrounds and perspectives. Our success is driven by our people, united by the spirit of partnership to deliver the best resourcing solutions for our clients.If you need any help or adjustments during the recruitment process for any reason , please let us know when you apply or talk to the recruiters directly so we can support you.TPBN1_UKTJ