GCP Data Engineer
Job Description
£500 - £550 per day inside IR35
\n6-month contract
\nHybrid working in London
\nWe're working with a global healthcare and AI research organisation at the forefront of applying data engineering and machine learning to accelerate scientific discovery. Their work supports large-scale, domain-specific datasets that power research into life-changing treatments.
\nThey're now looking for a GCP Data Engineer to join a multidisciplinary team responsible for building and operating robust, cloud-native data infrastructure that supports ML workloads, particularly PyTorch-based pipelines.
The Role\nYou'll focus on designing, building, and maintaining scalable data pipelines and storage systems in BigQuery, supporting ML teams by enabling efficient data loading, dataset management, and cloud-based training workflows.
\n Key Responsibilities\n- \n
- \n
Design and build cloud-native data pipelines using Python on GCP
\n - \n
Manage large-scale object storage for unstructured data within BigQuery
\n - \n
Build and optimise data integrations with BigQuery and SQL databases
\n - \n
Ensure efficient memory usage and performance when handling large datasetsImplement monitoring, testing, and documentation to ensure production-grade reliability
\n - \n
Participate in agile ceremonies, code reviews, and technical design discussions
\n
- \n
- \n
Strong Python development experience
\n - \n
Hands-on experience with cloud object storage for unstructured data within BigQuery
\n - \n
PyTorch experience, particularly:
\n- \n
- \n
Dataset management
\n - \n
Data loading pipelines
\n - \n
Running PyTorch workloads in cloud environments We are not looking for years of PyTorch experience - one or two substantial 6-12 month projects is ideal
\n
\n - \n
- \n
5+ years cloud experience, ideally working with large numbers of files in cloud buckets
\n
- \n
- \n
Experience with additional GCP services, such as:
\n- \n
- \n
Cloud Run
\n - \n
Cloud SQL
\n - \n
Cloud Scheduler
\n
\n - \n
- \n
Exposure to machine learning workflows (not ML engineering)
\n - \n
Some pharma or life sciences experience, or a genuine interest in working with domain-specific scientific data
\n
Please send your CV
