Senior GCP Data Engineer - Contract

  • Job Reference: 340983
  • Date Posted: 20 June 2022
  • Recruiter: ShareForce
  • Location: United Kingdom - All Regions
  • Salary: £500 to £550 Per Day
  • Bonus/Benefits: £500 - £550 Per Day (Inside IR35)
  • Sector: IT and Telecomms
  • Job Type: Contract

Job Description

This is an opportunity for a Senior GCP Data Engineer to take a lead role in the development of the UK's brightest Data Science and Machine Learning scale-up.  The successful candidate will play a key role in client focused projects, designing and developing data analysis and state science prototypes to improve operational business processes.

The Senior Data Engineer at can expect to...
  • Design and lead the development of valuable data analysis and data science prototypes to operational business processes
  • Deliver engaging technical demonstrations / ideas to both clients and our team
  • Design and provision cloud infrastructure via IaC (infrastructure as code), providing a stable base for data engineering & science software to execute
  • Design and develop data transformations + logical rulesets on a variety of data types and sizes - utilising a mixture of techniques e.g. MPP (massive parallel processing), SQL, Python and more
  • Design extendible data models that accelerate the development analytics and machine learning models by conforming disparate data sets
  • Demonstrate effective interpersonal skills through good co-working habits
  • Improve and maintain our internal and external data products, including our proprietary open source technology
  • Work within a client’s cloud environment, working closely with IT and engineers from their organisation
  • Be responsible for live AI and data services, on which our clients depend for business critical operations
  • Create a range of interfaces for data processes, including: APIs, integration with third party products, user interfaces (typically web) and more
  • Mentor and lead junior members of the engineering team, promoting a learning culture
Desired Skills / Experience Profile:

Evidence of developing data storage strategies and complex transformations in Google Bigquery, Dataproc or Dataflow (utilising both SQL and PySpark or similar)
Evidence of designing data models for analytics
  • Expert Python and SQL skills
  • Expert Version Control skills and workflows (especially Gitflow)
  • Good Docker and Kubernetes skills (GKE, EKS, AKS)
  • Expert Knowledge of orchestration and data movement tools like Composer, Apache Airflow or Luigi
  • Good understanding of security concepts
  • Linux bash scripting
  • Working knowledge of Terraform
Additional Information:
  • Rate Offered:  £500 - £550 per day
  • IR35 Status:  Inside IR35
  • Location:  London / Home Based
  • Duration:  6 Months