ROLE

Senior GCP Data Engineer (Managed Services)

Join people who are bright, curious and strive to make a meaningful impact

At Datasparq, we put our people first. After all, it's our people that make our business special.

Want to hear what it's like to work at Datasparq? Check out our Glassdoor reviews by clicking on the link below.

Find us on Glassdoor.

About the Role

At Datasparq, we work a little differently with our recruitment. If you have a great track record, then we want to help you get onboard with us. We will tell you what we’re looking for; we will give you guidance on how to make the most of your application during the process. We want you to succeed in getting the role and then we want to help you to excel in the role itself. We want to help you develop your career; get into new areas of engineering; help you inspire others to success; and develop impact from landed data projects. We want you to bring your teammates with you on that journey so we all get to benefit from the joint endeavour. Most of all we want you to enjoy what you do and further enthuse the team with that enjoyment!

Responsibilities

A Senior Data Engineer (Managed Services) at Datasparq can expect to...

  • Manage operational AI/ML data processes and services, determining maintenance activities, scoping of change
  • requests and leading the development of high complexity features
  • Design and lead the development of valuable data analysis and data science prototypes to operational business processes
  • Deliver engaging technical demonstrations / ideas to both clients and our team
  • Design and provision cloud infrastructure via IaaC (infrastructure as code), providing a stable base for data engineering & science software to execute
  • Design and develop data transformations + logical rulesets on a variety of data types and sizes - utilising a mixture of techniques e.g. MPP (massive parallel processing), SQL, Python and more
  • Design extendible data models that accelerate the development analytics and machine learning models by conforming disparate data sets
  • Demonstrate effective interpersonal skills through good co-working habits
  • Improve and maintain our internal and external data products, including our proprietary and open source libraries
  • Work within a client’s cloud environment, working closely with IT and engineers from their organisation
  • Be responsible for live AI and data services, on which our clients depend for business critical operations
  • Create a range of interfaces for data processes, including: APIs, integration with third party products, user interfaces (typically web) and more
  • Mentor and lead junior members of the engineering team, promoting a learning culture

You will also have the opportunity to contribute to our pre-product phase. Helping shape and define the data processes and products we build for our customers. Ensuring that our projects and services have the best possible chance of success.

Required Skills

This is a role for ambitious technologists who wish to work with the latest cloud technology from Azure, GCP and open source. Whilst we don’t expect everyone to have complete experience with all the technologies below, candidates will need to show their ability to rapidly learn new technologies

  • GCP Experience: Big Query, Cloud Build, Cloud Run, Cloud Functions, Cloud Monitoring, Cloud Logging
  • Good to have: Cloud Composer, Vertex AI Pipelines, Dataflow, Dataproc, Dataplex, CloudSQL, PubSub, Datastream
  • Expert Python knowledge (debugging, testing, logging,
  • Expert SQL skills (experience with dbt or similar is a plus)
  • Evidence of developing data storage strategies and complex transformations in Google BigQuery, Dataproc or Dataflow (utilising SQL, PySpark or similar)
  • Evidence of designing data models for analytics
  • Expert understanding of DevOps principles
  • Expert version control skills
  • Expert Knowledge of orchestration and data movement tools like Composer, Apache Airflow or Luigi
  • Good understanding of security concepts
  • Good containerization knowledge (e.a. Docker)
  • Good Bash scripting
  • Good knowledge of Terraform

Desirable Skills

About Datasparq

Datasparq is a boutique AI & data firm that solves complex business challenges.

We build bespoke AI and data science tools—and turn them into robust, reliable services for our clients.

We start with research and iterate—using lean startup principles—to quickly uncover impactful solutions to high-value challenges. Our product team ensure that we build the right solution in the right way. Our data science team ensure that the AI and data science solutions we build are best-in-class. And, our engineering team ensure that solutions are robust and ready to be deployed in the real world.

But—what’s special about Datasparq is the way our teams work together.

Just as no business challenge fits neatly into a box, neither do our people. Rather than simply hiring a data scientist or a data engineer, we seek out passionate experts who can bring a range of overlapping skills to any team. That gives us the ability to build the perfect team to solve any challenge. We believe in bespoke over one-size-fits-all.

We don’t just build ML models—we take our science from the broad spectrum of mathematics, statistics, operations research and computer science. We work with academic partners and Centres for Doctoral Training (CDTs) across the UK to ensure that what we do is founded on high-quality, up-to-date science.

When it comes to operationalising solutions, we can run data science products in the cloud as services for our clients—or deploy to their infrastructure as needed.

Diversity & ethics

As a company, we don’t just value diversity—we place it at the heart of what we do. To create solutions that serve our users—and our clients' users—diversity is a must, not a nice to have. Likewise, we place ethics at the heart of what we do. Our team are passionate about working on projects that drive positive results for people and the planet. We routinely undertake ethics reviews and champion a culture of openness, honesty and integrity.

Things you might like to see

Perks

Datasparq employees get these perks as standard.

AXA healthcare

The option to join our company healthcare plan

Monthly socials

Varied, lively socials every last Thursday of the month

Learning culture

Weekly (at least!) data science & engineering seminars

Flexible working

Work from our London office or at home

Ethics reviews

Regular ethics reviews to make sure our work is meaningful

D&I commitment

We have diversity, inclusion & wellbeing goals in our KPIs

25 days holiday

...with the option to buy 5 extra days

Dragon's Den

Vibrant startup culture; annual entrepreneurship competition

Labs

Developing our own tools like Houston and Xu

contact

Apply now

Max file size 10MB.
Uploading...
fileuploaded.jpg
Upload failed. Max size for files is 10 MB.
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Follow us on Instagram