Turning content data into better recommendations

Datasparq was engaged to help DesignSpark enhance the user experience on their main site. As with many content rich sites, giving users the ability to find relevant information but also discover new content, increases engagement and allows users to contribute to the community more effectively.

Furthermore, by consuming content the users get the chance to learn, interact and consecutively buy components from Electrocomponents PLC main site. Getting this right would allow better engagement and thus better monetisation of the community.

Building on Google Cloud Platform

Datasparq suggested building a personalised recommendation engine that would allow users to discover relevant content based on their interests and the interests of their peers thus improving their online experience and the way they are interacting with the site.

To achieve this Datasparq designed a rich article metadata & classification engine. This was needed to support enhanced recommendations, analytics and content commissioning. To make this a reality, we built a data service that continuously analyses all the articles’ content of the website, understands them semantically and creates ontological models around them. Then, we used various algorithms to provide article recommendations to users based on their reading history.

The platform has been in Production since January of 2022 helping DesignSpark engage their community of engineers through daily recommendations.

Architecture

The content extraction and semantic analysis layer is happening during a batch process but recommendations are happening in real-time, for each online user, and are served through an API that adheres to the agreed SLA of sub-second latency.

The service and the data pipeline were designed and delivered on Google Cloud Platform (GCP). By following Datasparq’s engineering principles, best practices and by leveraging our “elements of engineering” (link) we deployed the new service on GCP using serverless components and IaaC approach through Terraform.

The API serving happened through Google Cloud Run which allowed us to run stateless containers with a bit more flexibility than the current version of Cloud Functions allowed.

We are ingesting, daily, user activity data from Google Analytics (GA4) to Big Query where we apply our topic extraction methods and run our classification models before we save the output in Postgres Cloud SQL instance ready to be served to the users through our API.

How can Datasparq help you?

The end-to-end AI & data transformation company

Datasparq is an end-to-end AI & data transformation company. We help enterprises tackle complex, high-value business challenges using AI. Working as an integrated partner, we help the world’s best-known companies navigate the threats & opportunities of AI by designing, building and running cutting-edge solutions.

What makes Datasparq different?

• We’re practitioners—not PowerPointers. Our clients don’t just get a slide deck—in fact, we pride ourselves on getting things done. Our clients count on us to help them end-to-end—from finding ways to unlock the value in their data, to delivering and managing the finished product.
• Where data science meets design thinking. Our clients only get the A-team. We build bespoke, world-class teams for every unique challenge; carefully considering operational factors and putting end-users first. That’s where our SparQshop sessions come in.
• We’re here for people and the planet—not just profit. We’re part of the story about AI as a force for good. That means creating ethical, explainable AI that helps build a better world for everyone.