AI Readiness

Optimising big data queries for large volumes of complex data

Optimising big data queries for large volumes of complex data

Optimising big data queries for large volumes of complex data

Giving research and sales teams faster, more reliable access to complex audience data through scalable AWS search and reporting.

Giving research and sales teams faster, more reliable access to complex audience data through scalable AWS search and reporting.

3 mins read

BUSINESS IMPACT

Real results at scale

  • Ability to export a large amount of data to Excel

  • Multi-factor authentication to validate users for security purposes

  • Ability to save preferences and default settings for searches

  • Speedy and accurate data results

  • Email alerts when data results are ready

  • Flexible combination searches

The Challenge

Our client's existing system was unable to handle the large volumes of data they were dealing with on a daily basis and required a flexible, robust data reporting engine for time-efficient results.

The Solution

Multinational broadcasting company

Our client are a well-established, multi-national broadcasting company reaching 300 million subscribers across 150 countries, through 50 channels and in 37 languages. They deal with large sets of complex data audience data ranging from streaming to TV audiences. They need to be able to efficiently carry out searches, for research and sales purposes. Their data sets are sourced from Nielsen AMRLD which is stored in their data warehouse.

Program Search and Market Break Ranker tool

Our client’s existing data search tool performed the search queries extremely slow, frequently timed out because of the large volumes of complex data and did not offer the flexibility required. They needed a tool that would help them gain insights from large amounts of data to help support the research and sales efforts of the business.

Flexible, user-friendly tool that handles data searches on large volumes of complex data

The client was looking for an improved data search tool that allowed them to have a Program Search as well as a Market Break Ranker. These two different components were essentially search engines for the two types of data the company dealt with. The Ardent engineering team took on board the requirements and created a tool that optimised big data queries for large volumes of complex data with a user-friendly interface, using API Gateway and Angular technologies.

We offered flexibility by adding filters and drop-down menus, allowing the users to select multiple categories for the data results. As the client wanted the ability to be able to carry out Boolean logic combination searches, we needed to build a system that could search vast data sets to pull out relevant data results. We were able to provide a solution on Lambda and then moved to AWS Batch to ensure a quick and efficient search of the data.

Ardent's data engineering expertise

Our expert engineers made recommendations on boolean logic to streamline data searches as we have a vast amount of experience working on a similar scale of data and clients.

Optimised big data queries

Our experienced engineers delivered a fit for purpose data solution, allowing our client to optimise big data queries on large, complex big data with a number of features to make the search process easy and straightforward. This enabled our client to have a quick turnaround time on analysis of the data (household viewing figures), increasing efficiency in the data search process. Overall, they were able to save time, be efficient, and save costs allowing them to focus on other important business goals.

The Results

The new search and reporting tool gave research and sales users faster, more flexible access to complex audience data, reducing time lost to slow or timed-out queries.

Looking to achieve similar results?

Talk to our team about how we can help.

Get in touch

INDUSTRY

Media

SOLUTION

Amazon CloudWatch, CloudTrail, IAM, DynamoDB, SQL, Athena, S3 Data Lake, Angular, API Gateway, Lambda, AWS Batch

Ready to make your data work harder?

We build and manage the data foundations that remove the quality, consistency and reliability issues holding back AI, automation and better decisions.