What Is Big Data?

Is Big Data yet another buzz term? Steve Cassidy ponders what it really means for the IT industry...

And SEO is making matters worse, not better. Once a term is being researched by enough people, the SEO guys start to ask for subject material that hits the sweet spot when simpler, more naf searches are typed into Google. I can't claim to be immune from the effect, because that's what drove the title of this article but I am at least talking directly about the topic, rather than trying to spice up an uninspiring topic with a hot search phrase, in search of ratings or clicks.

Advertisement - Article continues below

As will be clear if you get the Super Crunchers book, the process of data mining pre-dates the whole Big Data concept by many years. Give yourself a relational database, and the process of construction includes a certain intellectual perspective on the information you're collecting.

This is all that very entertaining stuff (I am being ironic) such as Backus-Naur forms, Codd & Date scores, and the meaty and difficult comparisons between relational database competitors. Is SQL Server better at representing your data, or should you choose Oracle, or MySQL? Certainly if you are a hard-hitting entrepreneur then the abstract intellectual view doesn't look like the easy way to the right answer. The key revelation when looking at this issue is that any work that is poorly aligned to the data structure you're stuck with, is going to cost you money.

Advertisement
Advertisement - Article continues below

Superbly efficient data models are needed to store lots of data rapidly, but the better the job done with that, the more expensive the queries that cut across the data in unexpected slices become.

Advertisement - Article continues below

If your lips are moving (mine were, writing that) then here's a usable but inaccurate metaphor. If you are trying to get in or out of a Formula 1 race day, you can join in with the efficient group transport and arrive by bus. But, if some crisis arises, it's just not going to work to attempt to hijack the carefully scheduled and timed bus system the only way back out again is in a helicopter, and they don't come cheap.

Databases are like that or rather, evolved ones are. A mature relational database has been honed and tuned and tweaked to the nth degree, so that (for instance) 5,000 checkout tills in every Tesco in the country can all go "beep" within a single second: That's efficient design. But, when Tesco want to work out how many Baked Beans are sold before 11am, the resulting query has to climb into a computational helicopter. Hourglass icons animate; fans spool up; temporary disks get full; LEDs blink furiously.

Featured Resources

Staying ahead of the game in the world of data

Create successful marketing campaigns by understanding your customers better

Download now

Remote working 2020: Advantages and challenges

Discover how to overcome remote working challenges

Download now

Keep your data available with snapshot technology

Synology’s solution to your data protection problem

Download now

After the lockdown - reinventing the way your business works

Your guide to ensuring business continuity, no matter the crisis

Download now
Advertisement

Most Popular

How to find RAM speed, size and type
Laptops

How to find RAM speed, size and type

3 Aug 2020
How to use Chromecast without Wi-Fi
Mobile

How to use Chromecast without Wi-Fi

4 Aug 2020
How do you build a great customer experience?
Sponsored

How do you build a great customer experience?

20 Jul 2020