Why startups won't lead the Big Data revolution

Incumbent companies may move more slowly, but they've got all the data

Sorry startups with dreams of data-led disruption, but incumbent companies are in a better position to benefit from the Big Data revolution than you are.

That's according to Kenneth Cukier, data editor at The Economist and co-author of Big Data, speaking at Comptel's Nexterday North conference in Helsinki today.

Startups benefitted from their agility during the early expansion of the web, but larger, legacy companies have a leg up when it comes to Big Data, for one reason: they have the data already.

"In a world of Big Data, what it takes to succeed is access to the data," said Cukier. "Who has the data? Big companies."

Advertisement
Advertisement - Article continues below

However, that head start doesn't guarantee success. Cukier pointed to airlines, which had stacks of data about their customers and the flights they were buying, using it to adjust prices on the fly meaning shopping many months before your travel didn't mean you necessarily got the best price.

Oren Etzioni, the founder of Farecast, realised that he'd paid more than fellow passengers on a flight, and as a computer scientist, wrote an algorithm to figure out the best time to purchase a ticket, Cukier explained. The eventually hoovered up data on every single American flight for a year, some 70 billion data points  before it was bought by Microsoft for $100 million and all but killed off.

The idea has been picked up by others, helping consumers buy flights at lower prices the opposite of what airlines were hoping to do with their data. "Never for a second did the airlines think for a second that their own information could be used to undercut their own business," Cukier noted.  

Of course, for incumbent companies to make use of the data they already hold requires repurposing it for other uses something data protection regulators aren't always keen on. That balance between privacy and the potential of Big Data to bring value and solve problems needs to be solved for such companies to benefit from the "raw natural resource" that's sitting on their systems, he said.

"Who owns all this data anyway," he asked. "The entity who bothered to collect it or the individual from whom it was taken?" That needs to be clearly decided, with accountability and transparency to ensure data isn't abused just because Uber knows your smartphone battery is low doesn't mean it should bump up prices, something that's technically possible but the company has widely chosen not to implement.

"We need to accept Big Data because it leads to benefits, but it can't be a new alchemy, a black box or a religion it's only a representation of reality," Cukier said. "We need to accept Big Data, but it can't come at the expense of our values."

Featured Resources

Application security fallacies and realities

Web application attacks are the most common vulnerability, so what is the truth about application security?

Download now

Your first step researching Managed File Transfer

Advice and expertise on researching the right MFT solution for your business

Download now

The KPIs you should be measuring

How MSPs can measure performance and evaluate their relationships with clients

Download now

Life in the digital workspace

A guide to technology and the changing concept of workspace

Download now
Advertisement

Most Popular

Visit/operating-systems/25802/17-windows-10-problems-and-how-to-fix-them
operating systems

17 Windows 10 problems - and how to fix them

4 Nov 2019
Visit/strategy/28115/the-pros-and-cons-of-net-neutrality
Business strategy

The pros and cons of net neutrality

4 Nov 2019
Visit/domain-name-system-dns/34842/microsoft-embraces-dns-over-https-to-secure-the-web
Domain Name System (DNS)

Microsoft embraces DNS over HTTPS to secure the web

19 Nov 2019
Visit/social-media/34844/can-wikipedia-founders-social-network-really-challenge-facebook
social media

Can Wikipedia founder's social network really challenge Facebook?

19 Nov 2019