Big Data = Big Brother??

Big Data can make your life simpler, profit for businesses and at a lower cost than traditional business intelligence solutions.  Sound too good to be true??!  Read on…

What’s the problem with Little Data?
When you call a bank, they essentially validate who you are, against the information you gave on an application form.  The way they make sure that is you, is by validating that against a credit agency (like Experian or Call Credit) to make sure you are who you say you are, and that you can afford what you are buying.

Now as you well know, a lot can change between the day you opened a current account and today. Not least your mobile number, email address and importantly things like your lifestyle and buying habits.  What you buy and wanted 10 years ago, are very different to today I imagine!

What is Big Data?
Many modern businesses are made up of products that have been bolted on over the years.  These systems rarely talk to each other, and if they do, it’s even less likely the business is linking the data to be valuable for them, and valuable for you.

Big Data describes the patterns that emerge from analyzing trends across systems inside and outside the company.

Companies like ClouderaDatameer specialize in very quickly doing what business management have dreamed about for at least a decade, without the expense of a data warehouse, and in real time.  They have the tools to connect to all of your data sources, then provide very visual, actionable analysis.

Where does Big Data come from?
As you go about your life, you leave behind data, like a trail of crumbs.  Every time you correspond with a company, government department or make a purchase – all of that data is logged.  What’s more that has been standard procedure for many years.

On it’s own in a dark corner data about what you bought for lunch isn’t very valuable.  When that data is linked to data in other dark corners it becomes tremendously valuable.

What can you do with Big Data?

  • Predict when you might be coming into financial trouble (because your MOT and car insurance is due) – and offer you a temporary credit limit increase (That’s helpful banking!!)
  • Send you offers or deals from Burger King if you eat and McDonalds a lot – saving you money, and making money for the bank by selling that data.  (That data might also be of interest to a health insurance company!!)
  • Check your driving record against the DVLA, instead of relying on you to inform them of speeding offenses etc.
  • Offer an appointment with your bank branch manager when you are looking for a new house and asking friends for advice on social networks.

I’m sure you get the idea, and there are plenty more too.  The Big Data revolution has the potential to make your life a whole lot simpler, whilst giving struggling companies another way to make money if sales are down.

What about my privacy?
Always the big worry.  The key will be to make all of these services opt in.  Under the Data Protection Act and Freedom of Information Act, no entity can store information without your express permission.

As I find myself saying often lately… your data is the cost of free

Will you take advantage of Big Data?
Companies are heading this way, very slowly.  Centralized contact data bases, improved cross business data sharing, and developments like data.gov show even the UK Government endorses a Big Data future.  Big Data doesn’t have to mean big brother, and doesn’t have to be feared.  For most of us it will mean less painful interaction with companies that have the data they need to actually be helpful.  Some further reading on how Big Data is different from Business Analytics

What do you think of Big Data?

  1. Will it be profitable for business?
  2. Will it struggle against privacy laws?
  3. Do you trust it?

Want Mobile Payments?

The EDC 2009 Global Payments Survey suggested that in the USA, the mobile would replace the wallet over the coming half decade. A bold statement indeed, and something we have all heard before. It’s an argument that is winning traction since Square has won itself a lot of attention, mostly for some snazzy web design, and having a certain Jack Dorsey at its helm.


The problem facing these upstarts is that some very exciting companies are trying to create a solution where the consumer doesn’t see a problem. Perhaps the greatest degree of disruption will come from developing economies. Payment processors and banks have been attempting to load these territories with credit cards. Whilst this might give a short term revenue burst, where is the strategy?

Africans are already using SMS as a form of payment, because its simple and low tech. Payments in the western world need to be simpler, and have no barrier to entry for the consumer. The consumer has a phone, and has a bank account. They don’t have a payment mechanism that works as well as the card.


Until that is the case, we’re in an interesting but risky place with mobile. mPayy and oboPay both show a lot of promise in solving the Mobile Payments problem. However until someone is able to package this service and sell it to the banks, Mobile Payments will not take off. Given that most Payment Processors still think “e-commerce” is the future (scary I know), that could take a while.