Big Data is everywhere. Yet many companies lack a clear vision for rolling out big data in practical, measured steps. At the same time, with social networking, BYOD, and expectations from interactions with brands like Amazon, Apple, and Nike, most employees have seen the potential, yet many aren’t equipped to harness this power in their workplace. The small data movement — which I’ve been writing about for the past 6 months (and thinking about for many years) — aims to address these challenges and re-envision the “last mile” of big data via consumer-style, more responsive, more social apps that truly turn insight into action.
Not surprisingly, this idea is getting a LOT of attention. In fact, over the past 6 months there’s been as much published about small data as there was in the previous 3 years. Clearly small data has gone big time as a theme, concept, and set of tools.
So why is small data taking off?
- First, while understandably there’s a lot of excitement about big data, there’s a growing reality that doing it at scale and waiting for all the trickle down benefits can take a lot of time. Especially if you’re not in the C-suite.
- Second, (and here’s where I jump on my soapbox), the last mile of big data is really where the value is created, opinions are formed, insights are shared, and action are made. By non data scientists. Everyday.
- Third, there’s some great consumer examples of small data hitting the stage, most notably the much hyped but potentially game-changing Google Glass, which brings together small data and visualization with wearable computing, all in a semi-stylish package.
So who is fueling the small data movement? I wrote about 10 vendors who get the value of enabling simple, smart, responsive, socially aware tools and solutions in my last post. And a couple weeks back I wrote about 5 additional vendors and a new study I’m doing with Digital Clarity Group in a post on the DCG blog, which you can read here.
As small data takes off, I will continue to provide updates and thoughts both here and on the DCG blog. As always I’d love your thoughts and suggestions in the comments below.
Thanks for stopping by!
Large organizations are in love with big data and big analytics. In fact, back in March, IDC forecast that the big data technology and services market is expected to grow from $3.2 billion in 2010 to $16.9 billion in 2015, while it’s been reported that Deloitte estimates the size of the big data market at $1.3-$1.5 billion in 2012. Yet many employees aren’t equipped to harness these insights in their everyday decision making. And perhaps even worse, many executives and boards are still oriented towards an ‘inside’ data view vs customer or employee engagement type data that has increasing value as social and mobile networks take off, as Barry Libert argues.
Meanwhile, in the consumer world, brands like Amazon, Apple and Nike are shifting their own big data engines into high gear to deliver more personalized offers, recommendations and experiences that drive loyalty and sales.
What’s the connection? While companies (and computers!) like big data. Most people only need small data. Not only in terms of what is ‘good enough’ when it comes to the size of the data set. But also in terms of:
- Delivering simple, consumer-style, self-service apps and devices vs. complex toolkits,
- Providing context-driven, highly accurate answers and explanations (note I said answers, not data),
- Applying the latest Responsive Web Design and social marketing techniques to deliver a great experience across all Web-enabled devices and sharing channels.
Google may do this better than anyone currently when it comes to consumer applications. And on the business front, one can argue that Salesforce has done the best job to-date blending enterprise functionality with social insights and Web-style ease of use to create CRM solutions that your typical employee actually wants to use.
Of course other vendors, brands and investors can benefit from this small data approach, if they focus on creating simple, smart, responsive, socially aware tools and solutions.
Who is driving this small data revolution – even if they don’t know it yet? In terms of tools, my list would start with the new generation of speciality social analytics and business intelligence providers like Bluefin Labs, GoodData, NetBase, QlikTech, and Visible Technologies. In future posts I plan to explore these companies and other vendor categories, look at the role of rich media in both creating and delivering insights to the right audience, and highlight organizations like Nike who are leading the way in taking a small, localized view of big data. I look forward to hearing your thoughts and welcome recommendations on who I should spotlight in future posts.
thanks for stopping by!