• Skip to primary navigation
  • Skip to main content
Danny Brown

Danny Brown

podcaster - author - creator

  • About
  • Podcasts
  • Journal

big data

The Question of Context in Meaningless Data

Context in data

One of the things marketers and brands alike are excited about at the moment is the potential of Big Data. This excitement is understandable – the ability to tap into previously unheard of sources of information about our customers is a very big thing indeed.

Whether the excitement being generated is fully warranted is another thing, though, especially given the fact that Big Data more than lives up to its name when it comes to the reality of using it effectively.

At a conference earlier this year, one of the speakers – from a data analysis company – spoke of the craziness of trying to make sense of the amount of data we have access to. By her reckoning, it would take 1,000 data analysts working 24 hours a day, 7 days a week, more than 300 years to sift through everything currently available to us.

And that’s just with today’s data. As more users come online and begin to share their own information and preferences, the numbers continue to escape the folks trying to make sense of it.

Even with that, though, Big Data is, and continues to be, a valuable resource when used in the right context. However, there’s another opportunity just waiting for us – that of finding context in the meaningless data we discard.

Big Data – Beyond the Obvious

For most companies mining data, the goal is to find the nugget of gold that can help them with a variety of business goals – lead generation, customer acquisition, customer retention, crisis prevention, brand reputation, HR head-hunting and more.

All good stuff; all the kinds of the things businesses should be looking for, and all the kinds of questions that Big Data can answer. Yet while this kind of approach has been proven to yield results, the opportunities when we go beyond the obvious is where it gets really exciting.

For instance, a typical data mine might look like this:

  • Identify keywords, topics, and user groups/personas;
  • Start indexing search matches;
  • Use natural language processing (NLP) to identify sentiment, context, etc.;
  • Weight keywords against each other based on importance, relevance and frequency;
  • Create user groups of results for the relevant business team to take over;
  • Rinse and repeat.

Given, that’s a pretty basic overview of what a typical social search/data mine comprises of – but it does show you how the data can be found, filtered and used.

Ontology discussion

However, this is going after specific pre-defined targets – keywords and groups based on the business goal. So, it’s fair to say that the results achieved are only meeting the immediate targets set.

But what would happen if we stepped outside the immediate target area and started thinking beyond the obvious?

Out of Context Data, In Context Opportunities

One of the biggest challenges facing monitoring platforms, even with today’s technology, is they’re still (mostly) relying on scripted conversations to glean data from.

Sure, NLP and text analytics can help filter out certain emotions and sentiment around a conversation to give us the kind of data we need to make decisions – but the human mind is a far more complex beast than the flow of conversation traditionally used for monitoring reports, especially when complemented by Artificial Intelligence (AI).

It’s this complexity and the way it adapts on the fly while continuing the same conversation – or even taking an action based on a non-targeted conversation – that offers the greatest opportunity for analytics, monitoring and data companies to build for.

Example A – The Social Graph Data

Let’s say Mary is the target audience of a business that sells shoes. They might set up certain searches around how she decides what shoes to buy, and when – historical purchases, brands she follows, age group and similar consumer follows, seasonal choices (back to school, new job, etc.)

Based on these searches, any time Mary takes an action that involves the specified keyword(s) – a Like on Facebook, sharing a video on YouTube, an extended conversation on Google+, participating in a fashion chat on Twitter, etc. – will pop up as an opportunity for that brand to engage with her, either directly (a tweet, a blog comment) or indirectly (banner ad, Sponsored Story).

However, let’s take it a little bit further. Undetected by the search algorithm, Mary occasionally uses a hashtag on some of her updates. The hashtags don’t seem related – they’re innocuous, random, and spread across multiple networks.

While the automated search is ignoring them, though, a behavioural analyst or an AI program decides that there is a pattern to the hashtags, no matter how infrequent and haphazard they seem.

Data visualizer

This leads to the discovery that the hashtag refers to Mary’s crowning moment at high school, when she beat the high jump record. The hashtag – say, #WIWYAF – stands for “When I was young and fit”, and is a reminder of Mary’s youth that she’d love to get back, hence her love for certain sports shoes.

Sending a new search spider out connects her social graph together and uncovers multiple conversations and images around her reminiscing.

This little nugget allows the brand to reach out and say, “Hi, Mary, wouldn’t it be great to revisit the summer of school sports ’85? Well guess what – our new Running Shoe X is built from the memories that made that year so great.”

Instant connection. Instant relevance. High on context and memories and direct to Mary.

Example B – The Alternative Thinking Data

Another way to look at is is by thinking of alternatives to what we believe we’re being told by public updates.

John is in Vancouver, and posts an update to his networks that he hates the cold. Being Canadian, this could mean that John hates the winters in Vancouver, and wishes he was elsewhere.

A vacation company monitoring opportunities could see this update, and perhaps reach out with a special offer valid for the next 48 hours. The time-sensitive offer, and the likelihood that John is in that company’s target audience, could see a sale and a new customer.

Then there’s the thinking beyond that.

  • Does John hate the cold because he can’t afford his heating bills?
  • Does John hate the cold because he has a hole in his window?
  • Does John hate the cold because he has seasonal allergies?
  • Does John hate the cold because his roof isn’t insulated properly and letting heat escape?
  • Does John hate the cold because it usually means Christmas and crappy family dinners he hates attending?

One simple statement has now opened up a myriad of possibilities that, if we dig deep enough, could offer several opportunities to meet John’s need.

  • His bank could reach out discreetly to see if they can help;
  • A glazier could offer a low-cost emergency repair to his window;
  • A consumer advice group could offer tips on better roof insulation and heat preservation.

Each opportunities; each resolving a need. All that’s needed is the hidden context of an unremarkable update.

The Permission Factor of Data

Now, given, this assumes a lot of permission marketing and public acceptance of how data is used. Then again, who says data needs to be the sole domain of the marketer?

Think of identifying and activating new donors or activists for a non-profit or cause. Think about helping people in danger – depression, loneliness, abuse – by proactively digging beyond what may be a limited call for help but goes much deeper. Think about law enforcement spotting dangerous new drug avenues before they hit the streets.

The data we monitor today can often be hiding the real data we can use tomorrow. It’s going to take experimentation and respecting, as well as garnering the respect of, the people we’re monitoring to start the process.

However, as a starting point in truly meeting the needs of the people we say we want to help, it’s not a bad goal to be thinking of now.

Is it?

image: kris krug
image:?Francis Rowland

Without Context, Data is Meaningless

Context and marketing

There’s a big push at the minute by marketers and technology vendors around the concept and importance of Big Data. Run a Google Search for the term and the resulting titles of posts, articles or books speak for themselves:

  • Big Data: The Next Frontier for Innovation, Competition and Productivity;
  • Big Data: A Revolution That Will Transform How We Live, Work and Think;
  • Big Data Transforms Business;
  • Put a Fork In Big Data – It’s Done (just to balance the positive/negative results).

So, Big Data is clearly big business, and – with more than 1.7 billion search results – something that businesses are looking to understand, come to grips with and benefit from.

That’s understandable – after all, the potential of Big Data is huge. In March 2012, no less an institution than the White House itself announced the Big Data Research and Development Initiative.

So, yes, Big Data = Big News.

The thing is, though, while access to such huge amounts of data helps us be better marketers and – by association – better businesses, there’s also the danger that we let this data inform our decisions, without stopping to think of that most important aspect of any data analysis – context.

Context Drives Educated and Informed Decisions

Think of any major decision you’ve made in life, either personally or professionally. While there will be examples of impulse buys or snap decisions made in the heat of the moment, the majority of your actions will be based on the context surrounding them.

  • I wanted the sports car, but it wasn’t kid-friendly;
  • Job A offered more money, but Job B offered me deeper satisfaction;
  • The penthouse condo in the city offered amazing views, but the suburb neighbourhood was safer.

Three very simple examples of decisions that looked at the bigger picture of context, and took into account the long-term view versus the short-term buzz. Each option would satisfy our basic instincts, but the latter option of each choice is the one I’d go for based on its deeper context.

It’s simple economics of educated decisions, based on the data available – yet as the following examples show, context is still being missed where it’s needed the most.

Visual Data is Great, Real Data is Better

Professional social network LinkedIn is continuously looking to increase connections and the viability of its service with new additions, some useful, others less so. At least, currently.

One of the new features they’ve released is the visual ability to see who’s viewed your updates, and how far they’ve spread. Visually, it’s pretty cool, as can be seen below:

LinkedIn Visual Data

The problem is, functionality-wise, it’s very limited.

While the image on the left tells me my update had 536 views, it doesn’t allow me to dive into the data to see who actually viewed the update. The same with the image on the right – I can’t click into the big purple circle to identify the type of people viewing my content.

The potential for this visual data is obvious – I can see if I’m attracting my target audience to my content – either potential clients or new employers – and, by having access to this information, tailor my sharing even more, as well as connect with these folks in particular.

It’s not just LinkedIn that’s missing the importance of context, though. Check out the image below from technology vendor Jugnoo?(click to expand):

Visual data screen

The results are from a search around the words “social business”, and show not only the main keywords around the topic, but also who’s discussing them, via what platform, and the time they’re most likely to be discussed.

This basic data offers a simple overview of that particular search – but where’s the bigger context?

For example, you can see that “business” is the most discussed word, and then I’ve highlighted “product”, “agencies”, “customers” and “platform”. As you can see from the two yellow circles I’ve overlaid, a couple of people are in multiple results. So what’s the context behind that?

  • Is it because they’re connected to these different communities?
  • Is it because they’re seen as influential around these joint topics?
  • Is it because they’re more active than the other profiles?

Again, these are simple questions, but ones that the software doesn’t answer, or at least attempts to help with. Because of this, other software and analysis is needed to see how valuable these folks might be to my business.

That’s not to advocate lazy marketing, nor to forget about the legwork that real analysis requires. But if a software tool can’t provide further context around the solution it offers, why use that platform at all?

Dig Deeper, Think Bigger

And this is where Big Data’s main weakness can be found – it’s encouraging lazy solutions that seem to offer reams of data, but in reality offer very little. By doing so, it’s impacting the true potential of Big Data when used properly.

It’s this type of limitation that’s attracting valid critique of Big Data.

In his 2013 paper entitled Big Data for Development: From Information to Knowledge Societies, Martin Hilbert raised the concern that Big Data-led decisions are “informed by the world as it was in the past, or, at best, as it currently is.”

Last year, Harvard Business Review published an article, Good Data Won’t Guarantee Good Decisions, which highlighted the bigger issues around the data available to us today.

For all the breathless promises about the return on investment in Big Data, however, companies face a challenge. Investments in analytics can be useless, even harmful, unless employees can incorporate that data into complex decision making.?Meeting these challenges requires anthropological skills and behavioral understanding?traits that are often in short supply in IT departments.

Simply put, we can have all the data in the world available to us, but unless we understand the context in which it’s presented, and the actions that will drive based on our analysis, we’re as effective as driving at night with the lights off.

It’s up to us to think bigger when it comes to Big Data, and start providing the context and meaning behind it, as opposed to just the “But it looks cool, right?” mindset that seems popular today.

Challenge on.

image: Kris Krug

© 2026 Danny Brown - Made with ♥ on Genesis