What makes social media measurement hard?
By Iain MacMillan September 19th, 2009
In Measurement · Social media · Stories
A summary of some old and more recent thinking:
- 1. An activity that uses social media technologies can affect the performance of multiple business functions at the same time. For example, an activity based on Facebook and seeded within forums and social networks could help drive sales (marketing), improve a brand’s reputation (brand management) and convince existing customers to up-sell (customer experience). Therefore, ways of measuring all of these are ways to measure the success of that activity.
- Social media environments, where brands can engage with customers and customers can engage with customers, will require new and unfamiliar metrics. It’s the same problem we faced when ‘online’ was new and fluffy. Over time, clients grew to trust specific metrics within traditional media channels - for example GRPs as a meaningful metric within TV advertising. The tendency was, therefore, to find metrics that looked similar to the ones that clients were used to, even though these might not reflect the best way to measure the effectiveness of the medium.
- Success within social media will be due as much to the existing brand SWOTs and the assets with which the brand can fuel the conversation, as it will be an agency’s ability to improve these assets and introduce these to the right people and the right conversations. The development of social media activities works best as a partnership between the brand, its partners (including its agencies) and its customers. The quality of the input by all parties must be understood to correctly apportion praise for an activity’s success.
- The word-of-mouth nature of how messages spread within online (and for that matter offline) conversations - and the number of different factors and people involved in their spread - makes it hard to accurately attribute success to individual parties (such as a partner agency) within that conversation. Often we’re relying on simple econometric-lite tests (like measuring buzz) that are either too insubstantial or would cost too much to fully implement with any level of accuracy.
- There’s a fundamental difference in the social media marketing metrics required for promotional activity within social environments (e.g. ads on Facebook) and brand-driven social activities online (e.g. responses to brand posts in forums). This difference isn’t always fully recognised within activity measurement frameworks.
As Mat always reminded me, you can’t begin to find the right solution - or solutions - until we understand and agree what the challenges are. One of things I think we lack within those companies working with, and measuring the effect of, social technologies at the moment is consensus on what the challenges of doing this are. Without this consensus, I think our chances of creating a widely accepted and implemented social media measurement framework are slim. I’d appreciate any thoughts, amends and particularly additions to the list above.
1 KDPaine // Sep 19, 2009 at 1:07 pm
you are spot on in, but you forgot the part that says that perhaps the value of social media — the R in the ROI eequation — may be greater efficiency within the company (as in Best Buy) or lower recruitment costs (see Sodexo) or happier customers (as in Comcast).. not just sales and marketing results. That’s what is making this so difficult. Marketing and PR people have to look outside their silos.
2 Tweets that mention What makes social media measurement hard? -- Topsy.com // Sep 19, 2009 at 10:30 pm
[...] This post was mentioned on Twitter by Eric Budinger, Arbor Search and Social Media List. Social Media List said: What makes social media measurement hard? http://bit.ly/1qsBy [...]
3 Iain MacMillan // Sep 21, 2009 at 9:53 pm
KD - you’re absolutely right. Working across numerous silos is crucially important, and yet so hard for many businesses. There’s a future piece of homework for me right here - to look at who is leading the way in this area and embracing new business structures. I wonder if the technology consultancies have any interesting offers in this area?
4 Urs E. Gattiker // Sep 23, 2009 at 8:36 pm
Yes I agree with KD Paine that you are spot on but for me actionable metrics means that the company has to identify and define the measures it wants to use for assessing the mediating effects that affect - but are not the single cause - of ROI
“… Surely nobody tries to quantify the ROI of air conditioning. Having it when outside temperatures reach 35 degrees Celsius helps office productivity, making it a mediating factor for, though NOT a cause of, ROI. Similar reasoning applies for social media measurement…”
http://commetrics.com/articles/implement-5-tips/
Thanks for this intersting post
Urs
@ComMetrics
5 Iain MacMillan // Oct 2, 2009 at 9:18 am
Urs - many thanks for your response. Clarity in, and agreement on, objectives and metrics is crucial. I’ve had a happy time this week following links from your post.