Archive for June 6th, 2010
Measurement is a discipline, and it needs to be business-wide. If you’re going to ask about the ROI, value, or impact of social media and how to measure it, I’m going to ask how you’re going about determining those things for other areas of your business, and ask you to translate or adapt some of those practices over to social initiatives.
If you’re not measuring anything else, you’ll have a learning curve. A steep one. It’ll come complete with needing the right tools and platforms to collect data, the right people to analyze it, the buy in from management to spend the time doing all of this, and the commitment to use the measurement as a means to underscore your strategy. The social media data is available for the taking, so that’s not the problem. The *real* issue is connecting the dots. See #4.
2. Measurement is not the goal.
The goal is to derive insights that teach you something of value, and then act on them. Measurement is a waystation, a path, but is not the goal in itself. You don’t get a cookie for measuring.
You probably need to spend three times as much time and effort evaluating and acting on your data than you do collecting and formatting it. Why? Because the analysis is what yields direction, plans, action steps, you name it. You START with the data. You need to end up with a course of action, or the act of measuring (and all the time you spent doing it) is wasted.
3. Measuring activity isn’t as important as measuring results.
Gathering fans on Facebook is an activity. How those fans chose to respond to your offer, sign up for your newsletter, or buy your product (or not) is a result.
Number of forum posts is an activity. How many of those forum posts converted new downloads of your latest ebook is a result. (Even better if you can take it a step further and show the ebook downloads that became leads).
Follow me? We’re very caught up in trying to track all the stuff we’re doing, and not spending enough time connecting dots between those actions and how they drive progress toward the goals we’ve set. Speaking of which…
4. Metrics are determined by goals.
Learn how to create measurable objectives and the metrics practically jump out at you. If you know where you’re headed and have a clear definition of what it means to reach your goal, it becomes pretty apparent which signals (metrics) will tell you whether you’re close, far, or right on target.
And you don’t need 40 different metrics to underscore a hypothesis or progress toward a goal. Typically you just need a few. If your goal is to raise awareness for a cause, you can look at reach of mentions and messages, increased donations, or a surge in volunteer signups. Those go up, you can be reasonably certain that what you’re doing is contributing to those things, and likely justify staying the course. Which leads me to a biggie…
5. Cause and Correlation are different.
Cause means that something you did drove someone to act. Directly, and usually singly. There’s a clear line between initiative and result. (We could argue that nearly every causal relationship has external influences, but that discussion for a headier day).
Correlation is fuzzier, and where most folks get hung up with measurement. It’s about a relationship between two things, usually an action and a result, but that relationship isn’t exclusive of other factors.
We struggle with these two, because we’re often trying to prove cause, when correlation can be just as valuable in terms of justifying our efforts. Think of correlation as “contributing to” or “influencing”. So if you do an outreach campaign in social media and lead numbers through those channels increase, you can say that those two events are likely strongly correlated. (By contrast, if you do a campaign in social media and your offline event attendance increases, they might still be related, but likely more loosely).
Remember that today, we have any number of points where prospects and customers can be impacted by what we do. Proving cause can be tricky, because you can’t trace every interaction someone has with your company.
But we strive for cause why? Because we want CREDIT. We want to be able to say that OUR effort is what moved the needle so we can justify time, budget, headcount. But the only way to truly prove cause to a major degree is to adjust ONLY one thing while leaving all other factors the same. We rarely if ever do that in business, because we’re not conducting science experiments. We’re simply trying to understand what helps and what hinders. Get comfortable with this phrase: reasonable degree of confidence.
6. Analysis is the hard part, not measurement.
The human brain factor is the complicated bit. Data is easy to collect, easy to smash together, easy to do math around. The REAL question is: what does all this MEAN to me and why? What does this tell me about the effect and impact of my actions?
That’s the hard part because no tool in the world can do that for you. No case study will show you precisely the map you need to follow for YOUR business (though it might spark some ideas). No one person can hand you a turn-key set of metrics that will suddenly give you a lightbulb moment and show you the path ahead of you. Put the effort into goal setting on the front end and analysis on the back end, and let measurement be a process in between.
7. Standardization has limitations.
You might have some *types* of metrics that can be bucketed together – such as engagement or awareness metrics – but the unique ones that matter to your business aren’t likely to be standardized anytime soon. That’s a departure from the way we’ve always done it, but then again, some of our “standard” metrics haven’t really gotten us very far (like ad equivalency) and others are standard in name, but not in how they’re calculated (like customer satisfaction).
Instead of striving for metrics that are universally applicable, focus instead on the ones that consistently deliver valuable intelligence for your business. It doesn’t matter what the guy down the street is measuring unless you’re just looking for a little inspiration.
8. Reporting is not an outcome.
Related to #2, delivering the graph isn’t the end of the road. It’s what you outline as the next steps to either a) keep doing what you’re doing or b) adjust something in order to try and change the results.
The report, in fact, is often the starting line. And reports full of data alone aren’t very useful. The art in reporting isn’t just packaging the information, but its in interpreting and translating that. When you give your boss the monthly report of PR impressions or lead volume, do they ever ask you what you attribute those numbers to, and what recommendations you would make based on that information? Have YOU ever thought about that? Why?
9. Measurement doesn’t have to be complex to be effective.
You don’t necessarily need convoluted indices to get you where you’re headed, especially when you’re starting. Sometimes, just a simple correlation between an awareness metric and a sales timeline can tell you whether there might be a positive relationship, and you can act on that. Think of it this way: pair one qualitative metric – like customer satisfaction – with one related quantitative one, like sales or call center costs or website hits. One metric alone rarely tells you anything valuable.
Are they both headed in the direction you want them to be? Over time, do you see them moving together, away from each other, or in unrelated ways? Do the strategies you have in place to move them both tie into one another?
CAN measurement be complex? Sure. Some really detailed measurement formulas can help you get super scientific and granular. But again, if you’re getting mired in the process of measurement instead of the practice of deriving some intelligence from what you measure, you’re doing it wrong. The average business simply needs a guide, not a dissertation.
10. Measurement is a constant evolution.
You set a goal. You back out a few metrics. Then you evaluate, and realize you haven’t learned anything of value, or that you need more clarity, more specifics, a broader view, or whatever. That’s okay. Look, business is an iterative process. It’s part art, part science, and so is measurement. Who wrote the rule that said we had to have the perfect, bulletproof set of metrics before we start measuring?
If something doesn’t get you the information you need, change what you’re doing and try something else. If you’re missing something, add it. Eventually, you’ll settle into a few combinations of metrics that really illustrate to you those Almighty Actionable Insights.
We’re way too caught up with being perfectionists about gathering and presenting information, and not nearly good enough with FRAMING the information in a way that gives us something to chew on.
11. Measurement is cultural as well as operational.
We’re taught to fear failure, so if we track and measure failure, we don’t want to share it. We manipulate numbers to show our work in its best light, instead of showing the hard truth in order to identify what we need to improve to be more effective. That’s a *culture* problem, based in businesses where accountability is absolute, blame is personal, and failure is a dirty word. That’s a conversation that can’t be fixed with a PPT presentation.
12. Measurement is more than ROI.
Measuring ROI is something we can and should do. Track how much we spend (in time and capital), track how much we net in terms of return (usually $$). That’s a smart move.
But we can’t limit the discussion about measurement to ROI. We have to talk about qualitative metrics, like brand perception, customer satisfaction, advocacy. We have to talk about quantitative metrics that tie to things other than revenue, like reduced costs. We also have to understand the difference between justifying something from a “good use of time” perspective, and looking at a financial return as the way of determining success.
Ultimately, all roads lead to Rome. But so much of social media isn’t about being the sales channel, but is about positively impacting the likelihood of sales through all other experiences.
13. “Social media isn’t measurable” is an excuse.
Here’s what people really mean:
- I don’t have the right tools in place to collect the data I need
- When I have all the data, I don’t know where to start
- I don’t know what data might relate to each other to analyze it well
- I don’t want to or am not empowered to spend time doing data collection and analysis as part of my job
- I’m afraid of what measuring will actually tell me about the effectiveness of my work
The first one is a functional problem. The second and third ones are knowledge based, with no exact “right” answers, and require a bit of practice and applied effort, but they’re solvable too. The last two are cultural, and are probably much more firmly rooted in the people rather than the process. That’s a different discussion.
Above all, we have to stop blaming the medium for hindering the measurement process. It’s not social media’s fault at all. If anything, it’s guilty of providing us too much information.
What we need to understand about our own measurement practices is whether we’re equipped with the right tools and data, whether we’re willing to spend the time evaluating that data and extracting the juicy bits, and whether we’re functionally and culturally prepared for what it might show us, for better or for worse.
But make no mistake, folks, basic social media measurement isn’t someone else’s responsibility to sort out for us. And waiting for the manual is simply burning time and money.
Measurement is our job. It’s our responsibility. And it’s within our capabilities, without doubt. So let’s get cracking.
image credit: BigTallGuy
[Sent from Ralph Paglia’s iPhone]
There’s a lot of content out there and a lot of people creating stuff. How do you know who to pay attention to and who’s just mucking around? Remember, even a no friend nellie can drag you onto the front pages of the Saturday newspaper if they write right, but in the main, it pays to know if someone is actually an influencer or not. Oh and if they tick the following criteria in the field of social media-ness, then they are social media experts.
When you are researching online for influential bloggers and twitterers, bear in mind these points:
- Academics – society confers influence on academics because they have either researched themselves or studied those who have researched, a subject. An academic blogger of note would confer respectability to your enterprise [ensure before approaching that they are not funded by you or the competition]. I will sometimes use academic research to back up a story that otherwise appears a little frivolous. Always useful to connect with academics.
- Authors – being published in print confers instant influencer status. Except possibly in social media where one should maybe have a less traditional and more social publishing history. An example of an author with influence online would be @neilhimself (Neil Gaiman, author) or the blog of the Freakonomics guys. As authors are learning that a substantial online presence helps sell books, more are coming into the influencer sphere. The support their community gives them when writing their next books is often paid back in recognition, thereby reaffirming the author’s role as influencer.
- Politicians – politicians have conferred influence. They speak with two voices – the personal one and the political one. Very we, the people. Politicians more than any other tribe usually understand that their influence (and the hassles that goes with it) is notpersonal. President of Iran or the Member for Wentworth, politicans make good stablemates if you can get them to blog about your stuff. Good luck with that though!
- Traditional media – not journoggers but journalists that genuinely blog for other the love of writing or a genuine interest in storytelling. As influencers they are an odd one – journalists historically do not come down on the side of passion for the subject but an impartial voice. If you are looking to engage journalists online as influencers, find someone like Mia Freedman who already knows the PR score and value of her blog. Reminder: Check for tone and politics [I’m not talking about SMH blogs, but hobby blogs by journalists]
N.B. If traditional media consistently quotes someone as an expert (influencer) pay attention. They have already done the filtering for you!
- Celebrities – need I say more? celebrities usually bring crowds and traditional media to their causes and topics of discussion. @plusk (Ashton Kutcher) has 10 million followers. Lindsay Lohan blogs and tweets. Kim Kardashian. Maybe they are famous for being famous, but if you are looking for an influencer to shine some attention on your products or services, be prepared to pay to hire ‘em. I’m going to lump sports stars, musicians and bands, fashionistas in this lot – the same kind of influence (real world crowds, paparazzi, used to the Public voice).
- Charisma – not the same as celebrity which may rely more on a good PR machine than any real personality, this person would be interesting in pitch black darkness. Strength of personality is a key trait, an opinion, a great smile. This is not beauty or handsomeness, but a cosmic force. Cannot be ignored but could be a bit diva-ish.
- Corporate – industry leaders such as CEOs and financial backers carry their own influence. Money is influence. But it’s not just the money, it’s the connections. If Richard Branson tweets your startup business or some other CEO blogs about your products, their readers may well be in the same circles they are in.
- The Visionary – probably a better term will come to me. Maybe futurist? We don’t always know what they are saying but we suspect it is important. Not a huge number of followers but ardent fans. A little out there, but never ignored not even by the trendiest most popular of influencers. Sometimes combined with The Engineer the guy who knows how it works and how it should work and isn’t interested in gossip just the facts ma’am. Excellent for technology promotions or where the product is either cutting edge or really quite good.
- OldTimers – usually these people have longevity. They may not be at the top of their profession, in the sense of moving onwards and upwards to better things, but they ‘ve been around long enough to know everyone, seen everything, and have a story or two to tell. Their influence is incalculable, and their connections and sense of history vast. When connecting with influencers in an online community, you may want to seek them out first. They can explain the politics and who will support you and who won’t. Helpful ones will pass you on with a recommendation.
- Award winners – we do love award winners. They become self fulfilling. Why? Because a jury of our betters have already done our filtering for us. The more awards someone wins the more they will win. The C.V. just looks too delicious to ignore. When connecting with award winners, whether they be BAFTA or Olympics, ensure their personal brand meshes with yours.
- Crowd gatherers – they have the most followers on Twitter and lots of commenters on their blog but you can’t quite figure out why. Mostly it’s because they are personable (not the same as charisma) and don’t upset people. They value connections over original thought or “quality”.
- The Mover and Shaker – similar to the oldtimer this person doesn’t want the hordes following them but is a name dropper. They know the best parties, who to call, what to do. Social grace ad infinitum. They won’t follow you back on Twitter until they are sure you have some “value” to them as a “friend”. Definitely an influencer, but they value their connections and don’t pass on quality connections easily. Well, $40k gets you to Prince Andrew I guess. Easily overlooked as they are standing next to the celebrity influencer.
- The Practioner – oodles of experience in their field. Clear communication style, popular as a teacher, consultant, and with the Press. Deep knowledge. They may not be a celebrity or have charisma but they are judged on what they have done, experience-wise. As influencers they are probably the most sought after as they bring gravitas, connections and oodles of respect.
- Vox Pop – an unconscious influencer. I don’t mean Man on The Street, which is a chance opinion or influence. The Vox Pop character does the right thing to say and do for their generation. Think of Millenials that you know. Some seem “mature for their age”. It’s not them. I mean the ones that dress and talk and act unconsciously, exactly as their generation. These voices just purely and simply reflect back the thoughts and writings of their time. I love finding these influencers. All their generation gravitate to them, as spotlights. Paris Hilton was one, Corey Worthington and so on. Their influence comes from simply reflecting back current values. Invaluable.
So, are you an influencer in your field? Are there other attributes that an influencer may have? What’s missing from the list?
I reckon I could put a social media expert in everyone of these fields. Some in more than one. But I’m not gonna…
[Sent from Ralph Paglia’s iPhone]Ralph PagliaDirector – Digital MarketingADP Dealer Servicescell: 505-301-6369http://www.RalphPaglia.comhttp://ADPdealerservices.comhttp://ADMPC.comhttp://LinkedIn.com/in/RPaglia