Author: John Morrison

Labeling itself “The Standard for Influence,” Klout has worked to become a relevant influence-measurement tool for businesses and individuals.

While every marketer would love a way to quantify social media influence, is there really any substance behind Klout’s numbers? Does a high (or low) Klout score really have an impact on whether you can influence others’ behavior — or is Klout simply an imprecise measurement of one’s social media prowess? Here are three reasons Klout’s algorithm is probably more alchemy than science.

Measuring the Wrong Things

One of the main problems of Klout is that it relies on third-party APIs (Application Programming Interfaces) to get data from the networks it scans — and those APIs have limits. A good example of where this falls short is that Klout has no way to monitor click-through rates. The service has no way of knowing what volume of traffic flows through the items a member posts, or if these posts actually lead to any action offline. How can a service claim to monitor influence adequately with such a huge blind spot?

Another issue is what Klout actually tracks and how it tracks it. With Twitter, scores are determined by monitoring things like follower counts, mentions, and retweets. However, it doesn’t give credit very well for those using Twitter’s native retweet system. When a member retweets something, Klout gives credit back to the original account, even if another user’s retweet exposed it to a larger audience.

Some Twitter members don’t like this and have devised ways to game Klout’s handling of this metric. These individuals choose to use the older manual “RT @name” style retweets instead of the native Twitter system. This way, when the post is retweeted by their audiences, they get the score boost and increased visibility instead of the original user. This is essentially a way of stealing influence, and Klout’s algorithm (as it is today) encourages it.

An Ever-Shifting House of Cards

In February of last year, an infographic made the rounds on the web highlighting a Justin Bieber Twitter spam account with an astoundingly high Klout score. This illustrated some major flaws with Klout and served to embarrass the company briefly.

To combat the loss of confidence in its service, Klout has attempted to iterate and improve its scoring dramatically over the past year. However, it has often done this without notice or explanation. It was not uncommon for members to log in and find that their scores had plummeted by tens of points without explanation. These changes, while aimed at improving the service, essentially stomped all over Klout’s credibility and gave the company a boy-who-cried-wolf reputation with each new algorithm upgrade.

Perhaps most damning is the way Klout has de-emphasized and removed certain metrics in its latest redesign. For example, the latest revision has removed things like user classifications and score analysis. The company has even hidden the ability to track changes to certain metrics over time. If Klout felt more confident in its algorithm, it would expose more of this data, not less.

Topical Misunderstanding

Klout’s system of topics are, in many cases, baffling. For example, having one tweet including the words “Paparazzi” and “Matt Damon” retweeted by someone Klout deems of greater influence can get you labeled as influential on those topics. This can happen despite that tweet being the only time you ever mention those topics. It doesn’t matter if you have many other tweets pertaining to broader topics, such as politics or technology, that achieve a broader reach.

It appears that Klout matches its “topics” to keywords used in social media posts alone, instead of using actual, objective, topics. It also appears that Klout’s algorithm is not smart enough to understand and classify posts based on context—without the usage of such keywords directly. These are some of the flaws of automation. Algorithms cannot understand things like sarcasm and tone, and they have an especially hard time with nuances of language and meaning that only humans would pick up.

At the end of the day, Klout is trying to quantify something as inherently subjective as influence. But while some metrics can be helpful to understand audience reach, influence cannot be distilled into a single number. While Klout’s promise is tantalizing for marketers, it will always need to rely on a certain amount of assumption and fabrication to seem legit, thus leading its value to be questionable at best, and bogus at worst.