Tuesday, June 23, 2009

All For Good is All Good.

Non Profits have just been given a gem of a tool to publicize their volunteer opportunities. All for Good is a collaborative effort that has given you access to some of the most talented software engineers in the world. The video below and then the remainder of the videos on youtube will be a great overview and explanation.

It's a search engine for volunteer opportunities near you.
Very cool. Check it out.

This has come from out of a cohort of volunteer effort among the Craigslist Foundation, Google, and Jonathan Greenblatt from UCLA. There is tons of potential here.

Tuesday, June 16, 2009

Alumni Associations = Twitter FAIL -- Part 3

Yes, I am sticking with the flaming title for this series of posts. I do recognize that it is very unscientific of me to publish the hypothesis prior to the findings or even the research being collected. But this is a study that is remaining open for criticism and some midstream corrections. It also seems like it would increase the readership of the series. (My alternate title is something to do with making millions in fundraising dollars per month from the comfort of your own home!)

I am in the midst of collecting my fourth data set over the course of the last four weeks. There are some trends that are beginning to show themselves. It is interesting to watch the percentage growth of those twitter feeds that started with the most followers. It looks as if it will show that once a twitter profile reaches a certain level, it will continue to have steady growth no matter how the Alumni Association chooses to manage their outbound communication. This will be an interesting point to consider and, if true, can have several recommendations that emerge from it.

I am most interested in influence and engagement. Unless it is simply a branding exercise on the part of the alumni association, there is no reason to have a profile on twitter if you are not going to consider how much clout or influence the communication has. For example, would you rather have 2,000 follower who ignore your information or 150 followers where 50 will always reply back or retweet you?

This is the question the Katie Johnson considered as she began to manage the twitter presence of Cal State, Fresno. Katie is a numbers person, perhaps a statistician at heart. She was asking the ROI question from the very beginning of their feed. She also asked the questions early, of what kind of news and information their alumni might want to hear from them, and employed the answers she received directly to her outbound information.

SIDE NOTE --- I think it's great that she took the time to consider these important questions. I also think alumni associations everywhere should consider whether their twitter profile should be managed as a news distribution channel at all. In some cases, depending on the objectives and strategy, considering twitter use might not result in the question, "what kind of news do you want from us" but rather "how can we show our alumni our loyalty" or "what needs to our alumni have that we can meet." Those kind of questions and answers might result in the revelation that twitter is not the social web application you should be using.

Katie's orientation toward metrics caused her to use and track her tiny urls every time she sent out a news update. She has been tracking every outbound tweet, that has a link with it, for the past several months. There is quite a bit of information that can be reported on from this data. Here are a couple of basics.

Average click through rate when an update has a link - 4.2%
Highest click through rate of any update - 25%
Highest unique number of clicks on any one update - 52 (with 390 followers at the time)
Typical Time of Day for highest open rates - 2:30PM Pacific
Typical content source for highest open rates - YouTube and FresnoStateNews.com


This is one universities feed. I could only dream of being able to access analysis from all of the alumni associations I am observing. (If everyone were like Katie!) But it is an interesting analysis I recommend any mature feed employing. You can get these kind of clickthru rates using HootSuite or thru the new StumbleUpon tool that is in beta. Some of you might have additional tools that can give you similar statistics.

So leave a comment and lets talk about it. What should we compare our clickthru rates to in order to show we are doing well? Should they be better than email open rates or clickthru rates? Should this be a discussion about updates mimicking email subject lines with the tiny url mimicking the clickthru? I prefer this to be a discussion about engagement, but those numbers are not ready to be published yet.

Sunday, June 14, 2009

Alumni Association Research

The followup post is coming, I promise.
I have had a few people asking.
I am still in the data collection process on what will be a fuller report on the state of typical alumni association use of twitter.

In the mean time, I have a couple of other data sets that have been sent my way that will make for a nice little post. This is not it.

I don't imagine anyone is sitting there hitting the refresh button while staring at my my blog, but you should expect to see something in the next couple of days. I apologize if I am adjusting your expectations.

Friday, June 5, 2009

Alumni Associations = Twitter FAIL -- Part2

I have received some wonderful interaction (both online and off) from part one of this series and this research. This interaction has led to some adjustments I am considering and I'd like to hear what you think about some of these ideas.

Don't just lurk, feel free to chime in on the comments, I'm happy to hear ideas from friends I haven't met yet. One of those friends is Katie, who chimed in on the comments of the previous post. I even got to spend some time on the phone with Katie today. We had a good, invigorating conversation...I love when online introductions turn into offline interaction. (go to a tweetup some time, you'll really like it)

Anyway, a few things that have hit me as we are half way through this experimental analysis...

#1 - I HAVE BEEN HARSH


I need to come out and admit this right away. The title and opening paragraphs of my initial post on this topic were intentionally over the top.
It was my intent to pull readers, especially alumni association officers, all the way into the research. It is not my intention to publish a scathing diatribe about collective ignorance. I pledge to leave this kind of tactic in post one, and intentionally become affirming and offer help in the remaining posts on this topic. If the use of this tactic lured you in to reading, I'm happy for that. However, I don't want you to hide this report or it's findings from your VP or director because it felt like I had an agenda to make you look ignorant.

That being said, I am going to allow the numbers to be what they are, even if that means they are brutal.

There are a handful of Associations in the data that are doing remarkable with their feeds. Only a portion of this partial study has been published. I chose not to make any commentary on any individual feed, but there are some conclusions you can start to draw from looking at this limited data set.

#2 - BUILD A BETTER BASELINE

Baker alludes to this in his comment on the first posting. I had an offline conversation with him that expounded this idea. I initially chose to show a glimpse of two twitter power users, Beth Kanter and Chris Brogan, in the partial findings. I wanted to give a view of how their scores are coming out, not because I intended a comparison to show that Alumni Associations were awful. Instead, I wanted to give context to the scores generated by the twitter analytic tool I used. I would love to compare the AA feeds to the average or aggregate twitter user, but I don't know where to find a tool that can give those numbers. I could find or choose several random twitter users to establish this baseline, but I believe it might be more appropriate to compare AA analysis to a brand name or business organization. I think this point should be open for discussion. I'll be happy to take suggestions of who or how to establish an appropriate comparative baseline in the comments of this post.

#3 - ESTABLISH A CONTROL GROUP

This idea came from the conversation I had with Katie. Her concern was that AA behavior and tweet habits might be affected based on the partial release of the findings. Feed managers like her will react to this release by awareness that I'm watching. This would result in skewed results for the second half of the data.

Scientifically, this is true.

Practically, I @replied to about 35 of the AA profiles that I was examining with a link to the blog post. I have heard from 6. I think a control group might naturally emerge from among those who hardly read their @replies.

Katie's suggestion also means recruiting a few feeds that were not in the study to take us up on the findings and recommendations we make once the study is over. Let's see if our recommendations are effective. That turns this into a much project for me. (A second project, in fact)

Either way, I'd love your thoughts on this point that Katie brings up.

#4 - WHY TWITTER?

Bill asked me this in an offline conversation. I think the foundation of this question is wondering if I am suggesting that twitter is the thing Alumni Associations should be involved with.

No.

I like the idea of doing a similar analysis of facebook and Linkedin. Katie pointed me to Alumni Futures. This is written by Cal Tech's, Andy Shaindlin. His colleague, Elizabeth Allen, has written in several places about Linkedin best practices. Facebook recommendations are all over the place. I guess I just needed to start some place with twitter. I do think that objectives and strategy are important. I think those should be determined before AA's dive into any one of these technologies.

#5 - YOUR METRICS ARE INTERESTING, BUT DON'T REPRESENT OUR STRATEGY

I have heard several variations of this comment, and I think it is fair to bring up. I used some language in the opening paragraphs of the first post that would lead some to believe that I think a certain way about most of the AA twitter profiles that have been opened. That they are being managed without thought or examination of objectives or strategy. Though that may be the case for many of these feeds, I don't think it's true of all of them. Some of this analysis will come out in the final report and recommendations I'll put together.

That being said, I do believe there is well-intentioned, but faulty, strategy that exists among these feeds. I would like to refrain from talking about this too much prior to the data being collected completely. I am eager to engage in this as a constructive conversation. I think I have some practical suggestions that Alumni Associations can apply that will create both efficiency in the amount of time they spend while increase the engagement level of their alum followers.

If you have any metrics that measure effectiveness of your twitter strategy that are not represented in the tools I selected, I would love to know either the metric you want counted or a tool I might use to capture those numbers.

#6 - WHAT IS THE PLAN?

My plan is to collect data three more times over the next two weeks. This will give us a look at the numbers over a month-long period of time. I plan to invite suggestions into the process along the way so the results are both beneficial and encouraging to the Alumni Association community. Feel free to leave your suggestions.

Wednesday, June 3, 2009

Alumni Associations = Twitter FAIL



“You are not doing it right.”
This is a bold statement that might be better suited for a manifesto. The statement is directed at alumni associations who are (for the most part) failing to use twitter the way they should.

You are showing up to a cocktail party with a megaphone.

On twitter, your alums think of you as the obnoxious guy who is unaware of himself and unable to carry on a normal, human conversation. Do you know this guy? The one who only talks about himself…incessantly, completely oblivious to the nonverbal cues he is being sent that clearly communicate he should be quiet, ask a question, or take a breath? Yeah…that guy… is you (on twitter), and I have the numbers to prove it.

Identification

Finding your twitter feeds wasn’t that difficult. Most of you have the word “alumni” in your profile name. A few of your colleges and universities may have a consolidated feed that is named for your school and not for the association. Feeds that are managed by your central communication departments have the advantage of being unified and clear in the distribution of status updates, but the gigantic disadvantages of needing to crowd out the human voice that might come through a twitter feed compounded with inability of the alumni association to have a voice.

For instance, take a look at the feed of the University of Southern California. USC’s feed, at http://twitter.com/SCTrojans follows nobody, engages none, is primarily filled with automated feeds surrounding their sports teams, and boasts one of the largest followings among universities using twitter. Their contrast is Marquette University, http://twitter.com/MarquetteU . MU maintains a very engaging feed, has an even larger following than USC, but has little room or time to focus on alumni association goals.

Translation – twitter feeds controlled by your school’s marketing have large followings and don’t have time for the alumni association.


Therefore, I have ignored the feeds that are named for your college and university, and have focused this analysis on those feeds that have been named specifically for the alumni association. You won’t be able to blame central communication for this one!

The Obvious Numbers

What you will see here is sampling of 50 alumni associations and the brief analysis I found using free tools, easily available, on the web. The top 40 were intentionally chosen for analysis based on the size of their followings. Ashton Kutcher has taught us all (unfortunately) that the size of your following is what is most important. [You’ll see that the analysis of this report runs counter to that notion, but I went ahead and selected and organized these twitter feeds based upon this misunderstood metric] The last several entries were chosen as a cohort that was intentionally chosen for being low in followers and brand new to twitter. It sounded interesting to have input from this representation.

I'll arrange the first look at these based on the way that a casual twitter user might measure influence and clout - based on followers alone. These numbers were recorded as of May 27, 2009.

Don't let the follower metric fool you. What does it mean to have 1873 followers?
Is that follower number a metric that really matters?
What was the reason you opened up your alumni association twitter feed to begin with?
Was this a series of questions you even asked yourself prior to jumping into twitter?

The Not-So-Obvious Numbers


If we take a quick look at the way that these alumni associations engage their followers, we can come a little closer to the value of having over 1,000 followers. By looking at the feeds themselves, we can get a sense of what strategy is being used to increase followers as well as the approach that is being utilized in the day-to-day use of twitter.

* A twitter feed can be used as purely one-way communication and can also be used to speak with and republish others content.
* A twitter user that engages in conversation can be easily spotted by the number of @ replies found in their feed.
* A twitter user that intentionally republished others content can be easily spotted by the "RTs" that lead their updates.
* A twitter profile that asks questions is intentionally engaging followers and eliciting @replies.

An organizations tendency to follow or refollw people also says a lot about the way they have chosen to use twitter. Most of the time, those that just deliver content (and don't engage their followers by asking questions, engaging in conversation or refollowing them) expose themselves as users who are only using this social web platform as a distribution channel (while ignoring the social components).

Here is the same sampling and a look at how these organizations strategically use their feed.

The Numbers You Should Be Looking At...

Which would you rather have... 1000 followers who don't pay attention to you or 40 followers who are actively listening and participating with you?
What is 10,000 followers worth if you are causing your feed to be lost in the twitter noise?
To take a quick look at how engaged these feed's followings are, I took a quick look at their last several days of tweets. By doing a simple search of the twitter profile name you can count how often the feed name is mentioned by other twitter users in the past few days. This is a broad representation to how often people are retweeting, replying, or answering questions the alumni association is asking. This chart also gives you a general idea of the frequency of the outgoing updates by each of these feeds.

Do you see what these numbers are saying? Chris Brogan's twitter name is mentioned 100 times in the past 3 hours and 92 of those mentions are other people talking about, replying to, or retweeting what he has said. That is influence!

Speaking of Influence...


Influence is the real value of any social network. Your follower number is a deceiving metric, especially if you have inadvertently trained your followship to turn a blind eye to your updates. I suppose you could be satisfied with the idea that your alumni network is among the early adopters of this growing social network. As a branding exercise, this may cause you to not care about your influence in the conversation. As long as your profile isn't embarrassing you, maybe you couldn't care whether yor alums are actually listening. But if you do care, this last set of numbers will have some significance and education in themselves for you. This is a snapshot of the recent activity your profile was engaged with in the end of May. based upon the tweets of the previous seven days in combination with a whole host of metrics, these are the scores given to your twitter profiles by a great little tool found at www.twitalyzer.com.

I don't see any reports that show what the average Clout or Influence score is across all twitter users, but from a brief twitalyzer search of a handful of my active twitter friends and a few brands, it seems that a clout score of over 2% is above average and an influence score over 1% is perhaps a bit above average. Either way, you can compare yourself among others in your field to see where you fit in while comparing yourself to other alumni associations that are using twitter. I am not suggesting you should tweet like Chris Brogan does, but I do think there is a lot more value in these number than simply measuring success by your growing followers.
Here is a quick word about the scores you see and how the are mined. These are lifted directly from Twitalyzer's explanation.

Clout -
Clout is often thought of as "special advantage, pull, or influence" in the real world, as in "the senator's nephew has a lot of clout with his uncle." In our usage, clout is the likelihood that other people will reference you in Twitter, as in "gee that @Mashable sure does drive a lot of traffic!" The more people who reference you, the higher your clout.
Our definition of clout is simply the number of references to you divided by the total number of possible references (as governed by the Twitter Search APIs).

Velocity -
Your velocity is simply the rate at which you contribute to Twitter. Since the Twitter Search APIs limit us to 1,500 records, at least for the time being, you are judged against a theoretical maximum of 1,500 updates per week.
This is not to say that you should attempt to write 1,500 updates every week, especially if you don't have very much to say and would end up telling your followers about your cats, lint, or your feelings about your mother. But the reality of the situation is that the most influential people in Twitter are, by and large, writing a lot which helps increase the awareness of their personal brand, the likelihood that they will be referenced, and the likelihood that they will be retweeted by others.
Conversely, Twittering a lot about nothing will increase your velocity but decrease your signal-to-noise ratio. And while the latter is not directly factored into the influence calculation at Twitalyzer, in our experience if you start to ramble about nothing you will lose followers very, very quickly.


Generosity -
We believe that Twitter is a lot like life, only in fewer characters, and that being generous with others is extremely admirable. In Twitter, we think of generosity as one's willingness to pass along ideas and call attention to those ideas we think are great. Our measure of generosity is one's propensity to "retweet" someone else, thusly creating awareness of their work and ideas among your own followers. Specifically, our measure of generosity is based on the ratio of retweets you pass along to all updates you publish. Simple, huh?
This leads to the obvious (yet cynical) conclusion that "if you want to game the Twitalyzer's influence calculation, all you have to do is retweet other people a lot." Yes, yes that will work. And if we are able to get more people to share information in Twitter just to eke a few more points out of their influence score, well, then we believe we have done good work.
Incidentally, if you retweet more frequently, you'll also increase your signal-to-noise ratio as well. Sweet, huh?


Signal to Noise Percentage -
One of the great things about Twitter is that you can say anything you want (in 140 characters or less.) Some people choose to pass along information, others choose to share anecdotes, and still others talk about their cats. The Twitalyzer has observed that people tend to gravitate towards strangers who are passing along information. Our signal-to-noise ratio is a measure of the tendency for people to pass information, as opposed to anecdote.

By our definition, "signal" will be counted for any update that includes at least one of the following elements:

* References to other people (defined by the use of "@" followed by text)
* Links to URLs you can visit (defined by the use of "http://" followed by text)
* Hashtags you can explore and participate with (defined by the use of "#" followed by text)
* Retweets of other people, passing along information (defined by the use of "rt", "r/t/", "retweet" or "via")

If you take the sum of these four elements and divide that by the number of updates published, you get the "signal to noise" ratio. For example, if you published four updates and two of them contained links, your signal-to-noise ratio would be 50% (2 updates with signal / 4 total updates).


Influence -
As Twitter becomes increasingly important to online communication, the creators of the Twitalyzer believe that the need to measure the impact of our efforts in Twitter will increase a commensurate amount. While some believe that "popularity" is an appropriate measure of success, we disagree, eschewing this easily gamed metric in favor of something more robust, more fair, and more difficult to cheat.
The Twitalyzer solution is our measure of "influence in Twitter" calculated based on:

* Your relative reach in Twitter, measured by the number of followers you have
* Your relative authority, measured by the number of times you are "retweeted"
* Your relative generosity, measured by the number of times you "retweet" others
* Your relative clout, measured by the number of times you are referenced by others
* Your relative velocity, measured by the number of updates you publish over a seven day period.
Each of these measures are weighted but otherwise the calculation is incredibly simple. We believe that what you get is a measure of success in Twitter that can be applied in a variety of ways. We know this measure is not perfect but, well, we're not perfect and we don't believe in holding software to a higher standard that we ourselves live up to.

What do the Real Numbers teach us?


They teach us what we suspected from the beginning. Don't make too much of the following. Your influence is a much better indicator of effectiveness and usefulness. Your questions of whether you whould change your approach or turn this into a place for fundraising appeals is a question for your original objectives in particpating. Perhaps you are satisfied with the knowledge that your update habits are teaching your alums to ignore your messaging, as long as you have an active feed.

I am going to monitor these feeds (a total of 50) over the next several weeks and report on progressing numbers. I'm interested to compare tactics with growth rates and report on other observations that will come with time based analysis. Stay tuned!
When I have done a snapshot of the data over several weeks, I'll give you a look at all the numbers and all the feeds.

Fail Whale image via http://www.dache.ch