Archive for May, 2006

Measuring Web 2.0

As the Web 2.0 hype spreads wider, sooner or later it’ll start spreading beyond its trendy enclave and start to penetrate main stream websites. I’m sure that’s already happening in a few places (such as gmail), but by and large web 2.0 is dominated by small start ups. When you get big companies deploying stuff, they want to measure it - and rightly so.

However, web 2.0 is resistant to the normal sort of measurements. What are the traditional measurements? Let’s go through some Web 1.0 measurements and see how many of them are relevant in the Web 2.0 world.

Web 1.0 Web 2.0
Page views Not much use in AJAX applications. Replace with user actions - how many people clicked on button X.
Unique users Still some relevance, however more and more people are blocking cookies, and most modern web browsers make it easy to block 3rd party cookies which many tracking services rely on the maintain session state useful for unique users. Still a relevant metric and it never was precise (a dirty little secret the stats vendors don’t tell you), it may simply become increasingly less precise.
Click paths Click paths are still very relevant, but again, challenging in AJAX applications. A new term I propose is "action streams". What sequence of actions do people take?
Conversion statistics Many people, particularly ecommerce, are obsessed with conversion statistics, as they should be. Which ad drove the most traffic? Which ad converted the best? Which keywords? Which ad copy? Which graphical execution? Which landing page? I just dumped Overture from a campaign I manage as it was generating plenty of traffic but very few conversions relative to other sources. Web 2.0 still needs conversion statistics but needs to take this to another level - see below.

New to Web 2.0

  • Measure onsite buzz. Web 2.0 is more than just technology, it’s also about engaging your customers and partners and allowing them to contribute. So, measure the comments on your blog. Measure the track backs (ok, not strictly onsite). Which subject generates the most comments? Which subject generates the most positive track backs? Which post caused a big jump in the number of RSS subscribers? Which page on the Wiki is getting the most edits? The most page views? The most vandalism? Let your imagination run free, I’m sure I’ve only scratched the surface here.
  • Measure offsite buzz. This should be done in Web 1.0 world as well, but I very rarely see it. What are people blogging about you (without a track back)? Posting in forums?

The interesting thing is many of these things are very difficult to do in traditional analytics packages. Show me how you work out in webtrends or websitestory how many people clicked on button X which invoked AJAX action Y. Yes, there are ways to do it, but it’s really hard. Web vendors are going to have to either make a radical shift, or people are going to need to start instrumenting their applications - building measurement into them. I suspect it will be a combination - people will need to write against an API/webservice their statistics provider exposes. That has some pretty major repercussions for both statistics providers and for application developers. There’s certainly a great opportunity here for the right people, and vendor lock in will be pretty enormous - unless someone develops a standardised statistics API (I doubt that’ll happen).

General Mark 31 May 2006 No Comments

Dear Outlook,

Dear Outlook,

We’ve had many good times together. While I don’t like all your many siblings, you are one of my favourite children in your family. I love the way you are so together & integrated. Yes, we’ve spent hours together almost every day for almost 10 years now, laughing together, crying together and collaborating together.

But, as time has moved on we’ve grown apart - I think you’ve felt it as well. I feel we are moving in different directions. I need to move around a lot more, and need a partner that can move around with me. Yes, you have Outlook Web Access, and you do look very sexy in that. But you are still such good friends with your cousin exchange, and his tastes are just too expensive for me.

So, I’ve started seeing someone else. Yes, I’ve started seeing Gmail for Domains. I know what you are thinking, and yes, she is ad supported. No, she doesn’t integrate quite as well as you. But she does have much better search, her calendar is getting better, she looks very good in firefox (sorry, I know that’s a sore spot for you but it’s true) and most importantly, where ever I am, so is Gmail for Domains. She suits, yes, even enjoys my itinerant lifestyle.

Please don’t hate me. I’ll always have a special place in my heart for you, Outlook.

Affectionately yours,

Mark

PS. Please don’t tell your sister, Excel, that you saw me flirting with http://www.editgrid.com.

General Mark 18 May 2006 6 Comments