Reporting And Analytics Number One Complaint Of CDN Customers

Of the 1000+ customers who took our CDN survey and were asked "What value added services are you willing to pay a premium price for", over 75% of them said something having to do with better reporting and analytics with the most common answer being something along the lines of "Better reporting – and did I mention better reporting!!!"

So it will come as no surprise that analytics and reporting was also the number one answer when we asked "In your opinion, what is the one thing your CDN needs to improve on". While most CDNs I speak to know how big of a deal reporting is, very few seem to be taking the issue seriously. Much of what customers are getting today in terms of data is very basic and is at most, raw data that is presented to look pretty but with no analytics to tell them what the data means. I know that some CDNs will say that reporting and analytics is hard as the log files they are dealing with are so big and that many customers have custom reporting needs. That is true, but there should be some base line minimums, and when many CDNs reporting interface can’t even tell a customer during a live event how many simultaneous streams they are doing, the basics are missing.

Looking over the survey data, here were some of the most common comments from customers:

  • real-time reporting for live events
  • analytics reporting is technical only, not enough marketing oriented
  • reporting based on geographic region
  • reporting based on sub-accounts
  • monitoring/analytics APIs
  • self service reporting tools have a terrible interface
  • access to geographical based reporting, such as the map in Google analytics to determine local advertising impact
  • analytics for Flash content
  • providing metrics in a timely fashion
  • looking at how long each video is played on average, are people dropping half way through?
  • Analytics a little bit limited, e.g. can’t choose custom time frame (3 day for instance), also the reporting does not translate UTC to our local time
  • Reporting over longer periods of time (currently only 6 months)
  • detailed user analysis (who watched what for how long from where)
  • an API for accessing and displaying the tracking data, so that I could create my own "dashboard" to show real time stats
  • I would like an API where I can get raw metrics to feed into our internal report structure. We use several CDN’s and each has their own reports. We spend too much time translating data to produce a single comprehensive report.
  • reporting and analytics and the ability to parse it out by stream/customer
  • push default reports I want to me, rather than me have go get them
  • views per day, views per geographic location, length of each view then an aggregate % per day

From all the customers I speak to, the feedback I have heard is that Akamai and EdgeCast have the best reporting products in the market. That’s not to say that others may not also have a good functioning products, but those two are the ones I hear the most compliments about from customers. I think every CDN in the business should have a real reporting account on their homepage that anyone can log right into so that you can see first hand what their reporting and analytics package looks like. Too many times customers tell me that when they ask about reporting, most CDNs send them a product sheet with some screen grabs of the interface.

Reporting, and more importantly analytics, needs to get better a lot faster. Customers have to be able to show the value in these services, measure their success and justify why they should spend more money to deliver more content. While I see many of the CDNs all going to the market with the same message about performance, reliability, high-quality etc…. most of which don’t really mean anything to a customer anymore anyway, why not create a really good analytics package and use that as your go to market message? It would stand out from the rest of the commodity marketing terms CDNs use, would resonate well with customers and is a functionality of the service all customers need.

  • http://www.streametrics.tv Loïc Guillard

    Hi Dan,
    I knew you were going to come back with more stuff about Video metrics ;-)
    I am still trying to figure out how we could work with CDN…it’s all about the player with the flash environment (site centric). Akamai for example, would have to develop some players with us to allow their clients to have better reporting. It’s not going to happen with the server environment (server centric).
    We are back to the Webtrends story late in 98 when hosting providers used to install Webtrends on their servers to parse the logs from client’s Web site (server centric)…until Webtrends, Websidestory, Clicktracks, Urchin, etc released their live version consisting in adding a piece of code into Web pages (site centric).
    I think better statistics like Vstat from Streametrics for instance will be offered more by technology providers than CDN…or final clients themselves like medias and publishers. Don’t you think? Cheers,

  • http://www.BusinessOfVideo.com Dan Rayburn

    Honestly I don’t see a solution to the problem coming from third party products. The CDNs have the ability to collect the data that is needed now, and they have the ability to display it with analytics if they really wanted to. The fact that some CDNs already do this show that is can be done, the real question is how hard is it for each CDN and how much effort, time, resources and money do they want to put towards the problem?

  • Manuel Angelini

    I have to disagree on the fact that CDNs can already perform this task adequately. What is missing is a solution that would not only parse logs and display them in a fashionable way, but also a solution that would analyze the user behavior. A combination of both would be a winner. At the moment, and as you pointed it out in your post, reports are technical-oriented and not enough marketing-oriented, which is a real market need. I really doubt that the CDNs will start developing such a solution. What is available right now is basic and was easy for CDNs to implement since they had minimal efforts to put for building a log-based reporting service. But to build an entirely new solution that would involve much more intensive software development and that is server-logs “independent”, is a step that I doubt CDN would be willing to climb.
    I believe that a much more realistic approach for CDNs would be to acquire a third party solution to handle that stuff, including the technical support for web developers that would want to integer such a solution into their custom player (Flash and/or Silverlight). Don’t you think?