Intelligent Software Is The Future Of Application Delivery, Not Networking Centric Approaches

I have written a few times about Instart Logic and its web application streaming technology. The company has attacked incumbent CDNs with a novel technology that it claims makes those same CDNs obsolete. The core of the technology is a way to build a connection between Instart Logic’s delivery network and the browser on the user’s device. This connection is enabled by a small JavaScript software layer Instart Logic calls the nanovisor on the smartphone, tablet or laptop. The technology allows Instart Logic to identify which parts of a web app are the highest priority and stream them down to the user. This is attracting media companies as well as ecommerce companies that are both investing in delivering very high quality images and dynamic, personalized content.

Instart Logic’s intelligent connection is built entirely upon software smarts and is a shift away from the hardware centric approaches of traditional CDNs. Instart Logic claims that being software-based from the ground up allows for faster iteration and innovation along with lower capital costs. This is very different from the hardware centric approaches from Akamai and other similar vendors, who depend on lots of servers sitting in data centers around the world.

By moving to a “software-defined” model of application delivery, Instart Logic is designed to address the latest performance bottleneck – the wireless “last mile” from the cell tower or WiFi router to the device. The last mile is so painful for traditional CDNs because of four main variables including: network conditions and congestion, speed of Internet connection, application content and structure, and device type. One or any combination of the four can cause applications to load slowly or render a poor user experience. Instart Logic specifically designed its solution to take into account all four of these variables and use software-driven intelligence to address them for each specific user. This is their real secret sauce.

To back up their claim that software-based application delivery allows for faster builds of new features and greater technology innovation flexibility, Instart Logic has been releasing new features and technologies at an impressive clip. The two latest releases are both very interesting and something I have been spending some time to better understand. SmartVision is a new technology that works with the company’s image streaming capability. It uses computer vision technology to analyze the content of images. It can tell whether an image, for example, is a blue ocean or a face, a mountain or picture of a car.

SmartVision decides the minimum image data send required to make the image recognizable on first paint of the screen with a good quality of experience. A picture of a face might require more up front data transfer because of the sharp details whereas a picture of an ocean might not. This will reduce the data transfer to first-load images on the page and thereby reduce page load times. Instart Logic has a patent pending on this technology and is publishing scientific papers about the new approach, which came out of collaborations with image researchers at leading universities.

The second new technology is a feature Instart Logic calls InstantLoad. InstantLoad takes certain components of a web application that are most likely to be used early on in the page load process and use its client side nanovisor.js library to push those assets into the highest performing class of browser cache. In modern browsers with HTML5 technology, there are different classes of browser caches with varying performance. In a nutshell, InstantLoad puts the most highly demanded information into the highest performance cache depending on the devices capabilities and performance.

This is a clear way to leverage newer capabilities that only came online in HTML5 very recently. The technology works across all major browsers and is particularly useful for upping the performance of SaaS applications. Those types of web apps tend to be used throughout the day by users loading up the same pages over and over. So for those apps, any way to improve client side cache usage and performance can greatly improve the user experience and diminish wait times.

Both of these features plug directly into the existing software framework of Instart Logic. To be clear, some of the large incumbent CDNs use software to optimize content delivery and adapt delivery to changing circumstances, such as device type. Other CDNs capture very basic information such as the device type and the network condition and then make changes on the backend to code and images. To date and to my knowledge, only Instart Logic establishes a two-way communications channel between the device and the network and can make real-time decisions using a smart client in the browser, making them unique in the market.

By going deep into the device and using intelligent software to create an entirely new type of application delivery network, Instart Logic is clearly trying to differentiate itself from Akamai, EdgeCast and Amazon CloudFront. If the company can continue to roll out new features and pull in marquee customers like The Washington Post, then that product differentiation could force the incumbents to think about radical overhauls to their technologies, and makes Instart Logic a company to really keep an eye on. If I had to make a short-list of companies that I think are truly innovating in the content delivery market right now, Instart Logic would be number one on that list.

Thursday Webinar: Why Your CDN Needs To Be Paired With Managed DNS

Thursday at 2pm ET, I’ll be moderating another StreamingMedia.com webinar, this time on the topic of, “Four Reasons Why Your CDN Needs To Be Paired With Managed DNS.” Internet performance is more important to companies and brands than ever before with competition for page views, clicks, and conversions increasing every day. If your company is using a content delivery network (CDN) to deliver the videos, pictures, and content, you are putting your CDN investment at risk if you don’t have a managed DNS provider to help power that performance. Dyn Director of Performance Assurance Charlie Baker will go into why CDNs need to be paired with managed DNS, hitting up four specific areas:

  • The DNS impact on page load time
  • Why a CDN-agnostic plan with managed DNS is key
  • The big three of reliability, flexibility, and performance
  • Case studies on how to optimize your performance using multiple providers

REGISTER NOW to join us for this FREE Web event.

Updated: Private Equity Company Makes $645M Bid To Acquire CDN Provider Limelight Networks

The Phoenix Business Journal is reporting that on Friday, private equity company Tuition Build Inc. submitted a $645M bid to acquire CDN provider Limelight Networks in an effort to take the company private. With Limelight’s stock closing at $2.83 a share on Friday, Tuition Build’s offer values each share of Limelight at just over $6.50, which is a nice premium considering that Limelight has yet to turn a profit over the past thirteen years.

With Goldman Sachs still holding about 30M shares the last time I checked, they have a lot of veto power in accepting or rejecting such an offer and historically, have rejected many acquisition offers by other CDNs. Over the years Limelight had more than half a dozen legitimate offers to sell the company, including two offers from Level 3, at least two from Akamai and one from AT&T, for more than $12 a share, that I am aware of. Hopefully Goldman doesn’t make the same mistake this time around and gets a deal done so Limelight can get help in growing their business and making it profitable.

Updated June 16th: Limelight has issued a press release saying that their management,”has concluded that Tuition Build does not have the experience, credentials, financial resources, or capability to complete the proposed transaction, and that Tuition Build’s stated interest in acquiring Limelight Networks is not an actionable proposal. Accordingly, management believes current and prospective investors in Limelight Networks should disregard Tuition Build’s proposal.”

Disclaimer: I have never bought, sold or traded a single share of stock in any public company ever.

New Data Questions Netflix’s Assertion That ISPs Are At Fault For Poor Quality

In the Netflix versus ISPs peering dispute, there are a lot of opinions and debate around who’s at fault for letting some peering points degrade and who should be responsible for upgrading them. To date, many are having a hard time separating facts from opinions because Netflix and the ISPs haven’t released any concrete data to back up their claims. In most industries, if one company accused another of doing something wrong, it would be expected that the company making the claim would back up their position with detailed data that proves their point and leaves little doubt as to who’s responsible for the problem. Netflix has yet to do that.

Most seem to be giving Netflix a pass, with very few demanding real transparency into what’s taking place, or changed, that degraded Netflix performance back in September 2013. No company should try and force us to take their word for it, they should simply make the data public and let us decide on our own. Netflix says they are bringing transparency to the debate, but they are doing the opposite by using vague and high level terms with no definition. To date, Netflix has yet to set forth any details on how they want the current business models to change, how it should be regulated, what they consider “strong” net neutrality or even submitted a proposal to the FCC.

The best example of this is how Netflix’s player recently gave out messages saying that Verizon was at fault regarding quality issues, but then when challenged by Verizon to back up their claim, Netflix announced they would discontinue showing these messages on June 16th. Originally Netflix said these messages would be rolling out in a phased deployment on all networks, but in their blog post yesterday, they now say these messages were just a “test”. To me, it looks like Netflix simply created noise in the market, again with no data, and then when pressured by Verizon to prove their case, Netflix instead decided to stop sending the messages and now release any details. Why? If the problem lies within Verizon, Netflix should let us see the data that shows this and stand behind it. Why back down if they have the data to show where the problem is coming from?

This is just another example of many where all sides simply point the finger at each other and say it’s the other guys fault, but then provide zero details to back up their claims. However, that may change soon as Netflix will likely publish network and performance graphs around a peering event, taking place in DC on June 18th, to bolster their argument. At the same time, some ISPs are actively working to release some data to the market, like the internal chart below [Figure 2] that I received from a major U.S. broadband provider, which gives us some more visibility into what’s taking place inside an ISPs network.

Netflix’s accusation is that ISPs have purposely congested their peering points in order to specifically degrade the Netflix service. What Netflix has failed to be transparent about is that Netflix has always paid to deliver their traffic. CDNs like Akamai, Limelight and Level 3 successfully managed the majority of all of Netflix’s video and were responsible for Netflix customer performance. Each of these companies successfully delivered Netflix via all the same transit paths and business relationships equally available to Netflix today. When Netflix took over the routing controls for their video traffic with their own CDN Open Connect, customer performance began to suffer as highlighted in Netflix’s own data that they shared with the Washington Post. I added a red circle to the chart to show when the Netflix changes took place and the impact to customer performance by ISPs.

Figure 1.

chart1
While Netflix was able to convince smaller regional ISPs to voluntarily offer settlement free peering, most large ISPs maintain national/international infrastructures, which require peering policies and consistent business practices to ensure fair and equal treatment of traffic. For the providers Netflix did not qualify for peering, Netflix moved their traffic onto very specific Internet paths that were not capable of handling their massive load and caused the congestion that impacted customers (as highlighted in Figure 2 below). In other words, if Netflix receives free peering, ISP customers receive good performance and high rankings and blogging praise from Netflix. But if Netflix does not receive free peering, ISP customers do not receive good performance and get low rankings and shame from Netflix.

It was Netflix that specifically chose transit paths to those ISPs who refused to give it free peering that it knew (and measured) were not capable of handling an increase in load. In some cases I was told by ISPs that traffic levels increased by 500% in only a few months where normal Internet growth with these same peers was less than 20-30% across an entire year. These ISPs’ customers did not request traffic to be served from poorly performing paths. Netflix chose to create, and use, paths that they knew were congested, simply because they were cheaper than using paths that were less congested. While some may not like that decision, Netflix is running a business and like all businesses, cost is a factor in a lot of decisions. I’m fine with Netflix having to make tradeoffs between quality and cost, but it’s not true that 100% of every path going into Comcast was “congested”.

Some of the many other transit providers I have spoken with confirm this, saying that they could have handled incremental Netflix traffic into Comcast, but that it would have been more expensive than Cogent, which was Netflix’s primary transit provider at the time. Even Cogent would not deny they were the cheapest transit provider of all the ones Netflix was using, but as we’ve all learned, cheap does not guarantee quality. During this same time, Netflix was still using other third-party CDNs for some of their video delivery. These CDNs were delivering the same Netflix service at the same time, to the same locations and with good quality. That is why some customers said their Netflix video was working great, while others said it was buffering and it is also why if some customers used VPNs, their performance improved. Netflix had control over who to give good service to and who to degrade, as shown in this chart below, from a major U.S. broadband provider:

Figure 2: Major U.S. broadband provider

Red is Netflix Video Bitrate delivered via a 3rd Party CDN
Blue is Netflix Video Bitrate delivered via Netflix internal CDN

BCC6DD36-44AB-42A5-A192-0AC7D2BE1071

When Netflix delivered video through similar sized third Party CDNs, customers received a consistent HD video stream 24 hours a day and from the CDNs I have spoken to, none of them had any problems getting Netflix’s traffic to the ISPs. When Netflix sent the video stream through their own CDN using their used newly congested transit paths, prime time viewing based on these decisions had buffering and low quality video.

Amongst those in the industry, there is a widely used term “traffic manipulation” and is “one of the most clever and devious of all the [negotiation] tactics” as described in The Peering Playbook. As the playbook details, the problems this traffic manipulation strategy introduces are three-fold. It negatively impacts customers; the levels of Netflix traffic also impacts other services sharing the same path; and if the “traffic manipulation” tactic is successful by Netflix or any other large CDN provider, it will be repeated by others creating further instability on the Internet.

Netflix’s point of view is that the Internet has changed a lot since many of these paid interconnect deals were done ten years ago. Today only a few ISPs control the vast majority of the market in the U.S. and Netflix would like to see peering and interconnect business models change. While that’s a fine argument to make, Netflix has yet to deliver any proposal or suggest an alternative other than to say it should be free. Netflix only confuses the discussion by involving “net-neutrality” in the debate and opportunistically point fingers at specific ISPs like Verizon and Comcast. But, Netflix has always had all the same delivery options as every major CDN and video provider on the planet. Many of these CDNs and large content sources have large volumes of traffic as Netflix and able to deliver Netflix and other Internet services with high quality service for their customers. The transmission decisions that Netflix makes are just as suspect to what is impacting their customers’ performance. Putting all the fault on ISPs is not accurate as both sides share the blame in not being able to make this work.

I’ve also heard from some that Netflix has told them that they have self-limited their transit decisions to only ISPs without residential access customers. Most CDNs use ISPs like AT&T, Sprint, Centurylink, Verizon and Comcast as transit options to reach the entire Internet, including each other’s network. Akamai and Limelight for example are connected to every Tier 1 provider and most Tier 2’s to deliver their service. They do not impose these business limitations in order to ensure they deliver services with high quality, so why is Netflix? These are not “peering issues”, these are first mile network decisions that Netflix is 100% in control of.

By Netflix limiting themselves to only Cogent, Level 3 and smaller International ISPs, they could find themselves buying capacity that is just not available. “Just upgrade your peering links” is not always the answer due to Internet peering policies as well as concerns that after investing capital, Netflix will just move terabits of traffic again in a few months making the problem start all over. What if Comcast gave Cogent all the capacity it wanted and footed the bill for it, and then the next year, Netflix moved away from Cogent and used Tata instead? Now Comcast would be forced to have to give Tata all the capacity they wanted and this change could happen every year. In fact, over a 3-4 year period, Netflix moved some or all of their video traffic amongst multiple CDNs including Akamai, Limelight and Level 3 and in some cases, due to lower pricing, left one provider only to come back to them a year or two later.

Netflix dominates close to 70% of the long form streaming traffic which is 10x their nearest competitor.  This market dominance allows Netflix to use their massive traffic controls in ways to force or demand special free peering privileges from ISPs rather than continuing to include these market based delivery costs in their service as others do. These costs that Netflix is objecting to have always been a cost of doing business for large CDNs in the U.S. That’s why to date, no other large CDN like YouTube, Apple, Microsoft, Amazon, Akamai or Yahoo! has come out publicly and backed Netflix’s position. Some ISPs, like Google Fiber, have said they think interconnects should be free, but that’s not the CDN portion of Google’s business, which for years, has done some paid interconnect deals.

Netflix has always paid a portion of their traffic delivery cost just like all of Netflix competitors large and small. Netflix is unhappy that they are being held to the same Internet policies as every other player. With great power comes great responsibility, and if Netflix will be operating one of the largest CDNs in the world, they must start behaving like one of the largest CDNs of the world. If they think the current model is broken or feel that market dynamics have changed enough to where new models needs to be put in place, that’s a fair argument. But you can’t make that argument and expect any change when you don’t put forth any kind of proposal. Netflix says they want changes that are “fair” and rules that are “strong”, but those words don’t mean anything without details.

Netflix hasn’t been clear with their arguments. First it was really about transit, but now they are saying it’s about “terminating access monopolies,” broadband competition and such. Problem is that is a much different issue and they’re having a hard time making that case and tying it to why they must have this or that remedy to lower their own costs. If broadband competition is now their issue, then it clearly is unrelated to net neutrality or the Comcast and TWC merger since the companies don’t overlap. There are other ways to go about addressing broadband competition constructively without bad-mouthing ISPs and confusing the public and throwing out made-up regulatory remedies like Title II or strong net neutrality.

If you talk to the major transit providers, CDNs, ISPs and the companies tied up in this debate, many will detail what has been going on behind the scenes with traffic manipulation and only using the data that makes them look good. There is more to it than that, and it’s one of the main reasons why those involved won’t detail what’s really taking place, where the problem lies, what their business motivations are for some of the decisions they make and the impact these decisions have on their bottom line. Remember, Netflix locked in a fixed rate with Comcast, for more than five years, for nearly a third of their traffic, which gives them a clear advantage over any other OTT competitor. So lets not forget the positive impact these interconnect deals are having on Netflix’s bottom line. Cheaper costs, lower churn, better quality video and the longest length contract, which I have come across, in the industry.

If Netflix really believes broadband competition is an issue, why make enemies with the companies who you can partner with to address it? To me, it all seems like an irrational strategy, especially when some of the arguments Netflix makes, don’t align with what some transit providers, CDNs and data from within ISPs shows. If Netflix wants real transparency, then they need to come out and put their cards on the table and show us what they have. It’s easy for anyone to complain and blame the other guy, but just because you might not like your ISP, think your cable bill is too high or have some other reason not to like your ISP, that’s not a reason to give Netflix a free pass and not demand they give us the transparency that they themselves keep saying they want.

John Oliver’s Rant On Net Neutrality Hurts The Industry, Shows Lack Of Common Sense

While some want to suggest that TV personality John Oliver brought a lot of exposure to the topic of net neutrality by doing a segment about it on his show last Sunday, in reality, all he did was make the industry take two steps back. In addition to getting many of the details on net neutrality wrong [something the LA Times did a good piece on when they say, "if only he'd gotten the facts right"], asking people to focus their “indiscriminate rage” on the FCC simply lacks common sense.

All John did was get people to clog the FCC’s comment system, which means it’s now even harder for the FCC to find comments that are detailed or offer any kind of real feedback and suggestions. He’s done a disservice to the industry and to companies and consumers that want a change by asking “trolls” to bombard the FCC. I spent many painful hours going through a few thousand submissions and so many of them are completely off-topic, vulgar, racist and useless.

These are the types of comments that many, many people sent in and there are a LOT that are far worse than these, with language and comments I can’t even publish:

  • “the people running the fcc should just die”
  • “no one in the FCC is sexy”
  • “my cable should not be turned off because I didn’t pay my bill on time”
  • “smoke some drugs and maybe you’ll understand better”
  • “i hope that no more violence is ever shown on television again!”
  • “corporate America needs to die!”
  • “i don’t like big brother”
  • “this is how skynet started to take over the world”
  • “the U.S. has too much wealth”
  • “I’m an American born citizen”
  • “the President is great friends with the CEO of Comcast”
  • “torrent!”
  • “the US is on a downward trend to second-rate status”
  • “Estonia and the Czech Republic beat us at internets”
  • “i should not have to pay so much for my DVR”

Not surprisingly, there is a lot of confusion of what net neutrality is even about. So many comments talk to things that have nothing to do with net neutrality at all, and quite a few people say that net neutrally is not broken and the FCC does not need to fix anything. Some think that net neutrality already exists, doesn’t exist, already went away, is going to go away or that the FCC gets paid by cable companies.

John Oliver did nothing to educate consumers, didn’t get the facts right, and played on people’s emotions, rather than their intelligence. When you ask “trolls” to focus their “indiscriminate rage” on the FCC website, nothing good comes of that. The quality of comments the FCC gets should be the focus, the volume of comments received should come after that. Not the other way around, which is all John Oliver accomplished.