What consumers care about
Second, the pandemic concentrated everyone’s focus on application performance. Consumers simply weren’t concerned about their headline download speed – they cared about whether they could join a Teams meeting without the video stream glitching; they cared about whether their children could attend online lessons; they cared about whether they could unwind in the evening by watching an Ultra HD movie on Disney+. Application performance was – and still is – king.
For SamKnows, measuring real-world application performance has been its mission for the past decade or more. “The whole industry has been built around speed, and only recently moved to looking at latency when running a speed test,” said Alex Salter.
Most speed tests ping a test server and “infer lots of things around performance,” said Salter, but “if you want to know how well Netflix is performing, you need to test Netflix – and not just send a ping to Netflix; you need to see how the Netflix CDN works.”
Unlike any of its rivals, SamKnows devises specific tests for each application or game that it tests. It doesn’t rely on guesswork.
“I think that consumers actually have become way more focused on application performance, and the industry is catching up,” he added. “Certainly, from our point of view, the majority of insights that we’re giving to people now are around application performance. Speed is less interesting to consumers.”
Apps such as Disney+ are critical to users
Yet, currently, there’s very little ISP marketing around specific application performance, even though SamKnows’ research and work with regulators worldwide often reports significant differences in such performance from ISP to ISP. Alex Salter thinks providers are missing a trick by not demonstrating to customers that they can deliver industry- leading performance in the apps that matter most to them.
“If I’m a gamer, I don’t play every game,” he said. “If I’m a streamer, I don’t use every single streaming platform. What I really want my ISP to perform well for are the applications that I care about. So you might have someone that uses Microsoft Teams and they might like League of Legends and they might use Amazon Prime – those are the applications that they’re going to care about. We have tests for all of these applications; but actually when I want my ISP to communicate with me, I want them to talk about the applications that matter to me.”