2017│10│23 – The 2017 Mobile Network Test in the United Kingdom
Download the report as PDF here
The 2017 Mobile Network Test in the United Kingdom
The fourth successive year, the consulting, engineering and testing company P3 communications GmbH and connect magazine have examined UK’s mobile networks’. How would the ongoing improvements of the LTE network and the rollout of enhancements like Voice over LTE affect the ranking of the four mobile operators in the UK? Or simply put: Which operator offers the best network for mobile voice and data?
Results in a nutshell
The 2017 P3 connect Mobile Benchmark in the United Kingdom has a clear winner with a very good EE, and a good Vodafone on rank two. In contrast, Three and O2 have lost some ground compared to our previous year’s benchmark.
Due to the carefully designed methodology, including drivetests and walktests and for the first time, an additional crowdsourced assessment of service availability (see page 10), P3‘s network benchmarks are highly objective, and have been widely accepted as authoritative. In this year, the drive tests covered 20 of the largest cities in the UK with more than 100,000 inhabitants. Additionally, we conducted walktests in 11 cities, eight of which have also been included in the drivetests. The cars also visited smaller towns and drove on trunk roads and motorways. The areas in which we tested caters for more than 17 million people, or roughly 27% of the UK population.
P3‘s rigorous and meticulous measurement included the use of up-to-date LTE Cat 9 as well as VoLTE-capable smartphones for the tests. We also constantly readjust the thresholds of our evaluation. With steps like these, we reflect the latest technical developments in the mobile networks and once more emphasise the scope of our benchmarking: How do the mobile networks perform at the edge of what is technically feasible – and to what extent do customers benefit from these capabilities? In order to provide valid answers to these questions, we have also used the most comprehensive mobile plans available from each operator.
Top ranking EE and second-placed Vodafone
The overall winner of this year‘s UK benchmark is EE with the grade “very good” and a clear lead in voice and data as well as a high degree of operational excellence. Vodafone ranks second at some distance in voice and data and the overall grade “good” (but a full 30 points in our new crowdsourcing assessment – see page 10).
Compared to the previous year, both top-ranking contenders show distinct score improvements, with EE achieving the most distinct gain. Three comes in third, showing a definite gap behind Vodafone‘s voice and data as well as to the operational excellence results but still achieving the grade “good”. As in 2016, O2 ranks last with the grade “satisfactory”. In terms of points, both Three and O2 have lost some ground compared to the previous year.
THE UK’s OPERATORS
Of the four mobile networks competing in the UK, EE and O2 are the largest players in terms of subscribers, followed closely by Vodafone, with the smaller Three attacking with aggressive tariffs.
With approximately 30 million customers, EE (formerly Everything Everywhere) is the biggest mobile network operator in the UK. Since January 2016, EE has been part of the British Telecom Group. EE started offering a 4G service in October 2012. The operator claims that its 4G coverage today reaches about 99 per cent of the UK population. The geographic 4G coverage currently is approximately 85 per cent, with an ambition to hit 95 per cent by 2020. EE operates its 4G network at 800 MHz, 1800 MHz and 2600 MHz. Additionally, it operates 2G at 1800 MHz and 3G at 2100 MHz which also reach a population coverage in the 98 to 99 per cent range.
EE operates a growing number of “LTE Advanced” network cells that support Category 9 (Cat 9) and thus faster speeds of up to 450 Mbps. Also, EE offers Voice over LTE (VoLTE) in parts of its 4G network. All plans come with 4G at no extra cost.
Vodafone UK is part of the Vodafone Group which is also headquartered in the UK. The Vodafone Group owns and operates networks in 21 countries. Vodafone UK launched 4G/LTE in 2013. With around 18 million subscribers, Vodafone is the third largest mobile network in the UK after EE and O2. In June 2012, Vodafone and O2 signed a deal to “pool” their network technologies, creating a single national grid of 18,500 transmitter sites. Both networks however announced they would continue to use their own independent spectrum. Vodafone currently operates 4G/LTE at 800 and 2600 MHz and has started to refarm also some of its 3G spectrum at 2100 MHz to 4G. Additionally, Vodafone offers 2G at 900 and 1800 MHz plus 3G at 900 and 2100 MHz. With “Carrier Aggregation”, Vodafone is upgrading its 4G network to “4G+”, currently offering up to 450 Mbps – as well as Voice over LTE (VoLTE) telephony.
Three UK is a subsidiary of Hutchison Whampoa and launched its mobile service in the UK in 2003. As a relatively young operator Three started as a 3G-only network supplemented by 2G via national roaming. In December 2013, Three began to roll out its 4G/LTE service and expanded it rapidly all over the UK. With about 9.2 million customers Three is the smallest mobile network operator in the UK but claims to carry over 40% of the nation‘s data traffic. Offering the cheapest price for 4G and unlimited data plans (excluding tethering) may well support this claim.
In addition to 1800 MHz, Three offers 4G also at 800 MHz as well as 3G on 2100 MHz. The company currently claims to cover 98 per cent of the UK‘s population with 3G and about 91 per cent of the poplulation with 4G. Ultimately, Three is aiming at 98 per cent UK population coverage with its 4G network. Three has also started to deploy Voice over LTE (VoLTE) in parts of its growing 4G network.
O2 claims to be the second largest mobile network operator in the UK with approximately 25 million customers. Formerly a subsidiary of British Telecom, O2 plc was purchased by the Spanish telecommunications company Telefónica in 2006. Today, the company also owns half of the mobile virtual network operator Tesco Mobile which operates on the O2 network in the UK. O2 started providing its 4G service in August 2013 and has expanded this service across the UK since. In September 2017, O2 claimed to cover over 97 per cent of the UK population with its 4G service, striving to meet a regulatory requirement of covering 98 per cent of the indoor population by the end of 2017.
O2 operates its 4G network mainly on 800 MHz with limited additional 1800 MHz coverage in London. Additionally, O2 provides 2G on 900 and 1800 MHz and 3G on 900 and 2100 MHz. Like the other UK operators, O2 has started to roll out Voice over LTE (VoLTE) in parts of its 4G network.
A CLOSE LOOK AT UK NETWORKS
All UK operators are working hard to expand their LTE networks’ coverage and performance. Recently, they also introduced VoLTE. How will these investments affect the results of our network test?
P3 communications GmbH, based in Aachen, Germany, is a world leader in mobile network testing. It is part of the P3 group, with over 3,000 employees worldwide and a turnover of more than €300 million. P3 is partnering with connect, the international telecommunications magazine connect, which has more than 20 years of editorial expertise and is one of the leading test authorities in Europe for telecommunications products and services.
Together, P3 and connect have been conducting the most important network benchmark test in Germany for 15 years, extending it to Austria and Switzerland in 2009. Starting in 2014, P3 has also been conducting benchmarks in the UK and Australia, expanding its public mobile network benchmarks to the Netherlands, Spain and Sweden in 2016.
In 2016 alone, P3 compiled more than 60,000 measurement hours in 65 countries across five continents, with its test vehicles covering more than 620,000 miles. As the de-facto industry standard, the P3 benchmarking methodology focuses on customer- perceived network quality – examining voice telephony that makes up 38.8 per cent of the result, data connectivity that contributes 58.2 per cent as well as operational excellence, currently accounting for three per cent of the total result. P3‘s network benchmarks are widely accepted as a completely objective authority.
EE and Vodafone on top positions with score improvements
After a tie of both contenders in 2016, this year‘s P3 connect Mobile Benchmark in the UK finds EE to be the clear winner and Vodafone ranking second. Both top-ranking contenders in the UK show distinct score improvements over our 2016 results.
“All operators took the challenge of the P3 connect Mobile Benchmark and have increased their LTE coverage. In 2018 over the top content services, technologies like carrier aggregation and voice over LTE as well as crowdsourcing-based use cases will become more important. This will make the results even more exciting.”
Voice services may become less important – however, customers expect reliable connections when talking on the phone. How do the UK networks fulfil these expectations?
On their tour through the UK, P3‘s four test cars visited 20 of the largest UK cities and many smaller towns as well as covering the connecting roads. Additionally, two walktest teams conducted tests in selected cities and towns. For the voice rating, each car and walktest team member carried Samsung Galaxy S7 smartphones that permanently called each other. The connected testing equipment registered success ratios, setup times and speech quality. In order to simulate normal smartphone usage, data transfers took place in the background of the test calls.
EE shows best voice performance, Vodafone almost on par in larger cities
EE and Vodafone share the best test results for voice services in the larger cities. Here, Vodafone scored even slightly higher than EE in the drivetest scenario. And O2 is ahead of Three in the voice tests conducted in larger cities. However, in smaller towns and on the roads, EE takes a clear lead over its competitors.
All UK operators have started to roll out Voice over LTE (VoLTE) in their networks. EE, Vodafone and O2 managed to distinctly reduce call setup times in the cities, which might be one of the effects of VoLTE.
In the Three network, we observed considerably longer call set up times in larger cities – with a gap of more than 1.5 seconds to the other three contenders. O2 is losing ground in terms of voice performance especially in the smaller towns and on the roads.
Voice Results At a Glance
EE delivers the best voice performance in the UK. In larger cities, Vodafone shows equally good results, but falls somewhat behind in smaller towns and on the roads. O2 is strong in voice in larger cities, but falls back in towns and on the roads. Three scores third in voice, but shows long call set up times.
The volume of transmitted data is steadily growing. So, all operators face the challenge to keep data rates and reaction times at a high level. Which UK operator manages to best meet the growing demand?
The volume of mobile data downloads and uploads is growing exponentially. While 4G/LTE currently is the best technology to cope with these increasing demands and all UK 4G networks realise a wide coverage of the population, the four operators pursue different rollout strategies. EE and Vodafone chase each other with continually growing data rates that currently go up to 450 Mbps, based on the so-called carrier aggregation (the combination of multiple carrier frequencies). In contrast, O2 and Three stick with a solid 100 Mbps and mainly focus on enlarging their 4G footprint. P3‘s testing takes both aspects into account – the benchmarking of web-page downloads as well as file downloads and uploads rewards fast throughputs. At the same time, it assesses the networks‘ availability and stability by examining success ratios. In order to assess typical performance as well as peak speeds, we determined the minimum data rates that are available in 90 per cent of the cases plus the peak data rates that would be surpassed in 10 per cent of the cases.
P3‘s approach for YouTube testing recognises that this popular video service uses adaptive bit rates. This method strives for a better user experience, subordinating pixel resolution to stable playback. As a consequence, besides success ratios, start times and the absence of interruptions, we have added the average video resolution as another important performance indicator.
EE is data leader in larger cities
In the drivetests and walktests that P3 conducted in the large cities of the UK, EE takes a clear lead in the data category. With also strong results in the larger cities, Vodafone closely follows in these areas.
EE especially scores high in the disciplines of web browsing as well as file downloads and file uploads. In the YouTube tests, EE and Vodafone show a strong performance and are clearly ahead of Three and O2. EE showed the best YouTube performance in the drivetest scenarios, while Vodafone shows the strongest YouTube performance in the walktest scenarios.
Three ranking second in smaller towns
In the towns outside metropolitan areas, EE is also leading the field. However, similar to the voice results, Three performs somewhat stronger in smaller towns than the overall second-ranking Vodafone. This is especially due to Three‘s strong results for file downloads and web browsing in towns. In the YouTube discipline in smaller towns, the results of Three and Vodafone are not far apart.
EE ahead on major roads, Vodafone closely behind
On the connecting roads, EE again takes a clear lead, providing fast data rates and achieving convincing success ratios. Vodafone and Three also show strong results in this category, while O2 lags a little behind. Nonetheless, with the success ratios in all considered categories scoring well over 90 per cent even on the relatively demanding connecting roads, all four mobile network operators provide viable performance even in the more rural areas.
Data results at a glance
Again, EE is the overall winner in the data categories. Vodafone follows at a close distance, with a strong performance especially in the walktest scenarios. Three ranks third in the total data category, but is able to score ahead of the overall second-ranking Vodafone in smaller towns. O2 ranks last in all data test scenarios. But all four UK networks achieve relatively high success ratios even in demanding areas like the smaller towns and connecting roads.
Traditionally, P3 and connect take a closer look at the capital to see how the operators cover this busy metropolis.
Being a major business hub and by far the most densely populated area in the UK, London is an especially demanding terrain for deploying and maintaining a mobile network. This is why we regularly take a closer look to see how coverage in the capital compares to the rest of the country.
As the tests in London cannot obtain the points that could be gathered in smaller towns or on connecting roads, the achievable maximum is 600 points. We have adapted the achievable crowd score points accordingly which results in a possible maximum of 18 points.
Vodafone one point ahead in voice
In the drivetests and walktests measuring voice services in London, Vodafone takes a narrow lead over EE. But clearly ahead in the data discipline, EE defends the overall first rank also here.
O2 ahead of Three in London
Also, in the total results for London, O2 overtakes Three with a noticeable advance of 13 points. This advance is mostly obtained in the voice discipline. Regarding data performance, Three is still ahead of O2. In the proportionally matched crowd score, only Three loses one of the possible maximum of 18 points.
London results at a glance
The overall winner in the capital is EE, with Vodafone taking a lead in the voice discipline. In London, O2 is somewhat ahead of Three due to stronger voice results. However, when taking the data category into consideration, Three’s score remains ahead of O2.
CASE STUDY: UK’s LARGEST CITIES
For the inhabitants of other large cities in the UK, it is interesting to see how the different operators perform in their areas. Therefore, we performed additional analyses for the six largest UK cities behind London behind London, as well as Belfast to account for the capital of Northern Ireland.
As interesting as the focus on the densely populated London area may be, for obvious reasons the inhabitants of other large UK cities and the capitals of the other countries besides England have their own perspective on network performance and availability. In an attempt to also provide some insights for these points of view, we have additionally analysed the performances of the four operators in seven large UK cities – specifically Belfast, Birmingham, Bristol, Glasgow, Liverpool, Manchester and Sheffield. We would like to present the results as a case study. The values represented in the chart below are part of the overall UK score but do not earn individual grades. They may, however, help local customers to better chose their ideal network. We have not included the crowd score in this assessment, as the crowdsourced data in the single cities would not measure up to the required statistical relevance.
EE still mostly leading, Vodafone overtaking in Glasgow and Liverpool
In the cities of Birmingham, Bristol and Manchester, the overall picture is not much different to the nationwide results. Here, EE takes the lead, and the subsequent ranking is identical to our total score for the UK. In Belfast, EE also leads before Vodafone.
However, here O2 scores stronger than Three and reaches the third rank thanks to strong voice results. And in Sheffield, Three overtakes Vodafone by the fraction of a per cent and thus ranks second.
In Glasgow and Liverpool, Vodafone manages to take the lead over EE. In Liverpool, the gap is quite narrow, while it is a little more pronounced in Glasgow. In both cities, Vodafone takes the win due to strong data results. Looking only at the voice discipline, EE still is ahead in Glasgow (with a strong O2 as a third top voice candidate) and scores on par with Vodafone in Liverpool.
Three very strong in data in some cities
Looking for local champions, we can see that Three scored remarkably well in the data discipline in Belfast, Bristol, Glasgow and Sheffield. In Sheffield, Three manages to score slightly ahead of Vodafone, ranking second in the overall evaluation. But even in those cities where the competitors show remarkable strength in specific categories, EE still scores very high and – aside from the exceptions mentioned above – can defend its overall top position.
Beginning with this year’s P3 connect Mobile Benchmark in the UK, we start to complement our measurements with an additional, crowdsourced assessment of service availability. In this discipline of our 2017 benchmark, Vodafone and O2 are ahead, achieving the full score of 30 points.
An additional important aspect of mobile service quality – above performance and measured values – is the actual availability of the mobile networks to the customers. Obviously, even the best performing network is only of limited benefit to its users, if it is frequently impaired by outages or disruptions.
Therefore, P3 has been looking into additional methods for the quantitative determination of network availability, collecting data via crowdsourcing. This method must however not be confused with the drivetests and walktests described on the previous pages. We are convinced that crowdsourcing can significantly enhance the aspects of benchmarking: Drivetesting and walktesting has obvious advantages as a very controlled environment, while crowdsourcing accelerates when looking for longer time periods or geography beyond defined test routes. So, when it comes to diagnosing the sheer availability of the respective mobile networks, a crowdsourcing approach can provide additional insights. Therefore, P3 has developed an app-based crowdsourcing mechanism in order to assess how a large number of mobile customers experience the availability of their mobile network. We call this aspect “operational excellence”.
The UK mobile network test at hand is the first occasion where we expand our scoring scheme with the results of this crowdsourced investigation. As we have considered the results from July, August and September 2017 and each month is represented by a maximum of ten achievable points, this time the so called “crowdscore” contributes up to 30 points to the total result.
The detailed methodology of our analysis and the calculation of the resulting points is described on page 13 of this report. As a consequence of this addition, the P3 connect Mobile Benchmark is the only mobile network test which combines both aspects (drivetesting and walktesting as well as crowdsourcing) and thus provides the most comprehensive view on network performance.
Crowdsourcing shows mostly stable UK networks
The in-depth analysis of our crowdsourcing data gathered in the three months preceding and including our measurement campaign in the UK, shows that the UK networks are all in all very stable and reliable. For Vodafone and O2 we did not observe any degradations in the observation period.
In the relevant months, EE only suffered a one hour service degradation in the afternoon of August 21st. According to our scoring principle, this one-hour degradations costs one point – so EE scored a total of 29 out of 30 possible crowd score points.
In the Three network, we determined an incident that happened during the afternoon and evening of September 7th (from 5pm to 9pm), adding up to a total service degradation of five hours on this day. According to our crowd scoring scheme, that costs one point for the affected day plus another point for the time period of up to six hours. So, Three achieves a crowd score of 28 out of 30.
While these reductions of service availability were certainly annoying to the customers of the affected networks, they only have a limited impact to the overall results and did not have the capacity to change the actual ranking in the UK. However, for next year, we plan to consider a larger number of months and consequently to increase the share that our crowd score has in the total result.
Operational excellence at a glance
Considering July, August and September of 2017, we could only determine a one-hour degradation in the EE network and a five-hour incident in the Three network. For the networks of Vodafone and O2, we did not observe any relevant incidents. As we considered a three month period this time, which contributes 30 to the total maximum of 1000 achievable points, EE scores 29 out of 30 points and Three reaches 28 out of 30. Vodafone and O2 receive the full amount of 30 crowd score points.
The P3 connect Mobile Benchmark took place throughout September 2017. All samples were collected during the day, between 8am and 10pm. The network tests covered 20 large cities with more than 100,000 inhabitants. Measurements were also taken in smaller towns as well as on trunk roads and motorways. The combination of test areas had been selected to provide a significant series of test results covering the UK population in England, Scotland, Wales and Northern Ireland. The areas chosen for the 2017 test account for more than 17 million people, or approximately 27% of the total population of the UK. P3 conducted the tests with four drivetest cars, equipped with arrays of Samsung Galaxy S7 Cat 9 smartphones as well as a mixed allocation of Samsung Galaxy S7 and Sony Xperia XZ Cat 9 smartphones for simultaneous measurement of voice and data services. Additionally, two teams conducted the walktests, also measuring voice and data performance.
Two smartphones per operator in each car plus four smartphones per operator in the walktests were used for voice evaluation. They were setting up test calls between each other – from car to car and from each walking staff member to a stationary counterpart. The audio quality was evaluated based on the HD-voice capable and ITU standardised so-called POLQA wideband algorithm. All UK operators offer 4G capable subscriptions. All of the smartphones in the voice tests were set to 4G preferred mode. This reflects the common behaviour of customers. When a 4G connection, but no VoLTE was available, this would force the smartphones to switch (“fall back”) to 2G or 3G for the voice calls (so called “circuitswitched fall back” or CSFB). In 4G networks with VoLTE support, the phones would prefer this voice mode. In order to further reflect typical smartphone use scenarios during the voice tests, background data traffic was generated in a controlled way through random injection of small amounts of HTTP traffic. The voice test scores account for 38.8% of the total benchmark results.
Data performance was measured using one smartphone per operator per car. Two of the drivetest cars were equipped with four Samsung Galaxy S7 each while the other two were carrying four Sony Xperia XZ each. This setup was chosen in order to respect the variable data performance of different smartphones in different networks. For the data walktests, each of the two teams carried one Galaxy S7 per operator. In total, the drivetest cars carried 16 devices for the data tests and the walktest teams carried eight devices. For all data test devices, the radio access technology was set to LTE preferred mode.
The web tests accessed web pages according to the widely recognized Alexa ranking. In addition, the static “Kepler” test web page as specified by ETSI (European Telecommunications Standards Institute) was used. In order to test the data service performance, files of 3MB and 1MB for download and upload respectively were transferred from or to a test server located on the Internet. In addition, the peak data performance was tested in uplink and downlink directions by assessing the amount of data that was transferred within a 7 seconds time period. Another discipline was the playback of You- Tube videos. It took into account that YouTube dynamically adapts the video resolution to the available bandwidth. So, in addition to success ratios, start times and playouts without interruptions, YouTube measurements also determined the average video resolution. All tests were conducted with the best-performing mobile plan available from each operator and in a full drive and walktest mode. Data scores account for 58.2 per cent of the total results.
Routes and samples
The test routes are shown on page 1 of this report. In the big cities and smaller towns indicated, the cars had to follow predefined routes. Altogether, the four test cars covered more than 4700 miles, of which approximately 2750 miles led through the big cities, while 1950 miles were covered in smaller towns and on connecting roads.
Performance indicators and rating
The score weighting reflects both the geographical distribution of the UK population and the ranking of usage scenarios. Therefore, 582 of the total of 1000 maximum points were assigned to the cities – 233 maximum points refer to the voice results and 349 maximum points reflect the data results. For the towns and the roads, a maximum of 194 points each is available. In both categories, the possible maximum is 78 points in the voice, and 116 points in the data category. The table on page 2 of this report shows the percentage of maximum points that each operator has achieved in each discipline.
Crowdsourcing operational excellence
The remaining 30 points are awarded for operational excellence. For this survey, P3 uses a crowdsourcing method. To acquire these data, P3 considers connectivity reports that are gathered by background diagnosis processes included in a number of popular smartphone apps. While the customer uses one of these apps, a diagnosis report is generated daily and is evaluated per hour. As such reports only contain information about the current network availability, it generates just a small number of bytes per message and does not include any personal user data.
In order to differentiate network glitches from normal variations in network coverage, we apply a precise definition of “service degradation”: A degradation is an event where data connectivity is impacted by a number of cases that significantly exceeds the expectation level.
To judge whether an hour of interest is an hour with degraded service, the algorithm looks at a sliding window of 168 hours before the hour of interest. This ensures that we only consider actual network service degradations in contrast to a simple loss of network coverage of the respective smartphone due to prolonged indoor stays or similar reasons.
In order to ensure the statistical relevance of this approach, a valid assessment month must fulfil clearly designated prerequisites: A valid assessment hour consists of a predefined number of samples per hour and per operator. The exact number depends on factors like market size and number of operators. A valid assessment month must be comprised of at least 90 per cent of valid assessment hours (again per month and per operator).
Sophisticated scoring model for operational excellence
The relevant KPIs are then based on the number of days when degradations occurred as well as the total count of hours affected by service degradations. In the scoring model that we plan to apply to the gathered crowdsourcing data, 60 per cent of the available points (in this case a maximum of 18) will consider the number of days affected by service degradations – thus representing the larger-scale network availability. An additional 40 per cent of the total score (here 12 points) is derived from the total count of hours affected by degradations, thus representing a finer-grained measurement of operational excellence.
Each considered month is then represented by a maximum of ten achievable points. The maximum of six points (60 per cent) for the number of affected days is diminished by one point for each day affected by a service degradation. One affected day will cost one point and so on until six affected days out of a month will reduce this part of a score to zero.
The remaining four points are awarded based on the total number of hours affected by degradations. Here, we apply increments of six hours: Six hours with degradations will cost one point, twelve hours will cost two points and so on, until a total number of 24 affected hours will lead to zero points in this part of the score.
EE is the clear winner of this year’s mobile benchmark, followed at some distance by a “good” Vodafone and a “good” Three. O2 ranks last.
This year, the result is clear: EE is the overall winner of the P3 connect Mobile Benchmark in the UK 2017, taking a lead both in the voice and data categories and also showing a high level of operational excellence. The winner performs especially strong in all data categories as well as in the voice tests conducted in the smaller towns and on the connecting roads. Compared to the previous year, EE also shows the biggest score improvements both in the voice and data categories.
But, also Vodafone managed to improve on its 2016 results. In the large cities, Vodafone and EE are on par regarding voice services. When looking at the capital London, Vodafone even takes a lead over EE in the voice category. Nationwide, also in some disciplines like YouTube playback in the walktest scenarios, Vodafone manages to score slightly ahead of EE.
Three and O2 both lose some ground over their 2016 scores. Overall, Three again reaches the third rank. However, particularly in smaller towns, Three achieves somewhat better scores than the overall second-ranking Vodafone. The same is true for the voice tests performed on connecting roads.
EE wins this benchmark with excellent voice and data performances, and deserves the overall grade “very good”. Scoring 53 points ahead of the second-ranking Vodafone, EE’s lead is distinct. The UK’s largest operator achieves convincing results in all categories including the newly tested operational excellence.
Vodafone clearly improved on its 2016 score, but has to give leeway to the overall winner EE. Especially in the large cities, Vodafone’s performance is on par with EE. In London, Vodafone takes a narrow lead over EE in the voice category. This is also true in some nationwide disciplines like YouTube playback in the walktests.
Three performs strongly in the voice tests conducted in smaller towns and on connecting roads as well as in the data category in towns. But in comparison to the scores achieved in our 2016 benchmark, this operator loses some ground. However, all in all Three offers reliable connections with a suitable performance.
In comparison to our 2016 UK benchmark, O2 falls a little behind. In some categories like the voice tests conducted in the larger cities, O2 still manages to perform ahead of the overall third-ranking competitor Three. Also, O2 collected all available points in our newly introduced operational excellence score.
Last year’s report can be downloaded here