Android Kit Kat a Marshmallow, Has Thus Evolved Android Performance in Two Years

From Xataka Android we have seen how Google with each Update Android Announces improvements in performance, quantifying the functions where more difference there is with its previous version but without giving a general overview.

For this reason we have decided to make a proof of general use and the benchmarks usually we go to Android handsets in our analyses and compare on the same device, Nexus 5, the results in the latest version of Kit Kat, the latest in Lollipop and Marshmallow. Be noted that improvement of performance advertising Google? You anticipate that you will be surprised.

Methodology and testing

Before you begin to show you additional information and data, tables and graphs wanted to comment from where and how we have decided to make the measurements for those who think there is here enclosed cat.

Each measurement has been carried out by the mobile charged to 100% and unplugged the charger to an average brightness level (measured 200 lux, not of slipper) and allowing a reasonable time of 5 minutes between tests to prevent the heating of the chip and the throttling appearance between the measurements. Once passed the test, it reloads the terminal and switches off the light to follow with the next pass of the race or the next test.

On every last test we have done three measurements and we have used the average value of the three as the final value of the test, thus minimizing measurements out of place. All tests except for the battery life have been measured three times.

The used terminal has been a Nexus 5, 16 GB model, which have flashed with the various official versions of Android, set up the Gmail account, installed benchmarks and passed the tests.

Cleared up once all the interesting thing, will the results, already told you that in some sections they are, more than curious, surprising.

Results

Here have “tests” of the crime to discuss thoroughly the same in the next section compares all data.

First then you have a Summary table each version of Android, and for not making an endless post, you can see the screenshots and the values for each measurement by pressing the buttons show full results.

ANDROID 4.4.4

Results4.4.4 5 Android nexus

Quadrant 8.678
EPIC Citadel 51,3
PCMark Work Performance 3.953

Battery 3h41m

Antutu 33.629
3DMark Ice Storm Unlimited 15.133
Vellamo Chrome Browser 3.226
Metal 1.410
Multicore 1.628

See complete gallery» Benchmarks 4.4.4 5 Android nexus (37 photos)

Quadrant (4.4.4)

8.678

Final 8574 / 8677 / 8784
CPU 19741
(20013 / 19717 / 19495)
Memory 14505
(13956 / 14532 / 15029)
I/O 6588
(6479 / 6441 / 6844)
2D 385
(325 / 417 / 413)
3D 2204
(2198 / 2276 / 2137)

EPIC Citadel (4.4.4)

51.3 fps

Ultra High Quality
100% distance
52.1 fps
51 fps
50.8 fps

PCMark (4.4.4)

3.953

Work Performance (3862 / 4008 / 3988)
Web Browsing 3935
(3890 / 4076 / 3840)
Video Playback 4.127
(4119 / 4093 / 4170)
Writing 3.377
(3196 / 3423 / 3511)
Photo editing 4.456
(4345 / 4521 / 4501)

PCMark Battery (4.4.4)

3h42m

Work Performance 3.855
Web Browsing 3.567
Video Playback 4.168
Writing 3.201
Photo editing 4.638

Antutu (4.4.4)

33.629

Final (29661 / 34219 / 37006)
Multitask 4207
(3566 / 4358 / 4697)
Runtime 1905
(1565 / 2111 / 2039)
CPU integer 2813
(2256 / 2972 / 3210)
CPU float 2691
(2245 / 2617 / 2984)
Single CPU int 2348
(1801 / 2662 / 2580)
Single CPU float 2083
(1614 / 2318 / 2318)
RAM Operation 1169
(1054 / 1050 / 1404)
RAM Speed 1582
(1289 / 1379 / 2079)
2D Graphics 1640
(1638 / 1641 / 1642)
3D Graphics 11.054
(10657 / 10788 / 11719)
Storage I/O 1588
(1376 / 1683 / 1704)
Database I/O 623
(600 / 640 / 630)

3DMark (4.4.4)

15.133

Ice Storm Unlimited (15714 / 13093 / 16594)
Graphics Score 16.057
(17491 / 13093 / 17588)
Physics Score 11.219
(14069 / 8124 / 11466)
Graphics Test 1 90,4
(91 / 89,2 / 91)
Graphics Test 2 62,5
(65,3 / 56,2 / 66)
Physics Test 35,6
(44,7 / 25,8 / 36,3)

Vellamo

Android 4.4.4

Chrome Browser 3.226
(2921 / 3363 / 3394)
Metal 1.410
(1425 / 1396 / 1410)
Multicore 1.628
(1582 / 1604 / 1699)

ANDROID 5.1.1

Results5.1.1 5 Android nexus

Quadrant 12.079
EPIC Citadel 49
PCMark Work Performance 4.780

Battery 4h40m

Antutu 35.214
3DMark Ice Storm Unlimited 17.056
Vellamo Chrome Browser 2.982
Metal 1.199
Multicore 1.588

See complete gallery» Benchmarks 5.1.1 5 Android nexus (43 photos)

Quadrant (5.1.1)

12.079

Final 12650 / 11686 / 11900
CPU 38.190
(39890 / 36819 / 37861)
Memory 14162
(14902 / 13172 / 14413)
I/O 5.541
(5946 / 5846 / 4832)
2D 339
(330 / 330 / 357)
3D 2160
(2182 / 2262 / 2035)

EPIC Citadel (5.1.1)

49 fps

Ultra High Quality
100% distance
49.7 fps
50.1 fps
47.2 fps

PCMark (5.1.1)

4.780

Work Performance (4304 / 4467 / 4469)
Web Browsing 4679
(4397 / 4809 / 4832)
Video Playback 3.280
(3197 / 3345 / 3297)
Writing 4.861
(4830 / 4878 / 4874)
Photo editing 5.084
(5041 / 5076 / 5136)

PCMark Battery (5.1.1)

4h40m

Work Performance 4.355
Web Browsing 4.536
Video Playback 3.436
Writing 4.579
Photo editing 5.041

Antutu (5.1.1)

35.214

Final (33049 / 36926 / 35666)
Multitask 3.951
(3649/ 4387/ 3818)
Runtime 3806
(3632/ 3887/ 3898)
CPU integer 3.109
(2699/ 3501/ 3126)
CPU float 2.504
(2237/ 2859/ 2417)
Single CPU int 2.454
(2210/ 2578 / 2575)
Single CPU float 2.220
(2019 / 2324 / 2317)
RAM Operation 1.052
(1041/ 1060/ 1056)
RAM Speed 1.400
(1313/ 1386 / 1502)
2D Graphics 1639
(1638/1642/1637)
3D Graphics 10.799
(10403/11003/10992)
Storage I/O 1. 623br >(1553 / 1649 / 1668)
Database I/O 655
(655/650/660)

3DMark (5.1.1)

17.056

Ice Storm Unlimited (15652/ 17865 / 17651)
Graphics Score 16.057
(16930 / 17862 / 17830)
Physics Score 17.286
(12381 / 17877 / 17053)
Graphics Test 1 93
(92,1 / 93,3 / 93,6)
Graphics Test 2 64,6
(61,3 / 66,5 / 66,2)
Physics Test 50
(39,3 / 56,8 / 54,1)

Vellamo

Android 5.1.1

Chrome Browser 2.982
(2952 / 3181 / 2813)
Metal 1.199
(1150 / 1153 / 1294)
Multicore 1.588
(1583 / 1596 / 1585)

6.0 ANDROID (DP3)

ResultsNexus 5 6.0 Android

Quadrant 12.007
EPIC Citadel 48,4
PCMark Work Performance 4.575

Battery 4h35m

Antutu 23.134 * (test unfinished 3D)
3DMark Ice Storm Unlimited 15.711
Vellamo Chrome Browser 2.813
Metal 1.159
Multicore 1.611

Quadrant (6.0 DP3)

12.007

Final 12956 / 11147 / 11919
CPU 38.298
(42215 / 33923 / 38756)
Memory 13.653
(14354 / 13956 / 12650)
I/O 5.591
(5754 / 5564 / 5455)
2D 268
(327 / 154 / 324)
3D 2226
(2132 / 2137 / 2410)

EPIC Citadel (6.0 DP3)

48.4 fps

Ultra High Quality
100% distance
47.5 fps
48 fps
49.7 fps

PCMark (6.0 DP3)

4.575

Work Performance (4506 / 4482 / 4738)
Web Browsing 4.853
(4893 / 4625 / 5042)
Video Playback 3.575
(3568 / 3456 / 3701)
Writing 4.726
(4399 / 4840 / 4939)
Photo editing 5.352
(5370 / 5216 / 5469)

PCMark Battery (6.0 DP3)

4h35m

Work Performance 4.325
Web Browsing 4.506
Video Playback 3.751
Writing 4.026
Photo editing 5.141

Antutu (6.0 DP3)

23.134 *

Final (22072 / 23738 / 23593)
Multitask 2492
(3489 / 3653 / 3338)
Runtime 3616
(3193 / 3876 / 3778)
CPU integer 2775
(2606 / 2741 / 2977)
CPU float 2444
(2584 / 2268 / 2480)
Single CPU int 2164
(1803 / 2440 / 2250)
Single CPU float 1901
(1636 / 2031 / 2035)
RAM Operation 1053
(1048 / 1059 / 1052)
RAM Speed 1630
(1702 / 1616 / 1573)
2D Graphics 1638
(1637 / 1639 / 1639)
3D Graphics 0*
(0 / 0 / 0)
Storage I/O 1757
(1714 / 1750 / 1806)
Database I/O 663
(660 / 665 / 665)

3DMark (6.0 DP3)

15.711

Ice Storm Unlimited (14587 / 16606 / 15942)
Graphics Score 17.479
(17241 / 18062 / 17134)
Physics Score 11.750
(9479 / 12953 / 12820)
Graphics Test 1 90,8
(90,5 / 92,9 / 89,1)
Graphics Test 2 65,3
(64 / 68 / 64)
Physics Test 37,3
(30,1 / 41,1 / 40,7)

Vellamo

6.0 Android DP3

Chrome Browser 2.813
(2746 / 2789 / 2906)
Metal 1.159
(1161 / 1155 / 1163)
Multicore 1.611
(1600 / 1719 / 1514)

Is it better for performance? Clearly not

Here we pass to comment in detail the improvement of performance or not According to tests and various paragraphs hardware. The comparison will be mainly with Android Lollipop, i.e., the predecessor version, although we will leave some general notes from KitKat with which, in a general way, you notice more difference from these newer Android.

Results
Nexus 5Android 4.4.4Android 5.1.16.0 Android DP3

Quadrant 8.678 12.079 12.007
EPIC Citadel 51,3 49 48,4
PCMark Work Performance 3.953

Battery 3h41m

Work Performance 4.780

Battery 4h40m

Work Performance 4.575

Battery 4h35mm

Antutu 33.629 35.214 23.134 *
3DMark Ice Storm Unlimited 15.133 Ice Storm Unlimited 17.056 Ice Storm Unlimited 15.711
Vellamo Chrome Browser 3.226
Metal 1.410
Multicore 1.628
Chrome Browser 2.982
Metal 1.199
Multicore 1.588
Chrome Browser 2.813
Metal 1.159
Multicore 1.611

First of all, we want to explain that asterisk of Antutu by which you are asking:

We simply let evidence of an error in paragraph 3D of the benchmark by which the results of this test are not copied and 0 is reported as a result, hence the low score.

Surely Antutu upgrade version when you get Android 6.0 final although seen 3D on tests like 3DMark performance are committed to a small Lollipop performance drop in this section.

We wanted to leave a record of Kitkat (4.4.4) as a stable platform and more than purified and polished over the years has been joining us (announced in October 2013) but the big battle we have here facing Android Lolipop 5.1.1 that will be what we use as performance of reference, read 100%.

The percentages They aim to shed some light front so figure and so we will see in the following table to left and right of the column will be the improvement (if greater than 100%) or not (if it is less than 100%) of KitKat vs Lollipop and Marshmallow Lollipop vs.

Results
Nexus 5Android 4.4.4Android 5.1.16.0 Android DP3

Quadrant 71,84% 12.079 99.4%
EPIC Citadel 104.6% 49 fps 98,57%
PCMark 82,69%
78,92%
Work Perf 4.780

Battery 4h40m

95,71%
98,21%
Antutu 95.24% 35.214 65,69% *
(would be around 96%)
3DMark 88,72% Ice Storm Unlimited
17.056
92,11%
Vellamo 108,18%
117,59%
102,51%
Chrome Browser 2.982
Metal 1.199
Multicore 1,588
94,33%
96,66%
101,44%

As you can see in the previous comparison table CANNOT be said that there is improvement of performance General, perhaps in certain sections of some benchmarks, but infinitesimal improvement.

If you take a look at the full results, it seems that Android 6.0 shows a performance enhancement on multi-core management as we see in Vellamo, reflected in the previous graph. However, if we destem one of most comprehensive testing, Antutu, We realize that the paragraph multitasking as well as performance that produces each core is behind the results obtained in Lollipop.

The rest of tests shows a clear positioning behind Lollipop, although comparable in many of them, and there is even some evidence that the old Android KitKat gives them a review of new versions. Vellamo It is a test that uses real-world scenarios of testing, i.e., open applications as Chrome and performs Web, navigation, loading simulating a natural use and here it seems that Google still has sections of Polish.

Lollipop took a big leap forward in performance and now plays explore new features

If you look at paragraph 3D graph we see that Android 6.0 still something to Polish missing since a more demanding of this section tests, 3DMark, It has significantly less than Android 5.1.1 performance. It should also be mentioned that the performance of the graphics engine Unreal, used by EPIC Citadel, continues to operate better in KitKat to Lollipop or Marshmallow. Being the result of this last very even though behind Lollipop.

We want to put on record that one of the most notable performance improvements in Android occurred in Lollipop to impose as standard machine javascript ART and in the majority of test will be noted. This performance leap is not to get a Marshmallow.

With Lollipop came also the 64-bit support, but to check the performance improvement you need a 64-bit CPU and remember that Nexus 5 rode a Snapdragon 800, powerful quad – core, but with 32-bit architecture. This performance enhancement can reach 15-20% if you have a chip’s 64-bit before flowing in Kitkat and we give way to a subsequent Android optimized for 64-bit version.

Android 6.0 improves the autonomy at rest and achieves results comparable to Lollipop using the mobile

Theme autonomy, Let’s take a look at the results from PCMark, as you can see the hard work already made the jump to Lollipop. With this new version we’ve noticed a small drop of 5 minutes on screen but not mentioned so far is that the great improvement of Android 6.0 in the section of the battery standby and is that Nexus 5 has a negligible consumption at rest compared even with Lollipop.

This improvement comes from the hand of a management system that have been baptized as Android Doze: in two days on standby (without SIM, but with Wi-Fi and synchronization Gmail) Nexus 5 lost only 9% of battery compared to 24% of Android 5.1.1.

Another treat is the time of boot and shutdown of 6.0 Android against Android 5.1.1. As we discussed in our methodology we have conducted three measurements and then we leave the table:

Results
Nexus 5Android 5.1.16.0 Android DP3

Time off 13.5 seconds
(13,87 / 14,43 / 13,21)
8.2 seconds
(18,59 / 3,54 / 2,49)
Boot time 37.7 seconds
(42,02 / 36,75 / 34,35)
35,69 seconds
(44,27 / 32,73 / 30,07)
Available RAM
after start
1.204 MB (64%) 1,212 MB (64%)

As you can see in the graphic results are very even, but perhaps if we want to mention that shutdown, as we noted at the time of use it is more instant Android 6.0 than on Lollipop. Moreover, we see that they are very similar results.

Android news-laden 6.0, does not render more

View tests in general and once explores outcomes we realize that Android 6.0 will not go down in history as one of the Android versions with greatest increase in performance, given that performance is in the best of cases even to Lollipop.

Where Yes will deliver the knockout blow on the table is several points:

  • Improvement of autonomy face to the end user due to the lower consumption at rest via Android Doze.
  • Standardisation of payment systems, Android Pay.
  • Native support of readers of fingerprints that will improve the safety of the smartphone and will allow fingerprints to be used as input and even approval of payment authorization system.
  • Now on touch It will bring deeper Google Now in the system integration that you can take advantage of the same within any application, and shall make a contextual use of the situation to offer information or helps the user.

The other features will not be as differential Although it will be with this new version that we will see the arrival / landing of smartphones with connector charging USB-C. We have to prepare ourselves to replenish our arsenal of cables with new accessories with this new reversible connector that promises, too, a faster charging.

When available the final version of Android 6.0 for Nexus 5 we will resume this comparison to offer final performance figures, but all indications are that the DP3 version will be very similar to the final in this section.