JavaScript SunSpider Test: iOS 3.1.3 Versus iOS 4 GM

Result table

Test iOS 3.1.3 (3GS) iOS 4 GM (3GS) % change
Total 15396ms 13787ms -10.5%
3D 2411ms 1917ms -20.5%
Access 1884ms 1893ms +0.5%
Bitops 1044ms 1239ms +18.7%
Controlflow 143ms 221ms +54.5%
Crypto 982ms 850ms -13.4%
Date 1355ms 1065ms -21.4%
Math 2053ms 1511ms -26.4%
Regexp 1616ms 1916ms +18.6%
String 3908ms 3175ms -18.8%

Thoughts

After running these SunSpider tests, it looks like overall there’s significant speed gains between iOS 3.1.3 and iOS 4 GM. However, it’s concerning from these tests there were some things that actually ran slower on iOS 4. This either represents a real speed loss between the versions, a margin of error, or some flaw or inconsistency while testing. Or maybe I possibly have some wrong setting on my phone? Any input would be appreciated.

Testing methodology

Test: SunSpider 0.9.1

Device: iPhone 3GS

The test was run five separate times on the same phone for each version of the OS. The phone was completely turned off and on before each test.

The most extreme values of the five tests were thrown out, and the resulting four tests were averaged (sometimes from three tests when the values were very close together). I’m no statistics expert, so if you’d like to work it out for yourself, here are my raw test results:

SunSpider iOS 3.1.3 results (5 tests)

SunSpider iOS 4 results (5 tests)

Speed Test: iPhone 3GS Even Faster than Apple Claims