SPMarkJava06 - for evaluating handheld devices performance in running Java applications. The benchmark includes test for the latest Java functionality (MIDP 2, CLDC 1.1, JSR 184). Read on for a quick overview and results from several Symbian devices.
The end result of a benchmark run in SPMarkJava06 is an SPMark score than can be used to compare performance across handsets. The benchmark program (itself a MIDP application) is run on the handset and cycles through a series of tests including a 2D Games represenstation, a 3D Game / rendering representations, a video test, various graphics and images tests and a series of JVM tests (to test general Java performance). Further information on the tests is available on the Futuremark website.
Through the benchmark application users can also access detailed information about the Java implementation present on the test device including supported JSRs.
New to Futuremark's mobile benchmarking lineup is the inclusion of the Online Results Browser (ORB) on the phone itself (using the built in browsers) allowing users to compare results between different phones via the online database. As with other Futuremark products tests can be run individually (via user slection) or as part of a series to generate the overall benchmarking score.
Aside from the obvious uses in comparison test for end users and in reviews in the media the benchmark is also aimed at manufcaturers, operators, and developers who can now used a standardised performance testing solution to help with development and related business decisions. The source code is made avilable through Futuremark's BDP program to allow for the development of custom benchmarks by manufacturers and other interested companies.
There are three versions available, two for the conusmer (a free personal edition, and a $3 advanced edition with full testing features) and one for professional use ($20,000) with optional source code licensing.
The application is easy to use and provides a comprehensive set of tests and subsequent results and facillitates realistic Java performance comparisons across handsets (both Symbian and non Symbian handsets), something which has only be avilable in a limited form until now.