Futuremark updates 3DMark Android Benchmark app, delists devices with suspicious scores

Futuremark released the 3D mark Android benchmark app earlier this year. Since a lot of mobile manufactures are said to be cheating to show up higher scores on several benchmarks, the company has released a new update and has also announced that the company would delist devices that are suspicious. When a device is suspected of breaking the rules it is delisted. 3DMark scores from delisted devices should not be used to compare devices. Delisted devices appear unranked, and without scores, at the bottom of the 3DMark Device Channel and the Best Mobile Devices list on our website, says the company.

Here is the optimization policy for the devices

• The platform may not change the quality level of the work.
• The platform may not use an alternative technique to that requested by the workload.
• The platform may not replace or remove any portion of the requested work even if the change would result in the same output.
• Optimizations based on empirical data of benchmark workloads are not allowed.
• Optimizations that change the output of the work are not allowed.
• The platform may not detect the launch of the benchmark executable.
• The platform must not alter, replace or override any parameters or parts of the test, nor modify the usual functioning of the platform based on the detection of the benchmark.

The new v1.2.0.1232 update also brings range of new features and improvements including

• Option to compare your scores with Windows 8 tablets in the Device Channel.
• Devices are colour-coded by OS in the Device Channel.
• Filter scores by OS in the Device Channel
• Improved compatibility with the latest NVIDIA hardware.
• Improved compatibility with some Samsung Galaxy S3 models.

Will all smartphone manufactures stop rigging the benchmarks if all these companies start delisting devices from their benchmark list? Only time will tell. Since Futuremark can’t check every device, the company asks people to mail them at testlab@futuremark.com , if you come across a device with a suspcious score, so that they can can investigate further.