In light of the recent scandal involving Samsung‘s supposed cheating in benchmark tests, graphics benchmarking experts Futuremark has decided to look deeper into its own charts and apply sanctions if any misdeed is found. However, Samsung wasn’t alone in the verdict, as some of HTC‘s recent devices have also been found to have broken a few rules.
People rely on benchmarks to give accurate and unbiased analysis of device performance and, being one of the most popular out there, 3DMark creators Futuremark has to ensure the reliability of their scores. As such, they set up rules in order to make sure that devices and platforms all play fair. Platforms should not do anything to modify how a benchmarking tool is run, like pushing hardware beyond the usual operating parameters when the tool is detected. Those that get caught cheating will be delisted from Futuremark’s charts, which means getting their scores removed and getting sent to the very bottom of the pile.
Samsung has recently been caught with its hands inside the benchmarking cookie jar. Investigations have revealed certain pieces of code that, in effect, remove the CPU and GPU safety harnesses when a benchmarking tool such as AnTuTu or 3DMark is started, giving scores that do not actually reflect real-world usage. Naturally, Samsung denies the accusation. What is more worrying is the fact, or observation, that other Android manufacturers are, in one way or another, equally culpable to some extent, leading many to question the usefulness of benchmarks at all, at least as far as current tools are concerned. There are, in fact, some attempts to create a benchmark test that cannot be cheated, or so they claim.
For its part, Futuremark has delisted a couple of devices from Samsung and HTC, namely, all variants of the Galaxy Note 10.1 2014 edition and the Galaxy Note III, the HTC One, and the HTC One Mini. Futuremark says that both manufacturers can appeal the decision. It is also calling on its users to remain vigilant and report suspicious 3DMark scores.
VIA: The Register
So as a sucker um I mean consumer that just bought the very expensive Samsung galaxy note 10.1 2014 edition based partly on the impressive benchmark scores what recourse do I have against the behemoth that is Samsung? Don’t get me wrong it’s a nice piece of kit but this revelation really pisses me off I do a lot of research before making purchases with my hard earned income and I don’t appreciate being played the fool. SCREW YOU SAMSUNG HERE’S A BIG BRONX CHEER FOR YOU.