Konferenzen und Rahmenprogramm
Benchmarks: the Good, the Bad, and the Ugly
New options for embedded processing such as new microprocessors, graphics processors and accelerators are released every year. In order to make informed decisions on the solution that best suits their market or application, the embedded engineer needs accurate power and performance metrics. These metrics can be attained through proper benchmarking, however, this is not trivial as a poorly selected benchmarks does not tell the entire story of the full capabilities of the solution in relation to its intended workload. The purpose of benchmarking is to test your system with a workload that closely reflects your real world workload. Incorrect selection of the benchmark can lead to misinformed judgments on a platforms capabilities for you real world workload. This paper will introduce you to the fundamentals of a good representative benchmark as well as recommendations for benchmarks for IOT platforms across Automotive, Industrial, Retail, Computer Vision and Fog use cases. There will also be discussions on what we believe are bad benchmarks and which one are so ugly that they should never be used. Finally, the paper will also provide a look at cutting edge technologies such as M2M learning and CNN.
--- Datum: 28.02.2019 Uhrzeit: 10:00 Uhr - 10:30 Uhr Ort: Conference Counter NCC Ost