Fairness and throughput in switch on event multithreading

Ron Gabor, Shlomo Weiss, Avi Mendelson

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The need to reduce power and complexity will increase the interest in Switch on Event multithreading (coarse grained multithreading). Switch On Event multithreading is a low power and low complexity mechanism to improve processor throughput by switching threads on execution stalls. Fairness may, however, become a problem in a multithreaded processor. Unless fairness is properly handled, some threads may starve while others consume all of the processor cycles. Heuristics that were devised in order to improve fairness in Simultaneous Multithreading are not applicable to Switch On Event multithreading. This paper defines the fairness metric using the ratio of the individual threads ' speedups, and shows how it can be enforced in Switch On Event multithreading. Fairness is controlled by forcing additional thread switch points. These switch points are determined dynamically by runtime estimation of the single threaded performance of each of the individual threads. We analyze the impact of the fairness enforcement mechanism on throughput. We present simulation results of the performance of Switch on Event multithreading. Switch on Event multithreading achieves an average speedup over single thread of 24% when no fairness is enforced. In this case, over a third of our runs achieved poor fairness in which one thread ran extremely slowly (10 to 100 times slower than its single thread performance) while the other thread's performance was hardly affected. By using the proposed mechanism we can guarantee fairness of 1/4, 1/2 and I for a small performance loss of 2.2%, 3.7% and 7.2% respectively.

Original languageEnglish
Title of host publicationProceedings of the 39th Annual IEEE/ACM International Symposium on Microarchitecture, MICRO-39
Pages149-150
Number of pages2
DOIs
StatePublished - 2006
Event39th Annual IEEE/ACM International Symposium on Microarchitecture, MICRO-39 - Orlando, FL, United States
Duration: 9 Dec 200613 Dec 2006

Publication series

NameProceedings of the Annual International Symposium on Microarchitecture, MICRO
ISSN (Print)1072-4451

Conference

Conference39th Annual IEEE/ACM International Symposium on Microarchitecture, MICRO-39
Country/TerritoryUnited States
CityOrlando, FL
Period9/12/0613/12/06

Fingerprint

Dive into the research topics of 'Fairness and throughput in switch on event multithreading'. Together they form a unique fingerprint.

Cite this