Randomized algorithms for estimating the trace of an implicit symmetric positive semi-definite matrix

Haim Avron*, Sivan Toledo

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

We analyze the convergence of randomized trace estimators. Starting at 1989, several algorithms have been proposed for estimating the trace of a matrix by 1/M∑ M i=1 zTi Azi, where the zi are random vectors; different estimators use different distributions for the zis, all of which lead to E(1/M ∑M i=1 zT i Azi) = trace(A). These algorithms are useful in applications in which there is no explicit representation of A but rather an efficient method compute z T Az given z. Existing results only analyze the variance of the different estimators. In contrast, we analyze the number of samples M required to guarantee that with probability at least 1-δ S, the relative error in the estimate is at most ε. We argue that such bounds are much more useful in applications than the variance. We found that these bounds rank the estimators differently than the variance; this suggests that minimum-variance estimators may not be the best. We also make two additional contributions to this area. The first is a specialized bound for projection matrices, whose trace (rank) needs to be computed in electronic structure calculations. The second is a new estimator that uses less randomness than all the existing estimators.

Original languageEnglish
Article number8
JournalJournal of the ACM
Volume58
Issue number2
DOIs
StatePublished - Apr 2011

Keywords

  • Implicit linear operators
  • Trace estimation

Fingerprint

Dive into the research topics of 'Randomized algorithms for estimating the trace of an implicit symmetric positive semi-definite matrix'. Together they form a unique fingerprint.

Cite this