TY - JOUR
T1 - Compactification of the Rigid Motions Group in Image Processing
AU - Bendory, Tamir
AU - Hadi, Ido
AU - Sharon, Nir
N1 - Publisher Copyright:
© 2022 Society for Industrial and Applied Mathematics.
PY - 2022
Y1 - 2022
N2 - Image processing problems in general, and in particular in the field of single-particle cryo-electron microscopy, often require considering images up to their rotations and translations. Such problems were tackled successfully when considering images up to rotations only, using quantities which are invariant to the action of rotations on images. Extending these methods to cases where translations are involved is more complicated. Here we present a computationally feasible and theoretically sound approximate invariant to the action of rotations and translations on images. It allows one to approximately reduce image processing problems to similar problems over the sphere, a compact domain acted on by the group of three-dimensional rotations, a compact group. We show that this invariant is induced by a family of mappings deforming, and thereby compactifying, the group structure of rotations and translations of the plane, i.e., the group of rigid motions, into the group of three-dimensional rotations. Furthermore, we demonstrate its viability in two image processing tasks: multireference alignment and classification. To our knowledge, this is the first instance of a quantity that is either exactly or approximately invariant to rotations and translations of images that both rests on a sound theoretical foundation and is applicable in practice.
AB - Image processing problems in general, and in particular in the field of single-particle cryo-electron microscopy, often require considering images up to their rotations and translations. Such problems were tackled successfully when considering images up to rotations only, using quantities which are invariant to the action of rotations on images. Extending these methods to cases where translations are involved is more complicated. Here we present a computationally feasible and theoretically sound approximate invariant to the action of rotations and translations on images. It allows one to approximately reduce image processing problems to similar problems over the sphere, a compact domain acted on by the group of three-dimensional rotations, a compact group. We show that this invariant is induced by a family of mappings deforming, and thereby compactifying, the group structure of rotations and translations of the plane, i.e., the group of rigid motions, into the group of three-dimensional rotations. Furthermore, we demonstrate its viability in two image processing tasks: multireference alignment and classification. To our knowledge, this is the first instance of a quantity that is either exactly or approximately invariant to rotations and translations of images that both rests on a sound theoretical foundation and is applicable in practice.
KW - compactification
KW - group invariants
KW - group-invariant classification
KW - multireference alignment
UR - http://www.scopus.com/inward/record.url?scp=85141642159&partnerID=8YFLogxK
U2 - 10.1137/21M1429448
DO - 10.1137/21M1429448
M3 - ???researchoutput.researchoutputtypes.contributiontojournal.article???
AN - SCOPUS:85141642159
SN - 1936-4954
VL - 15
SP - 1041
EP - 1078
JO - SIAM Journal on Imaging Sciences
JF - SIAM Journal on Imaging Sciences
IS - 3
ER -