Neural Registration and Segmentation of White Matter Tracts in Multi-modal Brain MRI

Noa Barzilay, Ilya Nelkenbaum, Eli Konen, Nahum Kiryati, Arnaldo Mayer*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


Pre-surgical mapping of white matter (WM) tracts requires specific neuroanatomical knowledge and a significant amount of time. Currently, pre-surgical tractography workflows rely on classical registration tools that prospectively align the multiple brain MRI modalities required for the task. Brain lesions and patient motion may challenge the robustness and accuracy of these tool, eventually requiring additional manual intervention. We present a novel neural workflow for 3-D registration and segmentation of WM tracts in multiple brain MRI sequences. The method is applied to pairs of T1-weighted (T1w) and directionally encoded color (DEC) maps. Validation is provided on two different datasets, the Human Connectome Project (HCP) dataset, and a real pre-surgical dataset. The proposed method outperforms the state-of-the-art TractSeg and AGYnet algorithms on both datasets, quantitatively and qualitatively, suggesting its applicability to automatic WM tract mapping in neuro-surgical MRI.

Original languageEnglish
Title of host publicationComputer Vision – ECCV 2022 Workshops, Proceedings
EditorsLeonid Karlinsky, Tomer Michaeli, Ko Nishino
PublisherSpringer Science and Business Media Deutschland GmbH
Number of pages16
ISBN (Print)9783031250651
StatePublished - 2023
Event17th European Conference on Computer Vision, ECCV 2022 - Tel Aviv, Israel
Duration: 23 Oct 202227 Oct 2022

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13803 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference17th European Conference on Computer Vision, ECCV 2022
CityTel Aviv


  • Brain MRI
  • Convolutional neural networks
  • Multi-modal segmentation
  • Neuro-surgical planning
  • Registration
  • Tractography


Dive into the research topics of 'Neural Registration and Segmentation of White Matter Tracts in Multi-modal Brain MRI'. Together they form a unique fingerprint.

Cite this