E7 - Learning a Metric without Supervision: Multimodal Registration using Synthetic Cycle Discrepancy

Hanna Siebert, Lasse Hansen, Mattias P Heinrich

Show abstract - Show schedule - PDF - Reviews

Training deep learning based medical image registration methods involves the challenge of finding a suitable metric. To avoid the difficulty of choosing a metric for multimodal image registration, we propose a completely new concept relying on geometric instead of metric supervision with three-way registration cycles. Therefore, we create a synthetic image by applying a synthetic transformation on one of the input images. This leads to cycles that for each pair of input images comprise two multimodal transformations to be estimated and one known synthetic monomodal transformation. We minimise the discrepancy between the combined multimodal transformations and the synthetic monomodal transformation. By minimising this cycle discrepancy, we are able to learn multimodal registration between CT and MRI without metric supervision. Our method outperforms state-of-the-art metric supervision and comes very close to fully-supervised learning with ground truth labels.
Hide abstract

Thursday 8th July
E4-12 (short): Image Registration / Synthesis - 13:45 - 14:30 (UTC+2)
Hide schedule


Can't display slides, your browser doesn't support embedding PDFs.

Download slides