Azin Jahedi

2023

1. Jahedi, Azin ; Luz, Maximilian ; Rivinius, Marc ; Mehl, Lukas ; Bruhn, Andrés: MS-RAFT+: High Resolution Multi-Scale RAFT. In: International Journal of Computer Vision, International Journal of Computer Vision., Springer (2023), S. 1573–1405
   • BibTeX
   • Link

   BibTeX

   @article{jahedi2023msraft, abstract = {Hierarchical concepts have proven useful in many classical and learning-based optical flow methods regarding both accuracy and robustness. In this paper we show that such concepts are still useful in the context of recent neural networks that follow RAFT’s paradigm refraining from hierarchical strategies by relying on recurrent updates based on a single-scale all-pairs transform. To this end, we introduce MS-RAFT+: a novel recurrent multi-scale architecture based on RAFT that unifies several successful hierarchical concepts. It employs a coarse-to-fine estimation to enable the use of finer resolutions by useful initializations from coarser scales. Moreover, it relies on RAFT’s correlation pyramid that allows to consider non-local cost information during the matching process. Furthermore, it makes use of advanced multi-scale features that incorporate high-level information from coarser scales. And finally, our method is trained subject to a sample-wise robust multi-scale multi-iteration loss that closely supervises each iteration on each scale, while allowing to discard particularly difficult samples. In combination with an appropriate mixed-dataset training strategy, our method performs favorably. It not only yields highly accurate results on the four major benchmarks (KITTI 2015, MPI Sintel, Middlebury and VIPER), it also allows to achieve these results with a single model and a single parameter setting. Our trained model and code are available at https://github.com/cv-stuttgart/MS_RAFT_plus.}, affiliation = {Jahedi, A; Luz, M (Corresponding Author), Univ Stuttgart, Inst Visualizat & Interact Syst, Stuttgart, Germany. Luz, M (Corresponding Author), Univ Freiburg, Robot Learning Lab, Freiburg, Germany. Jahedi, Azin; Luz, Maximilian; Mehl, Lukas; Bruhn, Andres, Univ Stuttgart, Inst Visualizat & Interact Syst, Stuttgart, Germany. Luz, Maximilian, Univ Freiburg, Robot Learning Lab, Freiburg, Germany. Rivinius, Marc, Univ Stuttgart, Inst Informat Secur, Stuttgart, Germany.}, author = {Jahedi, Azin and Luz, Maximilian and Rivinius, Marc and Mehl, Lukas and Bruhn, Andrés}, doi = {10.1007/s11263-023-01930-7}, issn = {{0920-5691} and {1573-1405}}, journal = {International Journal of Computer Vision}, pages = {1573-1405}, publisher = {Springer}, pubstate = {prepublished}, research-areas = {Computer Science}, title = {MS-RAFT+: High Resolution Multi-Scale RAFT}, unique-id = {WOS:001126025000002}, url = {https://doi.org/10.1007/s11263-023-01930-7}, year = 2023 }

   Link

   https://doi.org/10.1007/s11263-023-01930-7