This image shows Jenny Schmalfuss

Jenny Schmalfuss

M. Sc.

Doctoral Researcher
Institute for Visualization and Interactive Systems (VIS)
Research Group Computer Vision

Contact

+49 711 685 88364

Universitätsstraße 38
70569 Stuttgart
Deutschland
Room: 1.465

Subject

My research interests are at the intersection of computer vision and machine learning. Here, I research new ways to quantify and improve the robustness of optical flow methods with the help of adversarial attacks. My goal is to enable robust motion estimation by understanding what influences the robustness of current methods.

Meet Spring: The new benchmark for scene flow, optical flow and stereo!
Test our dataset at spring-benchmark.org, and read the preprint for our CVPR 2023 paper.

Snowy conditions can break your optical flow method.
Our work on Attacking motion estimation with adversarial snow won a Best Paper Award at the  ECCV AROW Workshop 2022!

Are all optical flow networks equally vulnerable to adversarial attacks?
Check out our paper on evaluating the robustness of optical flow methods, which was an Oral at ECCV 2022!

Short Bio

I am a doctoral researcher at the Computer Vision Department of the University of Stuttgart, and a scholar of the International Max Planck Research School for Intelligent Systems (IMPRS-IS). I hold a MSc and BSc degree in Simulation Technology from the University of Stuttgart, where I focused on numerical mathematics, computer vision and machine learning. During my studies, I worked as research intern at the National University of Singapore and the University of Houston. 

Find me on google scholar or research gate.

News: I gave a talk at the TrustML Young Scientist Seminars about "Challenges in Adversarial Attacks for Motion Estimation". You can find the video on YouTube.

  1. 2023

    1. Mehl, L., Jahedi, A., Schmalfuss, J., & Bruhn, A. (2023, January). M-FUSE: Multi-frame Fusion for Scene Flow Estimation. Proc. Winter Conference on Applications of Computer Vision (WACV). https://doi.org/10.48550/arXiv.2207.05704
    2. Schmalfuss, J., Scheurer, E., Zhao, H., Karantzas, N., Bruhn, A., & Labate, D. (2023). Blind image inpainting with sparse directional filter dictionaries for lightweight CNNs. Journal of Mathematical Imaging and Vision (JMIV), 65, 323–339. https://doi.org/10.1007/s10851-022-01119-6
    3. Mehl, L., Schmalfuss, J., Jahedi, A., Nalivayko, Y., & Bruhn, A. (2023). Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereo. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). https://spring-benchmark.org/

  2. 2022

    1. Schmalfuss, J., Mehl, L., & Bruhn, A. (2022). Attacking Motion Estimation with Adversarial Snow. Proc. ECCV Workshop on Adversarial Robustness in the Real World (AROW). https://doi.org/10.48550/arXiv.2210.11242
    2. Schmalfuss, J., Scholze, P., & Bruhn, A. (2022). A perturbation-constrained adversarial attack for evaluating the robustness of optical flow. In S. Avidan, G. Brostow, M. Cissé, G. M. Farinella, & T. Hassner (Eds.), Proc. European Conference on Computer Vision (ECCV) (Vol. 13682, pp. 183--200). Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-20047-2_11

  3. 2021

    1. Schmalfuss, J., Riethmüller, C., Altenbernd, M., Weishaupt, K., & Göddeke, D. (2021). Partitioned coupling vs. monolithic block-preconditioning approaches for solving Stokes-Darcy systems. Proc. International Conference on Computational Methods for Coupled Problems in Science and Engineering (COUPLED PROBLEMS). https://doi.org/10.23967/coupled.2021.043

  4. 2016

    1. Wanigasekara, N., Schmalfuss, J., Carlson, D., & Rosenblum, D. S. (2016). A bandit approach for intelligent IoT service composition across heterogeneous smart spaces. Proc. International Conference on the Internet of Things, 121–129. https://doi.org/10.1145/2991561.2991562

Summer 2023:

  • Recent Advances in Computer Vision - Seminar (Supervision)
  • Computer Vision and Intelligent Systems - Colloquium (Organization)

Winter 2022/2023:

  • Computer Vision and Intelligent Systems - Colloquium (Organization)

Summer 2022:

  • Recent Advances in Computer Vision - Seminar (Supervision)
  • Computer Vision and Intelligent Systems - Colloquium (Organization)

Winter 2021/2022:

  • Computer Vision - Tutorial (Coordinator)
  • Computer Vision and Intelligent Systems - Colloquium (Organization)

Summer 2021:

  • Imaging Science - Tutorial (Coordinator)
  • Recent Advances in Computer Vision - Seminar (Supervision)
  • Computer Vision and Intelligent Systems - Colloquium (Organization)

Winter 2020/2021:

  • Computer Vision - Tutorial (Coordinator)
  • Bildverarbeitung und Computer Vision - Seminar (Supervision)
  • Computer Vision and Intelligent Systems - Colloquium (Organization)

Summer 2020:

  • Imaging Science - Tutorial (Coordinator)

Before Summer Term 2020:

  • Imaging Science - Tutorial (Tutor)
  • Computer Vision - Tutorial (Tutor)

"Preconditioning Techniques for Coupled Stokes Darcy Systems" (Master's thesis, 2019/2020)

"Learning to Transform: Neural Networks with Sparse Directional Filters for Blind Inpainting" (research project in cooperation with the University of Houston, 2018/2019)

"Detection of  Alternative Splicing in Coral Reef Fish Exposed to Climate Change" (research project with the King Abdullah University of Science and Technology, 2017)

"Simulation and Adaptation of Contextual Bandit Algorithms for IoT Service Discovery" (Bachelor's thesis in cooperation with the National University of Singapore, 2016)

"Differentiable illumination for naturalistic particle attacks on motion estimation". Work in progress. Bachelor’s Thesis. University of Stuttgart, 2023.

"A feature-level analysis of the adversarial robustness of RAFT". Work in progress. Master’s Thesis. University of Stuttgart, 2023.

"Untargeted attacks on optical flow methods". Work in progress. Research Project. University of Stuttgart, 2023.

"Attacks on defended optical flow networks for action recognition". Work in progress. Research Project. University of Stuttgart, 2023.

"A Global Adversarial Attack for Scene Flow". Master’s Thesis. University of Stuttgart, 2023.

"Filter dictionaries for optical flow prediction with RAFT". Master’s Thesis. University of Stuttgart, 2023.

"Sparse filters for optical flow robustness". Research Project. University of Stuttgart, 2022.

"An optimization approach for attacking the Horn and Schunck model". Bachelor’s Thesis. University of Stuttgart, 2022.

"Differentiating the Variational Horn and Schunck Method with Implicit Functions". Bachelor’s Thesis. University of Stuttgart, 2022.

"Atacking a defended optical flow network". Master’s Thesis. University of Stuttgart, 2022.

"A framework for attacking optical flow networks". Research Project. University of Stuttgart, 2022.

"Switching sparsity: investigating a training time adaptive layer". Research Project. University of Stuttgart, 2021.

"Stability of neural network architectures for optical flow estimation under adversarial attacks". Awarded Best SimTech Bachelor's thesis 2021. Bachelor’s Thesis. University of Stuttgart, 2021.

"Investigating the influence of learning rates on the learning speed of neural networks". Bachelor’s Thesis. University of Stuttgart, 2021.

"Analysing the quality of interframe interpolation with optical flow". Bachelor’s Thesis. University of Stuttgart, 2021.

"Improved RAFT architectures for optical flow estimation". Master’s Thesis. University of Stuttgart, 2021.

Team page
To the top of the page