Dieses Bild zeigt Jenny Schmalfuß

Jenny Schmalfuß

Frau M. Sc.

Wiss. Mitarbeiterin
Institut für Visualisierung und Interaktive Systeme (VIS)
Abteilung Computer Vision

Kontakt

Universitätsstraße 38
70569 Stuttgart
Deutschland
Raum: 1.465

Fachgebiet

My research interests are at the intersection of computer vision and machine learning. Here, I research new ways to quantify and improve the robustness of optical flow methods with the help of adversarial attacks. My goal is to enable robust motion estimation by understanding what influences the robustness of current methods.

Snowy conditions can break your optical flow method.
Our work on Attacking motion estimation with adversarial snow won a Best Paper Award at the  ECCV AROW Workshop 2022!

Are all optical flow networks equally vulnerable to adversarial attacks?
Check out our paper on evaluating the robustness of optical flow methods, which was an Oral at ECCV 2022!

Short Bio

I am a doctoral researcher at the University of Stuttgart, and a fellow of the International Max Planck Research School for Intelligent Systems (IMPRS-IS). I hold a MSc and BSc degree in Simulation Technology from the University of Stuttgart, where I focused on numerical mathematics, computer vision and machine learning. During my studies, I worked as research intern at the National University of Singapore and the University of Houston. 

Find me on google scholar or research gate.

News: On January 24, 2023 from 09:00-10:00 CET, I will give a virtual presentation at the TrustML Young Scientist Seminars about "Challenges in Adversarial Attacks for Motion Estimation"

  1. 2023

    1. Mehl, L., Jahedi, A., Schmalfuss, J., & Bruhn, A. (2023, Januar). M-FUSE: Multi-frame Fusion for Scene Flow Estimation. Proc. Winter Conference on Applications of Computer Vision (WACV). https://doi.org/10.48550/arXiv.2207.05704
  2. 2022

    1. Schmalfuss, J., Scheurer, E., Zhao, H., Karantzas, N., Bruhn, A., & Labate, D. (2022). Blind image inpainting with sparse directional filter dictionaries for lightweight CNNs. Journal of Mathematical Imaging and Vision (JMIV). https://doi.org/10.1007/s10851-022-01119-6
    2. Schmalfuss, J., Mehl, L., & Bruhn, A. (2022). Attacking Motion Estimation with Adversarial Snow. Proc. ECCV Workshop on Adversarial Robustness in the Real World (AROW). https://doi.org/10.48550/arXiv.2210.11242
    3. Schmalfuss, J., Scholze, P., & Bruhn, A. (2022). A perturbation-constrained adversarial attack for evaluating the robustness of optical flow. In S. Avidan, G. Brostow, M. Cissé, G. M. Farinella, & T. Hassner (Hrsg.), Proc. European Conference on Computer Vision (ECCV) (Bd. 13682, S. 183--200). Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-20047-2_11
  3. 2021

    1. Schmalfuss, J., Riethmüller, C., Altenbernd, M., Weishaupt, K., & Göddeke, D. (2021). Partitioned coupling vs. monolithic block-preconditioning approaches for solving Stokes-Darcy systems. Proc. International Conference on Computational Methods for Coupled Problems in Science and Engineering (COUPLED PROBLEMS). https://doi.org/10.23967/coupled.2021.043
  4. 2016

    1. Wanigasekara, N., Schmalfuss, J., Carlson, D., & Rosenblum, D. S. (2016). A bandit approach for intelligent IoT service composition across heterogeneous smart spaces. Proc. International Conference on the Internet of Things, 121–129. https://doi.org/10.1145/2991561.2991562

Winter 2022/2023:

  • Computer Vision and Intelligent Systems - Colloquium (Organization)

Summer 2022:

  • Recent Advances in Computer Vision - Seminar (Supervision)
  • Computer Vision and Intelligent Systems - Colloquium (Organization)

Winter 2021/2022:

  • Computer Vision - Tutorial (Coordinator)
  • Computer Vision and Intelligent Systems - Colloquium (Organization)

Summer 2021:

  • Imaging Science - Tutorial (Coordinator)
  • Recent Advances in Computer Vision - Seminar (Supervision)
  • Computer Vision and Intelligent Systems - Colloquium (Organization)

Winter 2020/2021:

  • Computer Vision - Tutorial (Coordinator)
  • Bildverarbeitung und Computer Vision - Seminar (Supervision)
  • Computer Vision and Intelligent Systems - Colloquium (Organization)

Summer 2020:

  • Imaging Science - Tutorial (Coordinator)

Before Summer Term 2020:

  • Imaging Science - Tutorial (Tutor)
  • Computer Vision - Tutorial (Tutor)

"Preconditioning Techniques for Coupled Stokes Darcy Systems" (Master's thesis, 2019/2020)

"Learning to Transform: Neural Networks with Sparse Directional Filters for Blind Inpainting" (research project in cooperation with the University of Houston, 2018/2019)

"Detection of  Alternative Splicing in Coral Reef Fish Exposed to Climate Change" (research project with the King Abdullah University of Science and Technology, 2017)

"Simulation and Adaptation of Contextual Bandit Algorithms for IoT Service Discovery" (Bachelor's thesis in cooperation with the National University of Singapore, 2016)

"A Global Adversarial Attack for Scene Flow". Work in progress. Master’s Thesis. University of Stuttgart, 2022.

"Filter dictionaries for optical flow prediction with RAFT". Work in progress. Master’s Thesis. University of Stuttgart, 2022.

"Sparse filters for optical flow robustness". Research Project. University of Stuttgart, 2022.

"An optimization approach for attacking the Horn and Schunck model". Bachelor’s Thesis. University of Stuttgart, 2022.

"Differentiating the Variational Horn and Schunck Method with Implicit Functions". Bachelor’s Thesis. University of Stuttgart, 2022.

"Atacking a defended optical flow network". Master’s Thesis. University of Stuttgart, 2022.

"A framework for attacking optical flow networks". Research Project. University of Stuttgart, 2022.

"Switching sparsity: investigating a training time adaptive layer". Research Project. University of Stuttgart, 2021.

"Stability of neural network architectures for optical flow estimation under adversarial attacks". Awarded Best SimTech Bachelor's thesis 2021. Bachelor’s Thesis. University of Stuttgart, 2021.

"Investigating the influence of learning rates on the learning speed of neural networks". Bachelor’s Thesis. University of Stuttgart, 2021.

"Analysing the quality of interframe interpolation with optical flow". Bachelor’s Thesis. University of Stuttgart, 2021.

"Improved RAFT architectures for optical flow estimation". Master’s Thesis. University of Stuttgart, 2021.

Zum Seitenanfang