It’s a great pleasure to welcome Raghav Selvan from the University of Copenhagen at our lab!
Abstract: Quantum Tensor Networks (QTNs) provide efficient approximations of operations involving high dimensional tensors and have been extensively used in modeling quantum many-body systems and also compressing large neural networks. More recently, supervised learning has been attempted with tensor networks, and has primarily focused on classification of 1D signals and small images. In this talk, we will look at two formulations of QTN-based models for 2D & 3D medical image classification and 2D medical image segmentation. Both the classification and segmentation models use the matrix product state (MPS) tensor network under the hood, which efficiently learns linear decision rules in high dimensional spaces. These QTN models are fully linear, end-to-end trainable using backpropagation, and have a lower GPU memory footprint than convolutional neural networks (CNN). We show competitive performance compared to relevant CNN baselines on multiple datasets for classification and segmentation tasks while presenting interesting connections to other existing supervised learning methods.
Bio: Raghavendra Selvan (Raghav) is currently an Assistant Professor at the University of Copenhagen, with joint responsibilities at the Machine Learning Section (Dept. of Computer Science), Kiehn Lab (Department of Neuroscience), and the Data Science Laboratory. He received his Ph.D. in Medical Image Analysis (University of Copenhagen, 2018), his MSc degree in Communication Engineering in 2015 (Chalmers University, Sweden), and his Bachelor's degree in Electronics and Communication Engineering degree in 2009 (BMS Institute of Technology, India). Raghavendra Selvan was born in Bangalore, India.
His current research interests are broadly pertaining to Medical Image Analysis using Quantum Tensor Networks, Resource-efficient ML, Bayesian Machine Learning, Graph-neural networks, Approximate Inference and multi-object tracking theory.
References
Raghav's Website https://di.ku.dk/english/staff/?pure=en/persons/532407
Raghav's Github Page https://raghavian.github.io
Slides: https://raghavian.github.io/talks/files/FAU_20210526.pdf
Tensor Networks for Medical Image Classification (2020) http://proceedings.mlr.press/v121/selvan20a.html
Locally orderless tensor networks for classifying two- and three-dimensional medical images (2021) https://www.melba-journal.org/article/21663-locally-orderless-tensor-networks-for-classifying-two-and-three-dimensional-medical-images?auth_token=HgMd7jGPhvS8EqDEmj30
Multi-layered tensor networks for image classification (2020) https://arxiv.org/abs/2011.06982
Segmenting two-dimensional structures with strided tensor networks (2021) https://arxiv.org/abs/2102.06900
Classification model: https://github.com/raghavian/loTeNet_pytorch/
Segmentation model: https://github.com/raghavian/strided-tenet
This video is released under CC BY 4.0. Please feel free to share and reuse.
For reminders to watch the new video follow on Twitter or LinkedIn. Also, join our network for information about talks, videos, and job offers in our Facebook and LinkedIn Groups.
Music Reference:
Damiano Baldoni - Thinking of You (Intro)
Damiano Baldoni - Poenia (Outro)