Knowledge distillation (KD) showed significant improvement in supervised learning in the last couple of years and became the facto part of Computer vision frameworks.
In this project you will learn about KD methods, experiment with KD in practice and try to learn an adaptive pace of teaching (based on similarities, uncertainty and more)
This project has a research potential.