How robust are unsupervised representation learning methods (e.g. SSL) to distirbution shift compared to supervised learning?
𝐒𝐡𝐨𝐫𝐭 𝐚𝐧𝐬𝐰𝐞𝐫: Quite!
𝐋𝐨𝐧𝐠 𝐚𝐧𝐬𝐰𝐞𝐫: Our #ICLR2023 paper http://arxiv.org/pdf/2206.08871.pdf
Joint work with Imant Daunhawer & Amartya Sanyal @amartya
Huge thanks to my amazing collaborator Imant Daunhawer and Amartya Sanyal. This is a project two years in the making and very close to each of our hearts. Generalisation is such an important problem in ML and there is much more to do – watch this space! (8/8)