Contrastive Representation Learning: A Framework and Review

By Phuc H. Le-Khac et al.

Read the original document by opening this link in a new tab.

Table of Contents

1. ABSTRACT
2. INDEX TERMS
3. INTRODUCTION
4. WHAT IS CONTRASTIVE LEARNING ?
A. REPRESENTATION LEARNING
B. CONTRASTIVE REPRESENTATION LEARNING
C. EXAMPLE: INSTANCE DISCRIMINATION
5. ...

Summary

Contrastive Representation Learning: A Framework and Review provides a comprehensive literature review on the topic of Contrastive Learning. It discusses the origins of Contrastive Learning, its development across various fields, and proposes a general framework. The paper also presents a taxonomy for contrastive learning components and discusses inductive biases in contrastive learning systems. Additionally, it explores the application of contrastive learning in computer vision, natural language processing, audio processing, and reinforcement learning. The challenges and future research directions in contrastive learning are also analyzed.