A Survey of Large Language Models

By Wayne Xin Zhao et al
Read the original document by opening this link in a new tab.

Table of Contents

Abstract, Introduction, Background for LLMs, Formulation of Scaling Laws for LLMs, Emergent Abilities of LLMs, Key Techniques for LLMs

Summary

This document provides a comprehensive review of Large Language Models (LLMs), focusing on the recent advances in LLMs. It discusses the evolution of LLMs, scaling laws for LLMs, emergent abilities observed in LLMs, and key techniques used in developing LLMs. LLMs are Transformer language models with hundreds of billions of parameters, trained on massive text data. The study highlights the impact of LLMs on natural language understanding and complex task solving through text generation.
×
This is where the content will go.