📙 Vocabulary Reference
Last updated on July 06, 2024 by Sander Schulhoff
Please refer to this page for a list of terms and concepts that we will use throughout this course.
Large Language Models (LLMs), Pretrained Language Models (PLMs)1, Language Models (LMs), and foundation models
These terms all refer more or less to the same thing: large AIs (neural networks), which have usually been trained
on a huge amount of text.
"Model" vs. "AI" vs. "LLM"
These terms are used somewhat interchangeably throughout this course, but they do
not always mean the same thing. LLMs are a type of AI, as noted above, but not all AIs are LLMs.
When we mentioned models in this course, we are referring to AI models. As such, in this course,
you can consider the terms "model" and "AI" to be interchangeable.
Verbalizer
In the classification setting, verbalizers are mappings from labels to words in
a language model's vocabulary2. For example, consider
performing sentiment classification with the following prompt:
Tweet: "I love hotpockets"
What is the sentiment of this tweet? Say 'pos' or 'neg'.
Here, the verbalizer is the mapping from the conceptual labels of positive
and negative
to the tokens pos
and neg
.
API
Application Programming Interface. Enables different systems to interact with each other programmatically. Two types of APIs are REST APIs (web APIs) and native-library APIs.
CoT prompting
The main idea of CoT is that by showing the LLM some few shot exemplars where the reasoning process is explained in the exemplars, the LLM will also show the reasoning process when answering the prompt.
Exemplars
Examples of the task that the prompt is trying to solve, which are included in the prompt itself.
few shot standard prompt
Standard prompts that have exemplars in them. Exemplars are examples of the task that the prompt is trying to solve, which are included in the prompt itself.
Gold Labels
The correct labels for a given task.
Label Space
All of the possible labels for a given task.
Labels
The concept of labels is best understood with an example.
Say we want to classify some Tweets as mean or not mean. If we have a list of Tweets and their corresponding *label* (mean or not mean), we can train a model to classify whether tweets are mean or not. Labels are generally just possibilities for the classification task.
LLM
Large Language Model. A model that is trained to predict the next word in a sentence.
Machine Learning (ML)
ML is a field of study that focuses on algorithms that can learn from data. ML is a subfield of AI.
Masked Language Models (MLMs)
MLMs are a type of NLP model, which have a special token, usually [MASK], which is replaced with a word from the vocabulary. The model then predicts the word that was masked. For example, if the sentence is "The dog is [MASK] the cat", the model will predict "chasing" with high probability.
PAL
A method that uses code as intermediate reasoning
Prompt
A text or other input to a Generatve AI
Reinforcement Learning from Human Feedback (RLHF)
RLHF is a method for fine tuning LLMs according to human preference data.
Self-Consistency
Generating multiple chains of thought and taking the majority answer.
Sentiment Analysis
Sentiment analysis is the task of classifying text into positive, negative, or other sentiments.
Get AI Certified by Learn Prompting
Don't get left behind on AI
Sign up and get the latest AI news, prompts, and tools.
Join 30,000+ readers from companies like OpenAI, Microsoft, Google, Meta and more!