🟢 Introduction

In the following section, we will be talking about soft prompts and interpretable soft prompts. This is a step up in difficulty as it involves LLM concepts that we have not covered prior. Soft prompts involve a concept called Prompt Tuning, which freezes the LLM's weights and instead modifies the input. It is important to recognize that this is a concept discussed previously and offers a novel approach to leveraging LLMs.

By the end of this section, you will have an understanding of how Prompt Tuning works and how soft prompts can be used to enhance the performance and interpretability of your GenAI applications.