Learn PromptingIntroduction
Prompt engineering is an iterative design task. More formalized iterative design fields (e.g. logo design) have well established tooling which allows designers to be more efficient. Similar tooling exists in the prompt engineering space, with a variety of prompt engineering IDEs (integrated development environments) having recently been created. There exists a surprising range of such tooling, with everything from research interfaces to professionally designed IDEs. This chapter will provide an overview of some of the tools which may be of interest to you as a prompt engineer.
See the final article in this chapter for my recommendations on tools to use.
Due to waitlists, I have not yet been able to access all IDEs mentioned here. Additionally, due to the number of tools coming out, not all have a dedicated page.
Here is a table of the tools we will be discussing in this chapter:
Text Prompt IDEs
| Name | Hosted Solution | Open Source | Research Focused | Business Model | Launched | Modalities | Supported Providers |
|---|---|---|---|---|---|---|---|
| GPT-3 Playground | ✅ | ❌ | ❌ | Pay per tokens | ✅ | Text | OpenAI |
| Dust | ✅ | ✅ | ❌ | ✅ | Text | OpenAI, Cohere | |
| Everyprompt | ✅ | ❌ | Freemium | ✅ | Text | OpenAI | |
| Promptmetheus | ✅ | ❌ | ✅ | Freemium | ✅ | Text | Anthropic, Cohere, OpenAI, PaLM 2, NLP Cloud, AI21 Labs, Aleph Alpha |
| PromptIDE | ✅ | Code TBD | ✅ | None | ✅ | Text | |
| PromptSource | ❌ | ✅ | ✅ | None | ✅ | Text | |
| PromptChainer | ❌ | ✅ | None | ✅ | Text | ||
| PromptMaker | ❌ | ✅ | Text | ||||
| PromptSandbox | ✅ | ✅ | ✅ | Free | ✅ | Text | OpenAI |
| ChainForge | ✅ | ✅ | ✅ | Free | ✅ | Text | OpenAI |
| Name | Hosted Solution | Open Source | Research Focused | Business Model | Launched | Modalities | Supported Providers |
|---|---|---|---|---|---|---|---|
| Prompts.ai | ✅ | ✅ | ❌ | None | ✅ | Text | OpenAI |
| Snorkel | ✅ | ❌ | ❌ | ✅ | Text | ||
| Human Loop | ✅ | ❌ | Wait list | Text | |||
| Spellbook (Scale AI) | ✅ | ❌ | ❌ | Wait list | Text | ||
| Kollaprompt | ✅ | ❌ | ❌ | Under Development | Wait list | Text, Image, Audio | OpenAI, Stable Diffusion |
| Promptable | ✅ | ❌ | ❌ | Wait list | Text | OpenAI | |
| DiscuroAI | ✅ | ❌ | ❌ | ✅ | Text, Image | OpenAI | |
| PromptShake | ✅ | ❌ | ❌ | Wait list | Text | ||
| GPT IDE | ❌ | ❌ | ❌ | ✅ | Text, images + audio later | OpenAI, later Stability.AI and more | |
| The Forge AI | ✅ | ❌ | ❌ | Marketplace | Wait list | Text, Images | OpenAI, Stable Diffusion |
| Orquesta AI Prompts | ✅ | ❌ | ❌ | Enterprise | ✅ | Text | Custom, Public, Private LLMs |
| AnySolve | ✅ | ❌ | ❌ | Freemium | ✅ | Text, images + audio later | OpenAI, Stability.AI and more |
Image Only IDEs
| Name | Hosted Solution | Open Source | Research Focused | Business Model | Launched | Modalities | Supported Providers |
|---|---|---|---|---|---|---|---|
| DALL·E | ✅ | ❌ | ❌ | Buy Credits | ✅ | Text2Image | OpenAI DALLE |
| Dream Studio | ✅ | ❌ | ❌ | Buy Credits | ✅ | Text2Image | Stable Diffusion |
| Patience | ✅ | ❌ | ❌ | Buy Credits | ✅ | Text2Image | Stable Diffusion, OpenAI |
| getimg.ai | ✅ | ❌ | ❌ | ✅ | Text2Image, AIEditor |
Hosted Solution: The tool is hosted on a website and can be used without installing anything.
Research Focused: The tool is designed for research purposes, and may not be as user friendly as other tools.
Business Model: Type of business model.
Sander Schulhoff
Sander Schulhoff is the CEO of HackAPrompt and Learn Prompting. He created the first Prompt Engineering guide on the internet, two months before ChatGPT was released, which has taught 3 million people how to prompt ChatGPT. He also partnered with OpenAI to run the first AI Red Teaming competition, HackAPrompt, which was 2x larger than the White House's subsequent AI Red Teaming competition. Today, HackAPrompt partners with the Frontier AI labs to produce research that makes their models more secure. Sander's background is in Natural Language Processing and deep reinforcement learning. He recently led the team behind The Prompt Report, the most comprehensive study of prompt engineering ever done. This 76-page survey, co-authored with OpenAI, Microsoft, Google, Princeton, Stanford, and other leading institutions, analyzed 1,500+ academic papers and covered 200+ prompting techniques.