🔨 ToolingPrompt Engineering IDEs🟢 Introduction

Introduction

🟢 This article is rated easy

Reading Time: 7 minutes

Last updated on August 7, 2024

Prompt engineering is an iterative design task. More formalized iterative design fields (e.g. logo design) have well established tooling which allows designers to be more efficient. Similar tooling exists in the prompt engineering space, with a variety of prompt engineering IDEs (integrated development environments) having recently been created. There exists a surprising range of such tooling, with everything from research interfaces to professionally designed IDEs. This chapter will provide an overview of some of the tools which may be of interest to you as a prompt engineer.

See the final article in this chapter for my recommendations on tools to use.

Due to waitlists, I have not yet been able to access all IDEs mentioned here. Additionally, due to the number of tools coming out, not all have a dedicated page.

Here is a table of the tools we will be discussing in this chapter:

Text Prompt IDEs

Name	Hosted Solution	Open Source	Research Focused	Business Model	Launched	Modalities	Supported Providers
GPT-3 Playground	✅	❌	❌	Pay per tokens	✅	Text	OpenAI
Dust	✅	✅	❌		✅	Text	OpenAI, Cohere
Everyprompt	✅		❌	Freemium	✅	Text	OpenAI
Promptmetheus	✅	❌	✅	Freemium	✅	Text	Anthropic, Cohere, OpenAI, PaLM 2, NLP Cloud, AI21 Labs, Aleph Alpha
PromptIDE	✅	Code TBD	✅	None	✅	Text
PromptSource	❌	✅	✅	None	✅	Text
PromptChainer	❌		✅	None	✅	Text
PromptMaker	❌		✅			Text
PromptSandbox	✅	✅	✅	Free	✅	Text	OpenAI
ChainForge	✅	✅	✅	Free	✅	Text	OpenAI

Name	Hosted Solution	Open Source	Research Focused	Business Model	Launched	Modalities	Supported Providers
Prompts.ai	✅	✅	❌	None	✅	Text	OpenAI
Snorkel	✅	❌	❌		✅	Text
Human Loop	✅		❌		Wait list	Text
Spellbook (Scale AI)	✅	❌	❌		Wait list	Text
Kollaprompt	✅	❌	❌	Under Development	Wait list	Text, Image, Audio	OpenAI, Stable Diffusion
Promptable	✅	❌	❌		Wait list	Text	OpenAI
DiscuroAI	✅	❌	❌		✅	Text, Image	OpenAI
PromptShake	✅	❌	❌		Wait list	Text
GPT IDE	❌	❌	❌		✅	Text, images + audio later	OpenAI, later Stability.AI and more
The Forge AI	✅	❌	❌	Marketplace	Wait list	Text, Images	OpenAI, Stable Diffusion
Orquesta AI Prompts	✅	❌	❌	Enterprise	✅	Text	Custom, Public, Private LLMs
AnySolve	✅	❌	❌	Freemium	✅	Text, images + audio later	OpenAI, Stability.AI and more

Image Only IDEs

Name	Hosted Solution	Open Source	Research Focused	Business Model	Launched	Modalities	Supported Providers
DALL·E	✅	❌	❌	Buy Credits	✅	Text2Image	OpenAI DALLE
Dream Studio	✅	❌	❌	Buy Credits	✅	Text2Image	Stable Diffusion
Patience	✅	❌	❌	Buy Credits	✅	Text2Image	Stable Diffusion, OpenAI
getimg.ai	✅	❌	❌		✅	Text2Image, AIEditor

Hosted Solution: The tool is hosted on a website and can be used without installing anything.

Research Focused: The tool is designed for research purposes, and may not be as user friendly as other tools.

Business Model: Type of business model.

Sander Schulhoff

Sander Schulhoff is the Founder of Learn Prompting and an ML Researcher at the University of Maryland. He created the first open-source Prompt Engineering guide, reaching 3M+ people and teaching them to use tools like ChatGPT. Sander also led a team behind Prompt Report, the most comprehensive study of prompting ever done, co-authored with researchers from the University of Maryland, OpenAI, Microsoft, Google, Princeton, Stanford, and other leading institutions. This 76-page survey analyzed 1,500+ academic papers and covered 200+ prompting techniques.

Introduction

Text Prompt IDEs

Image Only IDEs

Sander Schulhoff

OpenAI DALLE IDE

AnySolve

Conclusion

Dream Studio

Dust

Everyprompt

Human Loop

Kolla Prompt 🚧

Lang Chain

OpenPrompt

Patience

GPT-3 Playground

PromptChainer

Prompt IDE

Promptmetheus

Prompts.ai

PromptSandbox.io

PromptSource

PromptTools

Snorkel 🚧

Soaked

Spellbook 🚧

The Forge AI