Computer Use Prompting
Prompt an LLM to act as a computer user, enabling it to interact with tools and perform tasks by generating commands and interpreting outputs.
When to use
When you need the LLM to perform actions that require interacting with a computer system, such as running code, browsing the web, or using specific applications.
How to apply
Instruct the LLM to act as a computer user.
Provide the LLM with a clear goal or task to accomplish.
Define the available tools or commands the LLM can use.
Specify the format for outputting commands and interpreting results.
Allow the LLM to iteratively generate commands and process the simulated or actual system responses.
Glossary
- Computer Use Prompting
- A prompting strategy where an LLM is instructed to simulate or directly perform actions as a computer user, interacting with tools and interpreting system outputs.
- Available Tools
- The set of functions, commands, or applications that the LLM is permitted to use to achieve its goal.
- Iteratively Generate Commands
- The process where the LLM repeatedly produces a command, executes it (or simulates execution), and then uses the resulting output to inform its next action or command.
Sources