Crafting minds for Minecraft with Language Models and Mineflayer!
This project allows an AI model to write/execute code on your computer that may be insecure, dangerous, and vulnerable to injection attacks on public servers. Code writing is disabled by default, you can enable it by setting allow_insecure_coding to true in settings.json. Enable only on local or private servers, never on public servers. Ye be warned.
- OpenAI API Subscription, Gemini API Subscription, or Anthropic API Subscription
- Minecraft Java Edition
- Node.js (at least v14)
Add one of these environment variables:
OPENAI_API_KEY(and optionallyOPENAI_ORG_ID)GEMINI_API_KEYANTHROPIC_API_KEY(and optionallyOPENAI_API_KEYfor embeddings. not necessary, but without embeddings performance will suffer)
Clone/Download this repository
Run npm install
Install the minecraft version specified in settings.json, currently supports up to 1.20.2
Start a minecraft world and open it to LAN on localhost port 55916
Run node main.js
You can configure the agent's name, model, and prompts in their profile like andy.json.
You can configure project details in settings.json. Here is an example settings for connecting to a non-local server:
{
"minecraft_version": "1.20.1",
"host": "111.222.333.444",
"port": 55920,
"auth": "microsoft",
"allow_insecure_coding": false
}
Some of the node modules that we depend on have bugs in them. To add a patch, change your local node module file and run npx patch-package [package-name]