mindcraft 0.1.4-0

package/FAQ.md

@@ -0,0 +1,38 @@
+# Common Issues
+- `Error: connect ECONNREFUSED`: Minecraft refused to connect with mindcraft program. Most likely due to:
+  - you have not opened your game to LAN in game settings
+  - your LAN port is incorrect, make sure the one you enter in game is the same as specified in `settings.js`
+  - you have the wrong version of minecraft, make sure your MC version is the same as specified in `settings.js`
+
+- `ERR_MODULE_NOT_FOUND`: You are missing an npm package. run `npm install`
+
+- Many issues are caused by out-of-date node module patches, especially after updates. A catch-all is to delete the `node_modules` folder, and run `npm install`
+
+- **`npm install` fails with Python or C++ build errors**: This typically happens when building native modules like `gl`. Common solutions:
+  - **Python not found** (macOS/Linux): If you see `python: command not found`, create a symlink: `sudo ln -s $(which python3) /usr/local/bin/python`
+  - **C++20 errors or Node version issues**: If you see `"C++20 or later required"` errors, you're likely using Node v24 or newer. The `gl` package requires Node LTS (v18 or v20). Switch versions using:
+    ```bash
+    nvm install 20
+    nvm use 20
+    rm -rf node_modules package-lock.json
+    npm install
+    ```
+  - **Skip optional packages**: If you don't need the vision feature (disabled by default), you can skip the problematic `gl` package: `npm install --no-optional`
+
+- `My brain disconnected, try again`: Something is wrong with the LLM api. You may have the wrong API key, exceeded your rate limits, or other. Check the program outputs for more details.
+  
+- `I'm stuck!` or other issues with constantly getting stuck:
+  - Mineflayer's pathfinder is imperfect. We have improved upon it with patches, but these might not have been applied properly. Make sure your code is up to date with main, delete the `node_modules` folder, and run `npm install`
+  - The bot will still get stuck occasionally, but not constantly.
+    
+- `Why I added the api key but still prompted that the key can't be found?`
+  - Possible reason 1: Did not modify keys.example.json to keys.json.
+  - Possible reason 2: If you use vscode to edit, you need to `ctrl+s` to save the file for the changes to take effect.
+  - Possible reason 3: Not setting the code path correctly in setting.js, use andy.js by default. 
+
+# Common Questions
+- Mod Support? Mindcraft only supports client-side mods like optifine and sodium, though they can be tricky to set up. Mods that change minecraft game mechanics are not supported.
+  
+- Texture Packs? Apparently these cause issues and refuse to connect. Not sure why
+  
+- Baritone? Baritone is a mod that is completely different from mineflayer. There is currently no easy way to integrate the two programs.

package/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2024 Kolby Nottingham
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

package/README.md

@@ -0,0 +1,255 @@
+<h1 align="center">🧠mindcraft⛏️</h1>
+<h1 align="center">
+  <a href="https://trendshift.io/repositories/9163" target="_blank"><img src="https://trendshift.io/api/badge/repositories/9163" alt="kolbytn%2Fmindcraft | Trendshift" style="width: 250px; height: 55px;" width="250" height="55"/></a>
+</h1>
+
+<p align="center">Crafting minds for Minecraft with LLMs and <a href="https://prismarinejs.github.io/mineflayer/#/">Mineflayer!</a></p>
+
+<p align="center">
+  <a href="https://github.com/mindcraft-bots/mindcraft/blob/main/FAQ.md">FAQ</a> | 
+  <a href="https://discord.gg/mp73p35dzC">Discord Support</a> | 
+  <a href="https://www.youtube.com/watch?v=gRotoL8P8D8">Video Tutorial</a> | 
+  <a href="https://kolbynottingham.com/mindcraft/">Blog Post</a> | 
+  <a href="https://mindcraft-minecollab.github.io/index.html">Paper Website</a> | 
+  <a href="https://github.com/mindcraft-bots/mindcraft/blob/main/minecollab.md">MineCollab</a>
+</p>
+
+> [!Caution]
+Do not connect this bot to public servers with coding enabled. This project allows an LLM to write/execute code on your computer. The code is sandboxed, but still vulnerable to injection attacks. Code writing is disabled by default, you can enable it by setting `allow_insecure_coding` to `true` in `settings.js`. Ye be warned.
+
+# Getting Started
+## Requirements
+
+- [Minecraft Java Edition](https://www.minecraft.net/en-us/store/minecraft-java-bedrock-edition-pc) (up to v1.21.11, recommend v1.21.6)
+- [Node.js Installed](https://nodejs.org/) (Node v18 or v20 LTS recommended. Node v24+ may cause issues with native dependencies)
+- At least one API key from a supported API provider. See [supported APIs](#model-customization). OpenAI is the default.
+
+> [!Important]
+> If installing node on windows, ensure you check `Automatically install the necessary tools`
+>
+> If you encounter `npm install` errors on macOS, see the [FAQ](FAQ.md#common-issues) for troubleshooting native module build issues
+
+## Install and Run
+
+1. Make sure you have the requirements above.
+
+2. Download the [latest release](https://github.com/mindcraft-bots/mindcraft/releases/latest) and unzip it, or clone the repository.
+
+3. Rename `keys.example.json` to `keys.json` and fill in your API keys (you only need one). The desired model is set in `andy.json` or other profiles. For other models refer to the table below.
+
+4. In terminal/command prompt, run `npm install` from the installed directory
+
+5. Start a minecraft world and open it to LAN on localhost port `55916`
+
+6. Run `node main.js` from the installed directory
+
+If you encounter issues, check the [FAQ](https://github.com/mindcraft-bots/mindcraft/blob/main/FAQ.md) or find support on [discord](https://discord.gg/mp73p35dzC). We are currently not very responsive to github issues. To run tasks please refer to [Minecollab Instructions](minecollab.md#installation)
+
+
+# Configuration
+## Model Customization
+
+You can configure project details in `settings.js`. [See file.](settings.js)
+
+You can configure the agent's name, model, and prompts in their profile like `andy.json`. The model can be specified with the `model` field, with values like `model: "gemini-2.5-pro"`. You will need the correct API key for the API provider you choose. See all supported APIs below.
+
+<details>
+<summary><strong>⭐ VIEW SUPPORTED APIs ⭐</strong></summary>
+
+| API Name | Config Variable| Docs |
+|------|------|------|
+| `openai` | `OPENAI_API_KEY` | [docs](https://platform.openai.com/docs/models) |
+| `google` | `GEMINI_API_KEY` | [docs](https://ai.google.dev/gemini-api/docs/models/gemini) |
+| `anthropic` | `ANTHROPIC_API_KEY` | [docs](https://docs.anthropic.com/claude/docs/models-overview) |
+| `xai` | `XAI_API_KEY` | [docs](https://docs.x.ai/docs) |
+| `deepseek` | `DEEPSEEK_API_KEY` | [docs](https://api-docs.deepseek.com/) |
+| `ollama` (local) | n/a | [docs](https://ollama.com/library) |
+| `qwen` | `QWEN_API_KEY` | [Intl.](https://www.alibabacloud.com/help/en/model-studio/developer-reference/use-qwen-by-calling-api)/[cn](https://help.aliyun.com/zh/model-studio/getting-started/models) |
+| `mistral` | `MISTRAL_API_KEY` | [docs](https://docs.mistral.ai/getting-started/models/models_overview/) |
+| `replicate` | `REPLICATE_API_KEY` | [docs](https://replicate.com/collections/language-models) |
+| `groq` (not grok) | `GROQCLOUD_API_KEY` | [docs](https://console.groq.com/docs/models) |
+| `huggingface` | `HUGGINGFACE_API_KEY` | [docs](https://huggingface.co/models) |
+| `novita` | `NOVITA_API_KEY` | [docs](https://novita.ai/model-api/product/llm-api?utm_source=github_mindcraft&utm_medium=github_readme&utm_campaign=link) |
+| `openrouter` | `OPENROUTER_API_KEY` | [docs](https://openrouter.ai/models) |
+| `glhf` | `GHLF_API_KEY` | [docs](https://glhf.chat/user-settings/api) |
+| `hyperbolic` | `HYPERBOLIC_API_KEY` | [docs](https://docs.hyperbolic.xyz/docs/getting-started) |
+| `vllm` | n/a | n/a |
+| `cerebras` | `CEREBRAS_API_KEY` | [docs](https://inference-docs.cerebras.ai/introduction) |
+| `mercury` | `MERCURY_API_KEY` | [docs](https://www.inceptionlabs.ai/) |
+
+</details>
+
+For more comprehensive model configuration and syntax, see [Model Specifications](#model-specifications).
+
+For local models we support [ollama](https://ollama.com/) and we provide our own finetuned models for you to use. 
+To install our models, install ollama and run the following terminal command:
+```bash
+ollama pull sweaterdog/andy-4:micro-q8_0 && ollama pull embeddinggemma
+```
+
+## Online Servers
+To connect to online servers your bot will need an official Microsoft/Minecraft account. You can use your own personal one, but will need another account if you want to connect too and play with it. To connect, change these lines in `settings.js`:
+```javascript
+"host": "111.222.333.444",
+"port": 55920,
+"auth": "microsoft",
+
+// rest is same...
+```
+> [!Important]
+> The bot's name in the profile.json must exactly match the Minecraft profile name! Otherwise the bot will spam talk to itself.
+
+To use different accounts, Mindcraft will connect with the account that the Minecraft launcher is currently using. You can switch accounts in the launcher, then run `node main.js`, then switch to your main account after the bot has connected.
+
+## Tasks
+
+Tasks automatically start the bot with a prompt and a goal item to acquire or blueprint to construct. To run a simple task that involves collecting 4 oak_logs run 
+
+`node main.js --task_path tasks/basic/single_agent.json --task_id gather_oak_logs`
+
+Here is an example task json format: 
+
+```
+{
+    "gather_oak_logs": {
+      "goal": "Collect at least four logs",
+      "initial_inventory": {
+        "0": {
+          "wooden_axe": 1
+        }
+      },
+      "agent_count": 1,
+      "target": "oak_log",
+      "number_of_target": 4,
+      "type": "techtree",
+      "max_depth": 1,
+      "depth": 0,
+      "timeout": 300,
+      "blocked_actions": {
+        "0": [],
+        "1": []
+      },
+      "missing_items": [],
+      "requires_ctable": false
+    }
+}
+```
+
+The `initial_inventory` is what the bot will have at the start of the episode, `target` refers to the target item and `number_of_target` refers to the number of target items the agent needs to collect to successfully complete the task. 
+
+If you want more optimization and automatic launching of the minecraft world, you will need to follow the instructions in [Minecollab Instructions](minecollab.md#installation)
+
+## Docker Container
+
+If you intend to `allow_insecure_coding`, it is a good idea to run the app in a docker container to reduce risks of running unknown code. This is strongly recommended before connecting to remote servers, although still does not guarantee complete safety.
+
+```bash
+docker build -t mindcraft . && docker run --rm --add-host=host.docker.internal:host-gateway -p 8080:8080 -p 3000-3003:3000-3003 -e SETTINGS_JSON='{"auto_open_ui":false,"profiles":["./profiles/gemini.json"],"host":"host.docker.internal"}' --volume ./keys.json:/app/keys.json --name mindcraft mindcraft
+```
+or simply
+```bash
+docker-compose up --build
+```
+
+When running in docker, if you want the bot to join your local minecraft server, you have to use a special host address `host.docker.internal` to call your localhost from inside your docker container. Put this into your [settings.js](settings.js):
+
+```javascript
+"host": "host.docker.internal", // instead of "localhost", to join your local minecraft from inside the docker container
+```
+
+To connect to an unsupported minecraft version, you can try to use [viaproxy](services/viaproxy/README.md)
+
+# Bot Profiles
+
+Bot profiles are json files (such as `andy.json`) that define:
+
+1. Bot backend LLMs to use for talking, coding, and embedding.
+2. Prompts used to influence the bot's behavior.
+3. Examples help the bot perform tasks.
+
+## Model Specifications
+
+LLM models can be specified simply as `"model": "gpt-4o"`, or more specifically with `"{api}/{model}"`, like `"openrouter/google/gemini-2.5-pro"`. See all supported APIs [here](#model-customization).
+
+The `model` field can be a string or an object. A model object must specify an `api`, and optionally a `model`, `url`, and additional `params`. You can also use different models/providers for chatting, coding, vision, embedding, and voice synthesis. See the example below.
+
+```json
+"model": {
+  "api": "openai",
+  "model": "gpt-4o",
+  "url": "https://api.openai.com/v1/",
+  "params": {
+    "max_tokens": 1000,
+    "temperature": 1
+  }
+},
+"code_model": {
+  "api": "openai",
+  "model": "gpt-4",
+  "url": "https://api.openai.com/v1/"
+},
+"vision_model": {
+  "api": "openai",
+  "model": "gpt-4o",
+  "url": "https://api.openai.com/v1/"
+},
+"embedding": {
+  "api": "openai",
+  "url": "https://api.openai.com/v1/",
+  "model": "text-embedding-ada-002"
+},
+"speak_model": "openai/tts-1/echo"
+```
+
+`model` is used for chat, `code_model` is used for newAction coding, `vision_model` is used for image interpretation, `embedding` is used to embed text for example selection, and `speak_model` is used for voice synthesis. `model` will be used by default for all other models if not specified. Not all APIs support embeddings, vision, or voice synthesis.
+
+All apis have default models and urls, so those fields are optional. The `params` field is optional and can be used to specify additional parameters for the model. It accepts any key-value pairs supported by the api. Is not supported for embedding models.
+
+## Embedding Models
+
+Embedding models are used to embed and efficiently select relevant examples for conversation and coding.
+
+Supported Embedding APIs: `openai`, `google`, `replicate`, `huggingface`, `novita`
+
+If you try to use an unsupported model, then it will default to a simple word-overlap method. Expect reduced performance. We recommend using supported embedding APIs.
+
+## Voice Synthesis Models
+
+Voice synthesis models are used to narrate bot responses and specified with `speak_model`. This field is parsed differently than other models and only supports strings formatted as `"{api}/{model}/{voice}"`, like `"openai/tts-1/echo"`. We only support `openai` and `google` for voice synthesis.
+
+## Specifying Profiles via Command Line
+
+By default, the program will use the profiles specified in `settings.js`. You can specify one or more agent profiles using the `--profiles` argument: `node main.js --profiles ./profiles/andy.json ./profiles/jill.json`
+
+
+# Contributing
+
+We welcome contributions to the project! We are generally less responsive to github issues, and more responsive to pull requests. Join the [discord](https://discord.gg/mp73p35dzC) for more active support and direction.
+
+While AI generated code is allowed, please vet it carefully. Submitting tons of sloppy code and documentation actively harms development.
+
+## Patches
+
+Some of the node modules that we depend on have bugs in them. To add a patch, change your local node module file and run `npx patch-package [package-name]`
+
+## Development Team
+Thanks to all who contributed to the project, especially the official development team: [@MaxRobinsonTheGreat](https://github.com/MaxRobinsonTheGreat), [@kolbytn](https://github.com/kolbytn), [@icwhite](https://github.com/icwhite), [@Sweaterdog](https://github.com/Sweaterdog), [@Ninot1Quyi](https://github.com/Ninot1Quyi), [@riqvip](https://github.com/riqvip), [@uukelele-scratch](https://github.com/uukelele-scratch), [@mrelmida](https://github.com/mrelmida)
+
+
+## Citation:
+This work is published in the paper [Collaborating Action by Action: A Multi-agent LLM Framework for Embodied Reasoning](https://arxiv.org/abs/2504.17950). Please use this citation if you use this project in your research:
+```
+@article{mindcraft2025,
+  title = {Collaborating Action by Action: A Multi-agent LLM Framework for Embodied Reasoning},
+  author = {White*, Isadora and Nottingham*, Kolby and Maniar, Ayush and Robinson, Max and Lillemark, Hansen and Maheshwari, Mehul and Qin, Lianhui and Ammanabrolu, Prithviraj},
+  journal = {arXiv preprint arXiv:2504.17950},
+  year = {2025},
+  url = {https://arxiv.org/abs/2504.17950},
+}
+```
+
+## Contributors
+
+Thanks to everyone who has submitted issues on and off Github, made suggestions, and generally helped make this a better project.
+
+![Contributors](https://contrib.rocks/image?repo=mindcraft-bots/mindcraft)

package/andy.json

@@ -0,0 +1,6 @@
+{
+    "name": "andy",
+
+    "model": "gpt-5.4-mini"
+
+}

package/bin/mindcraft.js

@@ -0,0 +1,80 @@
+#!/usr/bin/env node
+import { init, createAgent } from '../src/mindcraft/mindcraft.js';
+import { overrideSpecDefaults } from '../src/mindcraft/mindserver.js';
+import * as userconfig from '../src/mindcraft/userconfig.js';
+
+const HELP = `
+mindcraft — LLM agents for Minecraft
+
+Usage:
+  npx mindcraft [ui] [options]
+
+Commands:
+  ui (default)   Start the mindserver web UI. Configure your API key,
+                 Minecraft server, and bots from the browser.
+
+Options:
+  --port <n>        Web UI port                       [default: 8080]
+  --data-dir <dir>  Where bot memories/histories live [default: ~/.config/mindcraft/bots]
+  --no-open         Don't auto-open the browser
+  -h, --help        Show this help
+
+Config is stored under $XDG_CONFIG_HOME/mindcraft (default ~/.config/mindcraft).
+`.trim();
+
+function parseArgs(argv) {
+    const opts = {
+        cmd: 'ui',
+        port: 8080,
+        dataDir: userconfig.paths.BOTS_DIR,
+        open: true,
+    };
+    for (let i = 0; i < argv.length; i++) {
+        const a = argv[i];
+        if (a === '-h' || a === '--help') { console.log(HELP); process.exit(0); }
+        else if (a === 'ui') opts.cmd = 'ui';
+        else if (a === '--port') opts.port = parseInt(argv[++i], 10);
+        else if (a === '--data-dir') opts.dataDir = argv[++i];
+        else if (a === '--no-open') opts.open = false;
+        else { console.error(`Unknown argument: ${a}\n\n${HELP}`); process.exit(2); }
+    }
+    return opts;
+}
+
+async function main() {
+    const opts = parseArgs(process.argv.slice(2));
+    if (opts.cmd !== 'ui') return;
+
+    // Load persisted config from ~/.config/mindcraft so a restart picks up where the
+    // wizard left off: keys → process.env, server settings → spec defaults,
+    // saved bots → recreated.
+    userconfig.loadKeysIntoEnv();
+    const config = userconfig.getConfig();
+    overrideSpecDefaults({
+        data_dir: opts.dataDir,
+        ...(config?.server || {}),
+    });
+
+    await init(false, opts.port, opts.open);
+    console.log(`\nMindcraft UI: http://localhost:${opts.port}`);
+    console.log(`Bot data dir: ${opts.dataDir}`);
+
+    if (config?.bots?.length) {
+        const profiles = Object.fromEntries(userconfig.listProfiles().map(p => [p.name, p]));
+        for (const bot of config.bots) {
+            const profile = profiles[bot.profile];
+            if (!profile) { console.warn(`Skipping bot "${bot.profile}": profile not found`); continue; }
+            console.log(`Restoring bot: ${bot.profile}`);
+            await createAgent({
+                ...(config.server || {}),
+                data_dir: opts.dataDir,
+                base_profile: bot.base_profile || 'assistant',
+                profile,
+            });
+        }
+    } else {
+        console.log(`No saved bots — open the UI to run setup.\n`);
+    }
+}
+
+main().catch((err) => { console.error(err); process.exit(1); });

package/keys.example.json

@@ -0,0 +1,19 @@
+{
+    "OPENAI_API_KEY": "",
+    "OPENAI_ORG_ID": "",
+    "GEMINI_API_KEY": "",
+    "ANTHROPIC_API_KEY": "",
+    "REPLICATE_API_KEY": "",
+    "GROQCLOUD_API_KEY": "",
+    "HUGGINGFACE_API_KEY": "",
+    "QWEN_API_KEY": "",
+    "XAI_API_KEY": "",
+    "MISTRAL_API_KEY": "",
+    "DEEPSEEK_API_KEY": "",
+    "GHLF_API_KEY": "",
+    "HYPERBOLIC_API_KEY": "",
+    "NOVITA_API_KEY": "",
+    "OPENROUTER_API_KEY": "",
+    "CEREBRAS_API_KEY": "",
+    "MERCURY_API_KEY":""
+}

package/main.js

@@ -0,0 +1,80 @@
+import * as Mindcraft from './src/mindcraft/mindcraft.js';
+import settings from './settings.js';
+import yargs from 'yargs';
+import { hideBin } from 'yargs/helpers';
+import { readFileSync } from 'fs';
+
+function parseArguments() {
+    return yargs(hideBin(process.argv))
+        .option('profiles', {
+            type: 'array',
+            describe: 'List of agent profile paths',
+        })
+        .option('task_path', {
+            type: 'string',
+            describe: 'Path to task file to execute'
+        })
+        .option('task_id', {
+            type: 'string',
+            describe: 'Task ID to execute'
+        })
+        .help()
+        .alias('help', 'h')
+        .parse();
+}
+const args = parseArguments();
+if (args.profiles) {
+    settings.profiles = args.profiles;
+}
+if (args.task_path) {
+    let tasks = JSON.parse(readFileSync(args.task_path, 'utf8'));
+    if (args.task_id) {
+        settings.task = tasks[args.task_id];
+        settings.task.task_id = args.task_id;
+    }
+    else {
+        throw new Error('task_id is required when task_path is provided');
+    }
+}
+
+// these environment variables override certain settings
+if (process.env.MINECRAFT_PORT) {
+    settings.port = process.env.MINECRAFT_PORT;
+}
+if (process.env.MINDSERVER_PORT) {
+    settings.mindserver_port = process.env.MINDSERVER_PORT;
+}
+if (process.env.PROFILES && JSON.parse(process.env.PROFILES).length > 0) {
+    settings.profiles = JSON.parse(process.env.PROFILES);
+}
+if (process.env.INSECURE_CODING) {
+    settings.allow_insecure_coding = true;
+}
+if (process.env.BLOCKED_ACTIONS) {
+    settings.blocked_actions = JSON.parse(process.env.BLOCKED_ACTIONS);
+}
+if (process.env.MAX_MESSAGES) {
+    settings.max_messages = process.env.MAX_MESSAGES;
+}
+if (process.env.NUM_EXAMPLES) {
+    settings.num_examples = process.env.NUM_EXAMPLES;
+}
+if (process.env.LOG_ALL) {
+    settings.log_all_prompts = process.env.LOG_ALL;
+}
+if (process.env.SETTINGS_JSON) {
+    try {
+        Object.assign(settings, JSON.parse(process.env.SETTINGS_JSON));
+    } catch (err) {
+        console.error("Failed to parse environment variable for SETTINGS_JSON:", err);
+    }
+}
+
+
+Mindcraft.init(false, settings.mindserver_port, settings.auto_open_ui);
+
+for (let profile of settings.profiles) {
+    const profile_json = JSON.parse(readFileSync(profile, 'utf8'));
+    settings.profile = profile_json;
+    Mindcraft.createAgent(settings);
+}

package/package.json

@@ -0,0 +1,78 @@
+{
+    "name": "mindcraft",
+    "version": "0.1.4-0",
+    "type": "module",
+    "publishConfig": {
+        "tag": "latest"
+    },
+    "main": "./src/mindcraft/index.js",
+    "exports": {
+        ".": "./src/mindcraft/index.js",
+        "./settings-spec": "./src/mindcraft/public/settings_spec.json"
+    },
+    "bin": {
+        "mindcraft": "./bin/mindcraft.js"
+    },
+    "files": [
+        "bin",
+        "src",
+        "profiles",
+        "patches",
+        "main.js",
+        "settings.js",
+        "andy.json",
+        "keys.example.json",
+        "FAQ.md",
+        "README.md",
+        "LICENSE"
+    ],
+    "dependencies": {
+        "@anthropic-ai/sdk": "^0.17.1",
+        "@cerebras/cerebras_cloud_sdk": "^1.46.0",
+        "@eslint/js": "^9.13.0",
+        "@google/genai": "^1.15.0",
+        "@huggingface/inference": "^2.8.1",
+        "@mistralai/mistralai": "^1.1.0",
+        "cheerio": "^1.0.0",
+        "eslint": "^9.13.0",
+        "eslint-plugin-no-floating-promise": "^2.0.0",
+        "express": "^4.18.2",
+        "globals": "^15.11.0",
+        "google-translate-api-x": "^10.7.1",
+        "groq-sdk": "^0.15.0",
+        "minecraft-data": "^3.97.0",
+        "mineflayer": "^4.33.0",
+        "mineflayer-armor-manager": "^2.0.1",
+        "mineflayer-auto-eat": "^3.3.6",
+        "mineflayer-collectblock": "^1.4.1",
+        "mineflayer-pathfinder": "^2.4.5",
+        "mineflayer-pvp": "^1.3.2",
+        "open": "^10.2.0",
+        "openai": "^4.4.0",
+        "patch-package": "^8.0.0",
+        "prismarine-item": "^1.15.0",
+        "prismarine-viewer": "^1.32.0",
+        "replicate": "^0.29.4",
+        "ses": "^1.9.1",
+        "socket.io": "^4.7.2",
+        "socket.io-client": "^4.7.2",
+        "three": "^0.128.0",
+        "vec3": "^0.1.10",
+        "yargs": "^17.7.2"
+    },
+    "optionalDependencies": {
+        "canvas": "^3.1.0",
+        "node-canvas-webgl": "^0.3.0"
+    },
+    "overrides": {
+      "canvas": "^3.1.0",
+      "gl": "^8.1.6"
+    },
+    "scripts": {
+        "postinstall": "patch-package",
+        "start": "node main.js",
+        "reinstall": "npm run clean:modules && npm install",
+        "clean:modules": "node -e \"const fs=require('fs');const p=require('path');['node_modules','package-lock.json'].forEach(f=>{if(fs.existsSync(f)){if(fs.lstatSync(f).isDirectory()){fs.rmSync(f,{recursive:true,force:true});}else{fs.unlinkSync(f);}}});\""
+    },
+    "devDependencies": {}
+}

package/patches/minecraft-data+3.97.0.patch

@@ -0,0 +1,13 @@
+diff --git a/node_modules/minecraft-data/minecraft-data/data/pc/1.21.6/protocol.json b/node_modules/minecraft-data/minecraft-data/data/pc/1.21.6/protocol.json
+index f80b696..fafa347 100644
+--- a/node_modules/minecraft-data/minecraft-data/data/pc/1.21.6/protocol.json
++++ b/node_modules/minecraft-data/minecraft-data/data/pc/1.21.6/protocol.json
+@@ -9033,7 +9033,7 @@
+             },
+             {
+               "name": "checksum",
+-              "type": "i8"
++              "type": "u8"
+             }
+           ]
+         ],

package/patches/mineflayer+4.33.0.patch

@@ -0,0 +1,54 @@
+diff --git a/node_modules/mineflayer/lib/plugins/digging.js b/node_modules/mineflayer/lib/plugins/digging.js
+index 496cf63..813a667 100644
+--- a/node_modules/mineflayer/lib/plugins/digging.js
++++ b/node_modules/mineflayer/lib/plugins/digging.js
+@@ -242,11 +242,14 @@ function inject (bot) {
+       enchantments = enchantments.concat(helmetEnchantments)
+     }
+ 
++    if (block.material === 'incorrect_for_wooden_tool')
++      block.material = 'mineable/pickaxe'
++
+     const creative = bot.game.gameMode === 'creative'
+     return block.digTime(
+       type,
+       creative,
+-      bot.entity.isInWater,
++      false, // isInWater, water calc is bugged, so always false
+       !bot.entity.onGround,
+       enchantments,
+       bot.entity.effects
+diff --git a/node_modules/mineflayer/lib/plugins/inventory.js b/node_modules/mineflayer/lib/plugins/inventory.js
+index 70db312..93d2054 100644
+--- a/node_modules/mineflayer/lib/plugins/inventory.js
++++ b/node_modules/mineflayer/lib/plugins/inventory.js
+@@ -125,10 +125,15 @@ function inject (bot, { hideErrors }) {
+         cursorZ: -1
+       })
+     } else if (bot.supportFeature('useItemWithOwnPacket')) {
++      const yawDeg = -bot.entity.yaw * 180 / Math.PI + 180 // invert + shift
++      const pitchDeg = -bot.entity.pitch * 180 / Math.PI // invert
+       bot._client.write('use_item', {
+         hand: offHand ? 1 : 0,
+         sequence,
+-        rotation: { x: 0, y: 0 }
++        rotation: {
++          x: yawDeg,
++          y: pitchDeg
++        }
+       })
+     }
+   }
+diff --git a/node_modules/mineflayer/lib/plugins/place_block.js b/node_modules/mineflayer/lib/plugins/place_block.js
+index fdaec6b..08983b6 100644
+--- a/node_modules/mineflayer/lib/plugins/place_block.js
++++ b/node_modules/mineflayer/lib/plugins/place_block.js
+@@ -11,7 +11,7 @@ function inject (bot) {
+     let newBlock = bot.blockAt(dest)
+     if (oldBlock.type === newBlock.type) {
+       [oldBlock, newBlock] = await onceWithCleanup(bot, `blockUpdate:${dest}`, {
+-        timeout: 5000,
++        timeout: 500,
+         // Condition to wait to receive block update actually changing the block type, in case the bot receives block updates with no changes
+         // oldBlock and newBlock will both be null when the world unloads
+         checkCondition: (oldBlock, newBlock) => !oldBlock || !newBlock || oldBlock.type !== newBlock.type