On a lazy Sunday I gave an AI full control of an OSRS character and told it to figure the game out itself.
WALKER reads live game state from files written by a custom RuneLite plugin — player stats, nearby objects, NPCs, items on the ground, current animations — sends it to an LLM (Groq Llama 70B, Ollama fallback), which decides what to do next and clicks accordingly. No API injection. Just files and pixels.
What makes it interesting:
→ Self-teaching — when it hits something it doesn't know, it searches the OSRS wiki, uses the LLM to write a procedure, and saves it for next time
→ Switches between skills autonomously based on XP efficiency scoring
→ Live web dashboard showing what it's thinking in real time
→ Handles login/logout recovery, Grand Exchange trading, banking, combat, and quests
→ Human-like timing so it doesn't look like a bot (it still clearly does)
Current character: Wise Iron Ma — F2P, combat level 11. Firemaking lv41, Woodcutting lv38, Mining lv41. Got there on its own.
It's not exactly polished. It walks into walls sometimes. It gets confused about where it is. But watching it reason through a problem, search the wiki, write itself a new procedure and then execute it — that part genuinely works.
Built for fun on a Sunday. Still running.
Interested in this project?
I'm always happy to talk through how it was built, the problems it solves, or how something similar could work for you.