walterfreedom

Hey, I have been posting here about my progress for a while. basically, I could implement the first iteration of my ML/AI/Agentic world generation and story generation engine in my RimWorld mod, FelPawns. I wish you all a nice read!

Current snapshot + semantic search related to the "recent event + messages since last trigger" in the database of memories. I prune unnecessary events (built chair, planted rice etc) as time goes on, and have a decay system that basically decreases the weight of old misc events. I also do not keep the messages in the save file directly and instead keep them in a seperate file in mod config, to not bloat the main save XML. Can it be polished more? Absolutely. but I had to publish this at some point after all. that being said, I am planning to actually focus on environmental awareness and better context as time goes on.

Hey, I wrote here about my FelWorld mod series, where I wished to turn RimWorld into an RPG game a few months ago (https://news.ycombinator.com/item?id=45921896#45921995). I couldn't release the FelQuest Module, that would be responsible with generating quests and world content overall yet, but as a start I could create my FelPawns mod, which makes you the main character, and allow you to talk to other pawns (LLM, RAG, Tool call setup). I wished to share it here too, as some people commented on the other thread before ^^

Not sure, I will publish this in different modules and add most of the content over time but first release might be around early january? really depends on my workload on my real job. I might release it earlier as proof of concept, but not planning this right now.

That's definitely true. LLMs, Especially small ones tend to give not so random responses. This can be mitigated by context a little bit (fortunately, RimWorld already has some lore building built in) but still it will never be completely unique. Without trying I cant say much tbh, but its promising nevertheless.

If we are talking about the Quest Generation part (which is still pretty early nin development), it's not just calling pre-existing RimWorld map events (Like Raids, Animals join, Ambrosia Sprout etc).

Instead, I am trying to create a sort of lego-bricks kind of approach for the LLM. Basically, I provide it a list (sometimes, a decently huge list) of building blocks for categorized as "Action", "Condition", and "Reward" nodes, each interface also inheriting from the "Node" interface and LLM creates this nodes which are formatted and created at a factory class at runtime, leading to a Tree like approach that fires a quest, tracks it at runtime if possible and if not possible LLM will interpret if the quest is complete (sadly, I will have to add a "Scan if complete" button somewhere, to save on performance).

Of course this approach is prone to lots of refactoring and design changes, since I am learning by doing. Just yesterday, I was reading about level generation using LLMs (https://arxiv.org/abs/2407.09013) which goes into a more detailed discussion at chapter 5, especially at 5.2

LLM also will also have the context about your colony, your recent quests and recent events, map situation etc so it will certainly be more immersive than just randomizing the events. After all, even the default storytellers (even Randy) plays by some rules, and is not totally random.

I am also trying to keep the core architecture pretty abstract, so I and maybe other developers can just patch it and easily implement their own "Nodes" (maybe I should start calling them leafs...) and this sorta adds some development overhead too. If I can find some time, I will share some examples about the generated quests (both raw response from LLM and processed result) int the future.

In my own system in unity, I used LLMs as merely an orchestrator and left Behaviour Trees (https://arxiv.org/abs/1709.00084) as the main core of NPC behaviour. I assume this question is directed at the NPC engine part of the mod, "FelPawns" as of right now.

Since my goal is to manupilate the NPC behaviour ingame directly, and use LLM for more than just roleplay chatbot purposes performance is indeed and issue. I think the hardest part is to bridge the LLM and Rimworld internal scheduler seamlessly. I am following some articles loosely , like Generative Agents (https://arxiv.org/abs/2304.03442) to take inspiration (and innovate/iterate on it). Nevertheless, my goal is not to make a better version of RimWorld pawns, but just a more immersive version and get to try some methods I wanted to try along the way. Taking players decision away and delegating to a machine that is not good at long term planning will never be a viable choice in RimWorld, in terms of meta-gaming. However, if we focus on social aspects of the pawns and leave the performance-sensitive parts to the game itself I think we can hit a pretty nice middle ground.

I have been learning about and trying LLM/SLM and other things that could be used to enhance RPG elements and replayability of games, and wanted to give RimWorld a try because creating my own ecosystem in Unity was pretty hard work for a sideproject.

AI is already very impressive for natural language formatting and filtering, we use it for ratifying profiles and posts. and it takes around like an hour to implement this from scratch, and there are no alternatives that can do the same thing as comprehensively anyways

I have been hearing the term 'context engineering' and wanted to share my article about it, which is mostly focusing on AI npcs and not enterprise use cases.

I am mostly focusing in this issue during the development of my agent engine (mostly for game npcs). Its really important to manage the context and not bloat the llm with irrelevant stuff for both quality and inference speed. I wrote about it here if anyone is interested: https://walterfreedom.com/post.html?id=ai-context-management

Personally, most the features Wpengine offered wasn't very useful for my team and we just went to rent servers on Hetzner for the sake of simplicity. Same goes for Cpanel too. We just used google drive + mysqldump to synchronize the database and rsync to synchronize the files. However, we manage the site ourselves with a team of 4 dedicated software engineers so I don't know if this approach would work for customers who just want a site that they will edit themselves.