I’ve been busy lately making the game ready for Steam and here it is: https://store.steampowered.com/app/4430050/SLOP_FIGHTER/
With this project I have had a lot of uncertainty as to what is actually possible to achieve from a large language model. I have constantly felt like I am walking a tightrope above complete incomprehensibility, but over time I have managed to work some very fine threads and sew together some truly impressive features I only ever dreamed were possible. I go into more length on itch.io, but to sum up, I’ve managed to better contextualise the LLM’s understanding of all the words I’ve stuffed into it. This means they can, and will, narrate the way they use themselves more effectively. A monster with camouflage, like a chameleon, will reference it when an attack against them misses, for example. The monsters are more aware of their environment, their opponent, and themselves. All the different information about the monsters is being passed properly all the way through. There is still some degree of “creative compliance”. I also added laser beams and other special attacks.
Underlying the narration are extensive semantic graphs, which are simply blocks of words sorted into categories, like body parts, movement styles, and mutation vocabulary. The LoRA adapters, which attach to the LLM, are trained on sentences constructed out of these graphs. Each word, in consideration of the sentence structure it was trained on, is given numerical weight and at runtime the LLM relies on its internal mathematics to decide which word to generate.
Its decision-making when it comes to generating words can be influenced, kind of guided, by careful prompting. Essentially, if you give the LLM enough of the information it needs in the right way it can start to build the required context to generate narration that reflects its character.
It’s a problem I’m familiar with as an author. How do I get the reader to generate an image in their head based on the words I am using? How do I make this person understand? It’s kind of fun to think about how the challenges are the same for what is just a machine that generates words.
Here’s the link again: https://store.steampowered.com/app/4430050/SLOP_FIGHTER/
Leave a Reply