Hello, DREAM_SEARCH_REPEAT Here. 
In the past week i was working in this prototype.

https://dream-search-repeat.itch.io/tom-the-gatekeeper-knigh

This game can 'comunicate' with an  locally running LLM (Ai that makes text like ChatGPT or Gemini) to make it control a NPC in a 3D game (I call it GenAINPC to separate it of the usual NPCs)

I used LM Studio but other servers like GPT4ALL or KoboldCPP should work as well (you might have to modify a script in the game files)

The game is open source and i am also sharing a PDF that explains how the codes work. If you have any question, please tell me. :-)

I hope this is at least useful to somebody.