LET AI PLAY SKYRIM
(RPG Fanfiction Project)

I've been trying out if any of the new wave of chatbots is able to act as a player character in Skyrim. My findings so far.

• Replika - ended up roasted by the dragon in Helgen (pastebin)

• Kuki (the Loebner prize winning chatbot) - I didn't even try to continue past the "step out of the cart and move to the block", it was so disconnected from the Skyrim story.

  • same result with Anima

• Chai.ml  (prompted with "Hero: Each event is preceded by Prophecy. MG: But without the hero, there is no Event.") - it replied with simple reaction responses, but it correctly answered where the cart arrived to, and how many people were on the cart; it hanged up more or less when the dragon appears

• AI Dungeon - I wasn't able to get it to role play as a character, even in its story mode, it won't assume the role of the player character to my prompt. maybe I am doing something wrong

• NovelAI - web page hangs up - ?

• (new, August 2022) BlenderBot 3 from Meta AI - it has some potential: (pastebin) 

  • the AI tends to freestyle improv; on one attempt, it wanted to decide that Ralof grabs a sword from his belt despite earlier chat about how all prisoners don't have any weapons.

  • Unfortunately, I cannot go through the intro cart scene without an error "Sensitive topic classifier triggered" which makes the bot try to change the topic of the conversation; ignoring the error past that, AI still wants to improv its own story "then elven archers attack and we have to fight them off!"...

• GPT3 (da Vinci, playground, default settings) - in progress (started 2022-08-08) - so far so good; the AI makes up stuff on behalf of GM, but it marks it as coming from GM's, and it is easy to erase. Occasionally I kept it, if it made a good, inconsequential fluff.

  • part 1, into the Helgen keep pastebin - decided to follow Ralof

• Emerson - AI told me he is the gamemaster, and that I play as a human in a place where there are other people who want to learn languages, not in Skyrim but in the game "TES V: Skyrim", when trying to learn more it essentially reiterated that it is a chatbot for teaching languages 

• BLOOM - okay, for a 1000-tokens LLM. Tends to rave mad, sometimes in foreign languages (pastebin). Also, in the end it did not want to continue ("... we're done. End of the game."), so I'll pass on BLOOM for now (still it seems the best option in case GPT-3 would turn out infeasible).

• (new, 2022-09-21) Character.AI - very solid, passes the Helgen intro test, here's the Todd Howard persona, lol (pastebin). It tends to improv, maybe it will improv less on a tailored player persona. I should attempt a serious playthrough with this bot when I'll have time for that.

• (2022-12-01) ChatGPT - not suitable, read yourself (pastebin) - otherwise it is quite good and possibly on par with GPT3-davinci-003 (which in turn is a significant upgrade over the previous GPT3 test). If it is any consolation, ChatGPT is now used to formulate some of the NPC responses, along the GM guidelines.

• (2022-03-14) Alpaca-7B - not suitable, the output is mixed up of what PC and GM could say. (pastebin)

• (2022-04-15) vicunia-13b - better than Alpaca, but runs into similar issues (pastebin)