Still waiting for something like this to be run on local hardware. Would be nice to be able to run this on my RTX 3090 :D
I'm in the same boat! I've been playing around with KobaldAI and Oobabooga. It's coming along slowly, but surely. I haven't checked in with the projects in a month or too, but even while I was playing with them you could do some interesting things. My main issue was speed. Responses were talking 10-20 seconds to come in, which felt really slow to have a conversation.
Personally, I really want an co-writer software. I can come up with my own ideas with little issue, but I find that a lot of current solutions are either chatbot only, or just an editor. Novel AI was really fun to play with, but got expensive pretty quickly.
It's actively under development and only came out a couple weeks ago, so sharing chats will probably happen soon.
I've used several of the scenarios and had a good time.
You can use the site for free with a queue, but you can sign up for the site's patreon at $14.50 to skip the queue.