Huggingface

This has been the best so far, some wierd behaviour sometimes, maybe that’s my parameters though.

For some characters, this has been the best at keeping them in character and progressing the story!

  • dbilitated@aussie.zone
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    1 year ago

    so glad to find this sub on lemmy. i was trying to find out more about this and didn’t want to re-open my reddit! thank you for posting

    Edit: unusably slow when i first got it set up but much faster once I got the GPTQ-for-llama set up. Some really good responses.

    • 2dollarsim@lemmy.worldOPM
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      I ended up downloading all of the 13B SuperHOT models, each one seems great, but I am still trying to work out how to set the parameters correctly