Show HN: Example POC to run the Dolly V2 12B model in 8bit mode I banged this out today because nobody seems to have figured this out yet (and I wanted to play with this model). I was inspired by the fact that Simon Willison was struggling to get this running[0], so I wanted to take a crack at it! This is by no means "clean", but it is a baseline for others to hack from. Feel free to send over PRs and I'll land them! (I'd love it somebody used this to glue this into this webui[1].) 0: https://ift.tt/Qm182xv 1: https://ift.tt/9rJl0td https://ift.tt/7DsV6gN April 15, 2023 at 03:46AM
Post Top Ad
Your Ad Spot
Friday, April 14, 2023
Home
Hacker News
Show HN: Example POC to run the Dolly V2 12B model in 8bit mode https://ift.tt/35DEx7Q
Show HN: Example POC to run the Dolly V2 12B model in 8bit mode https://ift.tt/35DEx7Q
Tags
Hacker News#
Share This
About latest news
Hacker News
Labels:
Hacker News
Subscribe to:
Post Comments (Atom)
Post Top Ad
Author Details
Ut wisi enim ad minim veniam, quis nostrud exerci tation ullamcorper suscipit lobortis nisl ut aliquip ex ea commodo consequat. Duis autem vel eum iriure dolor in hendrerit in vulputate velit esse molestie consequat.
Post Top Ad

No comments:
Post a Comment