The latest news and headlines from The News International. Get breaking news stories videos and photos

ive tv

Breaking

Post Top Ad

Your Ad Spot

Friday, April 14, 2023

Show HN: Example POC to run the Dolly V2 12B model in 8bit mode https://ift.tt/35DEx7Q

Show HN: Example POC to run the Dolly V2 12B model in 8bit mode I banged this out today because nobody seems to have figured this out yet (and I wanted to play with this model). I was inspired by the fact that Simon Willison was struggling to get this running[0], so I wanted to take a crack at it! This is by no means "clean", but it is a baseline for others to hack from. Feel free to send over PRs and I'll land them! (I'd love it somebody used this to glue this into this webui[1].) 0: https://ift.tt/Qm182xv 1: https://ift.tt/9rJl0td https://ift.tt/7DsV6gN April 15, 2023 at 03:46AM

No comments:

Post a Comment

Post Top Ad