lidd1ejimmy@lemmy.ml to Memes@lemmy.mlEnglish · 2 years agoOffline version of Chat GPTlemmy.mlexternal-linkmessage-square25linkfedilinkarrow-up1502arrow-down18
arrow-up1494arrow-down1external-linkOffline version of Chat GPTlemmy.mllidd1ejimmy@lemmy.ml to Memes@lemmy.mlEnglish · 2 years agomessage-square25linkfedilink
minus-squareNoiseColor @lemmy.worldBanned from communitylinkfedilinkarrow-up14arrow-down2·2 years agoRemoved by mod
minus-squareIgnotum@lemmy.worldlinkfedilinkarrow-up8·2 years ago70b model taking 1.5GB? So 0.02 bit per parameter? Are you sure you’re not thinking of a heavily quantised and compressed 7b model or something? Ollama llama3 70b is 40GB from what i can find, that’s a lot of DVDs
minus-squareNoiseColor @lemmy.worldBanned from communitylinkfedilinkarrow-up9·2 years agoRemoved by mod
minus-square9point6@lemmy.worldlinkfedilinkarrow-up7·2 years agoLess than half of a BDXL though! The dream still breathes
minus-squareSteve@startrek.websitelinkfedilinkarrow-up5·2 years agoFor some reason, triple layer writable blu-ray exists. 100GB each https://www.verbatim.com/prod/optical-media/blu-ray/bd-r-xl-tl/bd-r-xl-tl/
minus-squareerrer@lemmy.worldlinkfedilinkEnglisharrow-up8·2 years agoIt is a DVD, can faintly see DVD+R on the left side
minus-squareDannyBoy@sh.itjust.workslinkfedilinkEnglisharrow-up5·2 years agoIt does have the label DVD-R
Removed by mod
70b model taking 1.5GB? So 0.02 bit per parameter?
Are you sure you’re not thinking of a heavily quantised and compressed 7b model or something? Ollama llama3 70b is 40GB from what i can find, that’s a lot of DVDs
Removed by mod
Less than half of a BDXL though! The dream still breathes
For some reason, triple layer writable blu-ray exists. 100GB each
https://www.verbatim.com/prod/optical-media/blu-ray/bd-r-xl-tl/bd-r-xl-tl/
It is a DVD, can faintly see DVD+R on the left side
It does have the label DVD-R