chobeat@lemmy.ml to Technology@lemmy.worldEnglish · 3 days agoMeet the AI workers who tell their friends and family to stay away from AIwww.theguardian.comexternal-linkmessage-square38linkfedilinkarrow-up1274arrow-down18
arrow-up1266arrow-down1external-linkMeet the AI workers who tell their friends and family to stay away from AIwww.theguardian.comchobeat@lemmy.ml to Technology@lemmy.worldEnglish · 3 days agomessage-square38linkfedilink
minus-squarebrucethemoose@lemmy.worldlinkfedilinkEnglisharrow-up3·edit-23 days agoBloefz has a great setup. Used Mi50s are cheap. An RTX 3090 + a cheap HEDT/Server CPU is another popular homelab config. Newer models run reasonably quickly on them, with the attention/dense layers on the GPU and sparse parts on the CPU.
Bloefz has a great setup. Used Mi50s are cheap.
An RTX 3090 + a cheap HEDT/Server CPU is another popular homelab config. Newer models run reasonably quickly on them, with the attention/dense layers on the GPU and sparse parts on the CPU.