News for hackers. Stuff that matters.

A comment on DeepSpeed Chat: Easy, fast and affordable RLHF training of ChatGPT-like models. Parent comment

Re:DeepSpeed Chat: Easy, fast and affordable RLHF training o... by alwayslikethis on Thursday April 13, 2023 @02:18AM (#35551737)
Is it? It might have even more computing power, but are cards now able to share VRAM now? My hands-on experience of all this is from a few years ago and I think it was not possible back then.
[ Parent | on HN ]
Re:DeepSpeed Chat: Easy, fast and affordable RLHF training o... by Tepix on Thursday April 13, 2023 @05:05AM (#35552833)
DeepSpeed is designed to take care of spreading the work for you.

You can link two 3090s with nvlink to increase bandwidth.

[ Parent | on HN ]