News for hackers. Stuff that matters.

A comment on DeepSpeed Chat: Easy, fast and affordable RLHF training of ChatGPT-like models. Parent comment

Re:DeepSpeed Chat: Easy, fast and affordable RLHF training o... by Tepix on Thursday April 13, 2023 @02:02AM (#35551635)
Agreed, but two RTX 3090/4090 should be as capable in this regard (having 2x 24GB).
[ Parent | on HN ]
Re:DeepSpeed Chat: Easy, fast and affordable RLHF training o... by alwayslikethis on Thursday April 13, 2023 @02:18AM (#35551737)
Is it? It might have even more computing power, but are cards now able to share VRAM now? My hands-on experience of all this is from a few years ago and I think it was not possible back then.
[ Parent | on HN ]
Re:DeepSpeed Chat: Easy, fast and affordable RLHF training o... by Tepix on Thursday April 13, 2023 @05:05AM (#35552833)
DeepSpeed is designed to take care of spreading the work for you.

You can link two 3090s with nvlink to increase bandwidth.

[ Parent | on HN ]
Re:DeepSpeed Chat: Easy, fast and affordable RLHF training o... by mejutoco on Thursday April 13, 2023 @06:12AM (#35553298)
AFAIK the 4090 cannot share ram like that (no nvlink)
[ Parent | on HN ]