Re:Introducing DBRX: A New State-of-the-Art Open LLM by Data...
by XCSme on Wednesday March 27, 2024 @03:43PM
(#39843663)
That question was just an example (Lorem ipsum), it was easy to copy paste to demo the local LLM, I didn't intend to provide more context to the discussion.
I ordered a 2nd 3090, which has 24GB VRAM. Funny how it was $2.6k 3 years ago and now is $600.
You can probuild a decent AI local machine for around $1000.
Re:Introducing DBRX: A New State-of-the-Art Open LLM by Data...
by spxneo on Wednesday March 27, 2024 @03:49PM
(#39843742)
https://howmuch.one/product/average-nvidia-geforce-rtx-3090-... you are right there is a huge drop in price
Re:Introducing DBRX: A New State-of-the-Art Open LLM by Data...
by XCSme on Wednesday March 27, 2024 @07:29PM
(#39845896)
New it's hard to find, but the 2nd hand market is filled with them.
how much is your hardware at today's value? what are the specs? that is impressive even though its 3 words per second. if you want to bump it up to 30, do you then 10x your current hardware cost?