News for hackers. Stuff that matters.
Re:AI Infrastructure Landscape by Zetobal on Monday February 26, 2024 @06:39AM (#39510132)
You can do it pretty much with a random processor 64GB RAM (RAM is really cheap atm) and a 4080.
Re:AI Infrastructure Landscape by anditherobot on Monday February 26, 2024 @06:54AM (#39510242)
Really! I always imagine a system: Composed of 5 specialized computers.

One for each category: audio, text, video, image.

One analyzer to coordinate everything.

This would be my API that I could access with mobile devices.

Here's a scenario:

I could talk to my phone about ideas, in the background it would create apps prototypes, create posters, make music based on something i whistle, teach me ask i ask question about a topic.

We could delegate the mundane stuff to it.

Re:AI Infrastructure Landscape by PeterisP on Monday February 26, 2024 @06:59PM (#39518381)
For the currently used architectures, it doesn't make sense to have 5 specialized, dedicated computers as the "AI" text processing and "AI" video processing and the others use very similar architectures and there's no benefit from specialization, the "video-specialized" hardware would be just as good at processing text and vice versa.
Re:AI Infrastructure Landscape by anditherobot on Monday February 26, 2024 @10:02PM (#39519662)
I could be a new architecture.

A processor has different cores, Computers may have several hard-drives, 4 sticks of ram.

Each component can run in parallel.for example, if a long video processing task is underway and your text generation component is idle, it could assist.

Should the audio component fail , only that specific part would be affected.