News for hackers. Stuff that matters.

A comment on AI Infrastructure Landscape. Parent comment

Re:AI Infrastructure Landscape by PeterisP on Monday February 26, 2024 @06:59PM (#39518381)
For the currently used architectures, it doesn't make sense to have 5 specialized, dedicated computers as the "AI" text processing and "AI" video processing and the others use very similar architectures and there's no benefit from specialization, the "video-specialized" hardware would be just as good at processing text and vice versa.
[ Parent | on HN ]
Re:AI Infrastructure Landscape by anditherobot on Monday February 26, 2024 @10:02PM (#39519662)
I could be a new architecture.

A processor has different cores, Computers may have several hard-drives, 4 sticks of ram.

Each component can run in parallel.for example, if a long video processing task is underway and your text generation component is idle, it could assist.

Should the audio component fail , only that specific part would be affected.

[ Parent | on HN ]