News for hackers. Stuff that matters.
Re:AMD Alveo V70 AI inference accelerator card by inetsee on Tuesday January 10, 2023 @10:51AM (#34326661)
I have no problem imagining a security camera application needing to monitor quite a few video channels.
Re:AMD Alveo V70 AI inference accelerator card by h2odragon on Tuesday January 10, 2023 @11:25AM (#34327260)
Certainly. I'm suspecting that doing much of anything with all 96 channels would really need more RAM, for most users.
Re:AMD Alveo V70 AI inference accelerator card by scottlamb on Tuesday January 10, 2023 @12:34PM (#34328400)
On the inference accelerator? IIUC, the RAM is just to hold the model and whatever state it needs during a particular inference operation. I'm not an expert on ML but AFAIK 16 GiB is plenty. I suppose it'd also need to hold onto reference frames for the video decoding, but at 1080p with e.g. YUV420 (12 bits per pixel), you can hold a lot of those in 16 GiB. edit: e.g., 4 references for each of the 96 streams would take ~1 GiB.

Even on the host, 16 GiB is fine for say an NVR. They don't do need to keep a lot of state in RAM (or for that matter to do a lot of on-CPU computation either).

Re:AMD Alveo V70 AI inference accelerator card by andy_ppp on Tuesday January 10, 2023 @11:00AM (#34326853)
/camera/state/g
Re:AMD Alveo V70 AI inference accelerator card by phkahler on Tuesday January 10, 2023 @11:54AM (#34327726)
>> I have no problem imagining a security camera application needing to monitor quite a few video channels.

As a joke I sometimes tell people the automatic flushing toilets in public bathrooms work by having a little camera monitored by someone in a 3rd world country who remotely flushes as needed, while monitoring a whole lot of video feeds. They usually don't buy it, but will often acknowledge that our world is uncomfortably close to having stuff like become reality.