Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Show HN: Text-to-video model from scratch (2 brothers, 2 years, 2B params). Parent comment
The 2B parameters will take up 4 Gb of memory but activations will be a lot more given size of context windows for video.
A 720p 5 second video is roughly 100K tokens of context
There are no comments on this comment yet.
The 2B parameters will take up 4 Gb of memory but activations will be a lot more given size of context windows for video.
A 720p 5 second video is roughly 100K tokens of context