Re:Visual ChatGPT
by Der_Einzige on Friday March 10, 2023 @10:14AM
(#35095328)
Flash attention gets this down to linear time complexity with no loss of quality.
[ Parent
| on HN ]
Re:Visual ChatGPT
by sebzim4500 on Friday March 10, 2023 @12:09PM
(#35097359)
No it doesn't, it just improves the constant factor by a lot. Unless you are thinking of block sparse attention, which can chance complexity (assuming you scale sparsity with size) but decreases quality.