News for hackers. Stuff that matters.
Re:AI engineers claim new algorithm reduces AI power consump... by dietr1ch on Saturday October 19, 2024 @03:06PM (#41889877)
I guess that if the bulk of the computation goes into the multiplications, you can work in the log-space and simply sum, and when the time comes to actually do a sum on the original space you can go back and sum.
Re:AI engineers claim new algorithm reduces AI power consump... by a-loup-e on Saturday October 19, 2024 @03:35PM (#41890126)
Not sure how well that would work if you're often adding bias after every layer