News for hackers. Stuff that matters.
Re:Llama3 implemented from scratch by dauertewigkeit on Sunday May 19, 2024 @05:05PM (#40409739)
There are things like NAS (neural architectural search) but all you are doing is just growing the search space and making the optimization problem much harder. Typically you do the architectural optimization by hand, using heuristics and past experiments as guidance.

There are no comments on this comment yet.