News for hackers. Stuff that matters.
Re:Apple: Transformer architecture optimized for Apple Silicon by bitL on Thursday March 23, 2023 @09:39PM (#35283986)
Fine-tuning is a solved problem using transformer adapters which are fast, small and match regular fine-tuning, so that's not an issue. As for smaller models, their usefulness will quickly wane when they will be seen as producing trivial gibberish in the light of cloud models available in 5 years.

There are no comments on this comment yet.