Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on /story/35181406.
Demo: https://alpaca-ai0.ngrok.io/
Video summary: https://youtu.be/6qdzsDSduww
Text summary
Alpaca is a solution to NLP centralization proposed by Stanford researchers
Alpaca learns from GPT-3.5/ChatGPT to generate data for training
Base model: Llama (7 billion parameters)
Training cost: 3 hours on an A100 GPU*8 (< $100) Can be used with various models (sequence-to-sequence)
Usage: Primarily for academic research, commercial use prohibited
Future directions: Scaling models, properties of base models and instruction data, alternatives to supervised training on ChatGPT data
There are no comments on this comment yet.
Demo: https://alpaca-ai0.ngrok.io/
Video summary: https://youtu.be/6qdzsDSduww
Text summary
Alpaca is a solution to NLP centralization proposed by Stanford researchers
Alpaca learns from GPT-3.5/ChatGPT to generate data for training
Base model: Llama (7 billion parameters)
Training cost: 3 hours on an A100 GPU*8 (< $100) Can be used with various models (sequence-to-sequence)
Usage: Primarily for academic research, commercial use prohibited
Future directions: Scaling models, properties of base models and instruction data, alternatives to supervised training on ChatGPT data