News for hackers. Stuff that matters.
Re:Alpaca: A Strong Open-Source Instruction-Following Model by technerder on Monday March 13, 2023 @05:47PM (#35143335)
Is there anyway to use Google's Coral TPU PCIe Accelerator[1]'s to increase the inference performance of GPT models like this and Llama?

[1] https://coral.ai/products/pcie-accelerator/

Re:Alpaca: A Strong Open-Source Instruction-Following Model by tempaccount420 on Monday March 13, 2023 @09:18PM (#35145990)
Supposedly TPUs are better than GPUs, but everyone other than Google uses GPUs for models.