Weights will be realised tomorrow, according to one of the tech report authors on Twitter.
Re:Phi-3 Technical Report
by ignoramous on Tuesday April 23, 2024 @12:54AM
(#40128648)
> you meant 12 tokens/sec
Thanks! The HTML version on archive.is has messed up markup and shows 1212 instead: https://archive.is/Ndox6
Re:Phi-3 Technical Report
by intellectronica on Tuesday April 23, 2024 @02:24AM
(#40129089)
Weights are coming tomorrow.
tomorrow is now: https://huggingface.co/microsoft/Phi-3-mini-4k-instruct
Phi-1, Phi-1.5, and Phi-2 have all had their weights released, and those weights are available under the MIT License.
Hopefully Microsoft will continue that trend with Phi-3.
> outputs 1212 tokens/sec on iOS
I think you meant "12 tokens/sec", which is still nice, just a little less exciting than a kilotoken/s.