Meta Llama 3 Available on Cloudflare Workers AI Posted by gregorymichael on Thursday April 18, 2024 @05:01PM from the blog.cloudflare.com dept. https://blog.cloudflare.com/meta-llama-3-available-on-cloudflare-workers-ai ( 1 comment | 6 points | on HN )
Usually OpenAI response is within 2 seconds, but llama2 takes 20+ seonds for the same.
How are they tackling the performance?