Show HN: I made a free-to-use GPT-2 API

Re:Show HN: I made a free-to-use GPT-2 API by edunteman on Tuesday September 22, 2020 @10:01PM (#24562188)

UPDATE: First time launching this to larger audience, and hitting infra limits. It's self healing, but please be patient if an error throws; try back in 3 minutes. I'm working to remedy it now.

[ Parent | on HN ]

Re:Show HN: I made a free-to-use GPT-2 API by edunteman on Tuesday September 22, 2020 @10:32PM (#24562357)

UPDATE: (as of 24 upvotes on main post). I scaled up my infra. It should be more stable at current load. Please continue to be patient; y'all are great.

[ Parent | on HN ]

Re:Show HN: I made a free-to-use GPT-2 API by edunteman on Wednesday September 23, 2020 @01:11AM (#24563206)

UPDATE: (as of 36 upvotes): Thanks everyone for trying it out and hitting me with the traffic. Great Show HN.

Found a memory leak. Luckily it self heals on crash, so downtime is minimal. You can expect this api to be live 55/60 minutes. Will be fixing tomorrow - for now, it's bedtime.

If you want to wait for something with guaranteed uptime, jump on the waitlist at https://www.booste.io and I'll be reaching out when appropriate.

[ Parent | on HN ]

Re:Show HN: I made a free-to-use GPT-2 API by edunteman on Tuesday September 29, 2020 @08:10PM (#24634525)

UPDATE: (a week later): I've gutted my infrastructure and moved to TF Serving. Haven't had a downtime event in the 30 hrs it's been live. Jump on the waitlist for updates :)

[ Parent | on HN ]