Re:Hosting a GPT-2 autoresponder bot
by m-i-l on Wednesday January 08, 2020 @04:57AM
(#21989984)
> google provides computing resources for demo purposes for free, which can be exploited for non-intended use by clever automation
...and there are some issues with this free model (Colab notebook timeouts and TPUs sometimes being unavailable) which the author is "unfairly annoyed [with] since I’m getting something for free".
See also "AI Dungeon 2 costing over $10k/day to run on GCS/Colab"[0] noting that the costs were not due to Colab itself but the bandwidth in copying the model from the GCP Storage Bucket to Colab.
...and there are some issues with this free model (Colab notebook timeouts and TPUs sometimes being unavailable) which the author is "unfairly annoyed [with] since I’m getting something for free".
See also "AI Dungeon 2 costing over $10k/day to run on GCS/Colab"[0] noting that the costs were not due to Colab itself but the bandwidth in copying the model from the GCP Storage Bucket to Colab.
[0] https://news.ycombinator.com/item?id=21739879