News for hackers. Stuff that matters.
Re:Experimental library for scraping websites using OpenAI's... by specproc on Saturday March 25, 2023 @04:29PM (#35306964)
Yeah, #1 just makes this seem pointless for the time being. The whole point of needing something like this is horizontal scaling.

Also not clear from my phone down the pub if inference is needed at each step. That would be slow, no? Even (especially?) if you owned the model.

Re:Experimental library for scraping websites using OpenAI's... by tomberin on Saturday March 25, 2023 @04:33PM (#35307013)
No inference is needed. IME it can do a single page in ~10s, $0.01/page. Not practical for most use cases, great for a limited few right now.