News for hackers. Stuff that matters.
Re:Ask HN: Working with CPG Retail Data by JimXugle on Monday December 11, 2023 @11:46PM (#38609637)
Not specific to the CPG realm, but I've had some very good luck working with the OpenAPI-devtools Chrome Extension[1] (previous discussion here on hackernews[2]) to discover the underlying APIs of various sites that I want to scrape data from.

[1] https://github.com/AndrewWalsh/openapi-devtools

[2] https://news.ycombinator.com/item?id=38012032

Re:Ask HN: Working with CPG Retail Data by NickFanion on Tuesday December 12, 2023 @09:34AM (#38612627)
This is a huge help, thank you. I've been using the Postman Interceptor extension, but OpenAPI-devtools looks tailor made for my use case. The hard part will still be figuring out the auth headers/calls (EDIT: the dev has added auth support since the HN post!)