Re:Show HN: An API for scraping recipe web pages
by tinebak on Tuesday July 18, 2017 @07:24AM
(#14795688)
I made a recipe scraper that doesn't look at the structured (schema) data, but instead "reads" the whole page to detect the recipe. I found that there are too many recipe sites that don't use the schema rules including, of course, recipes from Facebook posts and emails. Users have used it to copy recipes into their recipe boxes from more than 70,000 different websites. There are a lot of different formats out there!
[ Parent
| on HN ]
Re:Show HN: An API for scraping recipe web pages
by agotterer on Tuesday July 18, 2017 @08:07AM
(#14795829)
Can you share a link?
Re:Show HN: An API for scraping recipe web pages
by tinebak on Tuesday July 18, 2017 @08:10AM
(#14795842)
Happy to! http://www.copymethat.com
Re:Show HN: An API for scraping recipe web pages
by pjc50 on Tuesday July 18, 2017 @08:14AM
(#14795859)
Nice :) Is there some artefact of the sorting that puts only pizza recipes on the front page?
Re:Show HN: An API for scraping recipe web pages
by tinebak on Tuesday July 18, 2017 @08:27AM
(#14795952)
That's funny! I'm not seeing any pizza recipes now. It shows the latest shared recipes that have images. There are trends, though. One person wrote and complained that vegans were taking over the website, but the next day the Community was back to having lots of meat. The app got a bad review in the app store because this person said that Copy Me That was always showing pot recipes!
Re:Show HN: An API for scraping recipe web pages
by k3oni on Tuesday July 18, 2017 @12:38PM
(#14797936)
Well not sure what it might be, but as the previous poster got pizza all over i'm into salmon apparently, in 2 pages and 95% recipes are all about salmon :)
Re:Show HN: An API for scraping recipe web pages
by tinebak on Tuesday July 18, 2017 @01:04PM
(#14798157)
How weird, it IS all salmon! :) The front page can have a bit of a theme if someone quickly copies in a lot of similar recipes, for example, if he/she is looking for the best salmon recipes from around the web. However, the front page is limited to three recipes from any given person's recipe box. The front page might also show several copies of the same recipe if that recipe suddenly becomes very popular. However, then the recipes would all be showing the exact same salmon recipe. But this is lots of different people copying in salmon recipes from lots of different websites! The world has gone bonkers for salmon.
The front page (Community page) looks different if you're logged in because it updates more often. Maybe I need to re-think the time frame because now the website is stuck on all salmon for two hours for non-logged in users (unless they do a search).