Re:Ask HN: Side project of more that $2k monthly revenue wha...
by mateuszbuda on Friday April 14, 2023 @07:34AM
(#35568269)
For https://scrapingfish.com/ it took us about 5-6 months from idea to $2k/month. It’s still not our main source of income. It was fun to build especially that it involved working with hardware.
[ Parent
| on HN ]
Re:Ask HN: Side project of more that $2k monthly revenue wha...
by danstewart_ on Friday April 14, 2023 @07:43AM
(#35568333)
I've got no use for it now but damn this used to be such a pain point in an old job. Looks great!
Re:Ask HN: Side project of more that $2k monthly revenue wha...
by kouteiheika on Friday April 14, 2023 @07:55AM
(#35568447)
Just curious, so how exactly do you source your IPs? I clicked on the "How IPs for web scraping are sourced" page expecting an answer on how you do it, but it doesn't actually tell me that; it just tells me how they're not sourced. You said that "it involved working with hardware", so did you source your own mobile SIM cards in various countries, hook up your own phones to that and use those as proxies?
Re:Ask HN: Side project of more that $2k monthly revenue wha...
by mateuszbuda on Friday April 14, 2023 @08:12AM
(#35568600)
Good question. Here we explain, with a few simplifications, how we source our IPs: https://scrapingfish.com/blog/byo-mobile-proxy-for-web-scrap...
Re:Ask HN: Side project of more that $2k monthly revenue wha...
by uptown on Friday April 14, 2023 @11:56AM
(#35570964)
Wouldn't this mean that you're bandwidth constrained by the data plan associated with the SIM from the mobile carrier?
Re:Ask HN: Side project of more that $2k monthly revenue wha...
by mateuszbuda on Friday April 14, 2023 @04:29PM
(#35574321)
Yes, but we have so many plans and actually many of them are unlimited. We also track data usage and can either add extra data package or a SIM card gets excluded from our proxy pool.
Re:Ask HN: Side project of more that $2k monthly revenue wha...
by edumucelli on Friday April 14, 2023 @02:51PM
(#35573281)
Props to you guys for putting a complete tutorial on that and not keeping it for you. Cheers!
Re:Ask HN: Side project of more that $2k monthly revenue wha...
by mateuszbuda on Friday April 14, 2023 @04:33PM
(#35574359)
Thanks! Internally we use more sophisticated system required by larger scale to support higher volume and concurrent connections from multiple clients, but for smaller scale limited to one person or a small team, everything described on our blog should be enough.
Re:Ask HN: Side project of more that $2k monthly revenue wha...
by martin_a on Friday April 14, 2023 @08:03AM
(#35568531)
Looks great, will give it a try.
Bug found: Your "Buy" page is missing the header bar for navigation etc.
edit: Contact page has the same problem. :-)
Re:Ask HN: Side project of more that $2k monthly revenue wha...
by mateuszbuda on Friday April 14, 2023 @08:14AM
(#35568627)
Actually, it’s a feature :)