News for hackers. Stuff that matters.
Re:Notes on Writing Web Scrapers by enigmatic02 on Thursday December 02, 2021 @05:18PM (#29423542)
Ah the sanitization links were great, thanks!

Do you plan on handling sanitization of roles so people can search by that? I ended up using a LONG case when statement to group roles into buckets, probably not ideal

Doing something similar to you, but focused on startups and jobs funded by Tier 1 investors: https://topstartups.io/

Re:Notes on Writing Web Scrapers by cushychicken on Friday December 03, 2021 @08:13AM (#29429603)
Do you plan on handling sanitization of roles so people can search by that? I ended up using a LONG case when statement to group roles into buckets, probably not ideal

Probably not. I get the impression that job titles are one of the ways that recruiters and hiring managers "show their shine", so to speak, in terms of marketing open roles. Job titles can convey explicit and important information about the role's focus - things like "FPGA", or "New College Grad", or "DSP", for example. It's an opportunity for them to showcase what's special about the role in a succinct way. Sanitizing that away would reduce the amount of information given to all sides in the transaction. It also seems like a really broad task; there are way more niche specialties in this field than there are succinct buckets to place them in, job-title-wise.

I've found it more useful to tag roles based upon title and contents of the job description. It's a way to get the same info across without obscuring the employer's intent.

Re:Notes on Writing Web Scrapers by yolo3000 on Thursday December 02, 2021 @05:58PM (#29424043)
Do you think there's a lot of job boards lately? Or have they always been there? It feels like I've seen a lot of them popping up this year.
Re:Notes on Writing Web Scrapers by jnguyen64 on Friday December 03, 2021 @03:59PM (#29435366)
Just checked out your website - the "Buy the full database" idea is genius! I'm working on a job board and just assumed that I would never be able to charge the users at all, but your idea circumvents that. Nice work!
Re:Notes on Writing Web Scrapers by cushychicken on Friday December 03, 2021 @10:54PM (#29438564)
What do you mean, "buy the full database"?
Re:Notes on Writing Web Scrapers by jnguyen64 on Saturday December 04, 2021 @09:45AM (#29441115)
There's a link at the bottom of the page that says "Tired of scrolling? Buy the full database organized in a spreadsheet " and it links to a stripe page that lets a user buy all of the data in a CSV sheet for $49