Show HN: FreshJobs – An aggregator of junior and entry-level jobs

Re:Show HN: FreshJobs – An aggregator of junior and entry-le... by CommanderData on Sunday August 19, 2018 @11:31AM (#17794641)

Salary, technologies if possible, and job age are all useful.

How do you get job data? Is it a mix between apis and direct website scraping?

[ Parent | on HN ]

Re:Show HN: FreshJobs – An aggregator of junior and entry-le... by lukehero on Sunday August 19, 2018 @12:42PM (#17794985)

>> Is it a mix between apis and direct website scraping?

That's right. I am trying to normalise the data from all the sources so I can generate some useful filters.

[ Parent | on HN ]

Re:Show HN: FreshJobs – An aggregator of junior and entry-le... by CommanderData on Sunday August 19, 2018 @06:06PM (#17796431)

Thanks this is fascinating. Do alot of companies (such as indeed) provide APIs for this? I would have thought it goes against their business models.

Also is there any legal concerns for website scaping here?

[ Parent | on HN ]

Re:Show HN: FreshJobs – An aggregator of junior and entry-le... by lukehero on Monday August 20, 2018 @05:42AM (#17798679)

Indeed do have an API, which I have applied for, but they didn't get back to me yet. Still waiting for a few big job sites to get back to me on using their APIs. Hoping eventually I can get them all!

I've made sure not to crawl any sites that do not allow it, such as LinkedIn for example prohibit it, so I left them alone ;)

[ Parent | on HN ]

Re:Show HN: FreshJobs – An aggregator of junior and entry-le... by CommanderData on Monday August 20, 2018 @02:51PM (#17802700)

Thank you for getting back.

I wanted to build a service to gather and analyse all types of job information and see trends. I would ultimately sell the data, however I don't think it would be possible reading some API T&C's. Just a flaunting idea.

[ Parent | on HN ]