News for hackers. Stuff that matters.
Re:Show HN: A Machine Learning Model for Salary Estimation by calcsam on Friday January 08, 2016 @01:46PM (#10867163)
(1) this is awesome

(2) http://glassbowl.info/ is not leading for me

(3) If you did scrape LinkedIn, you probably violated their ToS, so you may not want to admit this publicly in case this goes anywhere :)

Re:Show HN: A Machine Learning Model for Salary Estimation by elaineo on Friday January 08, 2016 @02:44PM (#10867629)
Re #2 - sorry! I had to restart the server. Try again now :)
Re:Show HN: A Machine Learning Model for Salary Estimation by personjerry on Friday January 08, 2016 @02:49PM (#10867667)
For me, it's now saying: "Oops! LinkedIn error. Please check your url."
Re:Show HN: A Machine Learning Model for Salary Estimation by elaineo on Friday January 08, 2016 @02:53PM (#10867692)
Usually it goes away if you wait a little bit. I think they do some rate-limiting. Also they'll probably block requests from my server soon ;)
Re:Show HN: A Machine Learning Model for Salary Estimation by prairiedogg on Friday January 08, 2016 @03:12PM (#10867833)
Could you get away with allowing folks to manually paste in the HTML of their own linkedin page, or perhaps upload a PDF version of their linked in page?

Are you scraping the page for input params? Would it be possible to just expose an API (or web forms that point there) to let folks put in those parameters manually?

Re:Show HN: A Machine Learning Model for Salary Estimation by elaineo on Friday January 08, 2016 @03:20PM (#10867897)
oy, that would actually have been a much better way of doing it. I was trying to be clever and keep the UI simple, and totally didn't expect to hit rate limits so quickly.
Re:Show HN: A Machine Learning Model for Salary Estimation by elaineo on Saturday January 09, 2016 @02:52AM (#10870483)
Okay, I added a field to manually paste in the HTML! Thanks for the suggestion :)
Re:Show HN: A Machine Learning Model for Salary Estimation by wisevehicle on Friday January 08, 2016 @04:01PM (#10868210)
I want to +1 this idea :)
Re:Show HN: A Machine Learning Model for Salary Estimation by garrettheaver on Friday January 08, 2016 @02:03PM (#10867292)
Came back here to suggest your point 3. I sense a cease and desist is on the way...
Re:Show HN: A Machine Learning Model for Salary Estimation by elaineo on Friday January 08, 2016 @02:57PM (#10867726)
Can I plead ignorance? :X
Re:Show HN: A Machine Learning Model for Salary Estimation by garrettheaver on Friday January 08, 2016 @06:31PM (#10869114)
You can always try I guess. Whether or not it works is another story :-p

I started using tor for this type of thing. It's very handy in that it generates a new circuit every 10 minutes or so and hence you get a new exit node.