News for hackers. Stuff that matters.

bashgrep

11k more than they needed
Similar events happened in Texas, but Texas' legislature isn't back in session until 2015.

http://money.cnn.com/2013/06/04/autos/tesla-texas/index.html

and in North Carolina... "Any time there's an innovative way to bring a product to market it's going to initially get push back from the fellows that have been doing business the same way since 1902..."

http://www.charlotteobserver.com/2013/05/24/4062463/tesla-se...

Access to HN posts

I am trying to use ec2 machines to scrape HN posts, but it isn't working. Specifically, it seems like HN is rate limiting request from ec2 machines. Does HN not want people scraping HN? How can I get access to all HN posts?

( Read More... | 2 comments | 3 points | on HN )
Re:Ask HN: HN data access on Saturday March 23, 2013 @10:45PM (#5430861)
Seems like HNS is rate limiting connection speed for connections from amazon ec2 machines.

HNS/pg, do you not want us scraping HNS? What is the best way to get all the posts?

Re:Ask HN: HN data access on Wednesday March 13, 2013 @12:07AM (#5366763)
These all lead to dead ends: https://news.ycombinator.com/item?id=1721105 https://news.ycombinator.com/item?id=1881262

Do you have a link for the post you are talking about?

EDIT: In this thread pg says wait 30 seconds between each request (https://news.ycombinator.com/item?id=1702488), but that doesn't work either.

EDIT: "unimpressive" Was this is what you were referencing?: https://docs.google.com/spreadsheet/ccc?key=0AqL8kR005z0QdEN...

Re:Ask HN: HN data access on Tuesday March 12, 2013 @11:16PM (#5366586)
Where did you read about them?

Ask HN: HN data access

How can I get access to all of the submissions on news.ycombinator.com? I don't want the comments, just the posts. It seems like after every HNS outage settings get added to make it more difficult to access the content on HNS. For example, it seems like you have to sign in now to access older posts. Also, the thrift database has only about 4million records but the hids on HNS are in the 5millions.

( Read More... | 8 comments | 5 points | on HN )

Ask HN: HN data access

How can I get access to all of the submissions on news.ycombinator.com? I don't want the comments, just the posts.It seems like it is getting increasingly more difficult to access the content on HNS. For example, it seems like you have to sign in now to access older posts. Also, the thrift database has only about 4million records but the hids on HNS are in the 5millions.

( Read More... | 1 comment | 5 points | on HN )
Re:Ask HN: Columbus HN meetup on Tuesday March 08, 2011 @08:07AM (#2300714)
Sounds good!!! I'll be there.