News for hackers. Stuff that matters.

jdrock

The consensus is that U/L's aggressive political campaigning prior to the vote backfired big time. They really screwed up on messaging by not understanding their audience. Had they made it about losing 10,000 jobs, they might have won. Hell, if they had just not called people multiple times without consent, they might have won.

There are multiple efforts going on as a result of the vote. Former U/L drivers are trying to put together a rally. A non-profit group (Ride Austin) has sprung up to replace U/L. Certain council members are trying to fight the rest of the council. The state legislature is consider a bill that would pre-empt city legislation.

The title and content of this article couldn't be farther from the truth.

1. Uber and Lyft's absence has created a huge void that remains to this day. There are crazy long lines at the airport.

2. There are multiple ridesharing companies that have sprung up in the meantime. Arcade City is just one of them.

3. I'm pretty sure Arcade City will disappear once either (a) U/L return or (b) one of the newer companies (Fare, Fasten, etc.) get more drivers.

Transportation in Austin is terrible right now. Arcade City hasn't changed that fact.

This isn't particularly difficult anymore. The most interesting challenges in web crawling around turning a diaspora of web content into usable data. E.g., how to get prices from 10 million product listings from 1,000 different e-retailers?
Re:A Web Crawler with Asyncio Coroutines on Tuesday September 15, 2015 @06:45PM (#10223615)
Here's how many URLs we crawl every second with 80legs (http://www.80legs.com)

https://dl.dropboxusercontent.com/u/44889964/Descartes%20%20...

This translates to about 700MM/month. The bump you see this month is just us adding more crawling nodes to our cluster.

Re:Spot the Ball on Friday June 19, 2015 @05:19PM (#9747732)
Trying to triangulate based on where players' eyes are looking rarely works. In many cases, the goalie is looking in a completely different direction than where the ball is. I guess that's why they're getting scored on.
Any word on integration with Graphite?
Re:Ask HN: Who is hiring? (April 2015) on Wednesday April 01, 2015 @11:50AM (#9304507)
Datafiniti - Data Engineer and Distributed Systems Engineer, Austin, TX

Data Engineer

Data engineers form the core of Datafiniti. You’ll be responsible for turning customer needs into usable data in Datafiniti. You’ll also be responsible for developing tools to help monitor and improve overall data quality. You should be familiar with data structures and basic algorithms, as well as have experience in 1-2 programming languages (Javascript a plus).

Distributed Systems Engineer

As a Distributed Systems Engineer, you’ll be responsible for developing, expanding and managing a highly-scalable architecture that handles our web crawlers, database and other applications. Familiarity with the following technologies will help in this role: Cassandra, Ruby, Erlang (or another functional language), Java, AWS, and Chef.

https://datafiniti.co

Re:Show HN: Scraperjs – A versatile web scraper on Monday August 18, 2014 @09:45AM (#8192560)
Let us know if you'd like to integrate this with http://www.80legs.com!
Re:Show HN: Get paid for crawling the web on Wednesday August 13, 2014 @11:11AM (#8173236)
Our intention is to pay the developer. Of course, there'd be nothing stopping the developer from paying out to users as well.

Happy to get more feedback!

Re:Show HN: Get paid for crawling the web on Wednesday August 13, 2014 @10:34AM (#8173061)
We're experimenting with a new way to power our Datafiniti search engine. Essentially you get paid for running a distributed web crawler through any Chrome Extension.
Re:Ask HN: Who wants to be hired? (August 2014) on Friday August 01, 2014 @12:05PM (#8120861)
Let us know if you're interested: https://www.datafiniti.net/home/careers
Re:Ask HN: Who is hiring? (October 2013) on Tuesday October 01, 2013 @10:38AM (#6476440)
Austin, TX - Datafiniti (https://www.datafiniti.net)

Datafiniti is the world's only search engine for data. We crawl and index close to 1 million websites each month to create structured, searchable data. Right now we have over 70,000,000 records on businesses, people, and products - and growing.

Build bleeding-edge technology with a team that's all good people. We're looking for experienced or junior-level sales and back-end developers. See https://www.datafiniti.net/home/careers to learn more.

Re:Ask HN: Who is hiring? (September 2013) on Tuesday September 03, 2013 @09:43AM (#6320867)
Datafiniti - Austin, TX.

We're looking for a Sales Engineer and Operations Engineer. Come help us scale the world's first and only search engine for data!

Full details here: https://www.datafiniti.net/home/careers

Re:Ask HN: Who is hiring? (May 2013) on Wednesday May 01, 2013 @10:41AM (#5638189)
Datafiniti - Austin, TX

At Datafiniti, you'll get to work on an absurdly ambitious problem - building the world's first search engine for data. We solve challenges that push the boundaries of what a search engine can do. Here are a few of the awesome things we work on:

  - Managing thousands of cloud nodes
  - Processing content from billions of URLs
  - Automatically converting web page content to valuable data
We're looking to fill roles for:

  - Sales Engineer: work with our clients team to implement customer projects.
  - Data Engineer: improve the coverage and quality of our data.
  - Ops Engineer: improve the scale and reliability our search engine infrastructure.
More details at http://www.datafiniti.net and https://angel.co/datafiniti/jobs/
Re:Ask HN: Who is hiring? (April 2013) on Monday April 01, 2013 @10:04AM (#5473051)
Austin, Texas http://datafiniti1.theresumator.com/

We're building the world's first search engine for data at Datafiniti. Work on fascinating problems that involve working with billions of data points, building intelligent agents, scaling out massive data collection, and more.

We have a small, close-knit team that enjoys working and hanging out together. Sending an email to [email protected] will go straight to me, the CEO & founder.

Re:Come and help save Posterous from oblivion on Tuesday March 12, 2013 @05:00PM (#5364837)
@jacquesm please send me a list of URLs to crawl (10M+), and I'll set up an 80legs job to do this. shion - at - 80legs - com.
We're working on this problem at Datafiniti (https://www.datafiniti.net). Since we index hundreds of sources for a similar service, we can leverage some basic string comparison techniques to normalize records from different sources and fill in attributes that are missing from any one source.
Re:Show HN: Datafiniti.net - We created the Google of Data on Tuesday December 04, 2012 @04:30PM (#4873357)
Happy to discuss any questions the HN community has about our site!

Older »