News for hackers. Stuff that matters.
Re:How I built a Slack bot to help me find an apartment in S... by ThePhysicist on Sunday August 28, 2016 @05:26AM (#12375907)
When I was searching for a flat in Berlin I wrote a bot that would continuously crawl EBay small ads and look for suitable apartments (based on surface, neighborhood, price, ...). When finding a compatible one, it would write to the poster and if a phone number was given send it to me via Slack. I would then always be the first person to call or write, and this helped me to find a really nice flat within just three weeks. The hardest part was pretending to have read the ad when people called me back after my bot wrote them, or explain how I could already call them when their ad was online only for a few seconds :D

Here's the code btw:

https://gist.github.com/adewes/c9b2a71457c6c6f01f2f

Re:How I built a Slack bot to help me find an apartment in S... by pingec on Sunday August 28, 2016 @02:56PM (#12377885)
That's how I buy other stuff as well.

On the other hand a rule quite frequent among my peers is when you list an add, ignore those that call in the first 8 working hours. Most of those calls are professional dealers (vehicles, properties, hardware) using bots that will only waste your time by trying to lower the price substantially in order to make a quick buck.

Re:How I built a Slack bot to help me find an apartment in S... by TillE on Sunday August 28, 2016 @09:09AM (#12376346)
That's quite an unusual selection of districts! From Charlottenburg to Tegel to Friedrichshain and Neukölln? I can't even guess what they have in common.

I didn't know that many people used eBay Kleinanzeigen for apartments. Good to know.

Re:How I built a Slack bot to help me find an apartment in S... by ThePhysicist on Sunday August 28, 2016 @11:12AM (#12376812)
My main criterion was good access to public transportation. I lived in various areas in Berlin already (each one has its individual flair), eventually I ended up in West Berlin close to Kurfürstendamm, which is a nice, quiet and central area.

The housing situation in Berlin is not nearly as bad as in other large cities BTW (contrary to what most people say), and although it got more difficult to find something nice for a reasonable price it's still possible.

Re:How I built a Slack bot to help me find an apartment in S... by raverbashing on Sunday August 28, 2016 @09:29AM (#12376420)
> From Charlottenburg to Tegel to Friedrichshain and Neukölln? I can't even guess what they have in common

I'm not the OP, but in common they have nothing much really, but beggars can't be choosers (which is the main issue)

They're usually accessible and are popular with expats (except Tegel, I wouldn't go there)

Re:How I built a Slack bot to help me find an apartment in S... by spaceflunky on Sunday August 28, 2016 @08:05PM (#12379178)
Who are these landlords that are selecting tenants based on how fast they replied to an ad!?!

What happened to background checks, credit checks, and general tenant due diligence?

"Well Mr. Applicant, it says here on your application, you're a heroin addict with a history of extreme violence and a credit score of zero, you don't have the income or the deposit, and quite frankly, I'm not sure how you'll pay the rent. But you did respond to my ad in 6 milliseconds thanks to a python script, so I guess the apt is yours! Welcome home!"

Re:How I built a Slack bot to help me find an apartment in S... by bjterry on Sunday August 28, 2016 @09:18PM (#12379408)
I have a friend who is an apartment manager. I believe they typically accept the first qualified candidate that applies. So those items are still required, but they just create a binary condition. First to apply is an obvious tiebreaker that presumably doesn't cause any equal opportunity problems.
Re:How I built a Slack bot to help me find an apartment in S... by ThePhysicist on Monday August 29, 2016 @02:24AM (#12380352)
Of course those are still required. But as landlords sometimes receive several hundred replies to an ad you will not even make it into the further selection process if you're not fast, as most people just consider the first ten or twenty people and choose among them. In that sense they're not looking for the perfect renter, but just for an acceptable one.
Re:How I built a Slack bot to help me find an apartment in S... by spaceflunky on Monday August 29, 2016 @02:45PM (#12384167)
I suppose this makes sense if you're renting a unit in a massive apartment block or from a large property management agency.

My guess is that a quicker reply would give you little to no advantage when it comes to mom&pop landlords who only have a couple units to lease out. All but one of the places I've rented have been from small time landlords and they seemed to put more work into than just who replied the fastest.

Re:How I built a Slack bot to help me find an apartment in S... by lisper on Sunday August 28, 2016 @05:32AM (#12375916)
I like this post not for its technical merit but for its pedagogy. Scraping Craigslist and posting the results to Slack is not rocket science, but the project is described in enough detail to make it accessible to -- and potentially reproducible by -- someone who didn't already know how to do it. IMHO that has a lot of value.
Re:How I built a Slack bot to help me find an apartment in S... by HiroshiSan on Sunday August 28, 2016 @12:22PM (#12377114)
Absolutely, I've really been enjoying the influx of good pedagogical posts lately like this one and the one on the lisp dinosaur.

As a beginner to programming, not knowing how to build anything, and seeing someones thought process. It's very valuable and enjoyable to read.

Re:How I built a Slack bot to help me find an apartment in S... by petercooper on Sunday August 28, 2016 @10:24AM (#12376632)
I think this is exactly where programming should be headed in all but the most engineered and rarified of situations. It's just a thing like reading and writing that anyone can use to make their lives better.
Re:How I built a Slack bot to help me find an apartment in S... by DonHopkins on Sunday August 28, 2016 @08:46AM (#12376270)
I also like how it showed a practical example of how to use SQLAlchemy, which is a wonderfully powerful sql toolkit, but can be hard to get your head around without some context like this example gives.
Re:How I built a Slack bot to help me find an apartment in S... by notyourwork on Sunday August 28, 2016 @07:25PM (#12379047)
Yep - usually these types of posts lose my interest after a few sentences. This one I couldn't stop reading even though I could easily build the same without the post. Very well composed.
Re:How I built a Slack bot to help me find an apartment in S... by mxuribe on Sunday August 28, 2016 @05:08PM (#12378543)
Agreed!
Re:How I built a Slack bot to help me find an apartment in S... by brchr on Sunday August 28, 2016 @12:43PM (#12377193)
Even with tools to automate the search through listings and get you ahead of other buyers, one of the tricky parts of apartment hunting is its “optimal stopping” structure: you have to decide when to commit without knowing whether an even better apartment might be out there.

This is a famous math problem (the “secretary problem”) with the lovely solution that you should define a time interval over which to search and not commit to anything until you’ve spent 1/e of that time -- 37% -- noncommittally exploring your options.

https://medium.com/galleys/optimal-stopping-45c54da6d8d0#.lj...

Re:How I built a Slack bot to help me find an apartment in S... by toomanybeersies on Sunday August 28, 2016 @08:18AM (#12376213)
I went hunting for a flat a while ago here in New Zealand, I gave up pretty quickly and just ended up staying with relatives. I've now moved cities and I live in a backpackers because I can't be bothered finding a flat (plus interesting people here!).

It's just so draining to have to contact all these people, and view their places. I guess it's like job hunting, except you're paying money. It doesn't help that I'm not very good with strangers.

Re:How I built a Slack bot to help me find an apartment in S... by osxrand on Sunday August 28, 2016 @08:48AM (#12376276)
Sounds like you're enjoying living where you are precisely because of strangers, some of which I'm assuming you meet ;)
Re:How I built a Slack bot to help me find an apartment in S... by praptak on Sunday August 28, 2016 @09:16AM (#12376373)
Different kind of stranger relation. Renting with its information asymmetry has a huge potential for creating distrust. Did the landlord hide how nasty the neighbors are? Will the tenant vandalize the apartment?

Backpacking/couchsurfing is much more lightweight.

Re:How I built a Slack bot to help me find an apartment in S... by toomanybeersies on Sunday August 28, 2016 @10:20PM (#12379588)
Well that's half the reason for staying at a backpackers. Forced interaction with lots of strangers, most of whom you will never meet again.
Re:How I built a Slack bot to help me find an apartment in S... by subspaceman on Sunday August 28, 2016 @06:26AM (#12376012)
To find our current apartment in NYC, I just used IFTTT, plugging in the URL of a custom search (neighborhood, price, bedrooms, etc) on craigslist. Worked a treat
Re:How I built a Slack bot to help me find an apartment in S... by jhalstead on Sunday August 28, 2016 @11:13AM (#12376817)
First thing I did was search for IFTTT references in this thread. :) I did the same thing in the Bay Area, and it worked pretty well. I should have made the filtering a little more restrictive though because I ended up with something like 5k emails/listings in 4 weeks.
Re:How I built a Slack bot to help me find an apartment in S... by lighttower on Sunday August 28, 2016 @10:57AM (#12376761)
How did you filter out duplicates or old ads?
Re:How I built a Slack bot to help me find an apartment in S... by jhalstead on Sunday August 28, 2016 @11:19AM (#12376842)
There's a "Posted Today" filter on Craigslist that I used. That helps with old ads, but not continuously reposted ads though, which was still a problem.
Re:How I built a Slack bot to help me find an apartment in S... by gcr on Sunday August 28, 2016 @07:53AM (#12376163)
Those real-time notifications definitely make a difference.

When I was searching for apartments in the NYCish area, I asked Zillow to ping my phone when a good listing came in.

One day, I got a ping during class and called the broker as fast as I could. "Yeah," he said, "I posted that listing 20 minutes ago but you're like the 6th caller. You almost certainly won't get it, sorry."

Re:How I built a Slack bot to help me find an apartment in S... by Nilzor on Sunday August 28, 2016 @10:42AM (#12376709)
The concept of selling to the highest bidder isn't popular in NYC?
Re:How I built a Slack bot to help me find an apartment in S... by rtpg on Sunday August 28, 2016 @11:49AM (#12376968)
Well as the landlord, would you rather spend 2 months going over the appartment with 12 people or just take the first offer at 10% over list price?

Especially if you could go through 12 people and end up with nothing (since that gives time for people to find alternatives)

Re:How I built a Slack bot to help me find an apartment in S... by icebraining on Sunday August 28, 2016 @04:25PM (#12378349)
> Well as the landlord, would you rather spend 2 months going over the appartment with 12 people or just take the first offer at 10% over list price?

Neither? We schedule an open house for the next weekend, people make their offers that day, then we accept one the following day.

Re:How I built a Slack bot to help me find an apartment in S... by rtpg on Sunday August 28, 2016 @10:15PM (#12379573)
Shows what I know about selling houses. Definitely sounds like a better solution
Re:How I built a Slack bot to help me find an apartment in S... by yitchelle on Monday August 29, 2016 @03:04AM (#12380475)
I would have thought that selling vs renting are two different situations. Different enought to warrant a different approach for each of them.
Re:How I built a Slack bot to help me find an apartment in S... by icebraining on Monday August 29, 2016 @09:41AM (#12381752)
Depends on the type of rental, I guess. If you're looking for long-term rentals (years), the process is probably much similar than if you're looking for seasonal or shorter-term rentals.
Re:How I built a Slack bot to help me find an apartment in S... by zwily on Sunday August 28, 2016 @11:00AM (#12376767)
Maybe it was rent controlled.
Re:How I built a Slack bot to help me find an apartment in S... by mcpherrinm on Sunday August 28, 2016 @03:30AM (#12375658)
While this is technically fine, the process strikes me as unnecessary. I suppose that's not too surprising for somebody new to the area and mostly experiencing it from scary anecdotes.

The list of "San Francisco" neighborhoods being searched are almost all more than 1.2 miles from BART. I'm sure it's hard to find an apartment if you have a robot excluding nearly all listings.

FWIW, there's been an apartment vacant in my building for 2+ weeks, with very few open house attendees. Other nearby buildings are much the same. If you're willing to look slightly outside the most desirable neighborhoods, it isn't that hard to find an apartment. Affordable? Well that's another story; this is SF after all.

Re:How I built a Slack bot to help me find an apartment in S... by kelnos on Sunday August 28, 2016 @04:58AM (#12375857)
> The list of "San Francisco" neighborhoods being searched are almost all more than 1.2 miles from BART. I'm sure it's hard to find an apartment if you have a robot excluding nearly all listings.

They only filtered by BART distance for the listings outside San Francisco: "Priya and I knew we’d both be traveling to San Francisco a lot, so we wanted to live near public transit if we weren’t going to be [in] SF."

Re:How I built a Slack bot to help me find an apartment in S... by randomdrake on Sunday August 28, 2016 @01:55PM (#12377544)
> If you're willing to look slightly outside the most desirable neighborhoods, it isn't that hard to find an apartment.

This is true for anything with less than 2 bedrooms. If you are looking for anything with 2 bedrooms or more (not a studio, one bedroom, or roommate situation) then finding an apartment within the northern Bay Area, including East Bay, downtown, or the peninsula, is quite difficult regardless of price.

Edit: from the post it does look like they were looking for a one bedroom place. They're using python-craigslist[1]. From the readme it doesn't look like it exposes the bedrooms under "CraigslistHousing" but the code tells a different story in __init__.py[2] and does seem to snag "bedrooms" and "bathrooms" as well as additional properties. Just in case anyone was looking to fork this and add some handling for the number of bedrooms or bathrooms.

[1] - https://github.com/juliomalegria/python-craigslist

[2] - https://github.com/juliomalegria/python-craigslist/blob/mast...

Re:How I built a Slack bot to help me find an apartment in S... by yarou on Sunday August 28, 2016 @04:15AM (#12375748)
> If you're willing to look slightly outside the most desirable neighborhoods, it isn't that hard to find an apartment.

Not trying to be pedantic but "willing to look slightly outside" is pretty ambiguous for a city like SF. The Tenderloin is slightly outside of Nob Hill, a very upscale and posh/safe neighborhood, whereas the Tenderloin greets you with used heroin needles on the street, homeless crackheads running around, and the noise of constant sirens.

I agree with you on affordability, though. Number one reason why I'm glad I'm back in the South Bay. Also, I'd rather enjoy the laid back nightlife of Los Gatos or Campbell over the Marina or Polk Street (20 year old sorority girls puking all over the place) any day.

Re:How I built a Slack bot to help me find an apartment in S... by mcpherrinm on Sunday August 28, 2016 @04:41AM (#12375823)
Sure, don't live in the Tenderloin.

But that doesn't mean you can't live in Forest Hill, or the Excelsior, or Balboa Park, or West Portal. I find lots of people totally discount what I think are some of the nicer parts of SF to live in because they're not walking distance from the mission.

Re:How I built a Slack bot to help me find an apartment in S... by kelnos on Sunday August 28, 2016 @05:03AM (#12375866)
I think that's just a matter of priorities and lifestyle. SF is an odd city in that there are some super residential, almost suburban, neighborhoods inside the city limits. I think it's personally reasonable to disqualify a neighborhood if it's not near one that you expect to hang out a lot in. I certainly don't mean to disparage any of the neighborhoods you mention, but I spend most of my time in the northeastern quadrant of SF, and love to walk everywhere, so those neighborhoods would be out of the question for someone like me.

If I were a little more amenable to driving/riding, I could easily see myself living in a quieter neighborhood, given that I certainly value the ability to have a quiet(er) place to live and sleep soundly!

Re:How I built a Slack bot to help me find an apartment in S... by kbar13 on Sunday August 28, 2016 @05:37AM (#12375924)
how's the public transit in those areas?
Re:How I built a Slack bot to help me find an apartment in S... by uiri on Sunday August 28, 2016 @03:39PM (#12378118)
Balboa Park has a BART station.

The K, L and M lines of the Muni Metro serve Forest Hill, West Portal. The L line goes to the SF Zoo but the K and M (along with the J) lines terminate at Balboa Park station. Personally, I prefer the Metro over BART due to its cleanliness and frequency of service.

I'm not sure about transit in Excelsior but I don't think it is that great.

Re:How I built a Slack bot to help me find an apartment in S... by mcpherrinm on Monday August 29, 2016 @01:32AM (#12380196)
Much of the Excelsior is a short walk to Balboa Park or Glen Park BART/Muni
Re:How I built a Slack bot to help me find an apartment in S... by amazingman on Sunday August 28, 2016 @01:05PM (#12377295)
What neighborhood? I remember looking at quite a few studio(-plus) apartments in ... let's call it "difficult" areas about a year ago. None of them were under $2800/month. The bit in the article about timing resonated most with me. We ended up finding a place because I responded to a listing ~4min after it went up.
Re:How I built a Slack bot to help me find an apartment in S... by encoderer on Sunday August 28, 2016 @12:02PM (#12377022)
Trulia has a filter to find rentals within walking distance from a transit stop.
Re:How I built a Slack bot to help me find an apartment in S... by DINKDINK on Sunday August 28, 2016 @12:17PM (#12377090)
Trulia has even better tech than that: They have a time-commute topology map dependent on your destination
Re:How I built a Slack bot to help me find an apartment in S... by chrisan on Sunday August 28, 2016 @02:54PM (#12377880)
Re:How I built a Slack bot to help me find an apartment in S... by 4ad on Sunday August 28, 2016 @08:19AM (#12376214)
Well I also built a program[1] to help me find an apartment in Vienna, in 2011. We actually needed two apartments, and we wanted them close to one another. We quickly found out how bad real estate websites are with moderatly complex queries even when wanting only a single apartment. With the additional constraint of needed two apartments close to each other... yeah, they were mostly useless.

So I built some shell scripts that scrapped all the websites, and generated some tables of pairs of houses sorted by the distance between them that can be easily read by awk. Then I could run queries on them.

All the scrapping was done with regular expressions, no fancy HTML parsing here.

For the distance calculation, I got the geographic coordinates by piping the address of the residence to Google Maps. I then calculated the geodesic distace between them in my scripts. Initially I wanted to let Google Maps calculate the more useful walking distance between residences, but that made the algorithm O(n²), and I ran into Google API free quota issues even with O(n). Geodesic distace was a good enough proxy though.

Being able to use awk, I could use any kind of arbitrary query I could think of. I filtered all residences that were not direct sales (used an agency), they were unfurnished, that were in a place where I didn't want to live (few such places in Vienna though), that were outside my price range, etc. basic stuff.

However, I could create arbitrary utility functions. For example it was really important for me that apartments were close together. So I was willing to sacrifice location, or the total area, or the numbers of rooms if they were really close, but if they were further away, I required more rooms or better location. No real estate agent or website will be able to do this for you.

In the end, it was too much trouble to rent two apartments, so we only rented one. However, the software was still very useful as it presensed all data in a much useful format, multiplexing data from all websites, and the data coming already filtered.

Plus being all text-based, and this being Unix and all that, I could easily manually input the 100 or so metro stations as "houses", so we could sort apartments based on the distance to the nearest metro station. And again I could create arbitrary utility functions. For example the U3 line is much more important for us than the U6 line, and we really don't care about U2 at all.

[1] https://code.google.com/archive/p/operation-housefinder/

Re:How I built a Slack bot to help me find an apartment in S... by visakanv on Sunday August 28, 2016 @04:17AM (#12375756)
I have a feeling, from the title alone, that some people are going to find some way to mock the OP. "You built some thing to do some task? I do it differently. Loser!"
Re:How I built a Slack bot to help me find an apartment in S... by rootlocus on Sunday August 28, 2016 @04:47AM (#12375835)
To be honest, I was hoping for something more impressive, like making a slack bot which did some heavy lifting (scraping conversations about real estate?). The moment I saw "scraping craigslist" the magic was gone.

The title sounds like "How I used a cherry to make a birthday cake". Intriguing, yet disappointing when you learn he only placed the cherry on the top of the finished cake for pretty decoration.

Re:How I built a Slack bot to help me find an apartment in S... by kelnos on Sunday August 28, 2016 @05:06AM (#12375874)
Technically impressive or not, I think what he built is super useful, and it's a testament to his skill, foresight, and charity to build it in a way that is configurable and reusable by others. My plan is to live in my current apartment until I decide to buy something, but if I end up looking for another rental, I'd likely dust this off and use it.
Re:How I built a Slack bot to help me find an apartment in S... by rootlocus on Sunday August 28, 2016 @03:13PM (#12377986)
You are right and I forgot to mention it. I was disappointed by the 'misleading' title, but I still appreciate that he built a useful and easy to use tool. If I had made something similar for myself, I wouldn't have polished it and it wouldn't have been usable by anyone else.
Re:How I built a Slack bot to help me find an apartment in S... by yitchelle on Monday August 29, 2016 @03:09AM (#12380493)
I think that will be in v2.0. The article also shows a shift from older tech such as slack vs email/twitter for notifications, which I quite like. However, I can't help feeling that as folks get more tech knowledgable, this type of strategy may not work. Maybe we will need the techniques used in high frequency trading employed in searching for an apartment, the milliseconds different may start to count :-)
Re:How I built a Slack bot to help me find an apartment in S... by draw_down on Sunday August 28, 2016 @04:20PM (#12378329)
What exactly is the point of this post?
Re:How I built a Slack bot to help me find an apartment in S... by visakanv on Monday August 29, 2016 @01:18AM (#12380158)
What is the point of anything?
Re:How I built a Slack bot to help me find an apartment in S... by draw_down on Monday August 29, 2016 @10:48PM (#12387135)
Umm, excellent retort I guess.
Re:How I built a Slack bot to help me find an apartment in S... by visakanv on Saturday September 03, 2016 @12:43PM (#12419853)
I don't know the answer either. :-(
Re:How I built a Slack bot to help me find an apartment in S... by viach on Sunday August 28, 2016 @03:08AM (#12375618)
Is scraping CraigsList legal?
Re:How I built a Slack bot to help me find an apartment in S... by andrewguenther on Sunday August 28, 2016 @04:11AM (#12375739)
It is against their terms, but they aren't going to come after you for personal use. There have been some high profile takedowns of commercial use cases however.

https://www.eff.org/deeplinks/2015/06/padmapper-and-3taps-se...

Re:How I built a Slack bot to help me find an apartment in S... by rmason on Sunday August 28, 2016 @03:10AM (#12375623)
I doubt they'd stop one person from doing it for a few weeks till they found an apartment. But if they sold the service commercially I'd bet sooner or later they'd be told to stop.
Re:How I built a Slack bot to help me find an apartment in S... by lowglow on Sunday August 28, 2016 @04:16AM (#12375753)
I've been hit with a Cease and Desist from Craigslist. Felt bad man. :)
Re:How I built a Slack bot to help me find an apartment in S... by jxm262 on Sunday August 28, 2016 @08:50AM (#12376280)
Me too :(

I wonder how many people have. A quick search on GitHub shows all kinds of cl scrapers.

Re:How I built a Slack bot to help me find an apartment in S... by lowglow on Sunday August 28, 2016 @03:33PM (#12378091)
I was providing a public service and offering free trend analysis graphs on technology stacks listed in job postings over a couple of years for different area. It was nice, but they wanted to say I owed them something like 2k per piece of information, fore every day I stored it.
Re:How I built a Slack bot to help me find an apartment in S... by coredog64 on Sunday August 28, 2016 @10:47AM (#12376724)
I wish CL sold API calls. I have an idea for helping people find lost pets. CL is probably the best source of data, but I don't want to expend a bunch of energy and then get a C&D.
Re:How I built a Slack bot to help me find an apartment in S... by lamby on Sunday August 28, 2016 @10:10AM (#12376568)
So what if it was…?
Re:How I built a Slack bot to help me find an apartment in S... by LeonM on Sunday August 28, 2016 @07:42AM (#12376139)
I'm currently trying the same approach to get an apartment in the Hague area, Netherlands. I find it very unreliable, but that's probably due to the poor state of house listings here.

The whole experience of searching a suitable house is just aweful, all listing sites are basically full of spam and scams:

- most houses are already taken, but they leave them on the site because free exposure/advertising for the realtor/landlord.

- pictures that are not taken in the actual apartment (they just reuse pictures of a different apartment that kinda looks like it).

- ads that look like normal list items (dark ui).

- super good looking houses for low prices, that turn out to be fake, just to promote the realtor/landlord name.

- loads of hidden costs (service, administration, VAT, parking etc).

- all sorts of requirements (based on sex, income, ethnicity, type of work and what not).

Re:How I built a Slack bot to help me find an apartment in S... by Veen on Sunday August 28, 2016 @08:31AM (#12376234)
I had similar problems finding a place in Budapest. Craigslist proved particularly unreliable: the usual process was to find a great looking apartment, do a reverse Google search on the image, and find the same place advertised in Paris, Berlin, and numerous other places. And those we did contact were scams: "I'm in Portugal at the moment but I'm happy to travel to Budapest to show you the place if you send me the deposit in advance."
Re:How I built a Slack bot to help me find an apartment in S... by fosco on Sunday August 28, 2016 @04:06PM (#12378254)
try http://www.hireahungarian.com/tablet/index.html

Disclaimer: I know the owner (friends with my wife who is from the area, we are living in Eastern US)

They are flexible and probably willing to be a proxy on your behalf.

Re:How I built a Slack bot to help me find an apartment in S... by Veen on Monday August 29, 2016 @10:00AM (#12381872)
Thanks! I found somewhere decent and reasonably priced in District VI after a lot of hunting.

The best place to look seems to be Facebook groups. People quickly call out scammers and the real estate folks post new listings regularly.

Re:How I built a Slack bot to help me find an apartment in S... by bayonetz on Sunday August 28, 2016 @10:39PM (#12379637)
Recently moved to SF and wanted to be able pick prospective apartments from Craigslist based on how close they were to BART/Muni stops...so I hacked together a little bookmarklet to help with this. Check it out if you are in the same boat:

https://github.com/christopher-skeels/add-walking-times-to-t...

Re:How I built a Slack bot to help me find an apartment in S... by danielmorozoff on Sunday August 28, 2016 @10:30AM (#12376659)
Cool project. A chat bot plugin to handle intro convos and scheduling with the brokers would be great :)
Re:How I built a Slack bot to help me find an apartment in S... by nxzero on Sunday August 28, 2016 @09:08AM (#12376343)
Honestly suprised that Craigslist doesn't embrace people interfacing with them via an official API; yes, I know lots about CL, but the after bring on (forgot his name) they changed their back an a lot and a bit on the front too.
Re:How I built a Slack bot to help me find an apartment in S... by punnerud on Sunday August 28, 2016 @04:28PM (#12378367)
Improvement: Calculate real walking distanse using Google Maps or OpenStreetmap.
Re:How I built a Slack bot to help me find an apartment in S... by ambicapter on Sunday August 28, 2016 @04:39PM (#12378414)
Anyone else have beautifulsoup crashing at line 160 of __init__.py?

160 p_text = row.find('span', {'class': 'p'}).text

'Nonetype' object has no attribute 'text'

Re:How I built a Slack bot to help me find an apartment in S... by ambicapter on Sunday August 28, 2016 @05:47PM (#12378703)
It appears the pip install is out of date and this issue has been fixed in the github repo.
Re:How I built a Slack bot to help me find an apartment in S... by fudged71 on Sunday August 28, 2016 @08:11PM (#12379206)
By documenting the process and making this open source it seems like it will be even harder to find an apartment in San Francisco.

Might be worth trying this code for other cities though :)

Re:How I built a Slack bot to help me find an apartment in S... by davidhariri on Sunday August 28, 2016 @08:11AM (#12376199)
I built something like this a couple of years ago for my own apartment hunt, but my IP got blacklisted. Has Craigslist changed their policy on scraping?
Re:How I built a Slack bot to help me find an apartment in S... by nommm-nommm on Sunday August 28, 2016 @02:54PM (#12377879)
Has anyone tried to post in the housing wanted section?
Re:How I built a Slack bot to help me find an apartment in S... by savrajsingh on Sunday August 28, 2016 @10:04AM (#12376539)
Craigslist has a built-in version of this -- email alerts on specific searches. That's the layman's solution. :)
Re:How I built a Slack bot to help me find an apartment in S... by lh7777 on Sunday August 28, 2016 @11:35AM (#12376908)
In my experience, Craigslist's email alerts are terrible, for a few reasons:

1. Craigslist combines listings that come in at once into a single email. That's fine, but they truncate the results (... SNIP...) if a lot of listings come in. Why? Are they worried about exceeding your incoming email size limit with an all-text email?

2. Sometimes they send emails with zero results. Again, why?

3. Maybe not an issue in NY or SF where good apartments rent minutes after listing, but even in Seattle's hot housing market duplicate listings are a big problem. I've seen the same listing posted multiple times per day for days on end. All of these listings appear in Craigslist's email alerts, so you have to wade through them all. While the author didn't address this in his bot's code, I see filtering out duplicate or "already seen, not interested" listings as the biggest benefit to a home-made solution like this.

Re:How I built a Slack bot to help me find an apartment in S... by nommm-nommm on Sunday August 28, 2016 @03:01PM (#12377915)
>I've seen the same listing posted multiple times per day for days on end

My landlord's property manager actually does this with the place I'm renting now. Every 3 hours the previous ad would be deleted and a new one with the exact same content would pop up in its place, obviously to stay on the front page. I thought it was a scam at first because surely that's not what normal landlords do? I did my due diligence that it wasn't a scam (which I would do anyways) but I was super, super suspicious. Turns out real landlords do that.

Re:How I built a Slack bot to help me find an apartment in S... by samirillian on Sunday August 28, 2016 @12:55PM (#12377238)
Aren't there existing Craigslist apps that do most of this already?
Re:How I built a Slack bot to help me find an apartment in S... by wcummings on Sunday August 28, 2016 @09:02AM (#12376323)
I feel like all these newfangled slack/whatever bots fall into two categories: stuff that used to be or would otherwise be a (toy) IRC bot, and what basically amount to annoying phone support menus, in text form. Not impressed.
Re:How I built a Slack bot to help me find an apartment in S... by dev1n on Sunday August 28, 2016 @09:15AM (#12376368)
Hammers are that impressive when you already have a rock that can do the job just as well.

Yet people still prefer hammers over rocks..

Re:How I built a Slack bot to help me find an apartment in S... by wcummings on Sunday August 28, 2016 @10:00AM (#12376521)
All this proves is that people still prefer to reduce support costs at the expense of consumers.
Re:How I built a Slack bot to help me find an apartment in S... by shortsightedsid on Sunday August 28, 2016 @12:15PM (#12377080)
The headline is slightly click-bait. Most the work is outside slack - parsing Craigslist, classifying etc.. The slack channel bit is one part of the puzzle. The article itself says there are 4 steps and devotes 2 paras to slack.

I guess the author chose slack in the title because it will result in eyeballs rather than saying how he used Python, craigslist because they aren't "sexy".

Re:How I built a Slack bot to help me find an apartment in S... by amazingman on Sunday August 28, 2016 @12:59PM (#12377262)
You're really reaching for something to complain about. Why?
Re:How I built a Slack bot to help me find an apartment in S... by shortsightedsid on Monday August 29, 2016 @01:42AM (#12380216)
I found the work on classifying the results, sorting them more interesting. Posting to a slack channel as a bot today could easily have been a perl script bot writing to an IRC channel 10 years ago. That's hardly innovative. The really useful part to me was the access to craigslist, classification of data etc.. I'm sure there are better way of using Slack.
Re:How I built a Slack bot to help me find an apartment in S... by wineisfine on Sunday August 28, 2016 @01:26PM (#12377396)
I guess the answer is in his user name :)
Re:How I built a Slack bot to help me find an apartment in S... by pop8row9 on Tuesday August 30, 2016 @02:54PM (#12392834)
You guys can be real dicks to people who express slightly alternate opinions.