Re:Analyzing 1.1B NYC Taxi and Uber Trips
by ufmace on Tuesday November 17, 2015 @05:16PM
(#10584397)
All on internal storage? What was the max internal storage then, 512GB? Sounds like that's pretty tight, barely possible if you aren't doing anything else that takes up much space.
I wonder if it would be easier to stick the Postgres on a server, maybe AWS or local, and just do the queries from the laptop. Or maybe on a Tmux on the server, so you can let a long query run without having to keep the laptop up.
Re:Analyzing 1.1B NYC Taxi and Uber Trips
by lil_tee on Tuesday November 17, 2015 @06:25PM
(#10584775)
Yes, the database is all on the machine's local 512 GB hard drive. I did store the downloaded flat text files to an external drive and loaded them into the db from there.
I wonder if it would be easier to stick the Postgres on a server, maybe AWS or local, and just do the queries from the laptop. Or maybe on a Tmux on the server, so you can let a long query run without having to keep the laptop up.