Fast Database Emerges from MIT Class, GPUs and Student’s Invention

Re:Fast Database Emerges from MIT Class, GPUs and Student’s ... by tmostak on Tuesday April 23, 2013 @12:46AM (#5593324)

Hi all, MapD creator here - I'd be happy to answer any questions. The 700K figure was done by rendering polygon files to textures and using them as lookup tables - it ran pretty fast on the CPU so its not all the GPU there. However if a point falls on a border - perhaps 1% of cases for say a medium-sized raster of the US - you have to do a geometric lookup as usual - which I didn't benchmark. Probably better would be to do some tiled implementation - basically something like textured quad-trees.

And as I told the journalist I wasn't sure if I did the PostGIS indexing right - I feel like the quote got taken a little out of context - but the speedups were "high" to "quite high" regardless.

[ Parent | on HN ]

Re:Fast Database Emerges from MIT Class, GPUs and Student’s ... by vanderZwan on Tuesday April 23, 2013 @06:39AM (#5594293)

> By opening the code, Mostak opens up the possibility of having a competitor rapidly develop a system and force him to the edge of the market. That possibility doesn’t bother him, he said. “If worse comes to worst, and somebody steals the idea, or nobody likes it, then I have a million other things I want to do too, in my head,” Mostak said. “I don’t think you can be scared. Life is too short.

Can I just compliment you on your attitude?

[ Parent | on HN ]

Re:Fast Database Emerges from MIT Class, GPUs and Student’s ... by throwaway1979 on Tuesday April 23, 2013 @01:19AM (#5593425)

Heh ... when I saw the speedup numbers, the first thing I wondered was ... index? Regardless, this is impressive work. Do you have a tech report you can point to for someone to get more details? I'd love to learn more about your setup. Also, would you mind describing your programming background? I have a cs PhD and I admit I never had the guts to get into GPUs! You've given me a whole lot of motivation!

[ Parent | on HN ]

Re:Fast Database Emerges from MIT Class, GPUs and Student’s ... by tmostak on Tuesday April 23, 2013 @01:25AM (#5593441)

Thanks! Yeah I'd like to revisit this benchmark soon (I'm actually working on rendering choropleths on the GPU now). I'm working on a database paper that will hopefully be ready for VLDB submission by next month - that would probably be the best.

In terms of CS background - nothing formal except for AP comp sci I took in high school like 12 years ago. However I've always loved hacking on things on the side, and a combination of my research on the Middle East/burning desire to make an Iphone app kind of got me back into it. Then to be fair I took a GPU Graphics class (basically OpenGL) at Harvard and then a Database course at MIT while doing my Masters in ME Studies, which is where this project started.

[ Parent | on HN ]

Re:Fast Database Emerges from MIT Class, GPUs and Student’s ... by ivanist on Tuesday April 23, 2013 @02:39AM (#5593627)

Can you tell me whether the main reason for speedup is because of using GPU, or do other factors also play in (such as new algorithms)?

[ Parent | on HN ]

Re:Fast Database Emerges from MIT Class, GPUs and Student’s ... by arpineh on Tuesday April 23, 2013 @09:00AM (#5594783)

This seems really interesting as a concept, and much more so as a working product!

Is MapD written to any specific GPU language, like CUDA or OpenCL? I'm in the market for new GPU and this might be a factor in purchasing... ;)

Also, I can sympathize to the mismatch of creation vs running business.

[ Parent | on HN ]

Re:Fast Database Emerges from MIT Class, GPUs and Student’s ... by phyalow on Tuesday April 23, 2013 @01:06AM (#5593383)

Thanks for the clarification! I was highly suspicious of the 700k figure, it makes a lot more sense with the context of precomputing and then looking up.

[ Parent | on HN ]