Re:Hacked Kinect is now a 3D video capture tool
by melvinram on Sunday November 14, 2010 @11:14PM
(#1905197)
I'm not in this space or planning on investing time into this but I just wanted to say Kudos to Microsoft for creating something that developers are excited about again... even if they didn't indent to do that. I'd start hacking on this if I wasn't invested in a different direction.
Re:Hacked Kinect is now a 3D video capture tool
by jakevoytko on Monday November 15, 2010 @08:51AM
(#1906206)
If money is no object, commodity stereo equipment exists with better range than the Kinect. From Wikipedia:
The Kinect sensor has a practical ranging limit of 1.2–3.5 metres
(3.9–11 ft) distance when used with the Xbox software.
The Kinect was limited by cost, size, and the need to work in poor lighting conditions. But by spacing your higher-quality cameras out (increasing the baseline), accurate depth at 10 meters is a reasonable goal.
Re:Hacked Kinect is now a 3D video capture tool
by modeless on Monday November 15, 2010 @02:06PM
(#1907412)
Not only bad lighting conditions but repeating patterns, low-contrast backrounds and large areas of a single color. Kinect is far more robust than any kind of stereo vision, and at the same time far less CPU intensive.
Re:Hacked Kinect is now a 3D video capture tool
by tudorachim on Sunday November 14, 2010 @10:31PM
(#1905107)
You could also just use pretty standard scanmatching algorithms to build a model from a sequence of scans from one camera (i.e. waving it around at a reasonable rate).
Re:Hacked Kinect is now a 3D video capture tool
by charleso on Sunday November 14, 2010 @11:06PM
(#1905180)
Could you synchronize two Kinect devices on one clock and then toggle the display/capture of that grid every odd or even 10ms span? So, only one grid is displayed and processed during its 'slice' of time, with the grids strobing rather than continuously projected.
Software-only, or would that result in too jerky of a motion capture?
Re:Hacked Kinect is now a 3D video capture tool
by ramidarigaz on Monday November 15, 2010 @12:31AM
(#1905334)
10ms seems like a reasonably small period of time. I believe it is considered to be effectively instantaneous in UI.
Edit: Although, I suppose the "refresh rate" of the entire system would then be 20ms, which might be noticeable. Chop that down to 5ms per Kinect, and it might be viable.
Re:Hacked Kinect is now a 3D video capture tool
by derefr on Monday November 15, 2010 @01:35AM
(#1905470)
Only one "eye" [Kinect] has to notice/process the movement; the other can infer, during the integration step, that the "rest" of a moving object comes with it, rather than stretching out.
Re:Hacked Kinect is now a 3D video capture tool
by raphman on Monday November 15, 2010 @07:19AM
(#1906012)
Last week, a guy from Microsoft Research said that they got multiple cameras in the same space working, but that others in the lab had problems with it. Seems to depend on the setup, but is obviously possible
Re:Hacked Kinect is now a 3D video capture tool
by sil3ntmac on Monday November 15, 2010 @04:39AM
(#1905797)
Maybe you could turn one on, capture the positions of the dots, and then turn the other on, and somehow guess which one was which when the 3d mesh changes (from motion)?
Re:Hacked Kinect is now a 3D video capture tool
by fictorial on Monday November 15, 2010 @01:34AM
(#1905467)
Neat. I did something similar for my graduate thesis project a couple of years ago, but to play pool/billiards on the computer using real cue sticks (for practice and feel) http://mixedrealitybilliards.com
Re:Hacked Kinect is now a 3D video capture tool
by jrmg on Monday November 15, 2010 @07:39AM
(#1906047)
It's implied in the measurement video that he's feeding his captured data through a realtime 3D modelling/rendering tool. Does anyone know what that tool is?
Re:Hacked Kinect is now a 3D video capture tool
by phreeza on Monday November 15, 2010 @08:37AM
(#1906174)
On his page[1] it says "The 3D reconstruction code is entirely written from scratch in C++, using my own Vrui VR toolkit[2] for 3D rendering management and interaction."
Re:Hacked Kinect is now a 3D video capture tool
by Seth_Kriticos on Monday November 15, 2010 @03:07AM
(#1905645)
For the frequency of the news about Kinect hacking I get the feeling that the homebrew software for Kinect will soon boost with much more professional features than the official software, esp. since it's pushed with games.
As Microsoft sells these things highly subsidized to claim profit with on the games I see lot's of conflict potential.
Of the roughly $56 BOM, about $17 is attributed to the cost of the PrimeSense reference system, including the cameras, microphones and processor, UBM TechInsights said. Microsoft is planning to retail the Kinect system for $149, and stands to make a healthy profit on each unit, UBM TechInsights noted
Re:Hacked Kinect is now a 3D video capture tool
by patrickk on Monday November 15, 2010 @07:03AM
(#1905985)
I can see indie game developers using Kinect to do realistic motion-capture in games.
I recall seeing this issue pop up in the 'making-of' DVD for Alan Wake by Remedy. When they made their first big game, Max Payne 1, they did the storytelling in the form of a comic due partially to budget constraints. Using a hacked Kinect and cheap PC hardware, game developers could capture a huge range of motions and use video editing software to overlay the required graphics onto the captured motions.
Re:Hacked Kinect is now a 3D video capture tool
by Kliment on Monday November 15, 2010 @09:54AM
(#1906391)
The point of the parent post was using these things in creating games, not as a game interface. That is, to make animation more realistic. Then again, given commercial motion capture systems are in the 5-10k range for pretty good stuff, I don't suppose that's a major concern for a game studio.
Re:Hacked Kinect is now a 3D video capture tool
by MarkNederhoed on Monday November 15, 2010 @04:20AM
(#1905759)
It's rough but still pretty damn cool.
Software that does this from footage can easily be in the thousands of dollars.
Image the results if you pair a kinect with this:
http://www.youtube.com/watch?v=vEOmzjImsVc
Re:Hacked Kinect is now a 3D video capture tool
by Kliment on Monday November 15, 2010 @02:30AM
(#1905562)
I have a 3d printer, but not a Kinect. Range data is not very good at all at creating 3d models. What you really want is that plus a turntable so you can get multiple views. To get a printable model, you need a mesh with no holes. A single range image has lots of holes, so you can't really print the image without filling them by taking multiple images and matching them. That said, I do think I'll make a 3d scanner based on this thing.
Re:Hacked Kinect is now a 3D video capture tool
by Kliment on Monday November 15, 2010 @09:06AM
(#1906250)
Well, I have been selling some parts, but mostly to other Reprappers. I'm looking for ways to develop something more extensive with it, but it's one of a stack of fabrication-related ideas I'd like to play with, each more attractive. The main problem is that printing is slow, and linear. You can't easily scale it. Some people are building botfarms, but even then their supply is linear, and limited by space.
Pop over on the #reprap channel on freenode and meet the rest of us if you want to know more.
Re:Hacked Kinect is now a 3D video capture tool
by almost on Monday November 15, 2010 @08:37AM
(#1906175)
While that would be very very cool I don't think it would work with the current hardware. It works by projecting a bunch of dots on the scene in IR (so you can't see them) then tracking them with a camera. So multiple Kinects are going to confuse each other (probably, I assume so anyway).
Just got my Kinect in the post this morning, very excited about what I can do with it!
http://www.primesense.com/?p=514
One such device: http://www.ptgrey.com/products/bumblebee2/index.asp
Accuracy chart: http://www.ptgrey.com/support/kb/data/stereoaccuracy.xls [XLS warning]
Software-only, or would that result in too jerky of a motion capture?
Unless the 3d environment is rapidly changing, you don't need that many frames per second from each device to capture a good image.
25 fps is one frame every 40ms.
Edit: Although, I suppose the "refresh rate" of the entire system would then be 20ms, which might be noticeable. Chop that down to 5ms per Kinect, and it might be viable.
Of course, the frame-rate would suffer.
a) His other video of the system where he shows that measurements of 3d objects exactly match real counterparts: http://www.youtube.com/watch?v=f1ieKe_ts0k
b) His homepage of other experiments: http://idav.ucdavis.edu/~okreylos/index.html
[1] http://idav.ucdavis.edu/~okreylos/index.html (frame navigation?? ugh)
[2] http://idav.ucdavis.edu/~okreylos/ResDev/Vrui/MainPage.html
As Microsoft sells these things highly subsidized to claim profit with on the games I see lot's of conflict potential.
http://www.eetimes.com/electronics-news/4210649/Kinect-s-BOM...
Of the roughly $56 BOM, about $17 is attributed to the cost of the PrimeSense reference system, including the cameras, microphones and processor, UBM TechInsights said. Microsoft is planning to retail the Kinect system for $149, and stands to make a healthy profit on each unit, UBM TechInsights noted
I recall seeing this issue pop up in the 'making-of' DVD for Alan Wake by Remedy. When they made their first big game, Max Payne 1, they did the storytelling in the form of a comic due partially to budget constraints. Using a hacked Kinect and cheap PC hardware, game developers could capture a huge range of motions and use video editing software to overlay the required graphics onto the captured motions.
They don't have much standing with the hackers atm, but a commercial indie game is another matter.
Which is concerning :(
Pop over on the #reprap channel on freenode and meet the rest of us if you want to know more.
Just got my Kinect in the post this morning, very excited about what I can do with it!