Laser tracking projection with Kinect and OpenCV

I finally downloaded OpenCV (an open source computer vision library) and spent some time learning about how to use it. It was actually surprisingly painless once I got the hang of it, and there are lots of things you can do once you feed it an image (in this case, the depth image). What I did was rig it to track contours on the depth image, and attempt to pick out a rectangular object.

Then, by using the detected location of the corners, I can apply it as a perspective transform to my laser projector. The end result is that the cardboard box I'm holding becomes a "virtual screen" that is tracked by the laser projection in real time and in perspective :)

---

Closed Caption:

hey guys i said i was going to try to
connect the connect with the laser to
try to do some laser tracking thing
actually i did was i downloaded open sea
which is an open source computer vision
library which we pick up edges and
objects and things like that they run a
quick test here
well which attempts to find rectangles
or quadrilaterals so when I take a
rectangular cardboard box which i have
here and I place it within range
it takes to track the corners of that
box is pretty cool so the thing is ie my
laser system works as a pipeline so i
can add filters to it
so what I've done is I've created a
laser filter that's built into this test
down test app so when I play a simple
quadrature test pattern on the laser
which is just my existing stuff i take
the cardboard box the pattern attempts
to track the box within the bounds you
know this is the edge of the projection
can't go any farther than that but
within the area that can protect it and
does a pretty good job of tracking the
box even and in 3d now in perspective
thank you can prove the angles and quite
a bit yeah it works surprisingly well
for a simple you know like 29 open
season and the nice thing is it's a
pipeline and it's just a filter instead
of a test pattern i can try it all bad
apple
so here we go
enjoy you have it
tracking a box with lip-read next opencv
and using it to show later images with
open days which hopefully release some
tension so there you go see you next
time