- Home /
How should I detect horizontal and vertical surfaces for AR?
I just got the Vuforia plugin, which looked like a good place to start but it seems to not be exactly what I am trying to do. I don't want to recognize pictures and things from the video and place them in 3d, I just want to recognize any solid surface that is parallel or perpendicular to the ground by the distinctive way it moves.
I have a fuzzy idea in my head that starts with tracking 2d motion of lots of points in the camera view that are recognized as being the same from one frame to the next, and their screen space movement vector ( streaming video compression does this, doesn't it?) and then finding if any group of points are moving in the same way they would if they were on a level floor surface or 90º vertical flat surface. Then extend the planes to the corners where they all meet and eventually make some kind of voxel octree of the walkable volume of your house, that would get more accurate and filled-in each time you walk through it...
Is there already something I can find for free or cheap that does that- just the first part about plane detection from video? If not, what do I even start reading to understand how to code such a thing myself? I can already tell it's not going to be pretty.
After searching some more, it looks like OpenCV or EmguCV is more what I want than Vuforia, but all of what I found about OpenCV in Unity is "I can't get it to work."
As you're talking about AR, is this for a mobile device? I have worked with OpenCV before but only in a desktop build - not sure if it could do what you're suggesting in realtime on a mobile.
Yes, I think I want to use a WebcamTexture and hopefully find some open-source code to get structure-from-motion points from an image sequence; I've just found some heavy-reading research papers with no code available and existing tricky-to-integrate packages that try to do a lot more than the one thing I need.
Hello! $$anonymous$$iloblargh!
Have you solved your question or find a viable solution ??
I just face the same problem here .
Any hint!?
Regards!
Your answer
Follow this Question
Related Questions
Cloud recognition in Vuforia 0 Answers
Face detection using dynamic image target. 1 Answer
how can i save a video from project folder (ASSETS) to android internal or external storage? 1 Answer
Have both canvas' buttons and Vuforia video canvas' button working in the same scene? 0 Answers
Unity and Vuforia 1 Answer