koobas.hobune.stream
How to turn real life object into gameobject
I am trying to add some interactivity to my ar app. I am using text recognition as the main feature but I need to some how allow the user to interact with the real life text (poster). as far as I know the way it works is that the app will have a rectangle on the screen and everything in the rectangle it will read, looking for a a recognizable word. the problem with this is that i will have multiple words on the the poster that it could read. My goal is for the app to only read the words the user wants it too. I was thinking of doing something where I start off making the rectangle disabled so that it won’t read anything. and then (this is where I’m stuck) somehow have the users hand be a game object recognizable by the app and when the user points to the word. it will enable the rectangle and place it around the the users hand. That way it only looks at the word the user is pointing to. The problem is I don’t know how to make a real life object(a hand) into a game object on iOS. Is this a good approach? if so what do I need (tools/general steps)? if not what would be a good approach? Sorry this is so long, thank you for reading all of it!
Im also using vuforia for the ar if that means anything?
Recognizing hand accurately inside a 3D world would require additional hardware like depth sensing camera and few others. Leap motion is a development kit designed for hand and gesture recognition.
For your usecase, using Leap motion (or anyother DK) you can recognize user's hand and position any gameobject in the 3d coordinates of user's hand. Though Leap works great with VR experiences, it can be used with AR too.
Thank you for answering! with leap motion I have a couple questions, first will all my users need leap motion controller? or can I develop the app with leap motion in a way so all the user will need is there phone? the app will pretty much always be used in public and i don't think most my users will have leap motion tech with them. if I can make the app with leap motion in a way where my users will only need to use there phone then great! But if all my users need leap motion then I don't think ill be able to use it, if this is the case is there any other way to add hand interaction? i'm totally guessing here but could I do something whereI create a prefab in the game with cubes and spheres and stuff that slightly looks like a hand and then some how have the app look for the prefab? Thank you again for answering!
