Realistic human avatar sync with vicon cameras
Hi I'm trying to make a super realistic human avatar sync with Vicon cameras and I've got some questions:
1.Is there a way to put more bones (green dot on the mapping when you configure) than just the default ones to make the motions of my avatar as realistic as the motions of a human?
plan to make a script for every single bone, making them rotate or/and translate using outputs of the software of the cameras (Nexus) as inputs. Is this the right way to do it?
3.Apparently, both Nexus and Unity are developed with C# so there's a way to use the output of Nexus and inputs in Unity but I don't know how to make that bridge.. Thanks a lot
1) Non humanoid skeletons will need to be Generic.
1) A script on every bone is probably a bad idea, but will work.
3) I'd hazard a guess they were written in C++. You can bridge in other languages so long as you can process the data; there's always intermediary text files as a crude base example.
I've got the Vicon DataStream SD$$anonymous$$(.Net) plugins http://www.vicon.com/products/software/datastream-sdk but I'm not sure how to use these.. trying to read some tutorial lately about these
Answer by JMAT · May 23, 2016 at 10:54 AM
Hello, I am doing the same idea but only for upper limb. i am lost and do not from where to start ! I am also new to unity !
Based on your experience, can you give me tips?
Looking forward to hear from you
Answer by DPH · Jun 04, 2016 at 03:43 PM
Sorry for the late reply! Here what I would suggest
Check some tutorial about the overview of unity (how it works generally nothing too deep)
Get an avatar model (or make one on your case?)
Learn C#
Get to fully understand how to use the vicon cameras
Download the vicondatastream sdk (it writes every data coming from your motion cap. The goal here is to use it to send to your avatar. Use the scriptest of dotnet)
Create a c# project with your scriptest that can send data to Unity (via networkstream, it is the hardest part buddy the struggle was real. You're gonna need to make a c# script on unity to read the data)
Work on your C# script on unity so that you can use the data properly to move your avatar
Good luck, you're gonna need it
Mind telling me what is the purpose of your project? (School,work) and where are you from
Feel free to ask more questions.
Thank you very much for your help. Regarding zour points : 1- Done ! 2-Done ! 3-is C++ nt suitable? 4- I am already familiar with Vicon system and how to record and process the data. 5-7. I will try. 8- This is exactly what I need :) 9- it is university project.
Thank you very much again
Answer by AnelorGui · Dec 24, 2018 at 10:21 AM
Hi DPH, I reactive your previous post because it's very interesting. I would like to use motion capture extracted from Vicon Nexus and Datastream SDK, and to import this information in real-time in Unity. Do you think it's possible ? I'm new in Unity but I'm following a complete tutorial to improve my skill, and I know how Vicon works. But not Datastream SDK. I've just dowload it last week. The Vicon tutorial is very poor.
In fact, today I'm able to extract real-time kinematic parameters with Datastream using MatLab langage. What do you mean : "Use the scriptest of dotnet" ? and "via networkstream, it is the hardest part buddy the struggle was real. You're gonna need to make a c# script on unity to read the data" ? It's a school project.
Thanks a lot. @DPH