Generate and manipulate objects using phone sensors as an input,Use phone sensors to generate and deform shapes

Hi everybody,

I'm trying to create an interactive generative 3D artwork in augmented reality and can't wrap my head around some things. The main goal is to let users manipulate an object (in AR), using the sensors in their phones. All the combined interactions should lead to an interesting abstract sculpture. Data from the sensors should control the parameters of the object(s). Example: By singing (mic) the object starts to extrude a unique shape (determined by volume, pitch,...) from the sculpture in the direction of your position (GPS). Could anybody tell me where to start?

So far, I've learned a lot of basics, the input system, procedural mesh generation/manipulation,... Any thoughts are welcome! Thank you,Hi all,

For my masters project I'm researching the social impact of collective interactions in location based augmented reality. The goal is to let users (simultaneously, online) interact with an interactive "abstract sculpture", using sensors in their phones (gps, gyro, light sensor,...). The parameters of these sensors (volume, location, oriëntatiën, light,...) should determine the visual output in the sculpture.

I'm looking al over and trying different things for a while now but I keep getting stuck before i see results. Could anyone suggest where to start? I've learned the basics of the input system and learned a lot about procedural mesh generation/manipulation so far.

Thanks!!!