Integrating 3-D objects and simulink

Hello every one,

I have built a a 3-D object using the VRML editor, and I know its possible to have a simulink model animate the 3-D object. But What I dont know how to do is have someone interact with the VR and feed the input into simulink ( sort of like the inverted pandulum model provided by mathworks) . I know there is a VR source block but when I use that the sensors do not work the same way they do when in the VRML editor in test mode. Any help or advice on where I can find the information would be greatly appreciated. Thank you all for your time.