NEW!  Version 3 of iPi Motion Capture is available. iPi Motion Capture 3 delivers new features for improved workflow including support of Kinect 2, improved arms tracking, simplified calibration and others. Read more >>

This documentation corresponds to version 2 of iPi Motion Capture. The latest documentation for version 3 can be found at https://docs.ipisoft.com/

Quick Start Guide for Single Depth Sensor Configuration

From iPiSoft Wiki
(Difference between revisions)
Jump to: navigation, search
(iPi Studio)
(Recording Video from Depth Sensor)
Line 77: Line 77:
 
== Recording Video from Depth Sensor ==
 
== Recording Video from Depth Sensor ==
  
Ok, after all these preparations you are ready for performance.
+
Finally, after all these preparations completed, you are ready for performance.
  
It is convenient to put MS Kinect Sensor on chair or table. The following drawing should provide you with some information about possible capture area and required space:
+
It is convenient to put MS Kinect Sensor on a chair or a table. The picture below will help you to understand possible capture area and required space:
 
<center><table border=0><tr>
 
<center><table border=0><tr>
 
<td>[[Image:KSensor-scene-side-view.png|center|385px|Click to enlarge]]</td>
 
<td>[[Image:KSensor-scene-side-view.png|center|385px|Click to enlarge]]</td>
Line 88: Line 88:
  
  
Start iPi Recorder and choose “MS Kinect Sensor” in Camera Selector dialog:
+
Please start iPi Recorder and choose “MS Kinect Sensor” in Camera Selector dialog:
 
[[Image:KSensor-install-step9.png|center|250px|Click to enlarge]]
 
[[Image:KSensor-install-step9.png|center|250px|Click to enlarge]]
  
Using “Motor” slider, adjust direction of sensor so that at the bottom of image floor is present and actor is visible in full length (with hands up if needed):
+
Using “Motor” slider, adjust direction of sensor so that you can see floor at the bottom and actor is fully visible (with hands up if needed):
 
[[Image:KSensor-recording-adjust-motor.png|center|457px|Click to enlarge]]
 
[[Image:KSensor-recording-adjust-motor.png|center|457px|Click to enlarge]]
  
Line 101: Line 101:
 
----
 
----
  
::<font color="#880000" size="+1">'''Important!''' Fist two seconds of video should contain only background and static objects. That is presence of actor or some moving object in first two seconds of recorded video is unacceptable. It’s because first seconds of video are used to calculate static background which is used to separate actor from other elements of 3D scene.</font>
+
::<font color="#880000" size="+1">'''Important!''' Initial two seconds of video should contain only background and static objects. Presence of actor or any moving objects in the initial two seconds of recorded video is unacceptable. It’s because initial seconds of video are used to calculate static background necessary to separate actor from other objects of 3D scene.</font>
  
 
----
 
----
  
As soon as recorder started and “clear” scene is recorded for a couple of seconds, go to the capture area and stand in a [http://www.trinity3d.com/media/axyz-design/metropoly2/T-Pose_models/Casual/MeCaT0005/image4.jpg T-pose]:
+
As soon as recorder starts and “clear” scene is recorded for a couple of seconds, go to the capture area and stand in a [http://www.trinity3d.com/media/axyz-design/metropoly2/T-Pose_models/Casual/MeCaT0005/image4.jpg T-pose]:
 
[[Image:KSensor-recording-TPose.png|center|451px|Click to enlarge]]
 
[[Image:KSensor-recording-TPose.png|center|451px|Click to enlarge]]
  
::'''Note''' that current version uses only depth information to track motions. Thus there is not any restrictions on clothing colors (just avoid shiny fabrics). But it is desirable that actor wears tightly to reduce noise in result animation.
+
::'''Note''' that current version uses only depth information to track motions. So there are no restrictions on clothes colors (just avoid shiny fabrics). Please use slim clothes to reduce noise in resulted animation.
  
 
After that you can act desired motions.
 
After that you can act desired motions.
Line 114: Line 114:
 
To stop recording, press “Stop Video Recording” button.
 
To stop recording, press “Stop Video Recording” button.
  
Using Windows Explorer, go to destination folder and open recorded file with name <c>video_''YYYY-MM-DD''_''hh-mm-ss''.avi</c> in Windows Media Player. You should see depth information as a blue image:  
+
Using Windows Explorer, go to destination folder and open the recorded file with name <c>video_''YYYY-MM-DD''_''hh-mm-ss''.avi</c> in Windows Media Player. You should see depth information as a blue image:  
 
[[Image:KSensor-bluevideo.png|center|358px|Click to enlarge]]
 
[[Image:KSensor-bluevideo.png|center|358px|Click to enlarge]]
  

Revision as of 19:23, 21 February 2011

Contents

System Requirements

  • CPU: x86 compatible (Intel Pentium 4 or higher, AMD Athlon or higher), dual- or quad- core is preferable
  • Operating system: Windows 7 (x86 or x64), Windows Vista (x86 or x64), Windows XP SP3 (x86 or x64)
  • Video card: Direct3D 10-capable (Shader Model 4.0) gaming-class graphics card (GeForce GTS 250 or Radeon HD 4850 or better recommended)
  • Microsoft Kinect Sensor (“Depth Sensor”)


Software Installation

iPi Recorder

Note that even if you have used iPi Recorder before you will need to perform actions below anyway. Just letting iPi Recorder to be updated automatically will not work, because drivers for MS Kinect Sensor must be installed in addition.
iPi Recorder is a tool for recording video from web cameras and depth sensors. Download the setup package of iPi Recorder latest version: http://ipisoft.com/downloads/iPiRecorderSetup.exe. Run it. In the following dialog window make sure that item “LibUSB-win32 Driver Registration for MS Kinect Sensor” is selected:
KSensor-install-step1.png


Note that if you do not plan to use Sony PlayStation Eye cameras then you can deselect the appropriate item in the list.

Click “Install” button to start the installation process. You’ll be asked about installation of “iPi LibUSB-win32 Driver Registration for MS Kinect Sensor”:
KSensor-install-step2.png
Please read license agreement and accept it by checking the appropriate checkbox. Then press “Install” button. As soon as you get the Windows Security screen, please select “Install this driver software anyway”:
KSensor-install-step3.png
At this point the driver will complete its installation and should not give any other errors:
KSensor-install-step4.png
After that iPi Recorder itself will be installed:
KSensor-install-step5.png

KSensor-install-step6.png


After that, connect MS Kinect Sensor to your PC. Under Windows Vista and Windows 7 device initialization should be performed automatically and you’ll receive notification about it in the system tray area. Under Window XP you’ll be asked three times (for “Xbox NUI Motor”, “Xbox NUI Audio” and “Xbox NUI Camera”):

  • “Can Windows connect to Windows Update to search for software?”
  • “What do you want the wizard to do?”

In all three cases answer “No, not this time” and “Install the software automatically (Recommended)” respectively:

Click to enlarge
Click to enlarge

Run iPi Recorder and make sure that there is “MS Kinect Sensor” in “Camera Selector” dialog:
KSensor-install-step9.png
Select “MS Kinect Sensor” and press “Ok” button. Make sure that you can see colored “depth video” from sensor, that actual frame rate is 30 fps, that frames drop is in range from 0 to 5 and that you can change motor position using appropriate slider:
KSensor-install-step10.png


Note that values of Tilt and Roll are updated with a time lag. During recording these values cannot be updated assuming that in this case sensor should be static.

iPi Studio

Note that if you have used iPi Studio before and have Internet connection on your computer then you only need to let iPi Studio to automatically update:
IPiStudio-auto-update.png


iPi Studio is a core software of iPi Desktop Motion Capture (iPi DMC) solution. It’s used to process pre-recorded video and export resulted animation into most popular formats. You can use 30 days free trial. To install iPi Studio please download and run setup program: http://ipisoft.com/downloads/iPiStudioSetup.exe. Then, follow instructions of the installation wizard.

As a result of installation, iPi Studio will be executed. You will be prompted to enter unlock/trial key:
IPiStudio-first-run.png

To obtain trial key please register to our user community forum: http://ipisoft.com/forum/ucp.php?mode=register. After registration please login to forum and take trial license key from forum’s “User Control Panel”:
Forum-trial-key.png


Note that if you don’t receive activation e-mail after registration then:
  1. Make sure that this e-mail is not in “Spam” folder of your mail client.
  2. Check that you have entered correct e-mail address.
  3. Try to resend activation email. To do it, go to login page and click “Resend activation e-mail” link.
  4. If none of above actions help, please report the problem to ipi@ipisoft.com.

Recording Video from Depth Sensor

Finally, after all these preparations completed, you are ready for performance.

It is convenient to put MS Kinect Sensor on a chair or a table. The picture below will help you to understand possible capture area and required space:

Click to enlarge
Click to enlarge
Side view
Top view

Please start iPi Recorder and choose “MS Kinect Sensor” in Camera Selector dialog:
Click to enlarge
Using “Motor” slider, adjust direction of sensor so that you can see floor at the bottom and actor is fully visible (with hands up if needed):
Click to enlarge
Set output directory for recorded video:
KSensor-recording-dest-folder.png

Press “Start Video Recording” button to begin video recording.


Important! Initial two seconds of video should contain only background and static objects. Presence of actor or any moving objects in the initial two seconds of recorded video is unacceptable. It’s because initial seconds of video are used to calculate static background necessary to separate actor from other objects of 3D scene.

As soon as recorder starts and “clear” scene is recorded for a couple of seconds, go to the capture area and stand in a T-pose:
Click to enlarge
Note that current version uses only depth information to track motions. So there are no restrictions on clothes colors (just avoid shiny fabrics). Please use slim clothes to reduce noise in resulted animation.

After that you can act desired motions.

To stop recording, press “Stop Video Recording” button.

Using Windows Explorer, go to destination folder and open the recorded file with name <c>video_YYYY-MM-DD_hh-mm-ss.avi</c> in Windows Media Player. You should see depth information as a blue image:
Click to enlarge

Now you are ready for processing this video using iPi Studio.

Processing Video from Depth Sensor

Next steps

Frequently Asked Questions

Personal tools