NEW!  Version 3 of iPi Motion Capture is available. iPi Motion Capture 3 delivers new features for improved workflow including support of Kinect 2, improved arms tracking, simplified calibration and others. Read more >>

This documentation corresponds to version 2 of iPi Motion Capture. The latest documentation for version 3 can be found at https://docs.ipisoft.com/

Quick Start Guide for Dual Depth Sensor Configuration

From iPiSoft Wiki
(Difference between revisions)
Jump to: navigation, search
(Calibration)
m
 
(51 intermediate revisions by 3 users not shown)
Line 1: Line 1:
<center><table border="1"><tr><td style="background-color:#FFBBBB"><font color="#770000" size="+2"><br/>&nbsp;&nbsp;BETA&nbsp;STATUS&nbsp;&nbsp;<br/><br/></font></td></tr></table></center>
+
For the impatient:
 +
* Get two Microsoft Kinect sensors<!--[XBOX] (for XBOX with separate power adapter or for Windows)[XBOX]-->, or ASUS Xtion Live sensors, or PrimeSense Carmine 1.08 sensors
 +
** To choose see [[Depth Sensors Comparison]]
 +
* Get computer with DirectX 10 videocard and at least two USB 2.0 or 3.0 controllers
 +
* [http://www.ipisoft.com/downloads_index.php Download iPi Recorder and iPi Mocap Studio]
 +
* [[IPi_Recorder_Installation|Install iPi Recorder]] and [[IPi_Mocap_Studio_installation|iPi Mocap Studio]] 
 +
* Find a suitable space (9 by 5 feet minimum)
 +
* Actor should be dressed in casual slim clothing, avoid shiny fabrics
 +
* Connect depth sensors to PC
 +
** Note that both sensors can't be connected through one and the same USB 2.0/3.0 controller
 +
* Point them at the actor (the angle between two depth sensors can be in the range 60-90 degrees, or near to 180 degrees)
 +
* For calibration, take flat rectangular cardboard, and use [[iPi Recorder]] to record calibration video
 +
* Please ensure that the calibration board is visible in both sensors. Turn the calibration board to the left and to the right, holding it vertically in front of yourself on outstretched arms.
 +
* Record video of actor's performance. Please ensure that the whole body including arms and legs is visible during the performance in both sensors. Start from a T-pose. Then goes actor’s performance.
 +
* Run [[iPi Mocap Studio]] to process actor performance video
 +
* Import your character into [[iPi Mocap Studio]] (File >Import Target Character) to adapt the animation for your character rig
 +
* [[Animation export and motion transfer|Export your animation in a desired format]]
  
 
+
<noinclude>
== Prerequisites ==
+
For more details see [[User Guide for Dual Depth Sensor Configuration]].
 
+
</noinclude>
* Computer (desktop or laptop):
+
** ''CPU:'' x86 compatible (Intel Pentium 4 or higher, AMD Athlon or higher), dual- or quad- core is preferable
+
** ''Operating system:'' Windows 7 (x86 or x64), Windows Vista (x86 or x64), Windows XP SP3 (x86 or x64)
+
** ''Video card:'' Direct3D 10-capable (Shader Model 4.0) gaming-class graphics card
+
*** for more info see [[Cameras and accessories#Video_Card]]
+
** ''USB'': at least two USB 2.0 or USB 3.0 '''controllers'''
+
*** for more info see [[USB controllers]]
+
** ''Storage system'': HDD or SSD or RAID with write speed at least 55 Mb/sec
+
* [http://ipisoft.com/downloads/iPiRecorderSetup.exe iPi Recorder] 1.6.0.0 or later
+
** see [[Quick Start Guide with MS Kinect Sensor#iPi_Recorder]] for installation instructions
+
* [http://ipisoft.com/downloads/iPiStudioSetup.exe iPi Studio] 1.3.0.0 or later (''Free Trial'' or ''Basic'' or ''Standard'' edition)
+
** see [[Quick Start Guide with MS Kinect Sensor#iPi_Studio]] for installation instructions
+
* Two Microsoft Kinect Sensors with separate power adapters
+
** ''If you bought "XBox 360 + Kinect" bundle then you need to [http://store.microsoft.com/microsoft/Kinect-Sensor-Power-Supply/product/9A4CFC08 order power adapter]''
+
* Optional: [http://www.amazon.com/s/ref=nb_sb_noss?url=search-alias%3Daps&field-keywords=active+USB+2.0+extension+cable&x=14&y=22 active USB 2.0 extension cables]
+
* Minimum required space: 3m by 3m (10 by 10 feet)
+
 
+
 
+
'''Note''' that before starting of working with two Kinects it's highly recommended to get appropriate results with single Kinect solution: [[Quick Start Guide with MS Kinect Sensor]].
+
 
+
 
+
== Recording with 2 Kinects ==
+
 
+
'''Important!''' Each Kinect Sensor should be plugged through different USB controllers. If both Kinects are plugged through one and the same USB controller then the second Kinect will not work. How it looks in the Device Manager:
+
<center><table border=0>
+
  <tr><td width="45%"><center>[[Image:Dual-kinect-device-manager-good.png]]</center></td>
+
      <td width="10%"/>
+
      <td width="45%"><center>[[Image:Dual-kinect-device-manager-bad.png]]</center></td></tr>
+
  <tr><td><center style="color:DarkGreen">'''Good'''</center></td><td/>
+
      <td><center style="color:DarkRed">'''Bad'''</center></td></tr>
+
  <tr><td><center>Both Kinects are plugged correctly</center></td><td/>
+
      <td><center>Both Kinects are plugged through one and the same USB controller</center></td></tr>
+
</table></center>
+
 
+
 
+
Run '''iPi Recorder''' and mark both MS Kinect Sensors in the Camera Selector dialog:
+
[[Image:Dual-kinect-camera-selector.png|center|300px|Click to enlarge]]
+
 
+
 
+
Press “Ok” button. As a result you should see something like this:
+
[[Image:Dual-kinect-ipirecorder.png|center|500px|Click to enlarge]]
+
 
+
 
+
Make sure that you can see correct colored “depth video” from both sensors and
+
# that you can change motor position for each sensor using appropriate slider and “Motor of” combobox
+
# that you can switch between RGB and “depth” video using “View RGB/Depth” button
+
# that actual frame rate is 30 fps (or 29.9) and frames drop is in range from 0 to 5 for each sensor
+
 
+
 
+
'''Note''' that you can turn off RGB streaming using appropriate checkbox in the Advanced Options section of Camera Selector dialog. Also you can change correspondence between cameras and motors in case when they are in the wrong order:
+
[[Image:Dual-kinect-ipirecorder-advanced-settings.png|center|300px|Click to enlarge]]
+
 
+
 
+
Don't forget to set output directory for recorded video:
+
[[Image:KSensor-recording-dest-folder.png|center|500px|Click to enlarge]]
+
 
+
== Calibration ==
+
 
+
There are two possible arrangements of the two sensors:
+
# angle between sensors is between 60 and 90 degrees;
+
# angle between sensors in near to 180 degrees that is sensors are opposite to each other.
+
 
+
 
+
At present time we strongly recommend to use the first configuration:
+
<center><table border=0><tr>
+
<td>[[Image:Dual-kinect-calibration-90-up-view.png|center|400px|Click to enlarge]]</td>
+
<td>[[Image:Dual-kinect-calibration-90-side-view.png|center|390px|Click to enlarge]]</td>
+
</tr><tr>
+
<td><center>'''Top view'''</center></td><td><center>'''Side view'''</center></td>
+
</tr></table></center>
+
 
+
 
+
For calibration purposes flat rectangular veneer/plywood/cardboard/pasteboard is used:
+
* horizontal size should be at least 0.5m (1m - 1.3m is recommended);
+
* vertical size should be at least 0.7m (1m - 1.5m is recommended);
+
* hold it vertically in front of yourself on outstretched arms;
+
* make sure that the veneer/plywood/cardboard/pasteboard is good visible in the both sensors (the amount of yellow is low in the area of veneer/plywood/cardboard/pasteboard).
+
<center><table border=0>
+
  <tr><td width="45%"><center>[[Image:Dual-kinect-calibration-good.png]]</center></td>
+
      <td width="10%"/>
+
      <td width="45%"><center>[[Image:Dual-kinect-calibration-bad.png]]</center></td></tr>
+
  <tr><td><center style="color:DarkGreen">'''Good'''</center></td><td/>
+
      <td><center style="color:DarkRed">'''Bad'''</center></td></tr>
+
  <tr><td><center>good size<br/>good depth data</center></td><td/>
+
      <td><center>too many yellow (no depth data) points<br/>too small<br/>too close to human body</center></td></tr>
+
</table></center>
+
 
+
== Tracking ==
+
 
+
== Next Steps ==
+
 
+
* [[Clean-up]]
+
* [[Animation export and motion transfer]]
+

Latest revision as of 19:13, 19 February 2014

For the impatient:

  • Get two Microsoft Kinect sensors, or ASUS Xtion Live sensors, or PrimeSense Carmine 1.08 sensors
  • Get computer with DirectX 10 videocard and at least two USB 2.0 or 3.0 controllers
  • Download iPi Recorder and iPi Mocap Studio
  • Install iPi Recorder and iPi Mocap Studio
  • Find a suitable space (9 by 5 feet minimum)
  • Actor should be dressed in casual slim clothing, avoid shiny fabrics
  • Connect depth sensors to PC
    • Note that both sensors can't be connected through one and the same USB 2.0/3.0 controller
  • Point them at the actor (the angle between two depth sensors can be in the range 60-90 degrees, or near to 180 degrees)
  • For calibration, take flat rectangular cardboard, and use iPi Recorder to record calibration video
  • Please ensure that the calibration board is visible in both sensors. Turn the calibration board to the left and to the right, holding it vertically in front of yourself on outstretched arms.
  • Record video of actor's performance. Please ensure that the whole body including arms and legs is visible during the performance in both sensors. Start from a T-pose. Then goes actor’s performance.
  • Run iPi Mocap Studio to process actor performance video
  • Import your character into iPi Mocap Studio (File >Import Target Character) to adapt the animation for your character rig
  • Export your animation in a desired format


For more details see User Guide for Dual Depth Sensor Configuration.

Personal tools