Good vs Bad Finger Tracking
To achieve good finger tracking it’s important that you follow the correct practice which enables the system to define your fingers with the most accuracy. Gaining this understanding will drastically improve the quality of your animations.
Camera Settings and Setup
When preparing for a shoot it’s important to make sure that the correct settings are chosen on the iPhones before filming any videos. It’s also essential that the capture devices are set up in the appropriate orientation depending on how many iPhones are being used.
The most effective way to improve the finger tracking is by walking closer to 2 cameras while staying in shot head to toe on all cameras. Getting closer to the cameras means that the fingers have a larger pixel count in the frame which will make it easier for the system to follow your fingers with increased precision.
The camera setup recommended when using 1 actor is 4 cameras. This will give the system a greater understanding of the position of the fingers in the capture volume. When using 4 cameras the optimal setup is positioning the cameras in a square shape around the one actor. By setting the cameras up in this layout, the system can utilise the multiple angles to reinforce its prediction of where the hands and fingers move within the volume. From this point you are now ready to calibrate the cameras.
The calibration quality is essential when it comes to good finger tracking. This stage in the workflow holds such importance because without a successful calibration the system is unable to create animation data. The calibration is mapping the camera positions to then be able to track anyone inside the capture volume.
To Calibrate, follow the below Steps;
1. Start the recording
2. Stand in the centre of the capture volume, Making sure each camera can see you head to toe. It is a good idea to mark the capture volume so that you know how close you can walk towards the cameras. The points that are marked should still show the entire actor head to toe for a better track.
3. Clap 3 times above your head and put your arms into a Y-pose. Keep this position for the entirety of the calibration.
4. Calibrate the entire volume by walking back and forth in each direction keeping your arms in the Y-pose. This is important because you're allowing the cameras to visualise your proportions from lots of different angles. When completed, walk back to the centre of the volume with your arms in the Y-pose before ending the recording.
Tips when recording Takes
- When using our system we recommend wearing lighter clothes so that the system can visualise your joints with greater accuracy. Not to mention that wearing baggy clothes can alter the performance of the system.
- Wearing a long sleeve top which covers your wrist will affect the system’s ability to track your hands which will also negatively impact the finger tracking on your video.
- We need to have optimal lighting conditions. This means the lighting can’t be too bright and overpowering as well as too dark.
- The contrast between the actor and the background should be high in terms of colour. For example it would be better if the actor stood out in the capture volume instead of mixing in with the background. This also links into what clothes the actor wears. For example you don’t want the actor wearing a top that has the same colour as their hand.
- The fingers and wrist need to be clearly visible to as many cameras as possible when creating your takes. Moving closer to two of the cameras will achieve a better result as this will increase the pixel count on your hands.
Bad finger tracking
These are a number of different reasons why users get bad finger tracking on their animation data.
- Hands in pockets
- Hands clenched together
- Poor Calibration
- Hands hidden by object being held
- Hands heavily occluded by objects in the scene
- Fingers out of sight of cameras
- Fingers to far away from cameras