SINBAN (sinban04@gmail.com)

EventCap: Monocular 3D Capture of High-Speed Human Motions using an Event Camera

Background: 3D Human Motion Capture

Multi-view infra-based method → Multi-view markerless method → Single-view (monocular) with depth camera method → Multiple event camera method → Monocular event camera method (with help of deep learning)

Infra-based motion capture

• Sensor-based motion capture

• Marker-based motion capture

Limitation of infra-based motion capture

• Costly and only possible indoor
• Intrusive for the users to wear the marker suites

Markerless image-based method

Overcome the limitation of infra-based motion capture method

Multi-Camera system

Limitation of multi-camera method (including monocular depth method)

• Synchronizing and calibrating multi-camera is challenging
• Capturing fast motion at high frame rate requires a large amount of data
  • The high frame rate camera systems are crucial for tracking fast motions