CAM-2: Our own tracking: the NPU finds the subject, we steer the gimbal
Size: W · Needs first: CAM-1 · Done when: with the camera's own tracking off, our code keeps a face (then a bass neck) in frame
Next step
A script that moves the gimbal: set pan_absolute and tilt_absolute in small steps with
v4l2-ctl and time how fast it settles.
Parts
Tick when it's in the bin; write "ordered YYYY-MM-DD" after an item on order.
- ☐ Insta360 Link 2 Pro (owned)
- ☐ (OpenVINO and a detection model on the laptop's NPU; v4l-utils; all from a flake)
Ideas
- Detect on the NPU (OpenVINO), steer with the UVC pan, tilt and zoom controls.
- The control loop: error in pixels to a pan/tilt step, with a dead band so it doesn't hunt.
- Rules for what to follow (ASP): "the bass neck when playing, the face when talking".