LookOut | IRL Tracker Comparison

We tried seven times to get this sequence with the DJI Osmo Mobile 3. We added some visualization to make keeping track of each attempt easier. A bright red dot means tracking is currently broken. With only DJI, we restarted tracking (red crosshair) or aligned the camera manually - by physcially moving it - to regain track to try and complete the sequence. A dark red dot means tracking had previously been broken and the sequence is ruined. The sole successful attempt is on the bottom row.

Here we're showing a visualization of our tracker's feature gallery management. Different color squares represent encodings at specific timestep. Time flows from left to right, and bottom to top

Video Information

Here we compare our tracker to a state-of-the-art real-time tracker, DaSiamRPN, in the full version of our system on the same scene filmed multiple times. We also compare the DJI Osmo Mobile 3 on the same sequence. Note that for both trakcers, ours and DaSiamRPN, we use the exact same control system, but the control system telemetry data (actor weights, process variances, leniency ellipse, and augmented points) for DaSiamRPN is not shown.