Source: docs/experiments/EXP-3D-RGBD-FULL-SYSTEM-ARKIT-V1/README.md · Plain text

EXP-3D-RGBD-FULL-SYSTEM-ARKIT-V1:TTT 集成加上按深度范围选择的补全

结论:FULL_SYSTEM_IMPROVEMENT_NOT_ESTABLISHED,FULL_SYSTEM_VS_MODEL_FREE_NOT_ESTABLISHED;Core B 在全新扫描上第三次复现(SUPPORTED)。

说明:

结果

编号 对比(> 0 表示右边更好) 区域 均值 95% CI 好/平/差 状态
P1 CORE_B − FULL ALL −0.0031 [−0.0102, +0.0021] 15/49/16 NOT_ESTABLISHED
P2 R7 − FULL ALL +0.0015 [−0.0058, +0.0070] 62/0/18 NOT_ESTABLISHED
S1 CORE_B − FULL FAR7(75 场景) −0.0220 [−0.0506, +0.0028] 14/44/17 NOT_ESTABLISHED
S2 R7 − CORE_B ALL +0.0047 [+0.0034, +0.0060] 71/0/9 SUPPORTED
S3 ZS_CACHE_F7 − ZS_TTT_F7 ALL +0.0071 [+0.0041, +0.0103] 61/0/19 SUPPORTED
S4 CORE_B − FULL_G1 ALL −0.0023 [−0.0087, +0.0029] 15/49/16 NOT_ESTABLISHED
S5 CORE_B − FULL_ALL ALL −0.0053 [−0.0166, +0.0071] 21/22/37 NOT_ESTABLISHED
S6 FULL_ALL − FULL ALL +0.0022 [−0.0090, +0.0110] 23/46/11 NOT_ESTABLISHED

均值(AbsRel):

读出 ALL NEAR7 FAR7
R7(7 帧重投影 + 调和插值) 0.152 0.069 0.270
ZS_CACHE_F7 0.153 0.071 0.267
ZS_TTT_F7 0.146 0.062 0.269
CORE_B = sqrt(R7 × ZS_TTT_F7) 0.148 0.064 0.269
FULL(选择后,GA) 0.151 0.064 0.291
FULL_G1(选择后,G1) 0.150 0.064 0.283
FULL_ALL(不选择,GA) 0.153 0.064 0.330

解读

文件

事后探索:7 帧载体(探索性,样本内)

上面的失败原因是:补全只看到了 3 个上下文帧。小载体训练时就支持 3–7 个视角,所以 exploratory_posthoc/eval_carrier_7view.py 用全部 7 帧(上下文 + 流式帧)为 G1、GA 建状态并封存,full7_explore.* 在同一批数据上比较了 9 种接入方式:

FAR7 中替换 R7 的方式 FAR7 AbsRel 接进 Core B 后的 ALL 变化(CORE_B − X) 好/平/差
R7(Core B 现状) 0.270 — —
3 帧 GA 0.339 — —
7 帧 GA,所有 episode 0.295 +0.0039 28/23/29
sqrt(R7 × 7 帧 GA),所有 episode 0.271 +0.0053 [+0.0002, +0.0122] 32/23/25
sqrt(R7 × 7 帧 GA),只在 S ≥ 1.2 的 episode — +0.0025 [+0.0005, +0.0049] 20/50/10