Forecast SAM 3D slat velocities to skip backbone evaluations
SAM 3D Objects reconstructs full 3D shape, texture, and layout from a single masked image. This fork adds training-free HiCache++ caching to the slat-stage flow-matching sampler, forecasting velocity from cached anchors and calling the backbone only every interval steps.
# create sam3d-objects environment mamba env create -f environments/default.yml mamba activate sam3d-objects # for pytorch/cuda dependencies export PIP_EXTRA_INDEX_URL="https://pypi.ngc.nvidia.com https://download.pytorch.org/whl/cu121" # install sam3d-objects and core dependencies pip install -e '.[dev]' pip install -e '.[p3d]' # pytorch3d dependency on pytorch is broken, this 2-step approach solves it # for inference export PIP_FIND_LINKS="https://nvidia-kaolin.s3.us-east-2.amazonaws.com/torch-2.5.1_cu121.html" pip install -e '.[inference]' # patch things that aren't yet in official pip packages ./patching/hydra # https://github.com/facebookresearch/hydra/pull/2863
01
Evidence
| HiCache++ (DMD) interval-6 speedup | 1.56× vs the uncached baseline at F1 1.000 |
|---|---|
| HiCache++ (DMD) interval-6 geometry | F1 1.000 vs the uncached baseline |
| HiCache (Hermite) interval-3 | 1.44× speedup at F1 1.000, lossless only to interval-3 |
| DMD interval-5 | 1.47× speedup at F1 1.000 |
| Lossless skip range | interval-6 for the DMD basis vs interval-3 for Hermite |
| CPU contract tests | 4 passed, no GPU or model weights needed |
02
Media

03
Install & verify
# CPU contract tests — expect 4 passed pytest tests/ -q # accel self-test, no GPU or weights — expect ALL TESTS PASSED python -m sam3d_objects.model.backbone.generator.flow_matching.accel
04
Limits
What this release does not claim (from the release notes):
- GPU speedup validation and weight-gated demo cells (not verified in this release — no GPU hardware).
05
Family
| Base model | SAM 3D Objects, accelerated by the hicache-plus-plus forecast core |
|---|---|
| Same base | sam3d-plus · fastsam3d-plus · fastsam3d-plus-plus |
| All 13 adapters | TRELLIS: faster-trellis, faster-trellis-plus-plus · TRELLIS.2: fast-trellis2, hermit-trellis2, hermit-trellis2-plus-plus · Hunyuan3D-2: hunyuan2-plus, hunyuan2-plus-plus · Hunyuan3D-2.1: hunyuan2.1-plus, hunyuan2.1-plus-plus · SAM: sam3d-plus, sam3d-plus-plus, fastsam3d-plus, fastsam3d-plus-plus |
| External | Paper arXiv:2511.16624 · Meta SAM 3D site |