File size: 3,453 Bytes
c47dc80 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 |
---
license: other
extra_gated_fields:
First Name: text
Last Name: text
Date of birth: date_picker
Country: country
Affiliation: text
Job title:
type: select
options:
- Student
- Research Graduate
- AI researcher
- AI developer/engineer
- Reporter
- Other
geo: ip_location
By clicking Submit below I accept the terms of the license and acknowledge that the information I provide will be collected stored processed and shared in accordance with the Meta Privacy Policy: checkbox
extra_gated_description: >-
The information you provide will be collected, stored, processed and shared in
accordance with the [Meta Privacy Policy](https://www.facebook.com/privacy/policy/).
extra_gated_button_content: Submit
language:
- en
pipeline_tag: mask-generation
library_name: transformers
tags:
- sam3
---
# SAM 3
This repository mirrors the official **Segment Anything Model 3 (SAM 3)** weights released by Meta Superintelligence Labs. SAM 3 is a unified foundation model for prompt-driven segmentation in images and videos. It supports open-vocabulary text prompts and visual prompts (points/boxes/masks). Compared to SAM 2, SAM 3 exhaustively segments each instance of a requested concept and reaches ~75–80% of human-level performance on the SA-CO benchmark (270K unique concepts).
## Highlights
- **Presence token** improves discrimination between closely related prompts.
- **Decoupled detector + tracker** scales better for long video sequences.
- **4M+ automatically annotated concepts** ensure broad coverage of open-world categories.
> Original paper: *SAM 3: Segment Anything with Concepts* (Meta AI, 2024).
> Resources: [Project Page](https://ai.meta.com/sam3) · [Demo](https://segment-anything.com/)
## Files Included
- `sam3.safetensors` — detector and tracker weights for image + video segmentation.
- Tokenizer/config assets should be copied from the official `facebookresearch/sam3` repository; this mirror only repackages the safetensors weights for self-hosting.
## Quickstart
```bash
pip install torch==2.7.0 torchvision torchaudio --index-url https://download.pytorch.org/whl/cu126
pip install git+https://github.com/facebookresearch/sam3.git
python - <<'PY'
from sam3 import build_sam3_image_model
from sam3.model.sam3_image_processor import Sam3Processor
model = build_sam3_image_model(
bpe_path="sam3/assets/bpe_simple_vocab_16e6.txt.gz",
device="cuda",
eval_mode=True,
checkpoint_path="sam3.safetensors",
load_from_HF=False,
)
processor = Sam3Processor(model, device="cuda")
state = processor.set_image("your_image.jpg")
state = processor.set_text_prompt("white bicycle", state)
print(state["masks"].shape)
PY
```
## Integration Notes
These mirrored weights are used in the **AILab SAM3 ComfyUI node** (RMBG edition) to enable promptable segmentation workflows directly inside ComfyUI. The node loads `sam3.safetensors`, tokenizer assets, and the SAM3 processors locally, so the entire pipeline stays compatible even when offline.
## License & Usage
- This mirror preserves Meta's original weights and is subject to the license on [facebook/sam3](https://huggingface.co/facebook/sam3). You must accept Meta's terms before downloading the official release.
- When hosting this file in your own Hugging Face repository, keep this notice and credit the original authors.
- Cite the SAM 3 paper for any research or product that builds upon these weights.
|