jay-jnp nielsr HF Staff commited on
Commit
3bad439
·
verified ·
1 Parent(s): fab5509

Add model card for F-ViTA (#1)

Browse files

- Add model card for F-ViTA (2f95271d39175da6c42b3b3bb064306a08cbd5e3)


Co-authored-by: Niels Rogge <nielsr@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +20 -0
README.md ADDED
@@ -0,0 +1,20 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ pipeline_tag: image-to-image
3
+ library_name: diffusers
4
+ license: mit
5
+ ---
6
+
7
+ # F-ViTA: Foundation Model Guided Visible to Thermal Translation
8
+
9
+ This repository contains the model described in the paper [F-ViTA: Foundation Model Guided Visible to Thermal Translation](https://huggingface.co/papers/2504.02801).
10
+
11
+ F-ViTA leverages foundation models (SAM and Grounded DINO) to guide the visible-to-thermal image translation process using an InstructPix2Pix diffusion model. This approach improves translation accuracy and generalizes well to out-of-distribution scenarios.
12
+
13
+ Code: https://github.com/jay-jnp/F-ViTA
14
+
15
+ Pre-trained checkpoints are available for several datasets:
16
+
17
+ * **KAIST:** [huggingface.co/jay-jnp/F-ViTA\_KAIST](https://huggingface.co/jay-jnp/F-ViTA_KAIST)
18
+ * **FLIR:** [huggingface.co/jay-jnp/F-VITA\_FLIR](https://huggingface.co/jay-jnp/F-VITA_FLIR)
19
+ * **NIRSCENE:** [huggingface.co/jay-jnp/F-VITA\_NIRSCENE](https://huggingface.co/jay-jnp/F-VITA_NIRSCENE)
20
+ * **OSU:** [huggingface.co/jay-jnp/F-VITA\_OSU](https://huggingface.co/jay-jnp/F-VITA_OSU)