initial commit

.gitattributes

@@ -0,0 +1,55 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.lz4 filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+# Audio files - uncompressed
+*.pcm filter=lfs diff=lfs merge=lfs -text
+*.sam filter=lfs diff=lfs merge=lfs -text
+*.raw filter=lfs diff=lfs merge=lfs -text
+# Audio files - compressed
+*.aac filter=lfs diff=lfs merge=lfs -text
+*.flac filter=lfs diff=lfs merge=lfs -text
+*.mp3 filter=lfs diff=lfs merge=lfs -text
+*.ogg filter=lfs diff=lfs merge=lfs -text
+*.wav filter=lfs diff=lfs merge=lfs -text
+# Image files - uncompressed
+*.bmp filter=lfs diff=lfs merge=lfs -text
+*.gif filter=lfs diff=lfs merge=lfs -text
+*.png filter=lfs diff=lfs merge=lfs -text
+*.tiff filter=lfs diff=lfs merge=lfs -text
+# Image files - compressed
+*.jpg filter=lfs diff=lfs merge=lfs -text
+*.jpeg filter=lfs diff=lfs merge=lfs -text
+*.webp filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,183 @@
+---
+tags:
+- text-to-image
+- lora
+- diffusers
+- template:diffusion-lora
+widget:
+- output:
+    url: images/Comparision_00001_.png
+  text: make the subjects skin details more prominent and natural
+- output:
+    url: images/Comparision_00002_.png
+  text: make the subjects skin details more prominent and natural
+- output:
+    url: images/Comparision_00003_.png
+  text: make the subjects skin details more prominent and natural
+- output:
+    url: images/Comparision_00004_.png
+  text: make the subjects skin details more prominent and natural
+- output:
+    url: images/Comparision_00005_.png
+  text: make the subjects skin details more prominent and natural
+- output:
+    url: images/Comparision_00006_.png
+  text: make the subjects skin details more prominent and natural
+- output:
+    url: images/Comparision_00007_.png
+  text: make the subjects skin details more prominent and natural
+- output:
+    url: images/Comparision_00008_.png
+  text: make the subjects skin details more prominent and natural
+- output:
+    url: images/Comparision_00009_.png
+  text: make the subjects skin details more prominent and natural
+- output:
+    url: images/Comparision_00010_.png
+  text: make the subjects skin details more prominent and natural
+- output:
+    url: images/Comparision_00011_.png
+  text: make the subjects skin details more prominent and natural
+- output:
+    url: images/Comparision_00012_.png
+  text: make the subjects skin details more prominent and natural
+- output:
+    url: images/Comparision_00013_.png
+  text: make the subjects skin details more prominent and natural
+- output:
+    url: images/Comparision_00014_.png
+  text: make the subjects skin details more prominent and natural
+- output:
+    url: images/Comparision_00015_.png
+  text: make the subjects skin details more prominent and natural
+- output:
+    url: images/Comparision_00016_.png
+  text: make the subjects skin details more prominent and natural
+- output:
+    url: images/Comparision_00017_.png
+  text: make the subjects skin details more prominent and natural
+- output:
+    url: images/Comparision_00018_.png
+  text: make the subjects skin details more prominent and natural
+- output:
+    url: images/Comparision_00019_.png
+  text: make the subjects skin details more prominent and natural
+- output:
+    url: images/Comparision_00020_.png
+  text: make the subjects skin details more prominent and natural
+- output:
+    url: images/Comparision_00021_.png
+  text: make the subjects skin details more prominent and natural
+- output:
+    url: images/Comparision_00022_.png
+  text: make the subjects skin details more prominent and natural
+- output:
+    url: images/Comparision_00023_.png
+  text: make the subjects skin details more prominent and natural
+base_model: Qwen/Qwen-Image-Edit-2509
+instance_prompt: make the subjects skin details more prominent and natural
+license: apache-2.0
+---
+# Qwen-Edit-Skin
+
+<Gallery />
+
+## Model description 
+
+
+##   
+Finetuned LoRA for Enhanced Skin Realism in Qwen-Image-Edit-2509
+
+This repository contains a finetuned Low-Rank Adaptation (LoRA) model designed to enhance the realism and detail of human skin in images. The LoRA has been trained on top of the powerful Qwen&#x2F;Qwen-Image-Edit-2509 model, leveraging its advanced image editing capabilities to focus specifically on generating more natural and detailed skin textures.
+
+This model was trained for 5000 steps on a local RTX 5090 using the AI-Toolkit. The resulting LoRA is ideal for photographers, digital artists, and anyone looking to improve the quality of human subjects in their generated or edited images.
+
+### Model Description
+
+The qwen-edit-skin LoRA is a specialized finetuning of the Qwen&#x2F;Qwen-Image-Edit-2509 base model. The base model is a versatile image editor with strong capabilities in multi-image editing and maintaining single-image consistency, particularly in preserving personal identity. This LoRA builds upon that foundation to specifically address the nuances of human skin, adding detail and realism that may not be present in the original generations.
+
+The training was conducted using this fork of [AI ToolKit](https:&#x2F;&#x2F;github.com&#x2F;relaxis&#x2F;ai-toolkit), a comprehensive suite for finetuning diffusion models.
+The process for curating the dataset involved reverse modification of subject skin details as follows:
+* Taking real images of versatile subject portraits with skin exposed
+* Captioning each of these as our &quot;Target&quot; (THE AFTER)  images for the final outcome expected in a standard Qwen Edit workflow
+* Editing the image in Photoshop to add more gaussian blur and smoother skin tones, to make the skin texture, tone and pores less visible
+* These became our &quot;Control&quot;  (The BEFORE) images for Qwen Edit training.
+
+
+### Training Details
+
+The model was finetuned with the following key parameters, which can be found in the accompanying config.yaml file:
+
+**Hardware:**
+
+-   **GPU:** NVIDIA RTX 5090
+    
+
+**Training Configuration:**
+
+-   **Training Steps:** 5000
+    
+-   **Batch Size:** 1
+    
+-   **Gradient Accumulation:** 1
+    
+-   **Learning Rate:** 1.0e-04
+    
+-   **Optimizer:**  adamw8bit
+    
+-   **Noise Scheduler:**  flowmatch
+    
+-   **Resolution:** The model was trained on a dataset with resolutions of 512, 768, and 1024 pixels.
+    
+-   **Precision:** bf16
+    
+
+**Network Architecture:**
+
+-   **Type:** LoRA
+    
+-   **Linear Rank &amp; Alpha:** 16
+    
+-   **Convolutional Rank &amp; Alpha:** 16
+    
+
+The choice of adamw8bit as the optimizer is significant as it reduces the memory footprint of the training process, allowing for more efficient finetuning on consumer-grade hardware without sacrificing performance. The flowmatch noise scheduler is a modern approach that can lead to more efficient training and high-quality image generation.
+
+A notable aspect of the LoRA architecture is that the alpha values for both linear and convolutional layers are set to be equal to their respective rank (16). This balanced approach is a common starting point for LoRA training, ensuring that the learned adaptations are applied with a proportional scaling factor, which can help in preventing overfitting while allowing the model to learn the desired new features effectively.
+
+### How to Use
+
+To use this LoRA, you will need to load the base model Qwen&#x2F;Qwen-Image-Edit-2509 and then apply the finetuned LoRA weights loaded as qwen-edit-skin.safetensors. Previous step versions of the weights are uploaded for reference but the final version is qwen-edit-skin.safetensors. 
+You can also leverage the example workflow attached in the repo for ComfyUI to compare the results across different weights. 
+
+The recommended weight is between 1 and 1.5, the examples provided show weights up to 2 only to show the effect of the Lora with a strength considered too high for effect. 
+
+
+### Intended Use
+
+This LoRA is intended for creative and artistic purposes to enhance the realism of human skin in digital images. It can be used by:
+
+-   **Digital Artists:** To add finer details and textures to the skin of their characters.
+    
+-   **Photographers:** For retouching and enhancing portraits.
+    
+-   **AI Art Enthusiasts:** To generate more lifelike images of people.
+    
+
+### Limitations and Bias
+
+This model is a finetuning of a large-scale, pre-trained model and may carry some of its inherent biases. The training dataset for this LoRA was focused on improving skin details and may not represent the full diversity of human skin tones and types equally. Users should be aware of this and use the model responsibly. The output of the model is influenced by the input prompt, and users are encouraged to use descriptive and inclusive language to guide the generation process.
+
+----------
+
+**Disclaimer:** This model is intended for artistic and creative purposes. Users are responsible for the content they create and should adhere to ethical guidelines and respect the privacy and dignity of individuals.
+
+## Trigger words
+
+You should use `make the subjects skin details more prominent and natural` to trigger the image generation.
+
+
+## Download model
+
+
+[Download](/tlennon-ie/qwen-edit-skin/tree/main) them in the Files & versions tab.