| | --- |
| | language: en |
| | license: mit |
| | thumbnail: https://i.ibb.co/6NLyc1P/stellar-diffusion.png |
| | tags: |
| | - stable-diffusion |
| | - text-to-image |
| | --- |
| | |
| | # Stellar Diffusion |
| |
|
| | Stellar Diffusion v0.2 vs Base Stable Diffusion v1.5 |
| |   |
| | ``` |
| | prompt = A hubble photograph of a galaxy |
| | seed = 42 |
| | size = 512x512 |
| | ``` |
| |
|
| |
|
| | Version: 0.2 (Nebula) (Dreambooth / .ckpt formats) |
| |
|
| | Stable Diffusion 1.5 finetuned on high quality processed space imagery. |
| |
|
| | --- |
| |
|
| | # Python Usage |
| |
|
| | ```py |
| | from diffusers import StableDiffusionPipeline |
| | import torch |
| | |
| | model_id = "rexwang8/stellar-diffusion" |
| | pipe = StableDiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16) |
| | pipe = pipe.to("cuda") |
| | |
| | prompt = "A hubble photograph of a galaxy" |
| | image = pipe(prompt).images[0] |
| | |
| | image.save("hubble_galaxy.png") |
| | ``` |
| |
|
| | --- |
| | # Example Results |
| |
|
| |  |
| |
|
| |  |
| |
|
| |  |
| |
|
| |  |
| |
|
| |
|
| | --- |
| |
|
| | # Suggested parameters |
| |
|
| | 512x512 |
| |
|
| | Place subjects and styles at the very front, roll a few times if you don't get the results you want. |
| |
|
| | Great - Nebulas, Galaxies |
| |
|
| | Good - Black holes, Pulsars, Comets, Jupiter |
| |
|
| | Decent - All other solar system planets |
| |
|
| | --- |
| |
|
| | # Reconized Tags |
| |
|
| | All reconized tags can be found in the tags.txt file. They are generated from the annotated descriptions of the photograph. |
| |
|
| | ### Partial support for scientific celestial body tags as follows: |
| |
|
| | NGC - New General Catalogue of Nebulae and Clusters of Stars |
| |
|
| | M / Messier - A set of 110 astronomical objects catalogued by the French astronomer Charles Messier |
| |
|
| | UGC – (catalog) Uppsala General Catalogue, a catalog of galaxies |
| |
|
| | ### Partial support for the following classification methods as follows: |
| |
|
| | By recording instrument/spacecraft (ex. Voyager, Hubble) |
| |
|
| | By Color |
| |
|
| | By Celestial Body type |
| |
|
| |
|
| |
|
| | # Dataset and Credits |
| |
|
| | ### Model |
| |
|
| | Rex Wang (me!) |
| |
|
| | RunwayML for their SD 1.5 |
| |
|
| | ### Compute |
| |
|
| | Coreweave - 2x A40s (~3 A40 hours) |
| |
|
| | ### Dataset |
| |
|
| | 91 of the 100 images from https://esahubble.org/ Top 100 Hubble Images |
| | ESA/Hubble |
| |
|
| | ~100 additional images from ESA/Hubble and ~10 images from ESA/Webb |
| |
|
| | ~50 additional images from images.nasa.gov |
| |
|
| |
|
| | --- |
| |
|
| | # Version History |
| |
|
| | V0.2 (Codename: Galaxy) - 264 image dataset |
| |
|
| | V0.1 - 91 image dataset |
| |
|
| | --- |
| |
|
| | # Contact me |
| |
|
| | All feedback, criticisms, complaints, etc to discord preferably. |
| |
|
| | wang5009@purdue.edu |
| |
|
| | Discord: bob#1236 |
| |
|
| | ### Donate |
| |
|
| | [](https://ko-fi.com/J3J1E24MB) |
| |
|
| |
|
