Instructions to use dataautogpt3/ProteusV0.1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use dataautogpt3/ProteusV0.1 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("dataautogpt3/ProteusV0.1", torch_dtype=torch.bfloat16, device_map="cuda") prompt = "black fluffy gorgeous dangerous cat animal creature, large orange eyes, big fluffy ears, piercing gaze, full moon, dark ambiance, best quality, extremely detailed" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
| license: cc-by-4.0 | |
| pipeline_tag: text-to-image | |
| widget: | |
| - text: >- | |
| black fluffy gorgeous dangerous cat animal creature, large orange eyes, | |
| big fluffy ears, piercing gaze, full moon, dark ambiance, best quality, | |
| extremely detailed | |
| output: | |
| url: ComfyUI_02614_.png | |
| - text: >- | |
| (impressionistic realism by csybgh), a 50 something male, working in | |
| banking, very short dyed dark curly balding hair, Afro-Asiatic ancestry, | |
| talks a lot but listens poorly, stuck in the past, wearing a suit, he has | |
| a certain charm, bronze skintone, sitting in a bar at night, he is smoking | |
| and feeling cool, drunk on plum wine, masterpiece, 8k, hyper detailed, | |
| smokey ambiance, perfect hands AND fingers | |
| output: | |
| url: 2024-01-18-140016_0_01_02_03_04.png | |
| - text: >- | |
| high quality pixel art, a pixel art silhouette of an anime space-themed girl in a space-punk steampunk style, lying in her bed by the window of a spaceship, smoking, with a rustic feel. The image should embody epic portraiture and double exposure, featuring an isolated landscape visible through the window. The colors should primarily be dynamic and action-packed, with a strong use of negative space. The entire artwork should be in pixel art style, emphasizing the characters shape and set against a white background. Silhouette | |
| output: | |
| url: aaaaaaaaaaaaa.png | |
| - text: >- | |
| The image features an older man, a long white beard and mustache, He has a stern expression, giving the impression of a wise and experienced individual. The mans beard and mustache are prominent, adding to his distinguished appearance. The close-up shot of the mans face emphasizes his facial features and the intensity of his gaze. | |
| output: | |
| url: 2024-01-18-140752_0_01_02.png | |
| - text: >- | |
| Super Closeup Portrait, action shot, Profoundly dark whitish meadow, glass | |
| flowers, Stains, space grunge style, Jeanne d'Arc wearing White Olive | |
| green used styled Cotton frock, Wielding thin silver sword, Sci-fi vibe, | |
| dirty, noisy, Vintage monk style, very detailed, hd | |
| output: | |
| url: 2024-01-18-135912_0_01.png | |
| - text: >- | |
| cinematic film still of Kodak Motion Picture Film: (Sharp Detailed Image) | |
| An Oscar winning movie for Best Cinematography a woman in a kimono | |
| standing on a subway train in Japan Kodak Motion Picture Film Style, | |
| shallow depth of field, vignette, highly detailed, high budget, bokeh, | |
| cinemascope, moody, epic, gorgeous, film grain, grainy | |
| output: | |
| url: 2024-01-18-140403_0_01_02_03.png | |
| - text: >- | |
| in the style of artgerm, comic style,3D model, mythical seascape, negative | |
| space, space quixotic dreams, temporal hallucination, psychedelic, | |
| mystical, intricate details, very bright neon colors, (vantablack | |
| background:1.5), pointillism, pareidolia, melting, symbolism, very high | |
| contrast, chiaroscuro | |
| parameters: | |
| negative_prompt: >- | |
| bad quality, bad anatomy, worst quality, low quality, low resolutions, | |
| extra fingers, blur, blurry, ugly, wrongs proportions, watermark, image | |
| artifacts, lowres, ugly, jpeg artifacts, deformed, noisy image | |
| output: | |
| url: ComfyUI_02698_.png | |
| - text: 1980s anime portrait of a character glitching. His face is separated from his body by heavy static. His face is deformed by pain. Dream-like, analog horror, glitch, terrifying | |
| output: | |
| url: GEH0sZIXAAABVsj.jpeg | |
| - text: Text Logo Proteus (best quality, HD, ~*~aesthetic~*~:1) | |
| output: | |
| url: ComfyUI_02778_.png | |
| <Gallery /> | |
| ## ProteusV0.1 | |
| ProteusV0.1 is currently my best model to date. | |
| ProteusV0.1 uses OpenDalleV1.1 as a substantial base to work from in terms of an untuned base model. It further refines said prompt adherence and stylistic capabilities to a measurable degree. | |
| normailzed using 220k GPTV captioned non-copyright stock images with some anime through in here and there. then further refined using 10k high-quality captioned ai generated image pairs. | |
| ProteusV0.1 has a noticeable improvement in facial features and skin detailing. while still keeping similar or slightly improved levels of surrealism, anime, and cartoonish styles. | |
| ## Settings for ProteusV0.1 | |
| Use these settings for the best results with ProteusV0.1: | |
| CFG Scale: Use a CFG scale of 8 to 7 | |
| Steps: 20 to 40 steps for more detail, 20 steps for faster results. | |
| Sampler: DPM++ 3M SDE | |
| Scheduler: Karras | |
| please also consider using these keep words to improve your prompts: | |
| best quality, HD, "~*~aesthetic~*~". | |
| if you are having trouble coming up with prompts you can use this GPT I put together to help you refine the prompt. https://chat.openai.com/g/g-RziQNoydR-diffusion-master | |
| ## Use it with 🧨 diffusers | |
| ```python | |
| import torch | |
| from diffusers import ( | |
| StableDiffusionXLPipeline, | |
| KDPM2AncestralDiscreteScheduler, | |
| AutoencoderKL | |
| ) | |
| # Load VAE component | |
| vae = AutoencoderKL.from_pretrained( | |
| "madebyollin/sdxl-vae-fp16-fix", | |
| torch_dtype=torch.float16 | |
| ) | |
| # Configure the pipeline | |
| pipe = StableDiffusionXLPipeline.from_pretrained( | |
| "dataautogpt3/ProteusV0.1", | |
| vae=vae, | |
| torch_dtype=torch.float16 | |
| ) | |
| pipe.scheduler = KDPM2AncestralDiscreteScheduler.from_config(pipe.scheduler.config) | |
| pipe.to('cuda') | |
| # Define prompts and generate image | |
| prompt = "black fluffy gorgeous dangerous cat animal creature, large orange eyes, big fluffy ears, piercing gaze, full moon, dark ambiance, best quality, extremely detailed" | |
| negative_prompt = "nsfw, bad quality, bad anatomy, worst quality, low quality, low resolutions, extra fingers, blur, blurry, ugly, wrongs proportions, watermark, image artifacts, lowres, ugly, jpeg artifacts, deformed, noisy image" | |
| image = pipe( | |
| prompt, | |
| negative_prompt=negative_prompt, | |
| width=1024, | |
| height=1024, | |
| guidance_scale=7, | |
| num_inference_steps=20 | |
| ).images[0] | |
| ``` | |
| please support the work I do through donating to me on: | |
| https://www.buymeacoffee.com/DataVoid | |
| or following me on | |
| https://twitter.com/DataPlusEngine | |