A list of awesome tools, ideas, prompt engineering tools, colabs, models, and helpers for the prompt designer playing with aiArt and image synthesis. Covers Dalle2, MidJourney, StableDiffusion, and open source tools. Many of these tools come with "batteries included" and won't include colabs or python code you have to run. (for colabs see this list)
Contents
-
- 💰 Commercial
- ☁️ Free hosted
- 💻 Free local - Run on your GPU
-
[🚨 Upcoming exciting projects](#upcoming-exciting-projects]
Text-to-image Models you can run
Models, commercial and open source, that you can either try for free and pay for credits or can run in the cloud.
Commercial
- DreamStudio - #StableDiffusion in the cloud
- Midjourney - Discord bot with amazing visuals
- Dalle2 - The one that started it all, great with multi characters
- NightCafe - Nightcafe studio is an AI Art Generator (incrorporates stableDiffusion)
- ArtBreeder Collage - A collaging tool to generate art using visual aides.
Free hosted tools
- Craiyon - Formerly dalleMini - open source tool that outputs great compositions but lower quality
- StableDiffusion on HuggingFace - Run the #StableDiffusion right in huggingface UI
- StableDiffusion on Replicate - Run #StableDiffusionon on replicate.com
- Google Colab - Google free GPU machines in the cloud running models of all sorts.
Free local
*Advanced Batteries not included, this section is for advanced folks who can use the command line, install python packages, run code etc'
-
StableDiffusion + Web GUI - This repo has a step by step way to install and run #stableDiffusion using local GPU + a gradio based web UI. Has a nice UI, upscalers built-in, img2img and inpainting, and a LOT more! (see thread with features
-
StableDiffusion with Diffusers - A simple-ish way to run stable diffusion locally using hugging face diffusers library
img2img - Generate images from a combination of prompt + init image
img2img refers to the practice of feeding a model an init image AND a prompt.
- stable-img-to-img - Hosted version of img2img tool from stable diffusion. Provide an image + a prompt
Prompt engineering
The emerging field of the Prompt Engineering is just beginning, and yet there are tools released for us every day. Follow this repo for the best tools as they become "Awesome"
Tools for prompt engineers
- Lexica - A prompts search engine
- Krea.ai - A prompt builder with a nice UI, searchable prompts.
- PromptMania prompt builder - A prompt builder that supports MJ, SD and Dalle, with visual examples and a lot of modifiers
- Promptbase Marketplace - Buy and sell your promtps for 💰
- GPT-2 prompt generator - A GPT2 model trained to autocomplete MJ prompts
Artist/Modifier studies
- Stable diffusion artist study - A huge list of artist (no living) with examples by (@sureailabs, @proximasan, @EErratica, and @KyrickYoung)
- StableDiffusion modifier study - A great study of modifiers that can enhance your prompts significantly
- Google doc with 3800+ artists and styles - Great collaborative effort 3800+ artists and styles + tips for prompting. Continuesly updated. (without generated images)
Browser extensions
- Dalle prompt helper - a chrome extension to inject prompts into the Dalle interface by @altryne
Tips and tricks
- CLIP interrogator - Convert uploaded images into prompts by @pharampsychotic
- img2prompt - Hosted version of CLIP interrogator on Replicate. Upload image, get prompt ideas.
Inspiration tools
- same.energy - A visual exploration search engine.
- CLIP retrieval - Allows you to browse the major datasets the img-2-text models were trained on.
Post processing tools
Resolution upscale - subscription
- Gigapixel upscaler Great upscaler app + web. One time payment
- https://letsenhance.io/ - LetEnhance is a credit based enhancement system
Resolution upscale - free
- WebUI repo has upscalers built in!
- real-esrgan - A hosted version of real-ERSGan with optional face correction
- Cupscale - Windows app that upscales with ERSGan on your GPU
Fix faces
- [
Fix hands
Beutify
- TBD
Outcrop
- TBD
Inpaint
- TBD
Communities
- StableDiffusion discord - A great community with folks who help each other
- MidJourney - A huge community of image synthesis folks, prompt help, inspiration channels etc'
Theory & Learning
Tutorials
- A-Traveler-s-Guide-to-the-Latent-Space - In depth guide for prompt engineering.
- Dalle2 prompt book - A great, visual intro to prompt creation by @guyp - Dalle focused
Twitter Threads
- Dalle vs MJ vs StableDiffusion - A great thread comparing the 3 main models by @fabianstelzer
- Stable Diffusion explained - A easy to udnerstand stable diffusion explanation thread by @ai__pub
Notable twitter follows
- Ai, AiArt, Generative - A twitter list of 70+ #aiArt community members, a stream of conciuosness for the field
- @ClaireSilver12 - Great content, tips and tricks, up to date knowledge about ai synthesis
- @TomLikesRobots - Deep insight into this new tech, with updates
- @diffusionBot - A stableDiffusion bot that generates a prompt right in twitter replies when you mention it.
- Whats AI - Louis Bouchard - Accessible AI concepts, paper reviews, youtube videos
Upcoming exciting projects
🚨 These are some of amazing things folks are working on, and is worth keeping in mind, maybe register to their waiting list or give them a follow
- Alpaca - Photoshop plugin - Exciting photoshop implementation! DEMO
- Ando - figma plugin - Figma plugin! DEMO
- Stablender - a blender plugin - a WIP blender plugin with SD
from https://github.com/altryne/awesome-ai-art-image-synthesis
-----
相关项目：
https://github.com/CompVis/latent-diffusion
https://github.com/girliemac/a-picture-is-worth-a-1000-words
https://github.com/WZMIAOMIAO/deep-learning-for-image-processing
https://github.com/alibaba/EasyCV
--------------------------------------------
开源书籍-《Stable Diffusion Book》
《Stable Diffusion Book》(中文)是国人编写的开源技术教程。介绍了 AI 绘画的相关内容，包括中文 Wiki、入门教程、推荐开源文档。覆盖 AI 绘画相关的术语解释、安装配置、配置与调试、模型训练等相关内容。推荐显存大小至少为 4GB 的GPU，进行调试安装。教程遵守 GFDL 自由文档许可，引用需要公开原始材料，且标明来源。
教程源码：https://github.com/sudoskys/StableDiffusionBook
文档的地址： https://draw.dianas.cyou/
No comments:
Post a Comment