Incredible artificial intelligence Easy Diffusion 3.0. The Middle and High School Guide

Step 1. Most popular programs

Today, there are quite a large number of different programs that, based on Artificial Intelligence technologies, create incredibly beautiful images.

In my opinion, the following programs are the most popular:

– Midjourney is a very popular Artificial Intelligence system created by the company of the same name, Midjourney. Artificial Intelligence Midjourney is a web service on the Internet that allows you to create very beautiful images without using the computing resources of your computer. To use it, you must have Discord installed – a convenient messenger for group work, which is often used by players around the world. The main drawback of the program is that not so long ago Midjourney became completely paid.

Program website:

https://www.midjourney.com

– Leonardo.Ai is a colorful web service on the Internet that provides access to the Leonardo.Ai neural network of the same name. With it, you can create images from text and other images. The advantages of Leonardo.Ai include an easy-to-use interface. The disadvantage is the limitation on the number of images created per day. Images are created very quickly and with high quality, but it will take a lot of time until you learn how to make something high-quality. If you want to spend more time working with this program, be prepared to pay for its services. Very often Leonardo.Ai is compared to Midjourney, but which one is better is up to you to decide.

Program website:

https://leonardo.ai

– Dreamstudio.ai is a web service created by Stability AI, which has developed one of the most famous neural networks or, as they say, «models» called Stable Diffusion. The web service is very convenient and allows you to create any images very quickly. This is because Dreamstudio.ai uses very powerful computers provided by Stability AI. In other words, your computer is not involved in the process of creating images, which is a significant advantage of the program. At the same time, the disadvantage of using Dreamstudio.ai is the limitation on the number of images created.

Program website:

https://beta.dreamstudio.ai/dream

– Stable Diffusion Web UI is a web-based program that you can install directly on your computer. Its advantages include the fact that it is a completely free option for using the Stable Diffusion model. The program allows you to choose flexible settings to improve the quality of the image and convert it to a new version or create another image based on it. Disadvantages include some difficulties associated with installation and the need for you to have additional knowledge of the programs necessary for its operation (for example, such as Python and Git). Stable Diffusion can be recommended to all those users who have already gained extensive experience with Easy Diffusion.

Program websites:

https://github.com/AUTOMATIC1111/Stable-diffusion-webui

https://www.python.org/downloads/windows/

https://git-scm.com/download/win

https://Stablediffusionweb.com/#demo

– Stablecog is a very easy to use, but at the same time very interesting web service. Unfortunately, it’s paid. However, you can create twenty free images per day. I liked it because out of ten models you can choose two created by our compatriots. These models are called Kandinsky and Kandinsky 2.2. In addition, you can increase the resolution of the created image four times (for example, from 1248x832 to 4992x3328).

Program website:

https://stablecog.com/generate

– Easy Diffusion is a completely free Artificial Intelligence system that combines the capabilities of using Midjourney and Stable Diffusion. Easy Diffusion offers you a convenient and simple web interface that allows you not only to create very beautiful images, but also to connect various additional modules and models to its work. By default, the program already has the well-known Stable Diffusion model preinstalled. Additionally, you can download many other models from www.civitai.com, including the «Openjourney» model, which will allow you to replace the use of Midjourney. Another advantage of the program is that it is very easy to install on a computer or laptop and works with not very powerful video cards. The only drawback of the program is the time it takes you to create images. For example, if an image in “Dreamstudio.ai” is created in 20 seconds, then in Easy Diffusion it can take up to 120 seconds to create.

Once again, I would like to draw your attention to the fact that Easy Diffusion is an easy-to-install assembly of software packages (or, in other words, a distribution kit) of the Stable Diffusion Artificial Intelligence system for various operating systems. Here and further, I will not talk about Stable Diffusion, but rather Easy Diffusion due to the fact that it is with this distribution and program that we will work.

Program website (program distribution):

https://github.com/easydiffusion/easydiffusion

Step 2. Install Easy Diffusion

In order for us to install the Easy Diffusion program, follow the following link and download the required distribution for your operating system (MS Windows, Linux or MacOS):

https://github.com/easydiffusion/easydiffusion

There are three distributions on the program page:

• For MS Windows operating system.

• For the Linux operating system.

• For the MacOS operating system.

Before installing the program, please pay attention to the minimum requirements for your computer. You must have:

– Video card from NVIDIA with 2 GB of RAM (better with 4 GB). A laptop video card will do, but keep in mind that you must have the latest drivers installed not only for the video card, but also for all components of the MS Windows system.

– The minimum amount of computer RAM is 8 Gigabytes.

– The minimum amount of disk space (either on the «C:\” drive or on any other drive) is 40 Gigabytes (25 for Easy Diffusion and 15 for models). I recommend installing the program on a computer flash drive (not an external drive, but an internal drive of a computer or laptop). It will make image creation faster.

Next, we will consider installing Easy Diffusion on a computer with the MS Windows operating system.

Before installing, you need to make sure that everything is in order on your MS Windows system. To do this, you need to right-click on the «My Computer» icon and select the «Manage» command from the context menu. The Computer Management program will open, and in the Device Manager section you will see not only all the devices on your computer, but also their operating status. If there is a malfunction of any of the devices, you need to install new drivers for this device. You can find them on the Internet.

Next, download the Easy-Diffusion-Windows program.

After downloading the file named Easy-Diffusion-Windows, launch the installation and click the «Next» button:

We agree to the license agreement and click the «I Agree» button:

Click the «I Agree» button again:

Select the disk on which the program will be installed. The main recommendation is that the program should be located in the root of the disk, that is, it should be installed on the disk, but not inside other folders, but only in its own.

For example, on the drive C:\EasyDiffusion\, as shown in the image below:

Or on drive D:\EasyDiffusion\, as shown in the image below:

Select the disk you need and click the «Install» button.

The process of installing and unpacking the files on your computer has begun:

The installation process takes some time.

During this process, the program will install all the necessary files and models for work, including installing the Stable Diffusion model (version 1.5), with which you will create your first works of computer art:

The program will install other auxiliary models (for example, GFPGAN model, Real-ESRGAN model, etc.), which are used by Easy Diffusion to improve the images you create.

At the end of the process, a CLIP model will be established, which allows you to determine how well the generated image matches the query you wrote.

After installation is complete, the following window will appear:

But don’t rush to click the «Finish» button.

Be sure to check the «Create Desktop Shortcut» box and uncheck the «Run Easy Diffusion 3.0» box.

And only now click the «Finish» button.

After completing all the steps, the program will be completely installed on your computer.

Why didn’t we launch the program immediately after installation?

All this is necessary because before we start working with the Easy Diffusion generative Artificial Intelligence system, we need to download and install a few more additional model files that will allow us to create incredibly beautiful images.

What is a model?

A model is a file containing a set of parameters of a trained neural network. The file size can be small or it can be several GB in size. It depends on what a particular model is created and used for.

Each model is trained on a large number of thematic images. A set of images or data is called a «dataset».

There are a large number of different models for creating photorealistic images in various artistic styles. Some models work better for creating anime images, while others work better for imitating famous artists.

To continue working, we need to follow the following links and download the latest versions of the model files with which we will work:

– Realistic Vision версия 5.1

(https://civitai.com/models/4201/realistic-vision-v51);

– DreamShaper версия 8.0

(https://civitai.com/models/4384/dreamshaper);

– Color Fusion версия 1.0

(https://civitai.com/models/20617/color-fusion);

– Midjourney версия 4.0

(https://huggingface.co/prompthero/openjourney/blob/main/mdjrny-v4.ckpt);

– Openjourney версия 4.0 (модель обучена на рисунках Midjourney)

(https://civitai.com/models/86?modelVersionId=27392);

– SDXL Yamer’s Realism! 2.0

(https://civitai.com/models/136669/sdxl-yamers-realism-realisticanime3d).

For example, we need to download the Realistic Vision model file version 5.1.

Follow the link above to the page where there is a model file:

https://civitai.com/models/4201/realistic-vision-v51

Then we find the file of the latest version of the model for downloading:

And download the file by clicking the «Download» button:

The realisticVisionV51_v51VAE.safetensors file, 1.9 GB in size, will be downloaded to your computer.

If you do not have an electronic version of the book, you can enter the names of the model files in any search engine and find them on the Internet. For example, upon request «download model Realistic Vision» you will be offered a list of sites for downloading, including the site civitai.com, from which I downloaded most of the files I needed.

After you download all or most of the models offered to you for download, you need to transfer all the files (using the «cut» and «put» commands) to a folder along one of the paths: «C:\EasyDiffusion\models\Stable-diffusion» or «D:\EasyDiffusion\models\Stable-diffusion», depending on where you installed your program.

For this:

– Open the folder on the disk where Easy Diffusion is installed (for example, «C:\EasyDiffusion\” or «D:\EasyDiffusion\»).

– Then find and open the «models» folder.

– In it you will see a folder called «Stable-diffusion». Open it and transfer the model files you downloaded into it.

Congratulations!

You have become the proud owner of your own Easy Diffusion Artificial Intelligence system, installed on your personal computer and supplemented with new models.

Now we can proceed to the first launch.

Step 3. Launch Easy Diffusion for the first time

If immediately after installing the program you selected the «Run Easy Diffusion 3.0» command, as shown in the figure below:

A black window will appear in front of you with running lines of incomprehensible text:

You shouldn’t be afraid of this window, since this is the window where the application itself works, or, more precisely, its server part. This window will always appear when the program starts working. There is no need to close it until you decide to finish your work. Just roll it up.

You need to wait a minute or two (depending on the performance (power) of your computer), after which another window will open in the Internet browser (installed by default). This will be the same Easy Diffusion user interface (or it can also be called the client application of the program), with which we will work throughout the entire time.

Easy Diffusion’s interface is dark, but that’s fixable. In the next chapter we will learn how to make our work more comfortable using program settings.

Thus, when we first launched the program, two windows opened: a window for the server part of the program and a window for the interface.

But don’t rush to get started.

I would recommend that you close both windows and start the program again. This is primarily due to the fact that when you restart the Easy Diffusion program will automatically check for updates, download and install all the necessary new files on its own.

Wait a little longer and your default Internet browser will open again.

After which we can begin with you the next step of work – setting up comfortable and stable operation of Easy Diffusion.

Step 4. Setting up Easy Diffusion

Setting up Easy Diffusion is actually very simple.

By default, the program has options that provide a high level of comfortable work and do not require any changes. However, there are a few that require our attention.

The figure below shows the user interface of the program:

So, let’s get started.

Easy Diffusion has only five main application work window tabs, which are placed one after the other at the top of the user interface work area:

– «Generate».

– «Settings».

– «Help & Community».

– «Models tools».

– «What’s new.»

All our work will take place in the main «Generate» window, which we will devote most of our time to in the next chapter.

In this chapter you will look at the contents of the following bookmarks:

– «Settings».

– «Help & Community».

– «Models tools».

– «What’s new».

«Settings»

To get started, we first need the Settings window.

For your convenience, I will use the «Light» theme of the program:

The Settings window provides the following options:

– «Theme». Allows you to change the current theme to the one you like. I’m using the «Light» theme.

– «Auto-Save Images». Let’s activate the option. It allows us to save all our images and descriptions for them in a folder we specify.