Website powered by

StableDiffusion Tips for 3D Character Artists

Tutorial / 10 March 2023

The useful "AICG tools" only generate 2D images, so the mainstream usage should be for quickly creating reference images, which is very helpful for the early stages of 3D character design.

Here are several usage examples provided in order of the process.

1. Brainstorming
(check the example from Andre-Lang Huynh)

One of the mainstream practices. I also use AICG for my daily speed sculpting exercises, replacing the space on my left screen that has been occupied by Pinterest for a long time.

Adjust "Checkpoint" and "Lora" according to the desired style, for example, using 3D-related data if necessary(Stylized 3D Model LoRA), or some auxiliary enhancement tools. (Character Turnaround helper, Contrast Fix)


2. Client's request in the text

If there is no clear design draft, please visualize the content that the customer needs.


3. Varied base model

Once the production direction and theme are determined, a basic model can be quickly created, and various possible directions can be calculated using this basic model.


4. Quickly iterate

The basic model can be iterated continuously with AICG, even only calculating local details. It is recommended to use "ControlNet" and "Zbrush" for collaboration. The following all use built-in functions and can be completed with almost one click.

Use the PBR channel to obtain DepthMask; use the filter to obtain the outline; use the material ball to obtain the range.

Alternatively, for example, use the 2.5D mode(ZB) to generate "CharTurn" and calculate the possible styles.


5. Details / Props / Scenarios

Using "Inpaint", models can be used as a base and fine-tuned with "Mask Blur" / "ControlNet". Importantly, the color of the base model will affect the output results, so a simple "Cloth Proxy and Flat Color" can be created.

After completing the partial or main body, it can be paired with various possible equipment.

Training can also be done on completed assets. (example from Jurand Macioszczyk / example from 木下曰本)


6. Texturing
(check the example from Sarafim)

The current usage is "image projection," which mainly visualizes inspiration but still requires significant improvement before it can be used. If you're looking for some common variations, I suggest using the Substance series directly.


As a frontline worker, I believe this is an excellent productivity tool and a good optimization patch for the work system. It should become a basic skill for professionals like Photoshop.