<aside> <img src="/icons/flag_gray.svg" alt="/icons/flag_gray.svg" width="40px" /> Embeddings、LoRa、Hypernetwork模型原理解析!让AI学会画手,还能画三视图!

对于第一次接触AI绘画的新手而言,各种艰深晦涩的模型概念是深入学习最主要的障碍之一。除了Checkpoint以外,还有很多不同类型的模型,它们可以用来塑造角色、改变画风、制作特定主题的艺术作品。

这节课里,我们就将集中讨论**Embeddings(词嵌入)、LoRa(低秩适应模型)、Hypernetwork(超网络)**这三种“小模型”,从原理出发,并探究它们在Stable Diffusion中的一系列应用。

花上十分钟,我相信,这节课会让你收获满满。

素材下载 | 正式课目录

Stable Diffusion 零基础入门课学习资料汇总

</aside>

课程视频

https://www.bilibili.com/video/BV1th4y1p7fH/

<aside> <img src="/icons/book-closed_gray.svg" alt="/icons/book-closed_gray.svg" width="40px" /> 目录索引

</aside>

思维导图

SD06:Embeddings、LoRA和Hypernetwork.png

生成信息

![使用Embeddings](https://prod-files-secure.s3.us-west-2.amazonaws.com/52541325-ce85-4577-bf7a-b7117fcc2565/5ff0d80c-2bee-45a7-8802-ebc5089d186a/00391-3590206651-SFW_masterpiece_best_quality_1girl_brown_hair_brown_eyes_smile_standing_dynamic_pose_outdoors_city_background_(corneo.png)

使用Embeddings

使用LoRA(权重0.8)

使用LoRA(权重0.8)

SFW, masterpiece, best quality, 1girl, brown hair, brown eyes, smile, standing, dynamic pose, outdoors, city background, <lora:dVaOverwatch_v3:0.5>, deeva \\(overwatch 1 version\\), d.va /(overwatch 1/),
facial_mark, whisker_markings, d.va_\\(overwatch\\), 1girl, blue bodysuit, long_hair, pilot_suit, solo, facepaint, headphones, gun, brown_hair, holding_gun, swept_bangs, clothes_writing, bangs, breasts, blue_background, hand_on_hip, animal_print, handgun, brown_eyes, medium_breasts, holding_weapon, bracer, ribbed_bodysuit, weapon, white_gloves, shoulder_pads, holding, high_collar, turtleneck, standing, white_footwear, full_body, charm_\\(object\\), pink_lips, gloves, hand_up, pistol, skin_tight, smile
Negative prompt: NSFW, (worst quality:2), (low quality:2), (normal quality:2), lowres, normal quality, ((monochrome)), ((grayscale)), skin spots, acnes, skin blemishes, age spot, (ugly:1.331), (duplicate:1.331), (morbid:1.21), (mutilated:1.21), (tranny:1.331), mutated hands, (poorly drawn hands:1.5), blurry, (bad anatomy:1.21), (bad proportions:1.331), extra limbs, (disfigured:1.331), (missing arms:1.331), (extra legs:1.331), (fused fingers:1.61051), (too many fingers:1.61051), (unclear eyes:1.331), lowers, bad hands, missing fingers, extra digit,bad hands, missing fingers, (((extra arms and legs))),
Steps: 20, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3590206651, Size: 600x800, Model hash: a074b8864e, Model: 二次元:Counterfeit V2.5, Denoising strength: 0.4, Clip skip: 2, ENSD: 31337, Hires upscale: 1.5, Hires upscaler: R-ESRGAN 4x+ Anime6B

![角色概念三视图(搭配LoRA使用人物形象更准确)](https://prod-files-secure.s3.us-west-2.amazonaws.com/52541325-ce85-4577-bf7a-b7117fcc2565/10fac750-d92b-44e9-ab69-abd27b12d119/00418-2790994655-A_character_turnaround_of_a_(corneo_dva)_wearing_blue_mecha_bodysuit_(CharTurnerV2_1.2)_(multiple_views_of_the_same_character.png)

角色概念三视图(搭配LoRA使用人物形象更准确)

A character turnaround of a (corneo_dva) wearing blue mecha bodysuit, (CharTurnerV2:1.2),
(multiple views of the same character with the same clothes:1.2), ((character sheet)), (model sheet),((turnaround)),(reference sheet), white background, simple background, character concept, full body,
SFW, masterpiece, best quality, 1girl, brown hair, brown eyes, smile, standing, dynamic pose, outdoors, city background, (corneo_dva:0.95),
facial_mark, whisker_markings, d.va_\\(overwatch\\), 1girl, (blue:1.4) bodysuit, long_hair, pilot_suit, solo, facepaint, headphones, gun, brown_hair, holding_gun, swept_bangs, clothes_writing, bunny_print, bangs, breasts, blue_background, hand_on_hip, animal_print, handgun, brown_eyes, medium_breasts, holding_weapon, bracer, ribbed_bodysuit, weapon, white_gloves, shoulder_pads, holding, high_collar, turtleneck, standing, white_footwear, full_body, charm_\\(object\\), pink_lips, gloves, hand_up, pistol, skin_tight, smile
Negative prompt: NSFW, (worst quality:2), (low quality:2), (normal quality:2), lowres, normal quality, ((monochrome)), ((grayscale)), skin spots, acnes, skin blemishes, age spot, (ugly:1.331), (duplicate:1.331), (morbid:1.21), (mutilated:1.21), (tranny:1.331), mutated hands, (poorly drawn hands:1.5), blurry, (bad anatomy:1.21), (bad proportions:1.331), extra limbs, (disfigured:1.331), (missing arms:1.331), (extra legs:1.331), (fused fingers:1.61051), (too many fingers:1.61051), (unclear eyes:1.331), lowers, bad hands, missing fingers, extra digit,bad hands, missing fingers, (((extra arms and legs))),
Steps: 20, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 2790994655, Size: 800x600, Model hash: a074b8864e, Model: 二次元:Counterfeit V2.5, Denoising strength: 0.7, Clip skip: 2, ENSD: 31337, Hires upscale: 1.5, Hires upscaler: R-ESRGAN 4x+ Anime6B

修手前

修手前

修手后

修手后

(1man, close-up, portrait, :1.3), hands up, hands covered face ,eyes peeped through fingers,
(masterpiece:1,2), best quality, masterpiece, highres, original, extremely detailed wallpaper, perfect lighting,(extremely detailed CG:1.2),
Negative prompt: (worst quality:2), (low quality:2), (normal quality:2), lowres, normal quality, ((monochrome)), ((grayscale)), skin spots, acnes, skin blemishes, age spot, (ugly:1.331), (duplicate:1.331), (morbid:1.21), (mutilated:1.21), (tranny:1.331), (easynegative:1.5)
Steps: 20, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 906910950, Size: 600x600, Model hash: a074b8864e, Model: 二次元:Counterfeit V2.5, Clip skip: 2, ENSD: 31337