当前位置:首页|资讯|LoRA|Stable Diffusion|百度

【lora评测12】用stable diffusion画原神q版表情包

作者:Chuck_2023发布时间:2023-06-16

前言

这款lora的主要作用是生成q版大头娃娃表情包,虽然作者并没有给出训练集的数据,但据lora标题我猜测,作者应该是使用了原神表情贴纸作为原始训练集。

 

生成效果非常不错,不仅是原神人物,即便是非原神的人物也能在保持其特征的情况下将其转换成一样的大头娃娃表情包。我感觉,用热门ip人物形象训练成lora,再结合这个lora把人物定制成微信表情包,可能也是个不错的变现手段。

下载链接

大模型链接:

链接:https://pan.baidu.com/s/14r1_Y7skbOnxDmCexDxXgA?pwd=3mou

提取码:3mou

 

Lora/Embedding链接:

链接:https://pan.baidu.com/s/1oot3sRq5TYPApGI9qMR_lg?pwd=vir6

提取码:vir6

 

图包链接:

链接:https://pan.baidu.com/s/1-6EcUZc6TBijJvNEMffKvQ?pwd=j8kh

提取码:j8kh

 

交流群

qq群:697080799

微信群:

 


 

测试中使用的模型

CKPT大模型

abyssorangemix2SFW

anything-v5

Chilloutmix

realisticVision

revAnimated_v11

cetusMix

Lora模型

gstamp_02(测试lora本体)

blindbox_V1Mix

zhongliLoraCollection_zhongliHard

kleeGenshinImpact

Add_detail

y2b_v2-1

Mecha

 

Embedding模型

ng_deepnegative_v1_75t

EasyNegative

 

实际使用案例

 


 

大模型:anything-v5-PrtRE

 

Loraadd_detail  权重:1

 

Loragstamp_02-000008  权重:1

 

嵌入式:EasyNegative  权重:1

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3),

white on side up ponytail, green highlight, hair ornament, four leaf clover, green eyes, pupil is a cross pattern, tareme, happy face, blush, smiling,

CHIBI,(big head, close-up face), (upper body),emoji, emote,Smiley face,happy,white background,simple background,thick outline,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 2951700620, Size: 512x512

 


 

大模型:anything-v5-PrtRE

 

Loraadd_detail  权重:1

 

Loragstamp_02-000008  权重:1

 

嵌入式:EasyNegative  权重:1

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3),

blonde hair, (red eyes), t-shirt, smile, 1girl, long hair, short sleeves, shorts, cute, (white background),sitting, long hair,CHIBI,(big head, close-up face), (upper body),emoji, emote,

Smiley face,happy,white background,simple background,thick outline,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 1462575519, Size: 512x512

 

 


 

大模型:anything-v5-PrtRE

 

Loraadd_detail  权重:1

 

Loragstamp_02-000008  权重:1

 

嵌入式:EasyNegative  权重:1

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3),red hair, (red eyes), t-shirt,1girl, long hair, short sleeves, shorts, cute, (white background),sitting, long hair,

CHIBI,(big head, close-up face), (upper body),emoji, emote,cry,sad,white background,thick outline,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 2865059948, Size: 512x512

 

 


 

大模型:anything-v5-PrtRE

 

Loraadd_detail  权重:1

 

Loragstamp_02-000008  权重:1

 

嵌入式:EasyNegative  权重:1

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3),

red hair, (red eyes), t-shirt,1girl, long hair, short sleeves, shorts, cute, (white background),sitting, long hair,CHIBI,(big head, close-up face), (upper body),emoji, emote,sad,white background,thick outline,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 754501790, Size: 512x512

 

 


 

 

大模型:anything-v5-PrtRE

 

Loraadd_detail  权重:1

 

Loragstamp_02-000008  权重:1

 

嵌入式:EasyNegative  权重:1

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3),brown hair, pure light blue eyes,CHIBI,(big head, close-up face), (upper body),emoji, emote,Sweat face,white background,thick outline,PCR, CHIBI

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 651572061, Size: 512x512

 


 

 

大模型:anything-v5-PrtRE

 

Loraadd_detail  权重:1

 

Loragstamp_02-000008  权重:1

 

嵌入式:EasyNegative  权重:1

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, (WHITE BACKGROUND:1.3), purah, smile

armor,1girl_knight,full body,  <lora:Mecha:0.3>,A long large cloak that grows to the ground,Gothic,CHIBI,white background,simple background,thick outline,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 4033805806, Size: 512x512

 

 

 

 

提示词对照表

大模型:anything-v5-PrtRE

 

Loraadd_detail  权重:1

 

Loragstamp_02-000008  权重:1

 

 

嵌入式:EasyNegative  权重:1

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3), (upper body),thick outline,

 

1girl,red hat,blonde hair,

 

happy,Smiley face,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 1988309810, Size: 512x512

 

对照表



 

阶段结论

触发词tag相对宽泛。

如果想要更好更方便抠图的纯色背景,使用simple backgrond与white background。

如果要稳定构图,加上close up face与upper body就能让人物稳定只出上半身的图。

 

表情包测试

笑(Smiley face)

 


悲伤(Sad face)

 


调皮(Grimace face)

 


 

害羞(Sweat face)

 


 

惊讶(Astonished face)

 

 


哭(cry face)

 


困(Sleepy face)

 


阶段结论

既然是表情包,不同表情的生成效果自然也非常重要。我尝试了从开心到悲伤等多种表情的生成,基本都能有不错的表现效果,大家在使用的时候也可以多多尝试不同种的表情。

 

 

大模型测试

基础信息

大模型:如下图对照表所示

 

Loraadd_detail  权重:1

 

Loragstamp_02-000008  权重:1

 

 

嵌入式:EasyNegative  权重:1

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3),CHIBI,(big head, close-up face), (upper body),emoji, emote,white background,simple background,thick outline,

 

1girl,red hat,blonde hair,

 

happy,Smiley face,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 2746976648, Size: 512x512

对照表

 


 

阶段结论

在大模型测试中,这款lora表现出了不错的兼容性,即便是类照片大模型情况下依然有不错的效果。除了realisticvision之外,对其他画风兼容的都很好。

 

 

兼容性测试

 

人物lora测试(2B)

基础信息

大模型:anything-v5-PrtRE

 

Loraadd_detail  权重:1

 

Loragstamp_02-000008  权重:1

 

嵌入式:EasyNegative  权重:0.7

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3),

 

HM2B, BLACK BLINDFOLD, COVERED EYES, MOLE UNDER MOUTH, CLOTHING CUTOUT, LONG SLEEVES, PUFFY SLEEVES, JULIET SLEEVES, FEATHER TRIM, BLACK THIGHHIGHS, BLACK GLOVES, BLACK DRESS, BLACK SKIRT,

 

CHIBI,(big head, close-up face), (upper body),emoji, emote,

 

Smiley face,happy,

 

white background,

 

simple background,

 

thick outline,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 2888620122, Size: 512x512

对照图

 


 

人物lora测试(可莉)

基础信息

大模型:anything-v5-PrtRE

 

Loraadd_detail  权重:1

 

Loragstamp_02-000008  权重:1

 

嵌入式:EasyNegative  权重:0.7

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3),

 

1girl,red hat,blonde hair,

 

CHIBI,(big head, close-up face), (upper body),emoji, emote,

 

Smiley face,happy,

 

white background,

 

simple background,

 

thick outline,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 2734360778, Size: 512x512

对照图

 

 


 

人物lora测试(钟离)

基础信息

大模型:anything-v5-PrtRE

 

Loraadd_detail  权重:1

 

Loragstamp_02-000008  权重:1

 

嵌入式:EasyNegative  权重:0.7

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3),CHIBI,(big head, close-up face), (upper body),emoji, emote,white background,simple background,thick outline,

 

1boy, solo, male focus, zhongli (genshin impact), jewelry, earrings, single earring, bangs, brown hair, long hair, hair between eyes, necktie, closed mouth, multicolored hair, tassel, tassel earrings, shirt, jacket, looking at viewer, collared shirt, ponytail, upper body, long sleeves, white necktie, gradient hair, black hair, orange eyes, formal, vest, coat, brown vest, suit,

 

happy,Smiley face,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 2639136916, Size: 512x512

对照图

 


 

画风lora测试(盲盒)

基础信息

大模型:anything-v5-PrtRE

 

Loraadd_detail  权重:1

 

Loragstamp_02-000008  权重:1

 

嵌入式:EasyNegative  权重:0.7

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3),CHIBI,(big head, close-up face), (upper body),emoji, emote,white background,simple background,thick outline,

 

armor,1girl_knight,A long large cloak that grows to the ground,Gothic,blindbox,

 

happy,Smiley face,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 4184112327, Size: 512x512

对照图

 


 

阶段结论

测试结果非常好,除了权重对它的影响成谜,好像在所有数值情况下的表现都大差不差。按照经验判断,如果在一些生成情况不太理想的大模型环境下,加高权重可能更有利于转化人物身体比例。

这里表情包lora权重推荐:0.7-1,人物lora权重推荐:0.6-0.9

 

这款lora在画风覆盖的表现上相当的霸道,不推荐与任何画风lora兼容使用,如果一定要用,最好在保持画面稳定的前提下开低这款lora的权重。

 

图生图测试

基础信息

大模型:anything-v5-PrtRE

 

LoraAddNet     权重:1

 

Loragstamp_02-000008  权重:0.5

 

嵌入式:EasyNegative  权重:0.7

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

masterpiece, best quality,

 

CHIBI, close-up face, white background,simple background, (upper body),thick outline,

 

1girl,black business suit,Arms folded across the chest,smile,short hair, black hair,

 

负:

 

NSFW,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, lowres, text, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, text, signature, watermark, simple background, toony, dated, low res, line art, flat colors

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 2835120182, Size: 609x882

 

对照表

 

 


 

阶段结论

所有会改变人物身体比例的lora一样,这款lora也不适合图生图。这里不做推荐。

 





Copyright © 2024 aigcdaily.cn  北京智识时代科技有限公司  版权所有  京ICP备2023006237号-1