当前位置:首页|资讯|LoRA|Stable Diffusion|百度

【Lora测试16】用stable diffusion做自己的fufu玩偶吧!

作者:Chuck_2023发布时间:2023-07-08

前言

对fufu LoRa的全面评测

 

FuFu一词,指的是在虚拟歌姬初音未来的周边中,由三月八日老师绘制并由SEGA出品的玩偶。其fufu的名称则取自玩偶名字fuwafuwa中的简称。除却初音未来iP形象可以被称为fufu,所有以这种呆萌形象画风出现的玩偶都可以称之为fufu。不过看着傻乎乎的fufu价格却不便宜,贫穷使人进步,学会SD自己生成几只过过瘾还是没问题的。

 

而本次测试的fufu LoRa模型,就能将任何形象都转化为fufu。

 

下载链接

大模型链接:

链接:https://pan.baidu.com/s/1qucE1B4DyaDRvkn_ZXuJng?pwd=91h1

提取码:91h1

 

Lora/Embedding链接:

链接:https://pan.baidu.com/s/1Mf0schQoyCm_hf8uOsHg7A?pwd=dzli

提取码:dzli

 

图包链接:

链接:https://pan.baidu.com/s/15RJF3HT2s0ycpEsdGOQeCg?pwd=kof2

提取码:kof2

交流群

qq群:697080799

微信群:

 


测试中使用的模型

CKPT大模型

abyssorangemix2SFW_abyssorangemix2Sfw

anything-v5

Basil mix

cetusMix_v4

Chilloutmix

CounterfeitV30_v30

ghostmix_v20Bakedvae

manmaruMix_v10

perfectWorld_v4Baked

realisticVision

revAnimated_v11

sxzLuma_098VAE

Lora模型

fufu3dv0.2(测试lora本体)

blindbox_V1Mix

zhongliLoraCollection_zhongliHard

kleeGenshinImpact_kleeGenshinImpact

 

Embedding模型

ng_deepnegative_v1_75t

EasyNegative

 

实际使用案例

 

 


 

大模型:CounterfeitV30_v30

 

Lorafufu3dv0.2  权重:0.8

 

嵌入式:EasyNegative  权重:1

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3698942781, Size: 600x800

 


 

 

大模型:anything-v5-PrtRE

 

Lora fufu3dv0.2  权重:0.8

 

嵌入式:EasyNegative  权重:1

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

 

1gril,white armor,knight,street,red hair,full body, chibi,wanju/(fufu/),standing,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3993299175, Size: 600x800

 

 

 


 

 

大模型:CounterfeitV30_v30

 

Lorafufu3dv0.2  权重:0.8

 

嵌入式:EasyNegative  权重:1

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

1gril,green eyes, bony meat, eating, happy, bonfire, night, moonlight, beast ears,smile,full body, chibi,wanju/(fufu/),standing,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 27581122, Size: 600x800

 

 


 

 

大模型:CounterfeitV30_v30

 

Lorafufu3dv0.2  权重:0.45

 

嵌入式:EasyNegative  权重:1

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

1gril,pointy ears,library,reading,red hair, magic,beast ears,smile,fox Tail,

full body, chibi,wanju/(fufu/),standing,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 778860232, Size: 600x800

 

 

 


 

 

大模型:CounterfeitV30_v30

 

Lora fufu3dv0.2 权重:0.45

 

嵌入式:EasyNegative  权重:1

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

1gril,pointy ears,outdoors,   magic,beast ears,smile,fox Tail,

full body, chibi,wanju/(fufu/),standing,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 1235833522, Size: 600x800

 

 


 

大模型:CounterfeitV30_v30

 

Lorafufu3dv0.2  权重:0.45

 

嵌入式:EasyNegative  权重:1

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

1gril,outdoors, smile,

full body, chibi,wanju/(fufu/),standing,

PCR, CHIBI

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 1814127239, Size: 600x800

 

 

提示词对照表

大模型:CounterfeitV30_v30

 

Loraadd_detail  权重:1

 

LorakleeGenshinImpact_kleeGenshinImpact  权重:1

 

Lorafufu3dv0.2 权重:1

 

嵌入式:EasyNegative  权重:1

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

1girl,red hat,blonde hair, WANJU\(FUFU\)

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 609054887, Size: 600x800

 

对照表

 


 

阶段结论

使用这款lora,触发词建议使用以上几个单词作为提示词,尤其是这个点点,虽然只是两个英文句号加一个空格,但能极大的稳定面部的生成,这个提示词的权重可以放到1.5左右。

 

大模型测试

基础信息

大模型:如下图对照表所示

 

Lorafufu3dv0.2  权重:0.8

 

嵌入式:EasyNegative  权重:1

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

Candles, Reading, Indoor,1girl, Top Hat,

WANJU\(FUFU\),chibi,hatsune miku,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3405368600, Size: 600x800

对照表

一测

 


 

二测

 


阶段结论

这款lora对各种画风的兼容方面表现一般,比较适合二次元画风的大模型,如果要追求还原度,则推荐revanimeted。二测的几款大模型比较推荐用于生成

 

 

兼容性测试

 

人物lora测试(可莉)

基础信息

大模型: CounterfeitV30_v30

 

Lorafufu3dv0.2  权重:0.5

 

LorakleeGenshinImpact_kleeGenshinImpact  权重:0.9

 

嵌入式:EasyNegative  权重:0.7

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

1girl,red hat,blonde hair,standing,looking at viewer, . . ,

WANJU\(FUFU\),chibi,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3187457933, Size: 600x800

对照图

 

 

 


 

人物lora测试(钟离)

基础信息

大模型:CounterfeitV30_v30

 

Lorafufu3dv0.2  权重:1

 

LorazhongliLoraCollection_zhongliHard  权重:1.5

 

嵌入式:EasyNegative  权重:0.7

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

 

1boy, solo, male focus, zhongli (genshin impact), jewelry, earrings, single earring, bangs, brown hair, long hair, hair between eyes, necktie, closed mouth, multicolored hair, tassel, tassel earrings, shirt, jacket, looking at viewer, collared shirt, ponytail, upper body, long sleeves, white necktie, gradient hair, black hair, orange eyes, formal, vest, coat, brown vest, suit,standing,

. . ,

WANJU\(FUFU\),chibi,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3187457933, Size: 600x800

对照图

 


 

画风lora测试(盲盒)

基础信息

大模型:CounterfeitV30_v30

 

Lorafufu3dv0.2  权重:0.6

 

Lorablindbox_V1Mix  权重:0.5

 

嵌入式:EasyNegative  权重:0.7

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

(1girl:1.5), Top Hat, blindbox,

. . ,

WANJU\(FUFU\),chibi,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3659272366, Size: 600x800

对照图

 


阶段结论

这款lora与人物兼容性适配的很不错,效果理想。不过要注意之前提到的污染问题,可能会让人物形象倾向初音未来的服装,也可能让发色偏向葱绿色,需要小心调试权重或者多试几次。

 

这里推荐fufuLora权重0.9~1.1,人物Lora0.5以上

 

 

图生图测试

基础信息

大模型:CounterfeitV30_v30

 

Lorafufu3dv0.2  权重:0.7

 

嵌入式:EasyNegative  权重:0.7

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

masterpiece, best quality,

WANJU\(FUFU\),chibi,hatsune miku,

1girl,black business suit,Arms folded across the chest,smile,short hair, black hair,

 

负:

 

NSFW,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, lowres, text, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, text, signature, watermark, simple background, toony, dated, low res, line art, flat colors

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 2605847031, Size: 608x880

 

对照表

 


 

 

阶段结论

图生图方面,由于身体比例变化大,这里不做推荐,在高重绘幅度下会有些微妙的效果,说不清是提取了原图元素还是只是单纯对提示词生效。总之不太推荐使用。

 




Copyright © 2024 aigcdaily.cn  北京智识时代科技有限公司  版权所有  京ICP备2023006237号-1