当前位置:首页|资讯|LoRA|Stable Diffusion

【Lora测试17】用Stable diffusion模拟油画笔触

作者:Chuck_2023发布时间:2023-07-10

前言

对油画LoRa的全面评测

 

今天给大家带来的是古典油画画风的画风lora,相较于之前评测的《极乐disco》巡回画派的狂野奔放,这款lora则更像是大家通常会见到的油画画风。

 

万物皆可油画,尤其是背景会表现的格外明显,图生图效果明显。

Lora训练集主要以风景画为主,生成风景效果格外棒且与大部分大模型都比较兼容,但过于独特的大模型就有点没办法融合。生成时有人物缺失的情况,可能与以风景画为主的训练集为主。虽然与极乐disco画风不一样,但生成效果与兼容性略弱一筹。

 

本次测试的可以生成一些很有反差感的东西,就比如把二次元美少女用油画的笔触勾勒出来,把一些人物肖像转化成接近油画的质感。

下载链接

大模型链接:

链接:https://pan.baidu.com/s/1Sf0d4dBguvGWbk7BoqZiHA?pwd=1rm6

提取码:1rm6

 

Lora/Embedding链接:

链接:https://pan.baidu.com/s/1ygNJZ79aCYO_BgKdqOq4pA?pwd=k8l7

提取码:k8l7

 

图包链接:

链接:https://pan.baidu.com/s/19MCdX2X3NX1iHCe8p3rFDA?pwd=14zq

提取码:14zq

交流群

qq群:697080799

微信群:

 


测试中使用的模型

CKPT大模型

abyssorangemix2SFW_abyssorangemix2Sfw

anything-v5

Basil mix

cetusMix_v4

Chilloutmix

CounterfeitV30_v30

ghostmix_v20Bakedvae

manmaruMix_v10

perfectWorld_v4Baked

realisticVision

revAnimated_v11

sxzLuma_098VAE

majicmixRealistic_v6

Lora模型

bichu-v0612(测试lora本体)

blindbox_V1Mix

zhongliLoraCollection_zhongliHard

kleeGenshinImpact_kleeGenshinImpact

Add_detail

Mecha

GachaSplashAlter

Embedding模型

ng_deepnegative_v1_75t

EasyNegative

 

实际使用案例

 

 


 

 

大模型:CounterfeitV30_v30

 

LoraGachaSplashAlter  权重:0.7

 

Lorabichu-v0612  权重:0.5

 

LoraMecha  权重:0.5

 

嵌入式:EasyNegative  权重:1

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting,  (white background:1.0),

1gril,white armor,knight,red hair,A long large cloak that grows to the ground,castle,

|BICHU,

|OIL PAINTING,

|IMPRESSIONISM,

<lora:Mecha:0.5>

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 4257521451, Size: 600x800

 

 


 

大模型:CounterfeitV30_v30

 

LoraGachaSplashAlter  权重:0.7

 

Lorabichu-v0612  权重:0.8

 

嵌入式:EasyNegative  权重:1

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting,  (white background:1.0),

dress,1girl,full body,A long large cloak that grows to the ground,street,Witch Hat,white hair,

|BICHU,

|OIL PAINTING,|IMPRESSIONISM,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3050064932, Size:  496x800

 

 

 


 

 

大模型:CounterfeitV30_v30

 

Lora:bichu-v0612  权重:1.05

 

嵌入式:EasyNegative  权重:1

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

1girl,red hat,blonde hair,Street, smile,solo, face focus,looking at viewer,skirt,full body,

|BICHU,

|OIL PAINTING,

|IMPRESSIONISM,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3440931077, Size: 960x536

 

 

 


 

 

大模型:CounterfeitV30_v30

 

LoraGachaSplashAlter  权重:0.7

 

Lorabichu-v0612   权重:0.8

 

嵌入式:EasyNegative  权重:1

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting,  (white background:1.0),

1gril,green eyes, bony meat, eating, happy, bonfire, night, moonlight, beast ears,

|BICHU,

|OIL PAINTING,

|IMPRESSIONISM,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,

 

Steps: 35, Sampler:DPM++ SDE Karras, CFG scale: 7, Seed: 4240876446, Size: 500x800

 

 

 


 

 

大模型:CounterfeitV30_v30

 

Lorahanfu  权重:0.8

 

LoraGachaSplashAlter 权重:0.7

 

Lorabichu-v0612   权重:0.8

 

LorakleeGenshinImpact_kleeGenshinImpact  权重:0.5

 

嵌入式:EasyNegative  权重:1

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting,  (white background:1.0),

masterpiece, best quality, <lora:hanfu:1>,hanfukozue, 1girl, black hair, bug, butterfly, barefoot, solo, hair ornament, sitting, hanfu, chinese clothes, anklet, leaf, fruit, jewelry, white background, long sleeves, simple background, food, grapes, full body, single hair bun, holding, hair stick, wide sleeves, hair bun, smile, yokozuwari, looking at viewer, long hair, closed mouth, hand up, flower, holding leaf, on floor,

|BICHU,

|OIL PAINTING,

|IMPRESSIONISM,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 4232934891, Size:  500x800

 

 


 

 

大模型: CounterfeitV30_v30

 

LoraGachaSplashAlter  权重:0.7

 

Lorabichu-v0612  权重:0.8

 

嵌入式:EasyNegative  权重:1

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting,  (white background:1.0),

1gril,pointy ears,library,reading,blonde hair,

|BICHU,

|OIL PAINTING,

|IMPRESSIONISM,

 

PCR, CHIBI

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3558119969, Size: 500x800

 

大模型测试

基础信息

大模型:如下图对照表所示

 

Lora bichu-v0612   权重:0.2

 

嵌入式:EasyNegative  权重:1

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

 

1girl,red hat,blonde hair,Street, smile,solo, face focus,looking at viewer,skirt,

BICHU,

OIL PAINTING,

IMPRESSIONISM,

负:

 

 paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 977523733, Size: 600x800

对照表

一测

 


 

二测

 


阶段结论

本次测试的油画lora意外的与二次元画风大模型契合度高,但论笔触的还原程度则realistic还原度更高。

从测试结果来看,平面类风格除了绘本风格的大模型之外几乎全部生效,生效程度略有高低。在选择大模型时,推荐规避画风过于独特的模型。并且因为本身训练集选择的是风景为主,生成画面时会有人物消失的情况,也需要注意提示词可以加强一些人物生成方面的控制。

 

 

兼容性测试

 

人物lora测试(可莉)

基础信息

大模型: CounterfeitV30_v30

 

Lorabichu-v0612  权重:0.5

 

LorakleeGenshinImpact_kleeGenshinImpact  权重:0.9

 

嵌入式:EasyNegative  权重:0.7

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

1girl,red hat,blonde hair,Street, smile,solo, face focus,looking at viewer,skirt,full body,klee \(genshin impact\),

BICHU,

IMPRESSIONISM,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 4207137183, Size: 600x800

对照图

 

 

 


 

人物lora测试(钟离)

基础信息

大模型:CounterfeitV30_v30

 

Lorabichu-v0612   权重:0.5

 

LorazhongliLoraCollection_zhongliHard  权重:0.7

 

嵌入式:EasyNegative  权重:0.7

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

1boy, solo, male focus, zhongli (genshin impact), jewelry, earrings, single earring, bangs, brown hair, long hair, hair between eyes, necktie, closed mouth, multicolored hair, tassel, tassel earrings, shirt, jacket, looking at viewer, collared shirt, ponytail, upper body, long sleeves, white necktie, gradient hair, black hair, orange eyes, formal, vest, coat, brown vest, suit,

BICHU,IMPRESSIONISM,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 1285252390, Size: 600x800

对照图

 

 


 

 

画风lora测试(盲盒)

基础信息

大模型 CounterfeitV30_v30

Lorablindbox_V1Mix  权重:0.5

 

Lorabichu-v0612   权重:0.5

 

嵌入式:EasyNegative  权重:0.7

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

(masterpiece, best quality:1.3), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

(1girl:1.5), Top Hat, blindbox,chibi,

BICHU,

IMPRESSIONISM,

 

负:

 

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:1.3), (bad anatomy:1.2), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:1.3),looking at viewer,(NSFW:1.3),naked,

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 185609732, Size: 600x800

对照图

 

 


 

 

阶段结论

对人物lora的兼容性效果不错,推荐油画lora权重0.5~1.0 人物lora权重 0.6~1.0。

盲盒lora的与同为画风lora的模型并不契合,这里不推荐使用。

 

图生图测试

基础信息

大模型: CounterfeitV30_v30

 

Lorabichu-v0612  权重:0.5

 

嵌入式:EasyNegative  权重:0.7

 

嵌入式:ng_deepnegative_v1_75t  权重:1

 

正:

 

masterpiece, best quality,

BICHU,IMPRESSIONISM,

1girl,black business suit,Arms folded across the chest,smile,short hair, black hair,

 

负:

 

NSFW,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, lowres, text, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, text, signature, watermark, simple background, toony, dated, low res, line art, flat colors

 

Steps: 35, Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 2839412415, Size: 608x880

 

对照表

 

 


 

阶段结论

图生图测试效果良好,在保留一定程度人物特征的情况下依然生成了画面,有较为明显的油画笔触。这里使用的是二次元画风的大模型,如果需要更加写实,换成realistic可能会有更强烈的效果。

 



Copyright © 2024 aigcdaily.cn  北京智识时代科技有限公司  版权所有  京ICP备2023006237号-1