Tponynai3 - v51weight optimized
é¢é£ããŒã¯ãŒãïŒã¿ã°
æšå¥šããã³ãã
score_9,score_8_up,score_7_up
score_8_up,score_7_up,1girl
æšå¥šãã¬ãã£ãããã³ãã
score_4,score_3,score_2,worst quality, bad hands, bad feet
score_3,score_2,ugly
æšå¥šãã©ã¡ãŒã¿
samplers
steps
cfg
clip skip
resolution
other models
æšå¥šãã€ã¬ãŸãã©ã¡ãŒã¿
upscaler
upscale
steps
denoising strength
ãã³ã
æé«ã®çµæãåŸãããã«ã¯ãäžè§£å床ã§é«ç²ŸåºŠä¿®æ£ã䜿çšããŠãã ããã
ç®ã®çްéšãæ¹åããã«ã¯ãstyle_3ãŸãã¯4ã詊ããŠãã ããã
929721518æ¬äººçqqå°çŸ€çŸ€å·ïŒæå¥äžäŒçå ³äºtponyçé®é¢å¯ä»¥è¿æ¥é®ãè®°åŸå€æ³šcç«åŠ
ã¢ãã«å·²ç»å 眮vaeäºïŒäžéèŠé¢å€æ·»å vae
The model already has included vae, there is no need to add additional vae
æäœ³çåºåŸçç¥æ¯éäžçå蟚çåŒé«æž ä¿®å€ïŒèäžæ¯çŽæ¥äœ¿çšå€§å蟚ççŽåº
The best generate strategy is to use high-fix at a moderate resolution, rather than directly using high-resolution direct output
(33) T-ponynai3-v5 - ïŒæéä¿®æ¹çæ¬ïŒ | Stable Diffusion Checkpoint | ååž tusi.cn (tusiart.com) tusiart(china version tensor) online generate link
(Because the model can only exist on both Tusi and Tensor simultaneously, it is better to use it in Tusi. If there are any issues with its use, please point them out more to meïŒ
v5çæ¬æ°å äº4䞪styleïŒå¯ä»¥éè¿style_1å°style_4æ¥åŸ®è°ç»é¢ç»èïŒçè®ºäžæ¯è¿æ ·çïŒå®é æææ¯èŸçåŠïŒ
V5 version has added 4 new styles, which can be used to fine tune the details of the image through style_1 to style_4 (theoretically, this is the case, but the actual effect is more mystical or lower)
æ¬æš¡åå®çŸæ¯æç±ponyv6äžºåºæš¡è®ç»çæš¡åïŒani3ïŒsdxl1.0çloraä¹èœåšæç§çšåºŠäžéé
This model perfectly supports lora trained with ponyv6 as the base model, and the Lora of ani3 and sdxl1.0 can also be adapted to some extent.
åºäºv4.1çåŸçåŸæµè¯ïŒè¿æ¯åšä¹åçæ¬é被応ç¥çéšåïŒ
Image inpaint testing based on v4.1 (this is a previously overlooked part)




ponyæ¯ç¥ïŒå Œå®¹æ§æ»¡åãæ¬æš¡åæ¯æaniïŒponyçlora
å¿ å€å眮ææè¯åponydiffusionäžæ ·
positive:(score_9,score_8_up,score_7_up,score_6_up,score_5_up,score_4_up)
OR (score_9,score_8_up,score_7_up)
èŽé¢å¯å ïŒ
negative: (score_4,score_3,score_2,score_1),
ä¹å¯ä»¥å æ£åžžçnaiç³»èŽé¢è¯ïŒäŸåŠïŒ
negative: worst quality, bad hands, bad feet
hope u like it á(â ÚŒâ )á base on nai3 and ponyv6
è®ç»é¡»ç¥ïŒv1䜿çšäº94åŒ ïŒv2çšäº119åŒ ïŒv3çšäº348åŒ ïŒv3.5çšäº474åŒ ïŒnai3çæçåŸç,è®ç»çloraèè¿åºæš¡è¿è¡åŸ®è°ïŒponyæ¯æçç»åžtagéœæ¯æïŒäœ¿çšäž€äžªä»¥äžçç»åžtagå¯èœäŒå¯ŒèŽèæ¯åŽ©æºïŒç®ååç°èœçæåç¥çè§è²ïŒå ¶ä»çäžç¥éäºïŒå¯¹äºè¿äžªæš¡åææµè¯çä¹äžå€ïŒæå¹äºå ¶å¯¹äºnai3çç»é£å€å»äžãåºæš¡æ¯T-anime-xlåponyv6以åani3çèåæš¡åïŒå¹¶æªååžã
䜿çšçè®ç»æŸå¡æ¯æèªå·±ç3090æŸå¡ïŒv1å°v3åå«äœ¿çšäº7å°æ¶ïŒ12å°æ¶ïŒ35å°æ¶ïŒ47å°æ¶
Training InstructionsïŒMerge Lora used 94 pictures for v1, 119 pics for v2, 348 pics for v3, 474 pics for v3.5,which generated by NAI3 to train into the basemodel for fine-tuning,Pony supports all artist tags which ponyv6 already have, but there is no any addition artist tag from nai3. Using more than two artist tags may cause background crashes,At present, it has been found that characters that can generate Genshin Impact.I don't know the others.I haven't tested much for this model.,Marvel at its reproduction of the painting style of NAI3.The base model is a fusion model of T-anime-xl and ponyv6 and animage3, which has not been released
The training graphics card I used was my own 3090 graphics card, which was used for 7 hours, 12 hours, and 35 hours and 47 hours from v1 to v3.5, respectively.
v1
äžæ¬¡æè¶£çå°è¯
An interesting attempt
v2
åšv1çåºç¡äžç¥åŸ®å¢å äºè®ç»éïŒå¹¶ç»åäº30å°æ¶å·Šå³çåæ°è¯éïŒäœæ¯è®ç»åºæ¥çç»é£ä»ç¶å ·æäžäºè¿æåïŒäŸåŠåéèèçŒä»¥åæä¹±ç倎å
On the basis of v1, the training set was slightly increased and went through about 30 hours of trial and error, but the trained art style still had some overfitting, such as double navel eyes and messy hair
v3
v3çè¢äœäŒæ¯v2çæŽå¥œïŒå¯¹äºfootfocusççè§£v3å¯ä»¥çæè§è§å²å»æŽå€§çèïŒä¹æŽé«éŸåºŠçéè§è§è§ïŒv3ç倎åçaiæä¹æ¯v2èŠåŒ±ïŒå 䞺v2çè®ç»é倪å°äºïŒæä»¥å€ŽåéšåäŒæäºè¿æåïŒèäžv2å¶å°äŒåºç°çåèèçŒä¹æ²¡äºãæ»äœæ¥è¯Žäžåäºv2è®ç»éç倧å°ä»¥åæŽå€§çdimåæ°äœ¿åŸç»é£æåçæŽå èªç¶ïŒèäžåšé¿promptäžç衚ç°åè¿è¿åŒºäºv2ã
The limbs of v3 are better than those of v2. In terms of understanding footfocus, v3 can generate feet with greater visual impact and higher difficulty perspective. The AI feeling of v3's hair is also weaker than that of v2, because v2 has too little training set, so the hair part may be slightly overfitting, and the occasional double navel eyes that appear in v2 are also gone. Overall, three times the size of the v2 training set and a larger dim parameter make the art style fit more natural, and the performance is much stronger than v2 under long prompts.
v3.5
åšè¿äžªçæ¬äžïŒå¯¹äºèŽšéè¯çèŠæ±å¹¶äžé£ä¹äž¥è°šïŒå¯ä»¥å®å šäžçšponyççŸåŠè¯åç莚éè¯å»åºåŸïŒåšæµè¯äžå¶å°äŒåºç°åŸççææ æä¹çè²åçæ åµïŒåªéèŠå°çŸåŠè¯åç莚éè¯æ¢æ1.5åžžçšç莚éè¯å°±è¡ïŒäŸåŠscore_1,score_2æ¢æworst qualityãè¿äžªçæ¬æå€å å ¥äº150åŒ å·Šå³çè®ç»éæ¥å¹³è¡¡ä»¥åå å®ç»é£ïŒå¹¶äžåå°äºåŠä¹ æ²çº¿çåå§æçïŒè¿è®©è¿äžªæš¡å没æé£ä¹è¿æåïŒå¯ä»¥éé æŽå€çlora以åå¥æåŠæ³çæç€ºè¯ãæ»äœæ¥è¯ŽïŒè¿äžªçæ¬æ¯çžèŸv3çæ¬æŽå èªç±çäžäžªçæ¬ïŒå¹¶äžè¿äžªçæ¬å¯¹äºç·æ§çå»ç»èŠè¿åŒºäºv3ïŒåšæäºæç€ºè¯äžçè²åœ©ä»¥åç»é£æ²¡æé£ä¹è¿åé²è³ä»¥åæ²¹è »ã
In this version, the requirements for quality words are not so strict, you can completely not to use the quality words of pony's aesthetic score to plot the picture, and occasionally there will be a situation where the picture generates meaningless color blocks in the test, you only need to replace the quality words of the aesthetic score with 1.5 commonly used quality words, such as score_1, score_2 replace it with worst quality. In this version, I added about 150 more training sets to balance and enrich the art style, and reduced the initial slope of the learning curve, which makes this model less overfitted and can be adapted to more lora and whimsical prompts. Overall, this version is a freer version than the v3 version, and this version is much stronger than the v3 version, and the colors and style of painting under some hints are not so bright and greasy.
v4
è¿äžªçæ¬äœ¿çšäº798åŒ åŸçäœäžºè®ç»çŽ æïŒå¹¶äœ¿çš3090æŸå¡è®ç»äº90äžªå°æ¶ãè¿äžªçæ¬çžèŸäºv3.5åšæäºpromptäžçæåŸä»¥åå¯¹äºæäºéšäœçå»ç»æŽå æ£ç¡®ïŒæ¯åŠææéšåçé圱以åäžäºèº«äœéšäœçéå ãåšpromptæ¹é¢ïŒæè¿æ¯ä»¥äžçé¿åºŠä»¥åçšçé¿åºŠçpromptäœäžºäž»èŠçè®ç»ç®æ ïŒæ¯ç«è°éœäžå欢åäžé¿äž²çpromptæèœçæèŽšé奜çåŸæ¯å§ïŒåšå»æponyççŸåŠåŸåç莚épromptåïŒåŸåç莚éçžæ¯v3.5æåŸé«çæåïŒåºåŸç莚éäŒååäºæŽå å¹³é¢èéç«äœçç»é¢ïŒæŽå æ¥è¿äºç»å žçåšæŒ«ç»é£ã对äºåŸçæ°é对äºponyv6çåŸ®è°ææçæµè¯æ¥è¿å°Ÿå£°ïŒäžäžæ¥å°±æ¯ä»promptçè®ç»æ çŸå ¥æïŒå°è¯åšponyæéç忬¡è®ç»çŽ ææ°éé颿·»å æŽå€å¯è°æ§çpromptïŒäŸåŠå°çŸåŠè¯åå å ¥è¿å»ïŒç°åšçè®ç»é»èŸè¿æ¯çšäž»æµç莚éè¯å»èŠçæponyççŸåŠåŸå莚éè¯ïŒïŒå¹¶äžäŒæç»å¢æ·»åéçæ°è®ç»çŽ æïŒäŸåŠåºæ¯çè®ç»çŽ æä»¥åæŽå€çè¶³éšè®ç»çŽ æïŒv4çè¶³éšè®ç»çŽ æäŒŒä¹æç¹å°äºïŒã
This version used 798 images as training materials and trained for 90 hours using a 3090 graphics card. This version has a more accurate composition and depiction of certain parts in certain prompts compared to v3.5, such as ghosting of fingers and overlapping of some body parts. In terms of prompts, my main training goal is to use medium and slightly shorter prompts, as nobody likes to write a long string of prompts to generate high-quality images, right? After removing the quality prompt of Pony's aesthetic score, the image quality has been significantly improved compared to v3.5, and the resulting quality tends to be more flat rather than three-dimensional, closer to the classic anime style. The testing of the fine-tuning effect of Ponyv6 on the number of images is nearing completion. The next step is to start with the training labels of prompts and try to add more adjustable prompts to Pony's limited number of single training materials (such as adding aesthetic scores, the current training logic still uses mainstream quality words to cover Pony's aesthetic score quality words), and continue to add suitable new training materials, such as scene training materials and more foot training materials (v4's foot training materials seem to be a bit scarce).
v4.1
ååäœçšæ·éæåšè¿ä¹çæ¶éŽå ååºäºäžªæ°çæ¬ïŒè¿ååèéªçµèçå å以åçœç»é床ãO_O
Firstly, I would like to apologize to all users for the release of a new version in such a short period of time, which greatly tests the computer's memory and network speed. O_O
è¿äžªæ°çæ¬æ¯åºäºv4çè¢äœè°è¯çæ¬ïŒç±äºv4çè¢äœææå®åšæäºéŸä»¥æ§å¶ïŒæéšçå®çŸçåšç»è¿æµè¯ä¹æ²¡æèŸŸå°æè¿å å€©çæµè¯é¢æãæä»¥æåæçæåæšç«ç«ç«å¯¹v4è¿è¡äºäžäºè°æŽä»¥åæ¹åïŒæç»äœ¿åŸv4.1çè¢äœèŸŸå°äºæçé¢æïŒæå°äŒæŸåºå 䞪xyåŸæ¥æž æ°çå±ç°v4.1åšçžååæ°äžçæåŸç对æ¯v4çæ¹åçšåºŠã
This new version is based on the limb debugging version of v4. Due to the difficulty in controlling the limb effects of v4, the perfection rate of the hands did not meet my testing expectations in the past few days. So my friend æšç«ç«ç« and I made some adjustments and improvements to v4, which ultimately made the limbs of v4.1 meet my expectations. I will release several xy graphs to clearly show the improvement of v4.1 compared to v4 under the same parameters.
v5
è¿äžªçæ¬è®ç»çŽ æåå°äºïŒç±äºv4ç倱å©ïŒæä»¥æåŒå±äºåŠäžäžªé¡¹ç®ïŒä»¥æ¥ä»äžäžªå°çæŸåå çšçè§åºŠæ¥æµè¯æçæ³æ³ïŒå°±æ¯è®ç»äºå䞪äžåç»é£çéé äºT-ponynai3çç»é£loraïŒåœç¶åå§æš¡åä¹äžäŒ äºcivitaiãåšæµè¯å®éé æ§åïŒæäŸ¿åŒå§å°è¿åç»äžåçç»é£äœäžºæ·»å åè®ç»è¿T-ponynai3-v5ã什人æè®¶çæ¯ïŒv5ç线æ¡èŽšæå¥œäºäžäžªå€§æ¡£æ¬¡ïŒåºè¯¥æ¯æè®ç»äºäžäžªåŸç»è »ççŽ æççŒæ ïŒå¯¹äºè¿å䞪ç»é£çææ ïŒæäœ¿çšäºstyle_1å°style_4çæç€ºè¯ïŒéæŸçæ¯ïŒäžç¥äžºäœïŒè¿å䞪ç»é£å¹¶æ²¡æåèªååŒïŒæè æ¯ææåŸ®åŒ±ïŒåèåŸå¥œçèåè¿äºåå§ç»é£ã尜管没æèŸŸå°æ¯æå€äžªç»é£çç®çïŒäœæ¯åŸå¥œçå°åå§çnai3ç»é£ç莚ææåäºäžäžªæ¡£æ¬¡ïŒæè®žäžäžªçæ¬å¯ä»¥å°è¯æŽè¿äžæ¥ãïŒæåŸåæ¬¢ææžžæïŒæ¯æ¬¡è®ç»çæ¶åäžèœç©çµèæžžæå¯¹ææ¥è¯Žå€ªéŸäºïŒ
The training materials for this version have been reduced. Due to the failure of v4, I launched another project to test my idea from a small perspective of memory usage, which is to train four different art styles of Lora adapted to T-ponynai3. Of course, the original model was also uploaded to Civitai. After testing the adaptability, I started training these four different art styles as additives into T-ponynai3-v5. Surprisingly, The line texture of v5 has improved to a high level, probably because I trained a very delicate material. For the marking of these four art styles, I used the prompt words from style_1 to style_4. Unfortunately, for some reason, these four art styles were not separated or the effect was weak, but rather integrated well into the original art style. Although it did not achieve the goal of supporting multiple art styles, it effectively elevated the texture of the original Nai3 art style to a higher level. Perhaps the next version can try to take it even further. (I really enjoy playing games, and it's too difficult for me to play computer games every time I train.)
对äºv5çæ¬çäžäºé®é¢è¿è¡äžäºæ»ç»ã
1ïŒloraå Œå®¹æ§åè¢äœä»¥åæš¡ç³ççŒçé®é¢ãloraå Œå®¹æ§æ¯æå¯¹äºè¿æ¬¡è®ç»çæç»æé䜿çšçæäºè¿é«äºïŒæäºæ åµäžäŒåºç°è¿æåãè¿äžªäŒåçæ¬äŸ¿æ¯éäœäºçžåºæéççæ¬ïŒè¢äœç厩åç以å对äºäžäºloraçå Œå®¹åºè¯¥äŒå¥œäžäºïŒå¯¹æ€æè·äºå åŒ äœ¿çšåºäºv4.1è®ç»çç»é£loraç对æ¯åŸä»¥äŸåèãçŒçæš¡ç³çé®é¢åºè¯¥æ¯æè®ç»äºstyle_1çåå ïŒäœ¿çšçåå§çŽ æççŒçå°±æ¯æš¡ç³çïŒå¯ä»¥éè¿äœ¿çšstyle_3æ4æ¥æ¹åã
2ïŒäœç§¯å çæå é®é¢ãæåšæµè¯çæ¶å没æåºç°è¿è¿äžªé®é¢ïŒå¯ŒèŽåºç°çåå åºè¯¥æ¯æäœ¿çšäºnoise offsetçè®ç»åæ°ïŒäœ¿åŸè¿äžªæš¡å对äºå ççžå ³æç€ºè¯çææåºŠæåïŒå¯ŒèŽåæ¥äžæ ·æéçå çæç€ºè¯å¯ŒèŽçç»æäŒæŽå æäº®ïŒæå»ºè®®å¯ä»¥å°è¯äžäœ¿çšæ¬å·åæ°åæ¥æåæéïŒç±äºsdxlå¯¹äºæç€ºè¯çææåºŠïŒå¯ä»¥è¯è¯éå€å€æ¬¡äžæ ·çæç€ºè¯ïŒè¿æ ·äžå®¹æå¯ŒèŽæç«¯ç»æãåæ¶ïŒäœ¿çšè¿äžªåæ°æ¯äžºäºä¿®å€å°éæç€ºè¯äžççæç»æåé»çé®é¢ïŒå¯¹æ€æè·äºå åŒ å¯¹æ¯åŸïŒä»¥äŸåèã
3ïŒæš¡åçå€æåºŠåäœçé®é¢ãç论äžä»¥å宿µæ¥è¯Žãv5åºè¯¥æ¯æ¯ä¹åçæ¬æŽå å¹²åçåå€å çæš¡åïŒåšäžäºæç€ºè¯çäœçšäžåºè¯¥èœè·åŸæŽå 粟åç衚ç°åïŒåæ ·çæè·äºå åŒ å¯¹æ¯åŸæ¥åæ¯èŸãè¿æ¬¡çè®ç»é并没æéçšäžäºè¿å倿ççŽ æïŒå 䞺æè§åŸè¿å倿çåŸåäŒäœ¿ç»æè¶äºè¿æåïŒè¿äžå®å¯ŒèŽäºäžå°ç»èç猺倱ã
ç®çïŒ æåžæèœå€åŸå°äžäžªåä¹åçæ¬æè¶³å€å€§å·®å«çæš¡åïŒèäžæ¯ååžäžäžªåä¹åå ä¹äžæžäžæ ·çæš¡åãè¿æ¬¡åäœçåéŠæ¯åŸå¥œçè¯éæºäŒïŒåªé æèªå·±ç¡®å®æ²¡æä»ä¹è¯éææ¬ãåšäžäžªçæ¬äžæäŒå°è¯æé«å䞪äžåç»é£ççŽ æéïŒäœ¿åŸäžåçŽ æçç»é£èœå€åŸå¥œçèååšäžèµ·ïŒå¹¶äžèœå€å®ç°ç»é£çå犻ïŒçšç¹å®çpromptæ¥åæ¢ç»é£ïŒè¿æè®žéèŠäžäºæ°çè®ç»æå·§ãæè°¢åäœçåéŠïŒ
Summarize some issues regarding the v5 version.
1, Lora compatibility and issues with limbs and blurred eyes. Lora compatibility is that I used too much final weight for this training, and in some cases, overfitting may occur. This optimized version is the one that reduces the corresponding weight, and the limb collapse rate and compatibility with some Loras should be better. I have run several comparison charts of Loras trained with v4.1 for reference. The problem of blurred eyes should be the reason why I trained style_1. The eyes in the original material used are blurry, and can be improved by using style_3 or 4.
2. Exposure issues with volume light. I did not encounter this issue during testing, and the reason for it should be that I used the noise offset training parameter to increase the sensitivity of the model to light related prompt words, resulting in brighter results when the same weight of light prompt words were used. I suggest trying not to use parentheses and numbers to increase the weight. Due to the sensitivity of sdxl to prompt words, you can try repeating the same prompt words multiple times to avoid extreme results. At the same time, using this parameter is to fix the problem of generating yellow results under a small number of prompt words. I have run several comparison graphs for reference.
3. The problem of reduced model complexity. In theory and in practice. V5 should be a cleaner and more diverse model than the previous version, and with the help of some prompts, it should be able to achieve more accurate performance. Similarly, I ran several comparison charts for comparison. This training set did not use overly complex materials because I believe that overly complex images tend to overfit the results, which inevitably leads to a certain degree of detail loss.
Purpose: I hope to obtain a model that is significantly different from the previous version, rather than releasing a model that is almost identical to the previous version. This feedback from everyone is a great opportunity for trial and error, and I really don't have any trial and error costs on my own. In the next version, I will try to increase the amount of materials for different art styles, so that the art styles of different materials can be well integrated and separated. Using specific prompts to switch art styles may require some new training techniques. Thank you for your feedback!
ã¢ãã«è©³çް
ã¢ãã«ã¿ã€ã
ããŒã¹ã¢ãã«
ã¢ãã«ããŒãžã§ã³
ã¢ãã«ããã·ã¥
äœæè
ãã£ã¹ã«ãã·ã§ã³
ã³ã¡ã³ããæ®ãã«ã¯ log in ããŠãã ããã






















