[WIP] Neural Network Upscaled Flats/Patches

For high-res texture/sprite projects, sprite-fix patches, music add-ons, music randomizers, and other graphic/sound-only projects.
Forum rules
The Projects forums are ONLY for YOUR PROJECTS! If you are asking questions about a project, either find that project's thread, or start a thread in the General section instead.

Got a cool project idea but nothing else? Put it in the project ideas thread instead!

Projects for any Doom-based engine (especially 3DGE) are perfectly acceptable here too.

Please read the full rules for more details.

[WIP] Neural Network Upscaled Flats/Patches

Postby Phredreeke » Thu Aug 22, 2019 4:57 am

People who are into Duke Nukem 3D or Blood may already know of my upscales for those games.

Anyway, I'm posting these here to see if there's any interest in something similar here. I am not doing sprites because 1. I've not gotten satisfactory results for most of them. and 2. there's already this project

I am doing this using multiple ESRGAN models and PSP scripts to combine them. Anyway, a picture tells a thousand words.



Also, some slide-over comparisons

https://imgsli.com/NTczOQ
https://imgsli.com/NTc0MA
https://imgsli.com/NTc0MQ

Feedback is much appreciated!
Phredreeke
 
Joined: 10 Apr 2018
Discord: phredreeke#6500

Re: [WIP] Neural Network Upscaled Flats/Patches

Postby Darkcrafter » Thu Aug 22, 2019 9:50 am

All these textures still need addtitional work on them, but this already starting to look better. Would be nice to see if there is anything that can be done in order to train a custom model exclusively for Doom.
User avatar
Darkcrafter
 
Joined: 23 Sep 2017
Location: South Russia
Operating System: Windows 10/8.1/8 64-bit
Graphics Processor: ATI/AMD (Modern GZDoom)

Re: [WIP] Neural Network Upscaled Flats/Patches

Postby MFG38 » Thu Aug 22, 2019 11:02 am

Darkcrafter wrote:Would be nice to see if there is anything that can be done in order to train a custom model exclusively for Doom.


I'm fairly sure that's a possibility. After all, AI has seen quite some advancements recently.
User avatar
MFG38
 
Joined: 14 Apr 2019
Location: Finland
Operating System: Windows 10/8.1/8 64-bit

Re: [WIP] Neural Network Upscaled Flats/Patches

Postby Samarai1000 » Fri Aug 23, 2019 2:00 am

Normally I'm not a fan of "Doom but HIGH DEFINITION!!!111ONE" mods, but I actually quite like the look of these. The way they're more 'detailed' but are still visibly pixelated reminds me of later-but-still-classic FPS games. It's a nice mix between being more detailed whilst still getting your brain to fill in the gaps. The bookshelf and corpse flats especially remind me of Blood.
Samarai1000
 
Joined: 25 Sep 2016

Re: [WIP] Neural Network Upscaled Flats/Patches

Postby Darkcrafter » Fri Aug 23, 2019 4:22 am

I personally still prefer playing modern gzdoom with pixelated look: the smallest scale factor - pixelated + none at textures without anisotropy and any kind of anti-aliasing. I just like it. Despite that bullshit I just typed above. Hi-Res stuff is still needed because a good hi-res texture looks good even at low resolutions.
User avatar
Darkcrafter
 
Joined: 23 Sep 2017
Location: South Russia
Operating System: Windows 10/8.1/8 64-bit
Graphics Processor: ATI/AMD (Modern GZDoom)

Re: [WIP] Neural Network Upscaled Flats/Patches

Postby Phredreeke » Sun Sep 01, 2019 8:47 am

Alright, I finally got around adding them to the actual game. Here's a few screens.

Spoiler:
Phredreeke
 
Joined: 10 Apr 2018
Discord: phredreeke#6500

Re: [WIP] Neural Network Upscaled Flats/Patches

Postby Scuba Steve » Sun Sep 01, 2019 8:02 pm

There already is a massive project to use Neural Network techniques to upscale every resource in the Doom/Doom2 wad.

https://www.doomworld.com/forum/topic/9 ... pscale-2x/

In fact, the project is now fully compliant with the Minor Spritefix wad that repaired dozens of mistakes in the vanilla doom gfx. The work you've done here looks really good, don't get me wrong... but I don't know if it's necessary to have TWO concurrent Neural Net projects running at the same time, especially considering one of them is 100% completed.
Scuba Steve
 
Joined: 27 Mar 2004

Re: [WIP] Neural Network Upscaled Flats/Patches

Postby dmslr » Mon Sep 02, 2019 7:14 am

@Scuba Steve it would be very cool if there was a project with only upscaled textures (w/o sprites and fonts). Do you think hidfan would release the version with only textures?
dmslr
 
Joined: 06 Aug 2019

Re: [WIP] Neural Network Upscaled Flats/Patches

Postby Scuba Steve » Mon Sep 02, 2019 10:10 am

It's easy enough, you could do it yourself in a matter of minutes. Open the pk3 and navigate the FILTER/DOOMX/HIRES and delete every folder that isn't TEXTURES or FLATS.
Scuba Steve
 
Joined: 27 Mar 2004

Re: [WIP] Neural Network Upscaled Flats/Patches

Postby dmslr » Mon Sep 02, 2019 12:03 pm

yeah i deleted and... everything is now invisible
dmslr
 
Joined: 06 Aug 2019

Re: [WIP] Neural Network Upscaled Flats/Patches

Postby Scuba Steve » Mon Sep 02, 2019 2:31 pm

You also need to delete the SPRITES/SOUNDS base folders as well. They were needed to make the sprites work properly, but if you deleted the HIRES sprites, you'll need to delete these folders as well. You can also delete the DECORATE.DEC file too.
Scuba Steve
 
Joined: 27 Mar 2004

Re: [WIP] Neural Network Upscaled Flats/Patches

Postby Scuba Steve » Tue Sep 03, 2019 8:01 am

Actually... there might still be a use for this project. The Neural Upscale project I linked to used the Nvidia Super Resolution AI to produce the current results, but Nvidia has taken it offline... so we are unable to complete Final Doom's textures. If you're interested in continuing this project, might I suggest you start with the Final Doom resources (Plutonia and Evolution)? I did some overlay comparisons and the work here is comparable to what was produced for the other upscaled project, it would be great to have a complete resource containing 2x scaled textures for EVERY official id software released project and we could merge both projects together.
Scuba Steve
 
Joined: 27 Mar 2004

Re: [WIP] Neural Network Upscaled Flats/Patches

Postby Phredreeke » Tue Sep 03, 2019 8:30 am

Sure. Do you have a list of what textures need upscaling?

Edit: Do the new textures all have unique names relative to the base Doom 2 textures? Because if that's the case I think I can make a simple script to sort them out.

Edit 2: Slide-over comparison for Plutonia's A-VINE3 https://imgsli.com/NjE2OA
Phredreeke
 
Joined: 10 Apr 2018
Discord: phredreeke#6500

Re: [WIP] Neural Network Upscaled Flats/Patches

Postby Scuba Steve » Tue Sep 03, 2019 10:33 am

That looks pretty good. It seems to keep the color tones equivalent to the original too. I recall the labor intensive part is making sure the seams line up properly when titled... running them through the AI was the easy part :P Also, the grueling task of proper alpha masks on transparent textures was a pain.
Scuba Steve
 
Joined: 27 Mar 2004

Re: [WIP] Neural Network Upscaled Flats/Patches

Postby Phredreeke » Tue Sep 03, 2019 12:48 pm

My way of dealing with tiling is repeat some of the opposite side on the edges of the texture. I added some green lines here to show where the texture repeats, this is then cropped out at the end of the process (I am assuming for these that the texture tiles horizontally but not vertically, but it can easily be adapted to work bidirectionally, as I did for the flats in my above upscale)



and yeah, making transparency masks is a pain.

(in addition to Final Doom, would there be interest in Perdition's Gate as I believe it was at one point meant to be the third episode of Final Doom)
Phredreeke
 
Joined: 10 Apr 2018
Discord: phredreeke#6500

Next

Return to Graphic/Audio Patches

Who is online

Users browsing this forum: No registered users and 3 guests