[Enhancement request] Performance optimization

[ray4b]

Hi, thank you for creating this GUI—it’s been really helpful! I was wondering if it might be possible to optimize the program to make better use of multiple CPU cores by adding more threads? It seems like the current performance is bottlenecked by the CPU. Apologies if this doesn’t make much sense.

[PeteJobi]

Hello, @ray4b. Unfortunately, not much can be done about that from my end. This program is only a wrapper, a GUI for the real program that does the actual work: Real-ESRGAN ncnn Vulkan. Just before typing this comment, I performed a test to compare the performance with and without the GUI (using Real-ESRGAN-ncnn-vulkan directly in cmd), and there wasn't a difference. The program doesn't properly use the GPU or CPU.

That said. I'm going to do some research on Real-ESRGAN-ncnn-vulkan. Perhaps the program accepts some parameters I don't know of that better utilizes the GPU. But I unfortunately can't do stuff like change the code, because it was written in languages I'm unfamiliar with.

[ray4b]

Got it. Thank you for the clarification!

[PeteJobi]

There is indeed an option to increase gpu usage. From Real-ESRGAN ncnn Vulkan's read.me:

-j load:proc:save = thread count for load/proc/save (default=1:2:2) can be 1:2,2,2:2 for multi-gpu"

load:proc:save = thread count for the three stages (image decoding + model upscaling + image encoding), using larger values may increase GPU usage and consume more GPU memory. You can tune this configuration with "4:4:4" for many small-size images, and "2:2:2" for large-size images. The default setting usually works fine for most situations. If you find that your GPU is hungry, try increasing thread count to achieve faster processing.

I have implemented this parameter and it is now live. If you check the "Higher GPU count" checkbox, load:proc:save is set to 10:10:10, otherwise, the default is used (1:2:2). I'll probably make it more customizable in the future.

I measured a 17.75% decrease in processing time on my RTX 3060. It might be more on your 4090.

Please try v4.1.2 and see if it works for you.

[ray4b]

Thanks for the update. But where can I find the "Higher GPU count" checkbox? It seems to be missing for me.

[PeteJobi]

You'll see it at the bottom left after the video starts processing, and you'll be able to check/uncheck the box before the upscaling process begins. Select a video to see it.

…

On Thu, Feb 20, 2025, 9:39 AM ray4b ***@***.***> wrote: Thanks for the update. But where can I find the "Higher GPU count" checkbox? It seems to be missing for me. Screenshot.2025-02-20.163747.png (view on web) <https://github.com/user-attachments/assets/0aefb0dc-2622-4381-8d8c-a43ffc344f17> — Reply to this email directly, view it on GitHub <#6 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AKY3HJDMKVKUTSIXSFI37E32QWICPAVCNFSM6AAAAABXA32YPSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMNZQHAYDONJRHE> . You are receiving this because you commented.Message ID: ***@***.***> [image: ray4b]*ray4b* left a comment (PeteJobi/RealEsrganUpscalerGUI#6) <#6 (comment)> Thanks for the update. But where can I find the "Higher GPU count" checkbox? It seems to be missing for me. Screenshot.2025-02-20.163747.png (view on web) <https://github.com/user-attachments/assets/0aefb0dc-2622-4381-8d8c-a43ffc344f17> — Reply to this email directly, view it on GitHub <#6 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AKY3HJDMKVKUTSIXSFI37E32QWICPAVCNFSM6AAAAABXA32YPSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMNZQHAYDONJRHE> . You are receiving this because you commented.Message ID: ***@***.***>

[ray4b]

Seems like it's hiding from me. Lol.

[PeteJobi]

Oh, that's strange. I'll have to look into that. Are you using 100% scaling on Windows?

…

On Thu, Feb 20, 2025, 9:54 AM ray4b ***@***.***> wrote: Seems like it's hiding from me. Lol. Screenshot.2025-02-20.165227.png (view on web) <https://github.com/user-attachments/assets/d39c5974-f261-46d0-85d1-79861121ab60> — Reply to this email directly, view it on GitHub <#6 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AKY3HJHCXQXLTPF2HJAUZL32QWJ3VAVCNFSM6AAAAABXA32YPSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMNZQHA2DCMZXGU> . You are receiving this because you commented.Message ID: ***@***.***> [image: ray4b]*ray4b* left a comment (PeteJobi/RealEsrganUpscalerGUI#6) <#6 (comment)> Seems like it's hiding from me. Lol. Screenshot.2025-02-20.165227.png (view on web) <https://github.com/user-attachments/assets/d39c5974-f261-46d0-85d1-79861121ab60> — Reply to this email directly, view it on GitHub <#6 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AKY3HJHCXQXLTPF2HJAUZL32QWJ3VAVCNFSM6AAAAABXA32YPSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMNZQHA2DCMZXGU> . You are receiving this because you commented.Message ID: ***@***.***>

[ray4b]

Positive. I've tried 25601600 at 100% (laptop screen), and 38402160 at 150% (external screen). They both shows the same problem.

[PeteJobi]

Has it always been like this for you or is it just the v4.1.2? There's also a "Encode 24 fps" checkbox at the bottom left. Have you ever seen that?

[ray4b]

It's the same with previous versions. I've never seen the other checkbox. I was assuming that it was removed for some reason. However, I've just found something that might help. It seems to work better with Windows 7 or 8 compatibility mode on, but it still doesn't fully fixes the issue.

[PeteJobi]

I couldn't find out why the program is cut off for you. I had this issue at the start of the project and I found a solution for it. Or so I thought. I'll keep looking.

In the meantime, I uploaded a build on drive with the height increased enough for you to see the checkbox, if you need it.

[ray4b]

Thanks. I've requested access for the file.

[PeteJobi]

Forgot to make the link public. Hope you're able to see the checkboxes. Had to guess a suitable height going by your screenshots.

…

On Fri, Feb 21, 2025, 1:00 AM ray4b ***@***.***> wrote: Thanks. I've requested access for the file. — Reply to this email directly, view it on GitHub <#6 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AKY3HJDGJZBLMR2JJFAV3UL2QZUDVAVCNFSM6AAAAABXA32YPSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMNZSHE4DKNBYHA> . You are receiving this because you commented.Message ID: ***@***.***> [image: ray4b]*ray4b* left a comment (PeteJobi/RealEsrganUpscalerGUI#6) <#6 (comment)> Thanks. I've requested access for the file. — Reply to this email directly, view it on GitHub <#6 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AKY3HJDGJZBLMR2JJFAV3UL2QZUDVAVCNFSM6AAAAABXA32YPSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMNZSHE4DKNBYHA> . You are receiving this because you commented.Message ID: ***@***.***>

[ray4b]

It's now working, thanks a lot! I guess it's now twice as fast for me, at the very minimum.