Question glsl shader

[Gitt-hubb]

Hi,

I am trying to upscale live video not animation, and i have tried realesrgan however thats really slow beacuse spec on my system low. It seems libplacebo have good performance and similar visual quality in animation but it does not have shader for live content.

Where the correct shader for live content can be downloaded

[rromerostec-source]

hooke007 mpv_PlayKit tiene buena coleccion de shaders.

nota: no todos los shader tienen efecto en el video, con video2x-qt6

lo recomendable seria cotrar un video y testear el shader, y ver si tiene efecto en el video.

despues de saber que shader funcionan, se puede hacer una combinacion de shaders

ejemplo: eq_HDRR_faux_RT+CuNNy_8x32_DS_vk+unsharp_masking_RT.glsl

los shaders se pueden editar, con cualquier editor de texto de su preferencia.

solo copiar y pegar el codigo en secuencia o combinacion que quiera testear los shaders en uno solo.

siempre y cuando mantenga la extension .glsl

shaders
https://github.com/hooke007/mpv_PlayKit/tree/main/portable_config/shaders

descripcion de shaders
https://github.com/hooke007/mpv_PlayKit/wiki/4_GLSL

parametros que se pueden ajustar de algunos shaders
hooke007/mpv_PlayKit#410

agradecimiento a ** hooke007 mpv_PlayKit **, ** k4yt3x video2x **

buen proyecto!

[k4yt3x]

@Gitt-hubb

Where the correct shader for live content can be downloaded

I don't know of any good ones for real-life content atm. As far as I understand, Anime4K (except for v4.1 GAN) is not a ML-based algorithm. I'm not sure it's possible to yield similarly high quality output for real-life content following the same approach since real-life footage could be much more complex than anime.

[rromerostec-source]

model
2x_OpenProteus_Compact_i2_70K.pth
2x_OpenProteus_Compact_i2_70K_fp32.onnx

es un poco mas rapido en procesar que Realesrgan. se puede convertir con chainner a un model NCNN.
no es un shader .

HD/FHD Live Action TV and Cinema - Open Proteus [Compact]
[Compact] Topaz Video AI is generally considered amongst the industry leaders of in upscaling movies and TV, however it sits behind a significant paywall. Open Proteus is a free alternative to Topaz's Proteus AI, and intended to upscale high-quality and low-noise HD sources to 4K. While I won't claim this is superior to Topaz Proteus by most metrics (which would be a near-impossible feat on open-source architectures anyway), Open Proteus produces output which is highly faithful, without causing oversharpening or upscaling artifacts.

si hay un modelo para NCNN. En el proyecto REAL-Video-Enhancer.

2x_OpenProteus_Compact_i2_70K.bin
2x_OpenProteus_Compact_i2_70K.param

suerte!

[k4yt3x]

@rromerostec-source well there's already realesrgan-plus, but it's slow. If we need to integrate a new model though there needs to be a new ncnn-vulkan adaptation for it which I don't have the time to write. I've mentioned this elsewhere but I'd rather spend the time on making v2x accept general pth models.