VK_ERROR_OUT_OF_DEVICE_MEMORY! After ~30 Seconds of upscaling

[derfurkan]

Describe the bug
When upscaling after around 30 Seconds my GPU (Shared Memory) is full and the upscaling process crashes with the Error code: VK_ERROR_OUT_OF_DEVICE_MEMORY

To Reproduce
Steps to reproduce the behavior:

1. Drag a Video in the GUI window.
2. Change the Filter to: libplacebo
3. Set output Width and Height to: 2560x1440
4. Use the GLSL Anime4k A+A Shader
5. Press Start
6. After ~30 Seconds (When Shared GPU Memory is full) see this error:

[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] Allocation of size 15M failed: VK_ERROR_OUT_OF_DEVICE_MEMORY!
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] Memory heaps supported by device:
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] 0: flags 0x1 size 8018M
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] 1: flags 0x0 size 15G
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] 2: flags 0x1 size 214M
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] Memory pool 0:
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] Compatible types: 0x3
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] Optimal flags: 0x1
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] Slab 0: 0 x 4320K: 10M used 16M res 16M alloc from heap 0, efficiency 63.89% [../src/utils/upload.c:245]
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] Slab 1: fc x 1200K: 2400K used 2400K res 9600K alloc from heap 0, efficiency 100.00% [../src/utils/upload.c:245]
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] Pool summary: 13M used 19M res 26M alloc, efficiency 68.29%, utilization 73.21%
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] Memory pool 1:
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] Compatible types: 0xffffffff
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] Optimal flags: 0x2
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] Buffer flags: 0x3
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] Pool summary: 0 used 0 res 0 alloc, efficiency 100.00%, utilization 100.00%
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] Memory summary: 13M used 19M res 26M alloc, efficiency 68.29%, utilization 73.21%, max page: 501M
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] Backtrace:
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #0 0x7ffb006767ce in pl_vulkan_release_ex+0x5c6e (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\avfilter-10.dll+0x5c67ce) (0x1805c67ce)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #1 0x7ffb006775fa in pl_vulkan_release_ex+0x6a9a (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\avfilter-10.dll+0x5c75fa) (0x1805c75fa)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #2 0x7ffb0066c77a in pl_vulkan_sem_create+0x111a (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\avfilter-10.dll+0x5bc77a) (0x1805bc77a)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #3 0x7ffb006516f9 in pl_buf_create+0x229 (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\avfilter-10.dll+0x5a16f9) (0x1805a16f9)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #4 0x7ffb00654518 in pl_timer_query+0xa48 (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\avfilter-10.dll+0x5a4518) (0x1805a4518)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #5 0x7ffb0066e9dc in pl_vulkan_sem_create+0x337c (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\avfilter-10.dll+0x5be9dc) (0x1805be9dc)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #6 0x7ffb00651303 in pl_tex_upload+0x93 (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\avfilter-10.dll+0x5a1303) (0x1805a1303)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #7 0x7ffb00664515 in pl_upload_plane+0x305 (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\avfilter-10.dll+0x5b4515) (0x1805b4515)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #8 0x7ffb0027b5b2 in avfilter_license+0xdfdd2 (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\avfilter-10.dll+0x1cb5b2) (0x1801cb5b2)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #9 0x7ffb0027b77d in avfilter_license+0xdff9d (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\avfilter-10.dll+0x1cb77d) (0x1801cb77d)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #10 0x7ffb006615f8 in pl_find_tone_map_function+0x1298 (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\avfilter-10.dll+0x5b15f8) (0x1805b15f8)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #11 0x7ffb0066180a in pl_find_tone_map_function+0x14aa (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\avfilter-10.dll+0x5b180a) (0x1805b180a)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #12 0x7ffb00663553 in pl_queue_update+0xd33 (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\avfilter-10.dll+0x5b3553) (0x1805b3553)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #13 0x7ffb0027d731 in avfilter_license+0xe1f51 (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\avfilter-10.dll+0x1cd731) (0x1801cd731)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #14 0x7ffb0015866b in avfilter_pad_get_type+0xa8b (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\avfilter-10.dll+0xa866b) (0x1800a866b)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #15 0x7ffb0015d220 in avfilter_graph_request_oldest+0x1250 (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\avfilter-10.dll+0xad220) (0x1800ad220)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #16 0x7ffb1018e103 in video2x::VideoProcessor::process_interpolation+0x14d33 (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\libvideo2x.dll+0x2e103) (0x18002e103)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #17 0x7ffb101954d7 in video2x::VideoProcessor::process_frames+0x6e7 (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\libvideo2x.dll+0x354d7) (0x1800354d7)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #18 0x7ffb101968ac in video2x::VideoProcessor::process+0x83c (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\libvideo2x.dll+0x368ac) (0x1800368ac)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #19 0x7ff7c6a53054 (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\video2x-qt6.exe+0x43054) (0x140043054)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #20 0x7ff7c6a28123 (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\video2x-qt6.exe+0x18123) (0x140018123)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #21 0x7ffb0ac92f70 in QObject::qt_static_metacall+0x1550 (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\Qt6Core.dll+0xe2f70) (0x1800e2f70)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #22 0x7ffb0ac95aa3 in QMetaObject::activate+0x83 (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\Qt6Core.dll+0xe5aa3) (0x1800e5aa3)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #23 0x7ffb0ad407be in QThread::started+0x2e (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\Qt6Core.dll+0x1907be) (0x1801907be)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #24 0x7ffb0ade7f2f in QThread::start+0x55f (C:\Users\Furkan\Downloads\video2x-qt6-windows-amd64\Qt6Core.dll+0x237f2f) (0x180237f2f)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #25 0x7ffb46b4e8d6 in BaseThreadInitThunk+0x16 (C:\WINDOWS\System32\KERNEL32.DLL+0x2e8d6) (0x18002e8d6)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] #26 0x7ffb48e0c53b in RtlUserThreadStart+0x2b (C:\WINDOWS\SYSTEM32\ntdll.dll+0x8c53b) (0x18008c53b)
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] for malloc: ../src/gpu/utils.c:575
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] No slab to serve request for 4050K bytes (with alignment 0xc00) in pool 1!
[2025-12-01 10:01:37] [error] [FFmpeg] [libplacebo @ 000002396b591900] Failed mapping frame id 2628 with PTS -9223372036854776.000000
[2025-12-01 10:01:37] [critical] Error filtering frame: Generic error in an external library
[2025-12-01 10:01:37] [critical] Error processing frames: Generic error in an external library
[2025-12-01 10:01:37] [debug] [FFmpeg] [AVIOContext @ 000002396568ee80] Statistics: 5859428 bytes written, 0 seeks, 23 writeouts

Expected behavior
Shared GPU Memory should be cleared.

Actual behavior
Upscaling Error

Screenshots
/

Environment:

• OS: Windows 11 25H2
• GPU: NVIDIA GeForce RTX 3070
• Video2X Version: 6.4.0

Full command
/

Additional context
/

[k4yt3x]

I'm a bit surprised 8G of VRAM isn't enough to handle 1440p videos... though it from the error messages that is what's happening.

This portion is handled by FFmpeg libraries and libplacebo. I'm not sure what I can do about it.

[Brangstong]

Hello, I was having the same problem and I fixed it by changing the video codec to H.264 before upscaling. For some reason, the video I was trying to upscale was encoded in AV1, and that was the cause of the whole error.

[derfurkan]

Hello, I was having the same problem and I fixed it by changing the video codec to H.264 before upscaling. For some reason, the video I was trying to upscale was encoded in AV1, and that was the cause of the whole error.

Good point since i haven't checked how the Video, i tried to upscale, was encoded.
I also got it working by using the CLI version, while still using the same settings as in the GUI.

I'll close this issue because, like @k4yt3x said, 8GB Vram does not seem to be enough for 1440p even when the CLI Version worked fine.