[FFmpeg-user] h264_vulkan and hevc_vulkan Encode failed on Intel
Terje J. Hanssen
terjejhanssen at gmail.com
Fri Dec 13 14:47:07 EET 2024
While decode benchmarks test seemingly works on Intel, encode failed as
shown below.
If here are some missing steps or something wrong with the ffmpeg
command lines used, I would be happy to hear back and test alternatives?
ls /usr/share/vulkan/icd.d
intel_hasvk_icd.x86_64.json intel_icd.x86_64.json lvp_icd.x86_64.json
export VK_ICD_FILENAMES=/usr/share/vulkan/icd.d/intel_icd.x86_64.json
export ANV_VIDEO_DECODE=1
export ANV_VIDEO_ENCODE=1
vulkaninfo | egrep -i 'decode|encode'
VK_KHR_video_decode_h264 : extension revision 9
VK_KHR_video_decode_h265 : extension revision 8
VK_KHR_video_decode_queue : extension revision 8
VK_KHR_video_encode_h264 : extension revision 14
VK_KHR_video_encode_h265 : extension revision 14
VK_KHR_video_encode_queue : extension revision 12
queueFlags = QUEUE_VIDEO_DECODE_BIT_KHR |
QUEUE_VIDEO_ENCODE_BIT_KHR
VIDEO_CODEC_OPERATION_ENCODE_H264_BIT_KHR
VIDEO_CODEC_OPERATION_ENCODE_H265_BIT_KHR
VIDEO_CODEC_OPERATION_DECODE_H264_BIT_KHR
VIDEO_CODEC_OPERATION_DECODE_H265_BIT_KHR
vulkaninfo --summary
==========
VULKANINFO
==========
Vulkan Instance Version: 1.3.296
Instance Extensions: count = 24
-------------------------------
VK_EXT_acquire_drm_display : extension revision 1
VK_EXT_acquire_xlib_display : extension revision 1
VK_EXT_debug_report : extension revision 10
VK_EXT_debug_utils : extension revision 2
VK_EXT_direct_mode_display : extension revision 1
VK_EXT_display_surface_counter : extension revision 1
VK_EXT_headless_surface : extension revision 1
VK_EXT_surface_maintenance1 : extension revision 1
VK_EXT_swapchain_colorspace : extension revision 5
VK_KHR_device_group_creation : extension revision 1
VK_KHR_display : extension revision 23
VK_KHR_external_fence_capabilities : extension revision 1
VK_KHR_external_memory_capabilities : extension revision 1
VK_KHR_external_semaphore_capabilities : extension revision 1
VK_KHR_get_display_properties2 : extension revision 1
VK_KHR_get_physical_device_properties2 : extension revision 2
VK_KHR_get_surface_capabilities2 : extension revision 1
VK_KHR_portability_enumeration : extension revision 1
VK_KHR_surface : extension revision 25
VK_KHR_surface_protected_capabilities : extension revision 1
VK_KHR_wayland_surface : extension revision 6
VK_KHR_xcb_surface : extension revision 6
VK_KHR_xlib_surface : extension revision 6
VK_LUNARG_direct_driver_loading : extension revision 1
Instance Layers: count = 3
--------------------------
VK_LAYER_KHRONOS_validation Khronos Validation Layer 1.3.296 version 1
VK_LAYER_MESA_device_select Linux device selection layer 1.3.211 version 1
VK_LAYER_MESA_overlay Mesa Overlay layer 1.3.211 version 1
Devices:
========
GPU0:
apiVersion = 1.3.296
driverVersion = 24.3.0
vendorID = 0x8086
deviceID = 0x56a1
deviceType = PHYSICAL_DEVICE_TYPE_DISCRETE_GPU
deviceName = Intel(R) Arc(tm) A750 Graphics (DG2)
driverID = DRIVER_ID_INTEL_OPEN_SOURCE_MESA
driverName = Intel open-source Mesa driver
driverInfo = Mesa 24.3.0
conformanceVersion = 1.3.6.0
deviceUUID = 8680a156-0800-0000-0300-000000000000
driverUUID = b3041234-0ed8-a53d-ceb8-4ffd54a9fd93
#######################
inxi -CGSz
System:
Kernel: 6.6.63-1-longterm arch: x86_64 bits: 64
Console: pty pts/0 Distro: openSUSE Tumbleweed-Slowroll 20241202
CPU:
Info: 12-core (8-mt/4-st) model: 12th Gen Intel Core i7-12700KF bits: 64
type: MST AMCP cache: L2: 12 MiB
Speed (MHz): avg: 800 min/max: 800/4900:5000:3800 cores: 1: 800 2: 800
3: 800 4: 800 5: 800 6: 800 7: 800 8: 800 9: 800 10: 800 11: 800
12: 800
13: 800 14: 800 15: 800 16: 800 17: 800 18: 800 19: 800 20: 800
Graphics:
Device-1: Intel DG2 [Arc A750] driver: i915 v: kernel
Device-2: Microdia Camera driver: snd-usb-audio,uvcvideo type: USB
Display: unspecified server: X.org v: 1.21.1.14 with: Xwayland v: 24.1.4
driver: X: loaded: modesetting unloaded: vesa dri: iris gpu: i915
resolution: 2560x1440~60Hz
API: EGL v: 1.5 drivers: iris,swrast platforms:
gbm,x11,surfaceless,device
API: OpenGL v: 4.6 compat-v: 4.5 vendor: intel mesa v: 24.3.0
renderer: Mesa Intel Arc A750 Graphics (DG2)
API: Vulkan v: 1.3.296 drivers: N/A surfaces: xcb,xlib
====================
ffmpeg version 7.1 Copyright (c) 2000-2024 the FFmpeg developers
built with gcc 14 (SUSE Linux)
ffmpeg -hide_banner -encoders | grep vulkan
V....D h264_vulkan H.264/AVC (Vulkan) (codec h264)
V....D hevc_vulkan H.265/HEVC (Vulkan) (codec hevc)
######################
ffmpeg -hide_banner -init_hw_device vulkan -i hdv09_04.m2t -vf
"format=nv12,hwupload" -c:v h264_vulkan -y hdv09_04_h264_vulkan_nv12.mp4
[mpeg2video @ 0x55db4fe22d80] Invalid frame dimensions 0x0.
Last message repeated 3 times
[mpegts @ 0x55db4fe042c0] PES packet size mismatch
[mpegts @ 0x55db4fe042c0] Packet corrupt (stream = 1, dts = 258142320).
[mpegts @ 0x55db4fe042c0] Could not find codec parameters for stream 2
(Unknown: none ([160][0][0][0] / 0x00A0)): unknown codec
Consider increasing the value for the 'analyzeduration' (0) and
'probesize' (5000000) options
[mpegts @ 0x55db4fe042c0] Could not find codec parameters for stream 3
(Unknown: none ([161][0][0][0] / 0x00A1)): unknown codec
Consider increasing the value for the 'analyzeduration' (0) and
'probesize' (5000000) options
Input #0, mpegts, from 'hdv09_04.m2t':
Duration: 00:03:59.06, start: 2629.496000, bitrate: 26110 kb/s
Program 100
Stream #0:0[0x810]: Video: mpeg2video (Main) ([2][0][0][0] / 0x0002),
yuv420p(tv, bt709, top first), 1440x1080 [SAR 4:3 DAR 16:9], 25000 kb/s,
25 fps, 25 tbr, 90k tbn
Side data:
cpb: bitrate max/min/avg: 25000000/0/0 buffer size: 7340032
vbv_delay: N/A
Stream #0:1[0x814]: Audio: mp2 (mp3float) ([3][0][0][0] / 0x0003),
48000 Hz, stereo, fltp, 384 kb/s
Stream #0:2[0x815]: Unknown: none ([160][0][0][0] / 0x00A0)
Stream #0:3[0x811]: Unknown: none ([161][0][0][0] / 0x00A1)
Stream mapping:
Stream #0:0 -> #0:0 (mpeg2video (native) -> h264 (h264_vulkan))
Stream #0:1 -> #0:1 (mp2 (native) -> aac (native))
Press [q] to stop, [?] for help
[h264_vulkan @ 0x55db4fe236c0] No rate control settings specified, using
fixed QP = 18
Output #0, mp4, to 'hdv09_04_h264_vulkan_nv12.mp4':
Metadata:
encoder : Lavf61.7.100
Stream #0:0: Video: h264 (High) (avc1 / 0x31637661), vulkan(tv,
bt709, top coded first (swapped)), 1440x1080 [SAR 4:3 DAR 16:9], q=2-31,
25 fps, 12800 tbn
Metadata:
encoder : Lavc61.19.100 h264_vulkan
Stream #0:1: Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo,
fltp, 128 kb/s
Metadata:
encoder : Lavc61.19.100 aac
[h264_vulkan @ 0x55db4fe236c0] Encode failed: -729850096.
[vost#0:0/h264_vulkan @ 0x55db4fe5d480] Error submitting video frame to
the encoder
[vost#0:0/h264_vulkan @ 0x55db4fe5d480] Error encoding a frame: Error
number -729850096 occurred
[vost#0:0/h264_vulkan @ 0x55db4fe5d480] Task finished with error code:
-729850096 (Error number -729850096 occurred)
[vost#0:0/h264_vulkan @ 0x55db4fe5d480] Terminating thread with return
code -729850096 (Error number -729850096 occurred)
Unable to submit command buffer: VK_ERROR_DEVICE_LOST
[hwupload @ 0x7ff7c0004440] Failed to upload frame: -542398533.
[vf#0:0 @ 0x55db4fd17100] Error while filtering: Generic error in an
external library
[vf#0:0 @ 0x55db4fd17100] Task finished with error code: -542398533
(Generic error in an external library)
[vf#0:0 @ 0x55db4fd17100] Terminating thread with return code -542398533
(Generic error in an external library)
[out#0/mp4 @ 0x55db4fd198c0] video:0KiB audio:19KiB subtitle:0KiB other
streams:0KiB global headers:0KiB muxing overhead: 5.515885%
frame= 0 fps=0.0 q=0.0 Lsize= 20KiB time=N/A bitrate=N/A speed=N/A
[aac @ 0x55db4fe069c0] Qavg: 1286.721
Conversion failed!
========================
ffmpeg -hide_banner -init_hw_device vulkan=vkdev:0 -filter_hw_device
vkdev -i h264_8bit_yuv420p.mp4 -filter:v "format=nv12,hwupload" -c:v
hevc_vulkan hevc_vulkan_8b420.mp4
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'h264_8bit_yuv420p.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2avc1mp41
encoder : Lavf61.1.100
Duration: 00:01:11.20, start: 0.000000, bitrate: 8464 kb/s
Stream #0:0[0x1](und): Video: h264 (High) (avc1 / 0x31637661),
yuvj420p(pc, smpte170m/unknown/unknown, top first), 1920x1080 [SAR 1:1
DAR 16:9], 8462 kb/s, 25 fps, 25 tbr, 12800 tbn (default)
Metadata:
handler_name : VideoHandler
vendor_id : [0][0][0][0]
File 'hevc_vulkan_8b420.mp4' already exists. Overwrite? [y/N] y
Stream mapping:
Stream #0:0 -> #0:0 (h264 (native) -> hevc (hevc_vulkan))
Press [q] to stop, [?] for help
[swscaler @ 0x7f0aa0014b00] deprecated pixel format used, make sure you
did set range correctly
[hevc_vulkan @ 0x5583b890fdc0] No rate control settings specified, using
fixed QP = 18
Output #0, mp4, to 'hevc_vulkan_8b420.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2avc1mp41
encoder : Lavf61.7.100
Stream #0:0(und): Video: hevc (Main) (hev1 / 0x31766568), vulkan(pc,
smpte170m/unknown/unknown, top coded first (swapped)), 1920x1080 [SAR
1:1 DAR 16:9], q=2-31, 25 fps, 12800 tbn (default)
Metadata:
handler_name : VideoHandler
vendor_id : [0][0][0][0]
encoder : Lavc61.19.100 hevc_vulkan
[hevc_vulkan @ 0x5583b890fdc0] Encode failed: -1744827296.
[vost#0:0/hevc_vulkan @ 0x5583b890aec0] Error submitting video frame to
the encoder
[vost#0:0/hevc_vulkan @ 0x5583b890aec0] Error encoding a frame: Error
number -1744827296 occurred
[vost#0:0/hevc_vulkan @ 0x5583b890aec0] Task finished with error code:
-1744827296 (Error number -1744827296 occurred)
[vost#0:0/hevc_vulkan @ 0x5583b890aec0] Terminating thread with return
code -1744827296 (Error number -1744827296 occurred)
[out#0/mp4 @ 0x5583b883ecc0] video:0KiB audio:0KiB subtitle:0KiB other
streams:0KiB global headers:0KiB muxing overhead: unknown
[out#0/mp4 @ 0x5583b883ecc0] Output file is empty, nothing was
encoded(check -ss / -t / -frames parameters if used)
frame= 0 fps=0.0 q=0.0 Lsize= 0KiB time=N/A bitrate=N/A speed=N/A
Conversion failed!
More information about the ffmpeg-user
mailing list