[FFmpeg-user] OpenVPL-cpu and ffmpeg's qsv encoder

Andrew Randrianasulu randrianasulu at gmail.com
Mon Oct 14 04:09:21 EEST 2024


Hello all!

I was trying to debug my _qsv profiles for Cinelerra-GG (of course) and was
hitting wall due to my machine being AMD CPU/Nvidia (nouveau) GPU.

Then I found https://github.com/oneapi-src/oneVPL-cpu/blob/master/INSTALL.md

Deprecated by intel but still buildable after some fighting.

bash-5.1$ vpl-inspect

Implementation #0: oneAPI VPL CPU Implementation
  Library path: /usr/local/lib/libvplswref32.so.1
  AccelerationMode: MFX_ACCEL_MODE_NA
  ApiVersion: 2.13
  Impl: MFX_IMPL_TYPE_SOFTWARE
  VendorImplID: 0x0000
  ImplName: oneAPI VPL CPU Implementation
  License: MIT
  Version: 1.2
  Keywords: VPL,CPU,x64
  VendorID: 0x8086
  mfxAccelerationModeDescription:
    Version: 1.0
    Mode: MFX_ACCEL_MODE_NA
  mfxPoolPolicyDescription:
    Version: 1.0
    Policy: MFX_ALLOCATION_UNLIMITED
  mfxDeviceDescription:
    MediaAdapterType: MFX_MEDIA_UNKNOWN
    DeviceID: 0000
    Version: 1.1
  mfxDecoderDescription:
    Version: 1.0
    CodecID: AV1
    MaxcodecLevel: 53
      Profile: MFX_PROFILE_AV1_MAIN
        MemHandleType: MFX_RESOURCE_SYSTEM_SURFACE
          Width Min: 64
          Width Max: 4096
          Width Step: 8
          Height Min: 64
          Height Max: 4096
          Height Step: 8
          ColorFormats: IYUV, I010
    CodecID: AVC
    MaxcodecLevel: 52
      Profile: MFX_PROFILE_AVC_HIGH
        MemHandleType: MFX_RESOURCE_SYSTEM_SURFACE
          Width Min: 64
          Width Max: 4096
          Width Step: 8
          Height Min: 64
          Height Max: 4096
          Height Step: 8
          ColorFormats: IYUV
    CodecID: HEVC
    MaxcodecLevel: 51
      Profile: MFX_PROFILE_HEVC_MAIN
        MemHandleType: MFX_RESOURCE_SYSTEM_SURFACE
          Width Min: 64
          Width Max: 4096
          Width Step: 8
          Height Min: 64
          Height Max: 4096
          Height Step: 8
          ColorFormats: IYUV
      Profile: MFX_PROFILE_HEVC_MAIN10
        MemHandleType: MFX_RESOURCE_SYSTEM_SURFACE
          Width Min: 64
          Width Max: 4096
          Width Step: 8
          Height Min: 64
          Height Max: 4096
          Height Step: 8
          ColorFormats: I010
    CodecID: JPEG
    MaxcodecLevel: 0
      Profile: MFX_PROFILE_JPEG_BASELINE
        MemHandleType: MFX_RESOURCE_SYSTEM_SURFACE
          Width Min: 64
          Width Max: 4096
          Width Step: 8
          Height Min: 64
          Height Max: 4096
          Height Step: 8
          ColorFormats: IYUV
    CodecID: MPG2
    MaxcodecLevel: 8
      Profile: MFX_PROFILE_MPEG2_MAIN
        MemHandleType: MFX_RESOURCE_SYSTEM_SURFACE
          Width Min: 64
          Width Max: 4096
          Width Step: 8
          Height Min: 64
          Height Max: 4096
          Height Step: 8
          ColorFormats: IYUV
  mfxEncoderDescription:
    Version: 1.0
    CodecID: AV1
    MaxcodecLevel: 53
    BiDirectionalPrediction: 1
    ReportedStats: 0
      Profile: MFX_PROFILE_AV1_MAIN
        MemHandleType: MFX_RESOURCE_SYSTEM_SURFACE
          Width Min: 64
          Width Max: 4096
          Width Step: 8
          Height Min: 64
          Height Max: 4096
          Height Step: 8
          ColorFormats: IYUV, I010
    CodecID: HEVC
    MaxcodecLevel: 51
    BiDirectionalPrediction: 1
    ReportedStats: 0
      Profile: MFX_PROFILE_HEVC_MAIN
        MemHandleType: MFX_RESOURCE_SYSTEM_SURFACE
          Width Min: 64
          Width Max: 4096
          Width Step: 8
          Height Min: 64
          Height Max: 4096
          Height Step: 8
          ColorFormats: IYUV
      Profile: MFX_PROFILE_HEVC_MAIN10
        MemHandleType: MFX_RESOURCE_SYSTEM_SURFACE
          Width Min: 64
          Width Max: 4096
          Width Step: 8
          Height Min: 64
          Height Max: 4096
          Height Step: 8
          ColorFormats: I010
    CodecID: JPEG
    MaxcodecLevel: 0
    BiDirectionalPrediction: 0
    ReportedStats: 0
      Profile: MFX_PROFILE_JPEG_BASELINE
        MemHandleType: MFX_RESOURCE_SYSTEM_SURFACE
          Width Min: 64
          Width Max: 4096
          Width Step: 8
          Height Min: 64
          Height Max: 4096
          Height Step: 8
          ColorFormats: IYUV
  mfxVPPDescription:
    Version: 1.0
    FilterFourCC: VCSC
    MaxDelayInFrames: 1
      MemHandleType: MFX_RESOURCE_SYSTEM_SURFACE
      Width Min: 64
      Width Max: 4096
      Width Step: 8
      Height Min: 64
      Height Max: 4096
      Height Step: 8
        InFormat: I010
          OutFormats: IYUV, RGB4
        InFormat: IYUV
          OutFormats: I010, RGB4
        InFormat: RGB4
          OutFormats: IYUV, I010
    FilterFourCC: VSCL
    MaxDelayInFrames: 1
      MemHandleType: MFX_RESOURCE_SYSTEM_SURFACE
      Width Min: 64
      Width Max: 4096
      Width Step: 8
      Height Min: 64
      Height Max: 4096
      Height Step: 8
        InFormat: I010
          OutFormats: I010
        InFormat: IYUV
          OutFormats: IYUV
        InFormat: RGB4
          OutFormats: RGB4
  NumExtParam: 0

Total number of implementations found = 1

But ffmpeg still does not work:

bash-5.1$ ./ffmpeg/ffmpeg -i mc.avi -c:v mjpeg_qsv -f null /dev/null
ffmpeg version N-116241-g9bc1678934 Copyright (c) 2000-2024 the FFmpeg
developers
  built with gcc 11.2.0 (GCC)
  configuration: --enable-libvpl
  libavutil      59. 41.100 / 59. 41.100
  libavcodec     61. 21.100 / 61. 21.100
  libavformat    61.  9.100 / 61.  9.100
  libavdevice    61.  4.100 / 61.  4.100
  libavfilter    10.  6.100 / 10.  6.100
  libswscale      8.  4.100 /  8.  4.100
  libswresample   5.  4.100 /  5.  4.100
[aist#0:1/pcm_u8 @ 0xb39c2c0] Guessed Channel Layout: mono
Input #0, avi, from 'mc.avi':
  Metadata:
    software        : MEncoder SVN-r38660-11.2.0
  Duration: 00:00:28.29, start: 0.000000, bitrate: 3259 kb/s
  Stream #0:0: Video: mjpeg (Baseline) (mjpg / 0x67706A6D), yuvj422p(pc,
bt470bg/unknown/unknown), 320x240, 3205 kn
  Stream #0:1: Audio: pcm_u8 ([1][0][0][0] / 0x0001), 7812 Hz, mono, u8, 62
kb/s
Stream mapping:
  Stream #0:0 -> #0:0 (mjpeg (native) -> mjpeg (mjpeg_qsv))
  Stream #0:1 -> #0:1 (pcm_u8 (native) -> pcm_s16le (native))
Press [q] to stop, [?] for help
[swscaler @ 0xf4c0e2c0] deprecated pixel format used, make sure you did set
range correctly
[mjpeg_qsv @ 0xb3a7040] Error creating a MFX session: -9.
[vost#0:0/mjpeg_qsv @ 0xb3a6b40] [enc:mjpeg_qsv @ 0xb3a6f80] Error while
opening encoder - maybe incorrect paramet.
[vf#0:0 @ 0xb3a7d40] Error sending frames to consumers: Unknown error
occurred
[vf#0:0 @ 0xb3a7d40] Task finished with error code: -1313558101 (Unknown
error occurred)
[vost#0:0/mjpeg_qsv @ 0xb3a6b40] [enc:mjpeg_qsv @ 0xb3a6f80] Could not open
encoder before EOF
[vost#0:0/mjpeg_qsv @ 0xb3a6b40] Task finished with error code: -22
(Invalid argument)
[vost#0:0/mjpeg_qsv @ 0xb3a6b40] Terminating thread with return code -22
(Invalid argument)
[vf#0:0 @ 0xb3a7d40] Terminating thread with return code -1313558101
(Unknown error occurred)
[out#0/null @ 0xb39cb40] Nothing was written into output file, because at
least one of its streams received no pac.
frame=    0 fps=0.0 q=0.0 Lsize=       0KiB time=N/A bitrate=N/A speed=N/A
Conversion failed!

I tried to look at sourcecode, but changing obvious places in
libavutil/hwcontext_qsv.c to sw implementation changed nothing, and

Error creating a MFX session: -9

was coming from libavcodec/qsv.c (I changed printed message a bit)

decoder also does not work

Any ideas how to convince ffmpeg to use this OneVPL implementation?


More information about the ffmpeg-user mailing list