I have both Coffee Lake and Skylake boxes here and managed to get both H264 encode/decode and H265 encode/decode working.  The H265 was MFX_PROFILE_HEVC_MAIN using MFX_FOURCC_NV12, i.e. 8 bit only.  Apparently you don't need to manually load a plugin to get it to work on these platforms.

Anyway I've now moved onto trying to get MFX_PROFILE_HEVC_MAIN10 with MFX_FOURCC_P010 HEVC working.  I think things are somewhat different here, i.e. I need to manually load a plugin first.  I'm not 100% when and where to do this however.  Right now I'm loading the plugin as follows:

        auto status = MFXVideoUSER_Load(*My_QSV_Session, &MFX_PLUGINID_HEVCE_HW, 1);

, if and only if the caller asks for HEVC Main10.  OK, I can choose one of the following plugins:

    MFX_PLUGINID_HEVCD_HW
    MFX_PLUGINID_HEVCE_HW
    MFX_PLUGINID_HEVCE_FEI_HW
    MFX_PLUGINID_HEVC_FEI_ENCODE
    MFX_PLUGINID_HEVCE_DP_GACC

Some of them don't exist, i.e. aren't in my Intel(R) Media SDK 2018 R2 Plugin folder.  So my first question is where do I find them all?  Secondly neither sample_encode nor my own project can successfully initialise against HEVC Main10.  Is the above MFXVideoUSER_Load statement all I have to do to load a plugin?  If I want the fastest hardware encode (we control customer CPU platform quite tightly, i.e. no need for CUDA-style encoding acceleration), which of the above options should I choose?

My command line with sample_encode is:

    sample_encode h265 -i "..\..\gops\in_p010\1.raw" -o output.265 -w 1280 -h 720 -p010 -hw -d3d11 -CodecProfile 2

The raw frame is p010 format (verified as such) and of the correct size.  I'd like -hw (hardware) and preferably -d3d11, with the Main10 profile which I believe is "2".  sample_encode fails with MFX_ERR_MEMORY_ALLOC in MFXVideoENCODE::Init.

I get incompatible params from Query with -d3d11, so I reverted it to use the SysMemAllocator.  Using that I get Unsupported when I come to Init my encoder.  The parameters in my project were:

    ...mfx.CodecId = MFX_CODEC_HEVC;
    ...mfx.CodecProfile = MFX_PROFILE_HEVC_MAIN10;
    ...mfx.FrameInfo.FourCC = MFX_FOURCC_P010;

These match the ones sample_encode submits (it fails too).

What mistake have I made?

Is there any available project on integrating Intel-Media SDK with Unity to decode and display videos on Unity Game Engine on windows platform?

Or can anyone please help me on how to integrate Intel-Media SDK with unity game engine exploiting the GPU capabilities to decode and display H264 encoded videos?

I will be happy to provide any further details about my scenario. (I want to change the encoded video file path and want to call the Intel-Media SDK to decode it then needs to put the frames on surface texture and pass it back to unity for display, specifically I am looking to build a media-player based on Intel-Media SDK ported with Unity game engine if any such project is not available)

Hi everyone.

I have a question.

Intel MediaSDK 2018R* for Windows* does not have audio decoder?

Intel MediaSDK 2017 has audio decoder (libmfxaudiosw32.dll/libmfxaudiosw64.dll)

Can I get audio decoder and sample code?

Regards,

Hi, I'm trying to integrate MSDK hw decoding feature inside my existing solution.

Video stream is provided and parsed using GStreamer libraries, the bitstream is then decoded alternatively using sw decoder (LIBAV gstreamer implementation) / nvdec / MSDK, and finally rendered through dx11/dxgi/dx9/wpf surface.

MSDK implementation is really basic, picking just necessary from sample_decode: session init (MFX_IMPL_HARDWARE/MFX_IMPL_VIA_D3D11/MFX_GPUCOPY_DEFAULT/MFX_IOPATTERN_OUT_VIDEO_MEMORY), decode header, prepare frame allocator, decode async, bind out surface to d3d11. It's all working fine, no leak detected on system/gpu memory after some minutes.

Problem appears during stop/start transient: on each stop decoder is flushed and closed, session is closed too, all pointers freed, directx11 layer is destroyed, then all items are created brand new at the next start.

On each stop/start cycle, task manager detect a +20Megs leak on system memory, while GPU dedicated memory grows of 100Megs each 2/3 cycle. When the application is closed, the directx11 debug layer print out:

D3D11 WARNING: Process is terminating. Using simple reporting. Please call ReportLiveObjects() at runtime for standard reporting. [ STATE_CREATION WARNING #0: UNKNOWN]

D3D11 WARNING: Live Producer at 0x0000013F35EB8850, Refcount: 2. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35EBB770, Refcount: 1. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35EF7020, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F2CF55570, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35D5C200, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35C2CEE0, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35C306F0, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35AF10C0, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35F03260, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35F041C0, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35EACBC0, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35D36090, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35F06BB0, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35C2DD80, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35F04F90, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35EAD530, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35C8FDC0, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING: Live                         Object :     16 [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING: Live Producer at 0x0000013F36103270, Refcount: 2. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F36160650, Refcount: 1. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35F6F170, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F2CF55A90, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35F64D90, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35C2EE90, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35C2EC20, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F360DC680, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35CD18D0, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35CB00E0, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35CB0EB0, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35D36590, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35CB2260, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35C2FFA0, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35D7E530, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35CB2BA0, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F360F3A30, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING: Live                         Object :     16 [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING: Live Producer at 0x0000013F360CAFF0, Refcount: 2. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F36128000, Refcount: 1. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35DAD340, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F2CF53E60, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F2F6703B0, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F360E4380, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F360E5490, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35CC9AA0, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F360CCED0, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F36101DD0, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35DBA7C0, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35D35E10, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F2F8ABEE0, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F360E6330, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F2F8993B0, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F35DBB130, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING:  Live Object at 0x0000013F360CDE30, Refcount: 0. [ STATE_CREATION WARNING #0: UNKNOWN]
D3D11 WARNING: Live                         Object :     16 [ STATE_CREATION WARNING #0: UNKNOWN]
DXGI WARNING: Live Producer at 0x0000013F2F8B6B08, Refcount: 4. [ STATE_CREATION WARNING #0: ]
DXGI WARNING:  Live Object at 0x0000013F35C562A0, Refcount: 3. [ STATE_CREATION WARNING #0: ]
DXGI WARNING: Live                         Object :      1 [ STATE_CREATION WARNING #0: ]
DXGI WARNING: Live Producer at 0x0000013F35B7A338, Refcount: 4. [ STATE_CREATION WARNING #0: ]
DXGI WARNING:  Live Object at 0x0000013F35C56770, Refcount: 3. [ STATE_CREATION WARNING #0: ]
DXGI WARNING: Live                         Object :      1 [ STATE_CREATION WARNING #0: ]
DXGI WARNING: Live Producer at 0x0000013F2F9CD678, Refcount: 4. [ STATE_CREATION WARNING #0: ]
DXGI WARNING:  Live Object at 0x0000013F35C57110, Refcount: 3. [ STATE_CREATION WARNING #0: ]
DXGI WARNING: Live                         Object :      1 [ STATE_CREATION WARNING #0: ]

It seems that d3d11_device/d3d11_textures remains referred inside decoder heap, but I can't figure out how to free them, besides MFXVideoDECODE_Close/MFXClose.

Input stream is 2592x1520@20fps h264 from network samsung camera, no problem detected using libav/nvdec implementation.

System analyzer log:

Intel(R) Media Server Studio 2017 - System Analyzer (64-bit)

The following versions of Media SDK API are supported by platform/driver
[opportunistic detection of MSDK API > 1.20]:

 Version Target Supported Dec Enc
 1.0 HW Yes  X X
 1.0 SW Yes  X X
 1.1 HW Yes  X X
 1.1 SW Yes  X X
 1.2 HW Yes  X X
 1.2 SW Yes  X X
 1.3 HW Yes  X X
 1.3 SW Yes  X X
 1.4 HW Yes  X X
 1.4 SW Yes  X X
 1.5 HW Yes  X X
 1.5 SW Yes  X X
 1.6 HW Yes  X X
 1.6 SW Yes  X X
 1.7 HW Yes  X X
 1.7 SW Yes  X X
 1.8 HW Yes  X X
 1.8 SW Yes  X X
 1.9 HW Yes  X X
 1.9 SW Yes  X X
 1.10 HW Yes  X X
 1.10 SW Yes  X X
 1.11 HW Yes  X X
 1.11 SW Yes  X X
 1.12 HW Yes  X X
 1.12 SW Yes  X X
 1.13 HW Yes  X X
 1.13 SW Yes  X X
 1.14 HW Yes  X X
 1.14 SW Yes  X X
 1.15 HW Yes  X X
 1.15 SW Yes  X X
 1.16 HW Yes  X X
 1.16 SW Yes  X X
 1.17 HW Yes  X X
 1.17 SW Yes  X X
 1.18 HW Yes  X X
 1.18 SW Yes  X X
 1.19 HW Yes  X X
 1.19 SW Yes  X X
 1.20 HW Yes  X X
 1.20 SW Yes  X X
 1.21 HW Yes  X X
 1.21 SW Yes  X X
 1.22 HW Yes  X X
 1.22 SW Yes  X X
 1.23 HW Yes  X X
 1.23 SW Yes  X X
 1.24 HW Yes  X X
 1.24 SW Yes  X X
 1.25 HW Yes  X X
 1.25 SW Yes  X X
 1.26 HW Yes  X X
 1.26 SW Yes  X X
 1.27 HW Yes  X X
 1.27 SW Yes  X X

Graphics Devices:
 Name                                         Version             State
 NVIDIA GeForce GTX 1050                      25.21.14.1967       Offline
 Intel(R) UHD Graphics 630                    24.20.100.6286      Running / Full Power

System info:
 CPU: Intel(R) Core(TM) i7-8750H CPU @ 2.20GHz
 OS: Microsoft Windows 10 Pro
 Arch: 64 bit

Installed Media SDK packages (be patient...processing takes some time):
 Intel(R) Media SDK 2018 R2 - HEVC GPU accelerated Encoder
 Intel(R) Media SDK 2018 R2 - Media Samples
 Intel(R) Media Server Studio 2017 - Video Quality Caliper
 Intel(R) Media SDK 2018 R2 - Software Development Kit
 Intel(R) Media SDK 2018 R2 - Documentation for HEVC
 Intel(R) Media SDK 2018 R2 - HEVC SW Encoder
 Intel(R) Media SDK 2018 R2 - HEVC SW Decoder

Installed Media SDK DirectShow filters:

Installed Intel Media Foundation Transforms:
 Intel(R) Hardware M-JPEG Decoder MFT : {00C69F81-0524-48C0-A353-4DD9D54F9A6E}

Analysis complete... [press ENTER]

Am I missing something?

Hi,

I'm trying to build MediaSDK in my system, but got following errors when run the sample code.

Test environment:

OS: ubuntu16.04

CPU:Intel® Core™ i7-6770HQ CPU @ 2.60GHz × 8

GPU:Intel® Iris Pro Graphics 580 (Skylake GT4e)

MediaSDK version: master branch

===============================================

Multi Transcoding Sample Version 8.4.27.

libva info: VA-API version 1.5.0
libva info: va_getDriverName() returns 0
libva info: User requested driver 'iHD'
libva info: Trying to open /usr/lib/x86_64-linux-gnu/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_5
libva info: va_openDriver() returns 0
Session 0:

[ERROR], sts=MFX_ERR_MORE_DATA(-10), Init, pThreadPipeline->pPipeline->Init failed at /home/qzhu2/buildmedia/MediaSDK/samples/sample_multi_transcode/src/sample_multi_transcode.cpp:363

[ERROR], sts=MFX_ERR_MORE_DATA(-10), main, transcode.Init failed at /home/qzhu2/buildmedia/MediaSDK/samples/sample_multi_transcode/src/sample_multi_transcode.cpp:974

Hi,

I am facing crash in encoder (while calling encoder->Init()) on my following environment:

OS: Windows 10 Enterprise 2016 LTSB, version 1607 (OS build 14393.2906)

Processor: Intel(R) Core(TM) i5-6402P CPU @ 2.80GHz

Graphics Card: Intel HD Graphics 510

Driver: 25.20.100.6323 (dated 18 Nov 2018)

SDK & Smaples: Intel(R) Media SDK 2018 R1 & Media Samples 8.3.26.352

This crash is reproducible through sample_encode exe too by using command:

sample_encode h264 -i input.rgb -w 1280 -h 720 -o out.h264 

Crash is occurring when I try to encode a RGB file into h264 using system memory & HW accel. But it works fine if I use:

- HW accel with video memory (d3d or d3d11), or
- SW accel with system memory or video memory (d3d or d3d11).

I tried to upgrade my display driver using  Intel Driver and Support Assistant, it shows an update available (dch_igcc_win64_26.20.100.6709) but this driver is not getting installed on system, error says "This installation package is not supported by this processor type".

Further, I did rollback my display driver and it reverted to 20.19.15.4501 and on this version there is no crash in any scenario, all case is working fine.

So it seems issue with only a specific driver version. Can you please suggest what can be done to fix this issue properly. I am afraid that as this driver is not getting updated too, so it may cause my product to crash in some of the customer's environment having same configuration.

Hi,

I am using intel media SDK jpeg encoder, and passing the encoded frames to the below gstreamer pipeline.

appsrc caps='image/jpeg,width=1920,height=1080,framerate=30/1' ! splitmuxsink muxer=matroskamux max-size-time=10000000000 location=video_%05d.mkv.

and the file is not splitting. and when i stop the application one big file is created.

I tried avc,hevc encoders with the same gstreamer pipeline it(file splitting) works.

And I also tried using gstreamer-media-SDK mfxjpegenc with the below commandline pipeline ..

gst-launch-1.0 v4l2src ! video/x-raw,width=1920,height=1080,framerate=60/1,format=YUY2 ! mfxjpegenc ! splitmuxsink muxer=matroskamux max-size-time=10000000000 location=video_%05d.mkv.

and the file is not splitting.

And if I use jpegenc (not mfxjpegenc) with the same gstreamer pipeline it(splitting) works.

Please help me solving this problem.

Thanks.

hi,

I run the sample_multi_transcode.exe from MediaSamples_MSDK_2017_8.0.24.271\sample_multi_transcode\, and it works.

then I make DLL based on  sample_multi_transcode code and meet an error as follows:

sts = m_pmfxENC->Query(&m_mfxEncParams, &m_mfxEncParams) returns MFX_WRN_PARTIAL_ACCELERATION.

P.S, The Intel GPU on my laptop is HD530 and all these code runs on win10.

Whary.D

25.Apr.2019

Hello,

I found this article with samples covering how to implement the Media SDK in a transcode filter. 

https://software.intel.com/en-us/articles/media-transcoding-sample-using...

My question is why were the DShow filter samples removed/deprecated from the media samples or tutorial samples?  For my application, I'm stuck using DirectShow and those samples did almost exactly what we need.  YUV ==> H264 ==> mux with AAC audio ==> .MP4.   

Is this still a valid solution for me, or would you suggest a different/better approach?

Thanks,  

Doug

Windows 10 -- Intel(R) Media SDK 2018 R2 -- VS2015

Hello, I'm trying to install a Mediasdk but I'm a beginner of Intel mediasdk so I followed this reference and used MediaServerStudioEssentials2017R3. 

My hardware and OS infomation is like that:

Processor : Intel Atom x5-Z8350 ( Cherrytrail)

OS: Ubuntu 16.04 

my vainfo command result is incorrect like that 

libva info: VA-API version 0.99.0
libva info: va_getDriverName() returns 0
libva info: User requested driver 'iHD'
libva info: Trying to open /opt/intel/mediasdk/lib64/iHD_drv_video.so
libva info: Found init function __vaDriverInit_0_32
libva info: va_openDriver() returns 0
vainfo: VA-API version: 0.99 (libva 1.67.0.pre1)
vainfo: Driver version: 16.5.1.59511-ubit
vainfo: Supported profile and entrypoints
      VAProfileH264ConstrainedBaseline:    VAEntrypointVLD
      VAProfileH264ConstrainedBaseline:    VAEntrypointEncSlice
      VAProfileH264ConstrainedBaseline:    <unknown entrypoint>
      VAProfileH264ConstrainedBaseline:    <unknown entrypoint>
      VAProfileH264Main               :    VAEntrypointVLD
      VAProfileH264Main               :    VAEntrypointEncSlice
      VAProfileH264Main               :    <unknown entrypoint>
      VAProfileH264Main               :    <unknown entrypoint>
      VAProfileH264High               :    VAEntrypointVLD
      VAProfileH264High               :    VAEntrypointEncSlice
      VAProfileH264High               :    <unknown entrypoint>
      VAProfileH264High               :    <unknown entrypoint>
      VAProfileMPEG2Simple            :    VAEntrypointEncSlice
      VAProfileMPEG2Simple            :    VAEntrypointVLD
      VAProfileMPEG2Main              :    VAEntrypointEncSlice
      VAProfileMPEG2Main              :    VAEntrypointVLD
      VAProfileVC1Advanced            :    VAEntrypointVLD
      VAProfileVC1Main                :    VAEntrypointVLD
      VAProfileVC1Simple              :    VAEntrypointVLD
      VAProfileJPEGBaseline           :    VAEntrypointVLD
      VAProfileJPEGBaseline           :    VAEntrypointEncPicture
      VAProfileVP8Version0_3          :    VAEntrypointEncSlice
      VAProfileVP8Version0_3          :    VAEntrypointVLD
      VAProfileVP8Version0_3          :    <unknown entrypoint>
      VAProfileVP9Profile0            :    <unknown entrypoint>
      <unknown profile>               :    VAEntrypointVideoProc
      VAProfileNone                   :    VAEntrypointVideoProc
      VAProfileNone                   :    <unknown entrypoint>
Segmentation fault (core dumped)

I don't know how could I solve this problem. 
Please help me.  

hi there, 

I am using ffmpeg 4.1.3 H264_qsv encoder to capture a video from  camera at 1920 x 1080.

the camera outputs BGRA frame, and I use  IPP function ippiBGRToYCbCr420_8u_AC4P2R to convert it to NV12 format. then the NV12 frame is passed to H264_qsv  encoder. the video file extension is mp4. 

however, the video has a horizontal green bar at the bottom of video. the height of the bar is a few pixels and the width is across the full frame. 

does anyone have some advices how to debug the problem?

thank you and regards

Leon

Hello support team,

I try to use H264 "sw" encode two 1080P bitstream at the same time. The cpu usage is up to 100%.
I have tried setting async =2. Encode one bitstream can reduce to 40% usage, but two bitstream is up to 100%.

Is there any other way to reduce cpu usage?

Product version: 2018 R2

Platform : Windows10 I7-8700 3.2GHZ UHD 630: 24.20.100.6287

Sample encode cmd: sample_encode.exe h264 -i input.yuv -o output.264 -sw -w 1920 -h 1080 -f 60 -b 8200 -cbr -g 120 -r 2 -async 2

How and where does pitch get set? I see that  

Encoder has a line 
MSDK_MEMCPY_VAR(m_pVppSurfaces[i].Info, &(m_mfxVppParams.mfx.FrameInfo), sizeof(mfxFrameInfo));

This line  sets the info struct of  mfxFrameSurface1
But where does the surface.data.pitch get set of mfxFrameSurface1
Does it automatically mults width by 8 bytes and since we alight the width with MSDK_ALIGN16 ?

Thanks

Hi,

Recently I wrote a C++ software to do h264 hardware encoding by using Intel Media SDK 2018R2, with my dual-GPU (Windows 10 1809 + Intel HD Graphics 4600 + Nvidia GTX1080) equipped desktop.

When I used the GTX1080 as my primary gfx device and tried to use the headless intel's GPU as secondary hw-accelerated device, everything is fine until about ten minutes later. The call of MFXVideoSession::SyncOperation() in my program begun to return MFX_ERR_DEVICE_FAILED occasionally, which lead to crash. But when I used Intel's GPU as the primary device, it works pretty well. There is no more MFX_ERR_DEVICE_FAILED errors, no matter how long it runs.

How to avoid this MFX_ERR_DEVICE_FAILED situation and make my secondary intel's gpu work stable? Any suggestion would be appreciated.

Best regards,

Is it possible to turn off fill outside crop region (MFXVideoVPP_RunFrameVPPAsync)?

Thanks.

Hi,

Downloads for Media SDK for Windows (any edition) are currently down; I get a 404 error. Can this be fixed?

Kind regards,

F.

Problem：

With the same H264 RTP sender stream,  receiver pipeline with 'mfxh264dec' gives larger latency (30~60ms) than pipeline with ‘avdec_h264.

In my application, end-to-end latency is critical.

Since mfxh264dec with HW acceleration has less CPU usage than avdec_h264,

it would be great if mfxh264dec could give the (almost) same latency as avdec_264.

Plarform: 
Win10,  VS2017,  gstreamer-1.16,  Media SDK 2017
gstreamer MSDK plugin from: 
https://github.com/intel/gstreamer-media-SDK.git
(Built with OpenGL support using VS2017)

Note 'mfxh264dec' is built WITH OpenGl support:

C:\Users\UI>gst-inspect-1.0 --gst-plugin-load=C:\gst_MSDK_intel\gst-mfx-build_msvc\gst\mfx\gstmfx.dll mfxh264dec
Factory Details:
  Rank                     primary + 3 (259)
  Long-name                MFX H264 decoder
  Klass                    Codec/Decoder/Video
  Description              An MFX-based H264 video decoder
  Author                   Ishmael Sameen<ishmael.visayana.sameen@intel.com>

Plugin Details:
  Name                     mfx
  Description              MFX encoder/decoder/video post-processing plugins
  Filename                 C:\gst_MSDK_intel\gst-mfx-build_msvc\gst\mfx\gstmfx.dll
  Version                  2.0.2
  License                  LGPL
  Source module            gst_mfx
  Binary package           gst_mfx
  Origin URL               http://www.intel.com

GObject
 +----GInitiallyUnowned
       +----GstObject
             +----GstElement
                   +----GstVideoDecoder
                         +----GstMfxDec_h264

Pad Templates:
  SINK template: 'sink'
    Availability: Always
    Capabilities:
      video/x-h264
              alignment: au
                profile: { (string)constrained-baseline, (string)baseline, (string)main, (string)high }
          stream-format: byte-stream
  SRC template: 'src'
    Availability: Always
    Capabilities:
      video/x-raw(memory:MFXSurface)
                 format: { (string)NV12, (string)BGRA, (string)P010_10LE, (string)YUY2, (string)ENCODED }
                  width: [ 1, 2147483647 ]
                 height: [ 1, 2147483647 ]
              framerate: [ 0/1, 2147483647/1 ]
      video/x-raw(memory:GLMemory)
                 format: { (string)RGBA }
                  width: [ 1, 2147483647 ]
                 height: [ 1, 2147483647 ]
              framerate: [ 0/1, 2147483647/1 ]
      video/x-raw
                 format: { (string)NV12, (string)BGRA, (string)P010_10LE, (string)YUY2 }
                  width: [ 1, 2147483647 ]
                 height: [ 1, 2147483647 ]
              framerate: [ 0/1, 2147483647/1 ]

Here are sender and receiver pipelines:

1. H264 RTP ender pipeline on Nvidia TX2:

gst-launch-1.0 v4l2src device=/dev/video0 ! 'video/x-raw, format=UYVY, framerate=30/1' ! \
        nvvidconv ! 'video/x-raw(memory:NVMM),format=I420, framerate=30/1' ! \
        omxh264enc bitrate=$bitrate MeasureEncoderLatency=true ! 'video/x-h264, stream-format=(string)byte-stream' ! \
        rtph264pay ! udpsink host=$ip port=$port sync=false async=false

Using wireshark, I confirmed that the sps.pic_order_cnt_type is 2.

2. Receiver pipeline with avdec_h264:

gst-launch-1.0   udpsrc port=5000 caps="application/x-rtp, encoding-name=H264,payload=96" !  \
                       rtph264depay ! h264parse ! avh264_dec ! glimagesink sync=false async=false

3. Receiver pipeline with mfxh264dec:

gst-launch-1.0  --gst-plugin-load=C:\gst_MSDK_intel\gst-mfx-build_msvc\gst\mfx\gstmfx.dll udpsrc port=5000 caps="application/x-rtp, encoding-name=H264,payload=96" !  \
                       rtph264depay ! h264parse ! mfxh264dec live-mode=true ! glimagesink sync=false async=false

I found the latency topic was discussed:
https://software.intel.com/en-us/forums/intel-media-sdk/topic/704136
And in this discussion,  Dmitry E. (Intel) Thu, 06/22/2017 - 14:37 gave possible solutions.

Now here if 'live-mode=true',

In gst-libs/mfx/gstmfxdecoder.c, line 333~line 339:

 if (live_mode) {
    decoder->params.AsyncDepth = 1;
    decoder->bs.DataFlag = MFX_BITSTREAM_COMPLETE_FRAME;
    /* Hack for H264 low-latency streaming */
    if (decoder->params.mfx.CodecId == MFX_CODEC_AVC)
      decoder->params.mfx.DecodedOrder = 1;
  }

And remember sender's sps.pic_order_cnt_type ==  2.

So ALL possible solutions have been applied,
but the latency is still there.

Any suggestion?

Hi Support team,

I try to use 2018 R2_1 sample to encode interlaced HEVC content.

Whether using software or hardware, I meet different issue.

When using HW encode:

command: sample_encode.exe h265 -i input.yuv -o output.265 -tff -w 1920 -h 1080 -f 120 -b 4000  -p 6fadc791a0c2eb479ab6dcd5ea9da347

I find the encoded bitstream resolution is 1920x540 but SPI.YUI.field_seq_flag and pic_struct value still is 0.

When using SW encode:

command: sample_encode.exe h265 -i input.yuv -o output.265 -tff -w 1920 -h 1080 -f 120 -b 4000  -p 2fca99749fdb49aeb121a5b63ef568f7

The SPI.YUI.field_seq_flag and pic_struct value is correct ( =1) but the encoded bitstream resolution is 1920x270.

I put the encoded bitstream at attached file. Thanks for your help.

System:

CPU: i7-8700@3.2GHz

GPU:UHD 630 (Driver: 25.20.100.6519)

Hello.

We are encountering a random crash in the MFXVideoENCODE_Query() function in 64 bits Windows on a lot of Intel HD Graphics.

The crash occurs between 80% and 100% of the times, depending on the platform.

Version : Intel(R) Media SDK 2018 R1 8.0.24.0 (Windows 10 64 bits)

We do not encounter the issue when running in 32 bits (or when using D3D11 memory instead of system memory, in 32 or 64 bits).

The issue can be reproduced with your intel_media_sdk_sample_encode.exe application and your YUV sample file.

We use the following command line:

intel_media_sdk_sample_encode.exe h264 -i test_stream_176x96.yuv -o out.h264 -w 176 -h 96 -g 256

Could you please let us know if you can reproduce the issue, and if you can provide a fix?

Thanks and best regards,

Xavier

I am trying to initialize mediasdk(libva, iHD driver) in a remote machine using ssh, but I am getting this error -

get chip id failed: -1 [13]
param: 4, val: 0
libva error: /opt/intel/mediasdk/lib64/iHD_drv_video.so init failed
libva info: va_openDriver() returns 1
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc

If I am directly running on the machine itself, It's happily running.

I have also set the environment variables related to libva

export DISPLAY=:0
export LIBVA_DRIVER_NAME=iHD
export LIBVA_DRIVERS_PATH=/opt/intel/mediasdk/lib64

I have search a lot about this issue but not able to figure out this behaviour.

I am using vainfo: VA-API version: 1.3 (libva 2.3.0) on ubuntu 16.04.5 LTS

Any help will be appreciated

Regards

Ashish