vainfo error with ssh

I am trying to initialize mediasdk(libva, iHD driver) in a remote machine using ssh, but I am getting this error -

get chip id failed: -1 [13]
param: 4, val: 0
libva error: /opt/intel/mediasdk/lib64/iHD_drv_video.so init failed
libva info: va_openDriver() returns 1
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc

If I am directly running on the machine itself, It's happily running.

I have also set the environment variables related to libva

export DISPLAY=:0
export LIBVA_DRIVER_NAME=iHD
export LIBVA_DRIVERS_PATH=/opt/intel/mediasdk/lib64

I have search a lot about this issue but not able to figure out this behaviour.

I am using vainfo: VA-API version: 1.3 (libva 2.3.0) on ubuntu 16.04.5 LTS

Any help will be appreciated

Regards

Ashish