[HW Accel Support]: Installed Nvidia-based GPU GT730, cannot get hw_accel to work #14645

Vendo233 · 2024-10-28T21:44:54Z

Vendo233
Oct 28, 2024

Describe the problem you are having

my setup: HP Z4G4, Proxmox -> LXC Container -> Docker -> Frigate

Followed the wiki , frigate works OK, but after 4 hrs of installing the GPU passthrough the GPU utilization shows 0%

Version

0.14.1-f4f3cfa

Frigate config file

detectors:
  coral_pci:
    type: edgetpu
    device: pci

mqtt:
  host: 192.168.1.128
  port: 1883
  topic_prefix: frigate
  user: secret
  password: secret

ffmpeg:
  hwaccel_args: preset-nvidia-h264
  global_args: -hide_banner -loglevel warning
  input_args: preset-rtsp-generic
  output_args:
    detect: -f rawvideo -pix_fmt yuv420p
    record: preset-record-generic
cameras:
  Front_Door_Wyze2:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://secret@192.168.1.107/ch1
          input_args: preset-rtsp-restream
          roles:
            - detect
        - path: rtsp://secret@192.168.1.107/ch0
          input_args: preset-rtsp-restream
          roles:
            - record
    detect:
      width: 640
      height: 360
      fps: 5
    record:
      enabled: true
      retain:
        days: 5
        mode: active_objects
      events:
        retain:
          default: 2
          mode: active_objects
          objects:
            person: 5
    objects:
      track:
        - person
        - cat
        - dog

    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      crop: false
      quality: 100
      height: 500
      retain:
        default: 2
        objects:
          person: 5
    mqtt:
      timestamp: true
      bounding_box: true
      crop: true
      quality: 100
      height: 500

  driveway:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://secret@192.168.1.154:554/h264Preview_01_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
        - path: rtsp://secret@192.168.1.154:554/h265Preview_01_main
          input_args: preset-rtsp-restream
          roles:
            - record
    detect:
      width: 640
      height: 360
      fps: 5
    record:
      enabled: true
      retain:
        days: 0
        mode: active_objects
      events:
        retain:
          default: 2
          mode: active_objects
          objects:
            person: 5
    objects:
      track:
        - person
        - car
        - dog
        - cat

    snapshots:
      enabled: true
      timestamp: false
      bounding_box: false
      crop: false
      quality: 100
      height: 1500
      retain:
        default: 2
        objects:
          person: 5
    mqtt:
      timestamp: false
      bounding_box: false
      crop: true
      quality: 100
      height: 1500

  garage:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://secret@192.168.1.16:8554/video2_unicast
          input_args: preset-rtsp-restream
          roles:
            - detect
        - path: rtsp://secret@192.168.1.16:8554/video1_unicast
          input_args: preset-rtsp-restream
          roles:
            - record
    detect:
      width: 640
      height: 360
      fps: 5
    record:
      enabled: true
      retain:
        days: 0
        mode: active_objects
      events:
        retain:
          default: 2
          mode: active_objects
          objects:
            person: 5
    objects:
      track:
        - person
        - car
    snapshots:
      enabled: true
      timestamp: false
      bounding_box: false
      crop: false
      quality: 100
      height: 1000
      retain:
        default: 2
        objects:
          person: 5
    mqtt:
      timestamp: false
      bounding_box: false
      crop: true
      quality: 100
      height: 1000

  Backyard_V3:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://secret@192.168.1.213:554/cam/realmonitor?channel=1&subtype=1
          roles:
            - detect
        - path: rtsp://secret@192.168.1.213:554/cam/realmonitor?channel=1&subtype=0
          roles:
            - record
    detect:
      width: 704
      height: 480
      fps: 5
    record:
      enabled: true
      retain:
        days: 0
        mode: active_objects
      events:
        retain:
          default: 2
          mode: active_objects
          objects:
            person: 5
    objects:
      track:
        - person
        - car
    snapshots:
      enabled: true
      timestamp: false
      bounding_box: false
      crop: false
      quality: 100
      height: 500
      retain:
        default: 2
        objects:
          person: 5
    mqtt:
      timestamp: false
      bounding_box: false
      crop: true
      quality: 100
      height: 500

  front_door_bell:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://secret@192.168.1.95:554/cam/realmonitor?channel=1&subtype=1
          input_args: preset-rtsp-restream
          roles:
            - detect
        - path: rtsp://secret8@192.168.1.95:554/cam/realmonitor?channel=1&subtype=0
          input_args: preset-rtsp-restream
          roles:
            - record
    detect:
      width: 640
      height: 480
      fps: 5
    record:
      enabled: true
      retain:
        days: 0
        mode: active_objects
      events:
        retain:
          default: 2
          mode: active_objects
          objects:
            person: 5
    objects:
      track:
        - person
    snapshots:
      enabled: true
      timestamp: false
      bounding_box: false
      crop: false
      quality: 100
      height: 1000
      retain:
        default: 2
        objects:
          person: 5
    mqtt:
      timestamp: false
      bounding_box: false
      crop: true
      quality: 100
      height: 1000

  Alley_Wyze3:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://secret@192.168.1.231/ch1
          input_args: preset-rtsp-restream
          roles:
            - detect
        - path: rtsp://secret@192.168.1.231/ch0
          input_args: preset-rtsp-restream
          roles:
            - record
    detect:
      width: 640
      height: 360
      fps: 5
    record:
      enabled: true
      retain:
        days: 0
        mode: active_objects
      events:
        retain:
          default: 2
          mode: active_objects
          objects:
            person: 5
    objects:
      track:
        - person
        - car
    snapshots:
      enabled: true
      timestamp: false
      bounding_box: false
      crop: false
      quality: 100
      height: 500
      retain:
        default: 2
        objects:
          person: 5
    mqtt:
      timestamp: false
      bounding_box: false
      crop: true
      quality: 100
      height: 500

#  Alley_Wyze4:
#    enabled: true
#    ffmpeg:
#      inputs:
#        - path: rtsp://secret@192.168.1.127/ch1
#          input_args: preset-rtsp-restream
#          roles:
#            - detect
#        - path: rtsp://secret@192.168.1.127/ch1
#          input_args: preset-rtsp-restream
#          roles:
#            - record
#    detect:
#      width: 640
#      height: 360
#      fps: 5
#    record:
#      enabled: true
#      retain:
#        days: 0
#        mode: active_objects
#      events:
#        retain:
#          default: 2
#          mode: active_objects
#          objects:
#            person: 5
#    objects:
#      track:
#        - person
#        - car
#    snapshots:
#      enabled: true
#      timestamp: false
#      bounding_box: false
#      crop: false
#      quality: 100
#      height: 500
#      retain:
#        default: 2
#        objects:
#          person: 5
#    mqtt:
#      timestamp: false
#      bounding_box: false
#      crop: true
#      quality: 100
#      height: 500
version: 0.14

docker-compose file or Docker CLI command

version: "3.9"
services:
  frigate:
    container_name: frigate
    privileged: true # this may not be necessary for all setups
    restart: unless-stopped
    image: ghcr.io/blakeblackshear/frigate:0.14.1
    shm_size: "64mb" # update for your cameras based on calculation above
    deploy:    # <------------- Add this section
      resources:
        reservations:
          devices:
            - driver: nvidia
              count: 1 # number of GPUs
              capabilities: [gpu]
    devices:
#      - /dev/bus/usb:/dev/bus/usb
      - /dev/apex_0:/dev/apex_0 
#      - /dev/dri/renderD128
      - /dev/nvidia-caps:/dev/nvidia-caps
      - /dev/nvidia0:/dev/nvidia0
      - /dev/nvidiactl:/dev/nvidiactl
      - /dev/nvidia-modeset:/dev/nvidia-modeset
      - /dev/nvidia-uvm:/dev/nvidia-uvm
      - /dev/nvidia-uvm-tools:/dev/nvidia-uvm-tools
    volumes:
      - /etc/localtime:/etc/localtime:ro
      - /home/server/frigate/:/config/
      - /mnt/frigate:/media/frigate
      - type: tmpfs # Optional: 1GB of memory, reduces SSD/SD Card wear
        target: /tmp/cache
        tmpfs:
          size: 1000000000
    ports:
      - "5000:5000"
      - "8554:8554" # RTSP feeds
      - "8555:8555/tcp" # WebRTC over tcp
      - "8555:8555/udp" # WebRTC over udp
    environment:
      - NVIDIA_VISIBLE_DEVICES=all
      - NVIDIA_DRIVER_CAPABILITIES=compute,video,utility

Relevant Frigate log output

s6-rc: info: service go2rtc: starting
s6-rc: info: service certsync-log successfully started
s6-rc: info: service go2rtc successfully started
s6-rc: info: service go2rtc-healthcheck: starting
s6-rc: info: service frigate: starting
s6-rc: info: service go2rtc-healthcheck successfully started
s6-rc: info: service frigate successfully started
s6-rc: info: service nginx: starting
2024-10-28 15:37:33.634265641  [INFO] Preparing Frigate...
2024-10-28 15:37:33.635792032  [INFO] Preparing new go2rtc config...
2024-10-28 15:37:33.636256963  [INFO] Starting NGINX...
2024-10-28 15:37:33.646521078  [INFO] Starting Frigate...
2024-10-28 15:37:33.968083629  [INFO] Starting go2rtc...
2024-10-28 15:37:34.098559250  15:37:34.098 INF go2rtc platform=linux/amd64 revision=b2399f3 version=1.9.2
2024-10-28 15:37:34.098568381  15:37:34.098 INF config path=/dev/shm/go2rtc.yaml
2024-10-28 15:37:34.098869366  15:37:34.098 INF [rtsp] listen addr=:8554
2024-10-28 15:37:34.098963636  15:37:34.098 INF [webrtc] listen addr=:8555/tcp
2024-10-28 15:37:34.099032942  15:37:34.098 INF [api] listen addr=:1984
s6-rc: info: service nginx successfully started
s6-rc: info: service certsync: starting
s6-rc: info: service certsync successfully started
s6-rc: info: service legacy-services: starting
2024-10-28 15:37:34.753317717  [INFO] Starting certsync...
s6-rc: info: service legacy-services successfully started
2024-10-28 15:37:34.848171617  127.0.0.1 - - [28/Oct/2024:15:37:34 -0600] "" 400 0 "-" "-" "-"
2024-10-28 15:37:34.989522465  [2024-10-28 15:37:34] frigate.app                    INFO    : Starting Frigate (0.14.1-f4f3cfa)
2024-10-28 15:37:34.989740265  [2024-10-28 15:37:34] frigate.util.config            INFO    : Checking if frigate config needs migration...
2024-10-28 15:37:35.062945812  [2024-10-28 15:37:35] frigate.util.config            INFO    : frigate config does not need migration...
2024-10-28 15:37:35.124860124  [2024-10-28 15:37:35] peewee_migrate.logs            INFO    : Starting migrations
2024-10-28 15:37:35.125504317  [2024-10-28 15:37:35] peewee_migrate.logs            INFO    : There is nothing to migrate
2024-10-28 15:37:35.135882650  [2024-10-28 15:37:35] frigate.app                    INFO    : Recording process started: 353
2024-10-28 15:37:35.141436828  [2024-10-28 15:37:35] frigate.app                    INFO    : Recording process started: 354
2024-10-28 15:37:35.144069988  [2024-10-28 15:37:35] frigate.app                    INFO    : go2rtc process pid: 96
2024-10-28 15:37:35.182285525  [2024-10-28 15:37:35] detector.coral_pci             INFO    : Starting detection process: 383
2024-10-28 15:37:35.187219723  [2024-10-28 15:37:35] frigate.app                    INFO    : Output process started: 385
2024-10-28 15:37:35.197068847  [2024-10-28 15:37:35] frigate.detectors.plugins.edgetpu_tfl INFO    : Attempting to load TPU as pci
2024-10-28 15:37:35.202245659  [2024-10-28 15:37:35] frigate.detectors.plugins.edgetpu_tfl INFO    : TPU found
2024-10-28 15:37:35.229336783  [2024-10-28 15:37:35] frigate.app                    INFO    : Camera processor started for Front_Door_Wyze2: 418
2024-10-28 15:37:35.236809422  [2024-10-28 15:37:35] frigate.app                    INFO    : Camera processor started for driveway: 428
2024-10-28 15:37:35.246445957  [2024-10-28 15:37:35] frigate.app                    INFO    : Camera processor started for garage: 436
2024-10-28 15:37:35.255327726  [2024-10-28 15:37:35] frigate.app                    INFO    : Camera processor started for Backyard_V3: 442
2024-10-28 15:37:35.265321479  [2024-10-28 15:37:35] frigate.app                    INFO    : Camera processor started for front_door_bell: 456
2024-10-28 15:37:35.275248934  [2024-10-28 15:37:35] frigate.app                    INFO    : Camera processor started for Alley_Wyze3: 470
2024-10-28 15:37:35.283628078  [2024-10-28 15:37:35] frigate.app                    INFO    : Capture process started for Front_Door_Wyze2: 483
2024-10-28 15:37:35.292616227  [2024-10-28 15:37:35] frigate.app                    INFO    : Capture process started for driveway: 489
2024-10-28 15:37:35.307683560  [2024-10-28 15:37:35] frigate.app                    INFO    : Capture process started for garage: 499
2024-10-28 15:37:35.316039456  [2024-10-28 15:37:35] frigate.app                    INFO    : Capture process started for Backyard_V3: 505
2024-10-28 15:37:35.322831706  [2024-10-28 15:37:35] frigate.app                    INFO    : Capture process started for front_door_bell: 514
2024-10-28 15:37:35.325297861  [2024-10-28 15:37:35] frigate.app                    INFO    : Capture process started for Alley_Wyze3: 523
2024-10-28 15:37:43.632313873  [INFO] Starting go2rtc healthcheck service...

Relevant go2rtc log output

N/A

FFprobe output from your camera

root@c94c6651fa44:/opt/frigate# ffprobe rtsp://secret@192.168.1.107/ch1
ffprobe version n5.1-2-g915ef932a3-20220731 Copyright (c) 2007-2022 the FFmpeg developers
  built with gcc 12.1.0 (crosstool-NG 1.25.0.55_3defb7b)
  configuration: --prefix=/ffbuild/prefix --pkg-config-flags=--static --pkg-config=pkg-config --cross-prefix=x86_64-ffbuild-linux-gnu- --arch=x86_64 --target-os=linux --enable-gpl --enable-version3 --disable-debug --enable-iconv --enable-libxml2 --enable-zlib --enable-libfreetype --enable-libfribidi --enable-gmp --enable-lzma --enable-fontconfig --enable-libvorbis --enable-opencl --enable-libpulse --enable-libvmaf --enable-libxcb --enable-xlib --enable-amf --enable-libaom --enable-libaribb24 --enable-avisynth --enable-libdav1d --enable-libdavs2 --disable-libfdk-aac --enable-ffnvcodec --enable-cuda-llvm --enable-frei0r --enable-libgme --enable-libass --enable-libbluray --enable-libjxl --enable-libmp3lame --enable-libopus --enable-mbedtls --enable-librist --enable-libtheora --enable-libvpx --enable-libwebp --enable-lv2 --enable-libmfx --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenh264 --enable-libopenjpeg --enable-libopenmpt --enable-librav1e --enable-librubberband --disable-schannel --enable-sdl2 --enable-libsoxr --enable-libsrt --enable-libsvtav1 --enable-libtwolame --enable-libuavs3d --enable-libdrm --enable-vaapi --enable-libvidstab --enable-vulkan --enable-libshaderc --enable-libplacebo --enable-libx264 --enable-libx265 --enable-libxavs2 --enable-libxvid --enable-libzimg --enable-libzvbi --extra-cflags=-DLIBTWOLAME_STATIC --extra-cxxflags= --extra-ldflags=-pthread --extra-ldexeflags=-pie --extra-libs='-ldl -lgomp' --extra-version=20220731
  libavutil      57. 28.100 / 57. 28.100
  libavcodec     59. 37.100 / 59. 37.100
  libavformat    59. 27.100 / 59. 27.100
  libavdevice    59.  7.100 / 59.  7.100
  libavfilter     8. 44.100 /  8. 44.100
  libswscale      6.  7.100 /  6.  7.100
  libswresample   4.  7.100 /  4.  7.100
  libpostproc    56.  6.100 / 56.  6.100
Input #0, rtsp, from 'rtsp://thingino:thingino@192.168.1.107/ch1':
  Metadata:
    title           : thingino prudynt
    comment         : Sub
  Duration: N/A, start: 0.095078, bitrate: N/A
  Stream #0:0: Video: h264 (High), yuv420p(tv, bt709, progressive), 640x360, 15 fps, 15 tbr, 90k tbn

Install method

Proxmox via Docker

Object Detector

Coral

Network connection

Wired

Camera make and model

multiple, reolink, wyze

Screenshots of the Frigate UI's System metrics pages

Any other information that may be helpful

took me a while to figure out how to install drivers and setup LXC config but now it seems like it should work but it does not look it.

NickM-27 · 2024-10-28T21:46:27Z

NickM-27
Oct 28, 2024
Collaborator Sponsor

everything looks to be working fine, perhaps nvidia-smi is just not working correctly?

2 replies

Vendo233 Oct 28, 2024
Author

Thank you Nicolas for such a quick response! appretiate it. Yes all looks and feels right, CPU ascilates around ~30%, was hoping the CPU would go down when GPU kicks in.
Tried to hide hwaccel line and Frigate continue working the same!
#hwaccel_args: preset-nvidia-h264
no idea.

NickM-27 Oct 28, 2024
Collaborator Sponsor

Tried to hide hwaccel line and Frigate continue working the same!

that is fine because Frigate detects hwaccel automatically if it is not set in the config

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[HW Accel Support]: Installed Nvidia-based GPU GT730, cannot get hw_accel to work #14645

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 1 comment 2 replies

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

Select a reply

[HW Accel Support]: Installed Nvidia-based GPU GT730, cannot get hw_accel to work #14645

Vendo233 Oct 28, 2024

Describe the problem you are having

Version

Frigate config file

docker-compose file or Docker CLI command

Relevant Frigate log output

Relevant go2rtc log output

FFprobe output from your camera

Install method

Object Detector

Network connection

Camera make and model

Screenshots of the Frigate UI's System metrics pages

Any other information that may be helpful

Replies: 1 comment · 2 replies

NickM-27 Oct 28, 2024 Collaborator Sponsor

Vendo233 Oct 28, 2024 Author

NickM-27 Oct 28, 2024 Collaborator Sponsor

Vendo233
Oct 28, 2024

Replies: 1 comment 2 replies

NickM-27
Oct 28, 2024
Collaborator Sponsor

Vendo233 Oct 28, 2024
Author

NickM-27 Oct 28, 2024
Collaborator Sponsor