[Support]: go2rtc 704% CPU Usage #14012

ph0nebooth · 2024-09-27T12:54:45Z

ph0nebooth
Sep 27, 2024

Describe the problem you are having

I noticed this morning the CPU fan in my Frigate PC going a little harder than it should. Upon investigation I saw that the go2rtc process was consuming 704% CPU usage. I'm not sure what has caused this issue because I haven't made any major changes to my config file for many weeks. The last changed related to an object mask (removing it).

Rebooting Frigate fixes the issue for a few hours.

There some errors relating to the camera "Kendra" - but they started after the high CPU kicked in.

Version

0.14.1-f4f3cfa

What browser(s) are you using?

Safari 20619.1.26.31.6

Frigate config file

objects:
  track:
    - person
    - car
tls:
  enabled: false

mqtt:
  enabled: true
  host: 192.168.178.253

auth:
  failed_login_rate_limit: 1/second;5/minute;20/hour
  trusted_proxies:
    - 172.16.0.0/12
    - 192.168.0.0./16

record:
  enabled: true
  retain:
    days: 7
    mode: all
  events:
    retain:
      default: 14 # <- number of days to keep event recordings
      mode: active_objects
snapshots:
  enabled: true

ffmpeg:
  hwaccel_args: preset-vaapi

go2rtc:
  streams:
    Doorbell:
      - rtsp://admin:redacted@192.168.178.120:554/h264Preview_01_sub
      - ffmpeg:Doorbell#audio=opus
    #Doorbell:
     # - ffmpeg:http://192.168.178.120/flv?port=1935&app=bcs&stream=channel0_main.bcs&user=admin&password=redacted#video=copy#audio=copy#audio=opus
     # - ffmpeg:Doorbell#audio=opus
     # - rtsp://192.168.178.120/Preview_01_sub
    #Doorbell_sub:
      #- ffmpeg:http://192.168.178.120/flv?port=1935&app=bcs&stream=channel0_ext.bcs&user=admin&password=redacted
    Driveway:
      - rtsp://cctv:redacted@192.168.178.203:554/cam/realmonitor?channel=1&subtype=0#backchannel=0
      - ffmpeg:Driveway#audio=opus
      - rtsp://cctv:redacted@192.168.178.203:554/cam/realmonitor?channel=1&subtype=0
    Driveway_sub:
      - rtsp://cctv:redacted@192.168.178.203:554/cam/realmonitor?channel=1&subtype=2#backchannel=0
      - ffmpeg:Driveway_sub#audio=opus
    Terrace:
      - rtsp://cctv:redacted@192.168.178.202:554/cam/realmonitor?channel=1&subtype=0#backchannel=0
      - ffmpeg:Terrace#audio=opus
      - rtsp://cctv:redacted@192.168.178.202:554/cam/realmonitor?channel=1&subtype=0
    Terrace_sub:
      - rtsp://cctv:redacted@192.168.178.202:554/cam/realmonitor?channel=1&subtype=2#backchannel=0
      - ffmpeg:Terrace_sub#audio=opus
    Backyard:
      - rtsp://cctv:redacted@192.168.178.201:554/cam/realmonitor?channel=1&subtype=0#backchannel=0
      - ffmpeg:Backyard#audio=opus
      - rtsp://cctv:redacted@192.168.178.201:554/cam/realmonitor?channel=1&subtype=0
    Backyard_sub:
      - rtsp://cctv:redacted@192.168.178.201:554/cam/realmonitor?channel=1&subtype=2#backchannel=0
      - ffmpeg:Backyard_sub#audio=opus
    Side:
      - rtsp://cctv:redacted@192.168.178.204:554/cam/realmonitor?channel=1&subtype=0#backchannel=0
      - ffmpeg:Side#audio=opus
      - rtsp://cctv:redacted@192.168.178.204:554/cam/realmonitor?channel=1&subtype=0
    Side_sub:
      - rtsp://cctv:redacted@192.168.178.204:554/cam/realmonitor?channel=1&subtype=2#backchannel=0
      - ffmpeg:Side_sub#audio=opus
    Kendra:
      - tapo://redacted@192.168.178.42
  webrtc:
    candidates:
      - WAN IP:8555
      - 103.94.50.2:8555

detectors:
  coral:
    type: edgetpu
    device: pci

cameras:
  Terrace: # <------ Name the camera
    enabled: true
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-copy
      inputs:
        - path: rtsp://127.0.0.1:8554/Terrace # <----- The stream you want to use for detection
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/Terrace_sub # <----- The stream you want to use for detection
          roles:
            - detect
    detect:
      enabled: true # <---- disable detection until you have a working camera feed
      fps: 10
    zones:
      Terrace_Main:
        coordinates: 0.095,0.099,0.228,0.085,0.241,0.314,0.354,0.491,0.739,0.997,0.192,0.997
        loitering_time: 0
        objects: person
      Terrace_Grass:
        coordinates: 
          0.457,0.303,0.695,0.226,0.997,0.401,0.996,0.84,0.609,0.503,0.409,0.578,0.253,0.305,0.451,0.307
        loitering_time: 0
        objects: person
    review:
      alerts:
        required_zones:
          - Terrace_Grass
          - Terrace_Main
      detections:
        required_zones:
          - Terrace_Grass
          - Terrace_Main
    motion:
      threshold: 30
      contour_area: 38
      improve_contrast: 'true'
      mask:
        - 0.223,0.29,0.233,0,0.373,0,0.501,0.271,0.507,0.312,0.516,0.431,0.347,0.487
        - 0.472,0.087,0.512,0.239,0.687,0.292,0.819,0.325,1,0.366,0.995,0.129,1,0,0.478,0
        - 0.395,0.573,0.613,0.484,0.692,0.521,0.695,0.406,0.661,0.293,0.786,0.3,0.787,0.333,0.745,0.361,0.722,0.57,0.805,0.611,0.837,0.517,0.824,0.315,0.984,0.352,0.871,0.552,0.846,0.66,0.994,0.829,0.998,0.993,0.72,0.991
    objects:
      filters:
        car: {}
  Backyard: # <------ Name the camera
    enabled: true
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-copy
      inputs:
        - path: rtsp://127.0.0.1:8554/Backyard # <----- The stream you want to use for detection
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/Backyard_sub # <----- The stream you want to use for detection
          roles:
            - detect
    detect:
      enabled: true # <---- disable detection until you have a working camera feed
      fps: 10
    motion:
      threshold: 30
      contour_area: 38
      improve_contrast: 'true'
      mask:
        - 0,0.291,0,0,0.378,0,0.623,0,0.613,0.154,0.285,0.202,0.157,0.288
        - 0.686,0.037,0.963,0.035,0.964,0.089,0.687,0.087
    zones:
      Backyard_Main:
        coordinates: 
          0.003,0.307,0.283,0.103,0.674,0.052,0.84,0.085,0.997,0.146,0.997,0.995,0.003,0.991
        loitering_time: 0
        objects: person
    review:
      alerts:
        required_zones: Backyard_Main
      detections:
        required_zones: Backyard_Main
  Doorbell: # <------ Name the camera
    enabled: true
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-copy
      inputs:
        - path: rtsp://127.0.0.1:8554/Doorbell # <----- The stream you want to use for detection
          input_args: preset-rtsp-restream
    motion:
      threshold: 30
      contour_area: 38
      improve_contrast: 'true'
      mask:
        - 0.614,0.68,0.613,0.392,0.93,0.275,0.951,0.419,0.945,0.576,0.927,0.717,0.9,0.845
        - 0.002,0.96,0.295,0.96,0.293,0.997,0.002,0.997
    zones:
      Doorbell_Main:
        coordinates: 0.002,0,0.998,0.001,0.996,0.996,0.296,1,0,1
        loitering_time: 0
        objects: person
    objects:
      filters:
        car:
          mask: 0.613,0.396,0.93,0.278,0.946,0.57,0.902,0.841,0.615,0.674
    review:
      alerts:
        required_zones: Doorbell_Main
      detections:
        required_zones: Doorbell_Main
  Driveway: # <------ Name the camera
    enabled: true
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-copy
      inputs:
        - path: rtsp://127.0.0.1:8554/Driveway # <----- The stream you want to use for detection
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/Driveway_sub # <----- The stream you want to use for detection
          roles:
            - detect
    detect:
      enabled: true # <---- disable detection until you have a working camera feed
      fps: 5
    motion:
      threshold: 30
      contour_area: 32
      improve_contrast: 'true'
      mask:
        - 0.409,0.096,0.407,0,0.997,0.003,1,0.326,0.605,0.085
        - 0.74,0.915,0.814,0.439,0.821,0.406,1,0.486,0.997,0.998
    objects:
      filters:
        car:
          mask:
            - 0.407,0.004,0.999,0,0.999,0.328,0.609,0.084,0.413,0.092
            - 0.812,0.223,0.941,0.296,0.946,0.413,0.793,0.382
    zones:
      Driveway_Main:
        coordinates: 0.003,0.118,0.405,0.003,0.414,0.098,0.602,0.089,1,0.317,1,1,0,0.998
        inertia: 3
        loitering_time: 0
    review:
      alerts:
        required_zones: Driveway_Main
      detections:
        required_zones: Driveway_Main
  Side: # <------ Name the camera
    enabled: true
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-copy
      inputs:
        - path: rtsp://127.0.0.1:8554/Side
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/Side_sub # <----- The stream you want to use for detection
          roles:
            - detect
    detect:
      enabled: true # <---- disable detection until you have a working camera feed
      fps: 5
    motion:
      threshold: 30
      contour_area: 38
      improve_contrast: 'true'
      mask:
        - 0.145,0.13,0.645,0.091,1,0.149,0.989,0.323,0.994,0.579,0.235,0.185,0.145,0.193
        - 0.442,0.041,0.935,0.039,0.938,0.08,0.438,0.084
    objects:
      filters:
        car: {}
    zones:
      Side_Main:
        coordinates: 
          0.146,0.199,0.241,0.189,0.994,0.593,0.994,0.988,0.004,0.996,0.013,0.084,0.148,0.083
        loitering_time: 0
        objects: person
    review:
      alerts:
        required_zones: Side_Main
      detections:
        required_zones: Side_Main
  Kendra:
    enabled: true
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-copy
      inputs:
        - path: rtsp://127.0.0.1:8554/Kendra
          input_args: preset-rtsp-restream
    detect:
      enabled: true
      fps: 5
    motion:
      threshold: 30
      contour_area: 38
      improve_contrast: 'true'
    zones:
      Kendra_Main:
        coordinates: 0.379,0.466,0.752,0.543,0.742,1,0.234,1
        loitering_time: 0
        objects: person
version: 0.14

Relevant Frigate log output

2024-09-27 12:06:25.226288732  [2024-09-27 12:06:25] ffmpeg.Kendra.detect           ERROR   :     Last message repeated 1 times
2024-09-27 12:06:50.835240465  [2024-09-27 12:06:50] frigate.video                  ERROR   : Kendra: Unable to read frames from ffmpeg process.
2024-09-27 12:06:50.835388653  [2024-09-27 12:06:50] frigate.video                  ERROR   : Kendra: ffmpeg process is not running. exiting capture thread...
2024-09-27 12:06:55.239626313  [2024-09-27 12:06:55] watchdog.Kendra                ERROR   : Ffmpeg process crashed unexpectedly for Kendra.
2024-09-27 12:06:55.239689411  [2024-09-27 12:06:55] watchdog.Kendra                ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-09-27 12:06:55.239753341  [2024-09-27 12:06:55] ffmpeg.Kendra.detect           ERROR   : [segment @ 0x6381cefa1040] Timestamps are unset in a packet for stream 0. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly
2024-09-27 12:06:55.239805709  [2024-09-27 12:06:55] ffmpeg.Kendra.detect           ERROR   : [segment @ 0x6381cefa1040] Non-monotonous DTS in output stream 0:0; previous: 0, current: 0; changing to 1. This may result in incorrect timestamps in the output file.
2024-09-27 12:06:55.239852336  [2024-09-27 12:06:55] ffmpeg.Kendra.detect           ERROR   : rtsp://127.0.0.1:8554/Kendra: Connection timed out
2024-09-27 12:06:55.239897932  [2024-09-27 12:06:55] ffmpeg.Kendra.detect           ERROR   :     Last message repeated 1 times
2024-09-27 12:26:07.764894571  [2024-09-27 12:26:07] frigate.video                  ERROR   : Kendra: Unable to read frames from ffmpeg process.
2024-09-27 12:26:07.765128119  [2024-09-27 12:26:07] frigate.video                  ERROR   : Kendra: ffmpeg process is not running. exiting capture thread...
2024-09-27 12:26:15.267355738  [2024-09-27 12:26:15] watchdog.Kendra                ERROR   : Ffmpeg process crashed unexpectedly for Kendra.
2024-09-27 12:26:15.267432902  [2024-09-27 12:26:15] watchdog.Kendra                ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-09-27 12:26:15.267493175  [2024-09-27 12:26:15] ffmpeg.Kendra.detect           ERROR   : [segment @ 0x596c30e6a380] Timestamps are unset in a packet for stream 0. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly
2024-09-27 12:26:15.267537438  [2024-09-27 12:26:15] ffmpeg.Kendra.detect           ERROR   : [segment @ 0x596c30e6a380] Non-monotonous DTS in output stream 0:0; previous: 0, current: 0; changing to 1. This may result in incorrect timestamps in the output file.
2024-09-27 12:26:15.267571992  [2024-09-27 12:26:15] ffmpeg.Kendra.detect           ERROR   : rtsp://127.0.0.1:8554/Kendra: Connection timed out
2024-09-27 12:26:15.267606697  [2024-09-27 12:26:15] ffmpeg.Kendra.detect           ERROR   :     Last message repeated 1 times
2024-09-27 12:29:23.229801152  [2024-09-27 12:29:23] frigate.video                  ERROR   : Kendra: Unable to read frames from ffmpeg process.
2024-09-27 12:29:23.230019060  [2024-09-27 12:29:23] frigate.video                  ERROR   : Kendra: ffmpeg process is not running. exiting capture thread...
2024-09-27 12:29:25.283672616  [2024-09-27 12:29:25] watchdog.Kendra                ERROR   : Ffmpeg process crashed unexpectedly for Kendra.
2024-09-27 12:29:25.283746875  [2024-09-27 12:29:25] watchdog.Kendra                ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-09-27 12:29:25.283811336  [2024-09-27 12:29:25] ffmpeg.Kendra.detect           ERROR   : [segment @ 0x6159bd019ec0] Timestamps are unset in a packet for stream 0. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly
2024-09-27 12:29:25.283872771  [2024-09-27 12:29:25] ffmpeg.Kendra.detect           ERROR   : [segment @ 0x6159bd019ec0] Non-monotonous DTS in output stream 0:0; previous: 0, current: 0; changing to 1. This may result in incorrect timestamps in the output file.
2024-09-27 12:29:25.283931260  [2024-09-27 12:29:25] ffmpeg.Kendra.detect           ERROR   : rtsp://127.0.0.1:8554/Kendra: Connection timed out
2024-09-27 12:30:23.019200167  [2024-09-27 12:30:23] frigate.video                  ERROR   : Kendra: Unable to read frames from ffmpeg process.
2024-09-27 12:30:23.019427212  [2024-09-27 12:30:23] frigate.video                  ERROR   : Kendra: ffmpeg process is not running. exiting capture thread...
2024-09-27 12:30:25.300023057  [2024-09-27 12:30:25] watchdog.Kendra                ERROR   : Ffmpeg process crashed unexpectedly for Kendra.
2024-09-27 12:30:25.300077820  [2024-09-27 12:30:25] watchdog.Kendra                ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-09-27 12:30:25.300120199  [2024-09-27 12:30:25] ffmpeg.Kendra.detect           ERROR   : [segment @ 0x55e402e5d580] Timestamps are unset in a packet for stream 0. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly
2024-09-27 12:30:25.300161446  [2024-09-27 12:30:25] ffmpeg.Kendra.detect           ERROR   : [segment @ 0x55e402e5d580] Non-monotonous DTS in output stream 0:0; previous: 0, current: 0; changing to 1. This may result in incorrect timestamps in the output file.
2024-09-27 12:30:25.300192725  [2024-09-27 12:30:25] ffmpeg.Kendra.detect           ERROR   : rtsp://127.0.0.1:8554/Kendra: Connection timed out
2024-09-27 12:30:25.300228862  [2024-09-27 12:30:25] ffmpeg.Kendra.detect           ERROR   :     Last message repeated 1 times
2024-09-27 12:38:51.490994510  [2024-09-27 12:38:51] frigate.video                  ERROR   : Kendra: Unable to read frames from ffmpeg process.
2024-09-27 12:38:51.491331891  [2024-09-27 12:38:51] frigate.video                  ERROR   : Kendra: ffmpeg process is not running. exiting capture thread...
2024-09-27 12:38:55.338246556  [2024-09-27 12:38:55] watchdog.Kendra                ERROR   : Ffmpeg process crashed unexpectedly for Kendra.
2024-09-27 12:38:55.338386879  [2024-09-27 12:38:55] watchdog.Kendra                ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-09-27 12:38:55.338389424  [2024-09-27 12:38:55] ffmpeg.Kendra.detect           ERROR   : [segment @ 0x5b33fde8f580] Timestamps are unset in a packet for stream 0. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly
2024-09-27 12:38:55.338402478  [2024-09-27 12:38:55] ffmpeg.Kendra.detect           ERROR   : [segment @ 0x5b33fde8f580] Non-monotonous DTS in output stream 0:0; previous: 0, current: 0; changing to 1. This may result in incorrect timestamps in the output file.
2024-09-27 12:38:55.338440309  [2024-09-27 12:38:55] ffmpeg.Kendra.detect           ERROR   : rtsp://127.0.0.1:8554/Kendra: Connection timed out
2024-09-27 12:38:55.338491294  [2024-09-27 12:38:55] ffmpeg.Kendra.detect           ERROR   :     Last message repeated 1 times

Relevant go2rtc log output

2024-09-27 04:12:35.685077608  [INFO] Preparing new go2rtc config...
2024-09-27 04:12:36.175864716  [INFO] Not injecting WebRTC candidates into go2rtc config as it has been set manually
2024-09-27 04:12:36.229599458  [INFO] Starting go2rtc...
2024-09-27 04:12:36.320344231  04:12:36.320 INF go2rtc platform=linux/amd64 revision=b2399f3 version=1.9.2
2024-09-27 04:12:36.320366332  04:12:36.320 INF config path=/dev/shm/go2rtc.yaml
2024-09-27 04:12:36.320807758  04:12:36.320 INF [rtsp] listen addr=:8554
2024-09-27 04:12:36.320835250  04:12:36.320 INF [api] listen addr=:1984
2024-09-27 04:12:36.322138479  04:12:36.322 INF [webrtc] listen addr=:8555
2024-09-27 04:12:45.681666482  [INFO] Starting go2rtc healthcheck service...

FFprobe output from your camera

{
  "producers": [
    {
      "type": "Tapo active producer",
      "medias": [
        "video, recvonly, H264",
        "audio, recvonly, PCMA/8000",
        "audio, sendonly, PCMA/8000"
      ],
      "receivers": [
        "255 H264, bytes=82074007, senders=2",
        "8 PCMA/8000, bytes=5865600, senders=1"
      ],
      "senders": [
        "0 ANY, bytes=0, receivers=1"
      ],
      "recv": 93506624
    }
  ],
  "consumers": [
    {
      "type": "RTSP passive consumer",
      "url": "rtsp://127.0.0.1:8554/Kendra",
      "remote_addr": "127.0.0.1:53314",
      "user_agent": "FFmpeg Frigate/0.14.1-f4f3cfa",
      "sdp": "v=0\r\no=- 1 1 IN IP4 0.0.0.0\r\ns=go2rtc/1.9.2\r\nc=IN IP4 0.0.0.0\r\nt=0 0\r\nm=video 0 RTP/AVP 96\r\na=rtpmap:96 H264/90000\r\na=control:trackID=0\r\n",
      "medias": [
        "video, sendonly, H264, H265",
        "audio, sendonly, MPEG4-GENERIC"
      ],
      "senders": [
        "96 H264, bytes=82074007, receivers=1"
      ],
      "send": 83140606
    },
    {
      "type": "probe",
      "remote_addr": "192.168.178.138:49212",
      "user_agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/18.0 Safari/605.1.15",
      "medias": [
        "video, sendonly, ALL",
        "audio, sendonly, ALL",
        "audio, recvonly, ANY"
      ],
      "receivers": [
        "0 ANY, bytes=0, senders=1"
      ],
      "senders": [
        "255 H264, bytes=0, receivers=1",
        "8 PCMA/8000, bytes=0, receivers=1"
      ]
    }
  ]
}

Frigate stats

{"cameras":{"Backyard":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":10.1,"capture_pid":610,"detection_enabled":false,"detection_fps":0.0,"ffmpeg_pid":617,"pid":546,"process_fps":10.1,"skipped_fps":0.0},"Doorbell":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":5.0,"capture_pid":614,"detection_enabled":true,"detection_fps":0.0,"ffmpeg_pid":627,"pid":558,"process_fps":5.0,"skipped_fps":0.0},"Driveway":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":5.0,"capture_pid":626,"detection_enabled":true,"detection_fps":0.1,"ffmpeg_pid":635,"pid":570,"process_fps":5.0,"skipped_fps":0.0},"Kendra":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":5.0,"capture_pid":639,"detection_enabled":false,"detection_fps":0.0,"ffmpeg_pid":252395,"pid":590,"process_fps":5.0,"skipped_fps":0.0},"Side":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":5.0,"capture_pid":633,"detection_enabled":true,"detection_fps":0.0,"ffmpeg_pid":643,"pid":576,"process_fps":5.0,"skipped_fps":0.0},"Terrace":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":10.1,"capture_pid":595,"detection_enabled":true,"detection_fps":10.1,"ffmpeg_pid":611,"pid":539,"process_fps":10.1,"skipped_fps":0.0}},"cpu_usages":{"1":{"cmdline":"/package/admin/s6/command/s6-svscan -d4 -- /run/service","cpu":"0.0","cpu_average":"0","mem":"0.0"},"106":{"cmdline":"bash ./run.user go2rtc-healthcheck","cpu":"0.0","cpu_average":"0","mem":"0.0"},"107":{"cmdline":"python3 -u -m frigate","cpu":"3.1","cpu_average":"2","mem":"1.7"},"121":{"cmdline":"nginx: master process nginx","cpu":"0.0","cpu_average":"0","mem":"0.0"},"15":{"cmdline":"s6-supervise s6-linux-init-shutdownd","cpu":"0.0","cpu_average":"0","mem":"0.0"},"16":{"cmdline":"/package/admin/s6-linux-init/command/s6-linux-init-shutdownd -c /run/s6/basedir -g 3000 -C -B","cpu":"0.0","cpu_average":"0","mem":"0.0"},"160":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"161":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"162":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"163":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"176":{"cmdline":"nginx: cache manager process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"24":{"cmdline":"s6-supervise nginx","cpu":"0.0","cpu_average":"0","mem":"0.0"},"249298":{"cmdline":"sleep 9999","cpu":"0.0","cpu_average":"0","mem":"0.0"},"25":{"cmdline":"s6-supervise frigate","cpu":"0.0","cpu_average":"0","mem":"0.0"},"252395":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.14.1-f4f3cfa -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/Kendra -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy /tmp/cache/Kendra@%Y%m%d%H%M%S%z.mp4 -r 5 -vf fps=5,scale_vaapi=w=2304:h=1296:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:","cpu":"3.7","cpu_average":"3","mem":"0.4"},"26":{"cmdline":"s6-supervise go2rtc-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"260400":{"cmdline":"sleep 30s","cpu":"0.0","cpu_average":"0","mem":"0.0"},"27":{"cmdline":"s6-supervise s6rc-fdholder","cpu":"0.0","cpu_average":"0","mem":"0.0"},"28":{"cmdline":"s6-supervise go2rtc-healthcheck","cpu":"0.0","cpu_average":"0","mem":"0.0"},"29":{"cmdline":"s6-supervise nginx-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"30":{"cmdline":"s6-supervise frigate-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"30733":{"cmdline":"/usr/bin/python3 -c from multiprocessing.resource_tracker import main;main(56)","cpu":"0.0","cpu_average":"0","mem":"0.0"},"31":{"cmdline":"s6-supervise go2rtc","cpu":"0.0","cpu_average":"0","mem":"0.0"},"32":{"cmdline":"s6-supervise certsync-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"326":{"cmdline":"bash ./run.user certsync","cpu":"0.0","cpu_average":"0","mem":"0.0"},"33":{"cmdline":"s6-supervise certsync","cpu":"0.0","cpu_average":"0","mem":"0.0"},"34":{"cmdline":"s6-supervise s6rc-oneshot-runner","cpu":"0.0","cpu_average":"0","mem":"0.0"},"356":{"cmdline":"frigate.logger       ","cpu":"0.0","cpu_average":"0","mem":"0.4"},"45":{"cmdline":"/package/admin/s6-2.11.3.2/command/s6-fdholderd -1 -i data/rules","cpu":"0.0","cpu_average":"0","mem":"0.0"},"46":{"cmdline":"/package/admin/s6/command/s6-ipcserverd -1 -- /package/admin/s6/command/s6-ipcserver-access -v0 -E -l0 -i data/rules -- /package/admin/s6/command/s6-sudod -t 30000 -- /package/admin/s6-rc/command/s6-rc-oneshot-run -l ../.. --","cpu":"0.0","cpu_average":"0","mem":"0.0"},"470":{"cmdline":"frigate.recording_manager","cpu":"3.2","cpu_average":"2","mem":"0.5"},"472":{"cmdline":"frigate.review_segment_manager","cpu":"0.7","cpu_average":"0","mem":"0.5"},"498":{"cmdline":"/usr/bin/python3 -c from multiprocessing.resource_tracker import main;main(67)","cpu":"0.2","cpu_average":"0","mem":"0.0"},"499":{"cmdline":"frigate.detector.coral","cpu":"1.6","cpu_average":"1","mem":"0.5"},"501":{"cmdline":"frigate.output       ","cpu":"4.6","cpu_average":"3","mem":"0.5"},"519":{"cmdline":"ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -threads 1 -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"524":{"cmdline":"ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -threads 1 -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"538":{"cmdline":"ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 640x480 -i pipe: -threads 1 -f mpegts -s 960x720 -codec:v mpeg1video -q 8 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"539":{"cmdline":"frigate.process:Terrace","cpu":"14.0","cpu_average":"8","mem":"0.6"},"546":{"cmdline":"frigate.process:Backyard","cpu":"1.5","cpu_average":"1","mem":"0.6"},"550":{"cmdline":"ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -threads 1 -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"558":{"cmdline":"frigate.process:Doorbell","cpu":"0.7","cpu_average":"0","mem":"0.5"},"570":{"cmdline":"frigate.process:Driveway","cpu":"1.1","cpu_average":"2","mem":"0.6"},"571":{"cmdline":"ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 720x1280 -i pipe: -threads 1 -f mpegts -s 405x720 -codec:v mpeg1video -q 8 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"576":{"cmdline":"frigate.process:Side ","cpu":"0.6","cpu_average":"0","mem":"0.6"},"589":{"cmdline":"ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 2304x1296 -i pipe: -threads 1 -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"590":{"cmdline":"frigate.process:Kendra","cpu":"0.9","cpu_average":"0","mem":"0.6"},"595":{"cmdline":"frigate.capture:Terrace","cpu":"2.5","cpu_average":"2","mem":"0.4"},"609":{"cmdline":"ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -threads 1 -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"610":{"cmdline":"frigate.capture:Backyard","cpu":"2.4","cpu_average":"2","mem":"0.4"},"611":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.14.1-f4f3cfa -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://127.0.0.1:8554/Terrace_sub -r 10 -vf fps=10,scale_vaapi=w=1280:h=720:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:","cpu":"4.1","cpu_average":"3","mem":"0.3"},"614":{"cmdline":"frigate.capture:Doorbell","cpu":"0.4","cpu_average":"0","mem":"0.4"},"617":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.14.1-f4f3cfa -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://127.0.0.1:8554/Backyard_sub -r 10 -vf fps=10,scale_vaapi=w=1280:h=720:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:","cpu":"4.3","cpu_average":"3","mem":"0.3"},"625":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.14.1-f4f3cfa -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/Terrace -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy /tmp/cache/Terrace@%Y%m%d%H%M%S%z.mp4","cpu":"0.4","cpu_average":"0","mem":"0.1"},"626":{"cmdline":"frigate.capture:Driveway","cpu":"1.2","cpu_average":"1","mem":"0.4"},"627":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.14.1-f4f3cfa -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/Doorbell -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy /tmp/cache/Doorbell@%Y%m%d%H%M%S%z.mp4 -r 5 -vf fps=5,scale_vaapi=w=640:h=480:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:","cpu":"1.1","cpu_average":"1","mem":"0.3"},"632":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.14.1-f4f3cfa -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/Backyard -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy /tmp/cache/Backyard@%Y%m%d%H%M%S%z.mp4","cpu":"0.4","cpu_average":"0","mem":"0.1"},"633":{"cmdline":"frigate.capture:Side ","cpu":"1.3","cpu_average":"1","mem":"0.4"},"635":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.14.1-f4f3cfa -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://127.0.0.1:8554/Driveway_sub -r 5 -vf fps=5,scale_vaapi=w=1280:h=720:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:","cpu":"2.3","cpu_average":"1","mem":"0.3"},"639":{"cmdline":"frigate.capture:Kendra","cpu":"3.8","cpu_average":"3","mem":"0.5"},"643":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.14.1-f4f3cfa -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://127.0.0.1:8554/Side_sub -r 5 -vf fps=5,scale_vaapi=w=720:h=1280:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:","cpu":"2.4","cpu_average":"2","mem":"0.3"},"650":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.14.1-f4f3cfa -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/Driveway -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy /tmp/cache/Driveway@%Y%m%d%H%M%S%z.mp4","cpu":"0.4","cpu_average":"0","mem":"0.1"},"654":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.14.1-f4f3cfa -rtsp_transport tcp -timeout 5000000 -i rtsp://127.0.0.1:8554/Side -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy /tmp/cache/Side@%Y%m%d%H%M%S%z.mp4","cpu":"0.3","cpu_average":"0","mem":"0.1"},"87":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/nginx","cpu":"0.0","cpu_average":"0","mem":"0.0"},"88":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/go2rtc","cpu":"0.0","cpu_average":"0","mem":"0.0"},"89":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/frigate","cpu":"0.0","cpu_average":"0","mem":"0.0"},"90":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/certsync","cpu":"0.0","cpu_average":"0","mem":"0.0"},"98":{"cmdline":"/usr/local/go2rtc/bin/go2rtc -config=/dev/shm/go2rtc.yaml","cpu":"704.3","cpu_average":"50","mem":"0.2"},"frigate.full_system":{"cpu":"65.0","mem":"15.8"}},"detection_fps":10.2,"detectors":{"coral":{"detection_start":0.0,"inference_speed":6.85,"pid":499}},"gpu_usages":{"amd-vaapi":{"gpu":"5.83%","mem":"71.89%"}},"processes":{"go2rtc":{"pid":98},"logger":{"pid":356},"recording":{"pid":470},"review_segment":{"pid":472}},"service":{"last_updated":1727441553,"latest_version":"0.14.1","storage":{"/dev/shm":{"free":496.9,"mount_type":"tmpfs","total":512.0,"used":15.1},"/media/frigate/clips":{"free":622182.4,"mount_type":"ext4","total":1876684.2,"used":1159099.4},"/media/frigate/recordings":{"free":622182.4,"mount_type":"ext4","total":1876684.2,"used":1159099.4},"/tmp/cache":{"free":896.2,"mount_type":"tmpfs","total":953.7,"used":57.5}},"temperatures":{"apex_0":42.55},"uptime":31169,"version":"0.14.1-f4f3cfa"}}

Operating system

Other Linux

Install method

Docker Compose

Object Detector

Coral

Network connection

Wired

Camera make and model

Dahua and Tapo

Screenshots of the Frigate UI's System metrics pages

Any other information that may be helpful

No response

NickM-27 · 2024-09-27T13:01:24Z

NickM-27
Sep 27, 2024
Collaborator Sponsor

probably best to check the go2rtc dashboard and see what the stream counts look like

1 reply

ph0nebooth Sep 27, 2024
Author

I had a peak initially and all stream counts are 1 (preload frigate-hass-card).

hawkeye217 · 2024-09-27T13:01:24Z

hawkeye217
Sep 27, 2024
Collaborator

If you haven't made any changes to Frigate recently, my first guess would be that the camera was just sending bad data.

Since you're using the tapo protocol, you might also want to see if there are any issues reported on the go2rtc github with it.

2 replies

ph0nebooth Sep 27, 2024
Author

Could be the Tapo camera. Worst case I'll disable it for 24hrs to see if the issue goes away.

hawkeye217 Sep 27, 2024
Collaborator

We've seen a fair number of users have issues with Tapo cameras.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Support]: go2rtc 704% CPU Usage #14012

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 2 comments 3 replies

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

Select a reply

[Support]: go2rtc 704% CPU Usage #14012

ph0nebooth Sep 27, 2024

Describe the problem you are having

Version

What browser(s) are you using?

Frigate config file

Relevant Frigate log output

Relevant go2rtc log output

FFprobe output from your camera

Frigate stats

Operating system

Install method

Object Detector

Network connection

Camera make and model

Screenshots of the Frigate UI's System metrics pages

Any other information that may be helpful

Replies: 2 comments · 3 replies

NickM-27 Sep 27, 2024 Collaborator Sponsor

ph0nebooth Sep 27, 2024 Author

hawkeye217 Sep 27, 2024 Collaborator

ph0nebooth Sep 27, 2024 Author

hawkeye217 Sep 27, 2024 Collaborator

ph0nebooth
Sep 27, 2024

Replies: 2 comments 3 replies

NickM-27
Sep 27, 2024
Collaborator Sponsor

ph0nebooth Sep 27, 2024
Author

hawkeye217
Sep 27, 2024
Collaborator

ph0nebooth Sep 27, 2024
Author

hawkeye217 Sep 27, 2024
Collaborator