[Config Support]: HighRes Stream not working properly in Homeassistant

[Remko76]

Describe the problem you are having

I use a Reolink RLC-410W camera with Frigate. This camera offers 2 rtsp streams (a high-res and a low-res). I have set Frigate up to use the high res for recording and the low-res for detection. Both streams run through go2rtc and it basically works fine within the Frigate Addon (running HAOS on a NUC).
When I try to view the stream in Homeassistant by use of the Frigate Card or the Picture card, the stream does not work. It only updates stale images every 1 or 2 seconds. When I watch the stream within the Frigate Addon it is just very smooth and without issues.

Version

0.14.1-f4f3cfa

Frigate config file

mqtt:
  host: 192.168.178.XX
  user: XXX
  password: XXXXX

ffmpeg:
  hwaccel_args: preset-vaapi
  output_args:
    record: preset-record-generic-audio-aac

detectors:
  coral:
    type: edgetpu
    device: usb

go2rtc:
  streams:
    achtertuin:
      - rtsp://USER:PASS@192.168.178.XXX:554/h264Preview_01_main
      - ffmpeg:achtertuin#audio=opus
    achtertuin_sub:
      - rtsp://USER:PASS@192.168.178.XXX:554/h264Preview_01_sub
      - ffmpeg:achtertuin_sub#audio=opus
  webrtc:
    candidates:
      - 127.0.0.1:8555
      - stun:8555

birdseye:
  enabled: true
  mode: continuous
#  width: 1280
#  height: 360
cameras: 
 achtertuin:
    ffmpeg:
      inputs:
        #High Res
        - path: rtsp://127.0.0.1:8554/achtertuin
          roles:
            - record
        #Low Res    
        - path: rtsp://127.0.0.1:8554/achtertuin_sub
          roles:
            - detect
    detect:
      enabled: true
      width: 640
      height: 360
      fps: 5
    snapshots:
      enabled: true
    record:
      enabled: true
      retain:
        days: 3
        mode: motion
      events:
        retain:
          default: 5
    objects:
      track:
        - person
        - cat
        - bird
      filters:
        person:
          threshold: 0.72
          min_area: 3500
    motion:
      mask:
        - 89,0,0,0,0,360,87,360,98,297,111,250,122,51
        - 640,0,640,360,544,360,467,321,411,270,506,239,547,208,568,0

Relevant Frigate log output

2024-11-12 10:57:24.208163288  [2024-11-12 11:57:24] frigate.app                    INFO    : Starting Frigate (0.14.1-f4f3cfa)
2024-11-12 10:57:24.208810111  [2024-11-12 11:57:24] frigate.app                    INFO    : Creating directory: /tmp/cache
2024-11-12 10:57:24.209564659  [2024-11-12 11:57:24] frigate.util.config            INFO    : Checking if frigate config needs migration...
2024-11-12 10:57:24.323424147  [2024-11-12 11:57:24] frigate.util.config            INFO    : frigate config does not need migration...
2024-11-12 10:57:24.424586232  [2024-11-12 11:57:24] peewee_migrate.logs            INFO    : Starting migrations
2024-11-12 10:57:24.426127729  [2024-11-12 11:57:24] peewee_migrate.logs            INFO    : There is nothing to migrate
2024-11-12 10:57:24.458368164  [2024-11-12 11:57:24] frigate.app                    INFO    : Recording process started: 349
2024-11-12 10:57:24.469461490  [2024-11-12 11:57:24] frigate.app                    INFO    : Recording process started: 351
2024-11-12 10:57:24.475889706  [2024-11-12 11:57:24] frigate.app                    INFO    : go2rtc process pid: 98
2024-11-12 10:57:24.528142535  [2024-11-12 11:57:24] detector.coral                 INFO    : Starting detection process: 378
2024-11-12 10:57:27.144176013  [2024-11-12 11:57:24] frigate.app                    INFO    : Output process started: 380
2024-11-12 10:57:27.144602197  [2024-11-12 11:57:24] frigate.app                    INFO    : Camera processor started for garage: 398
2024-11-12 10:57:27.150701250  [2024-11-12 11:57:24] frigate.detectors.plugins.edgetpu_tfl INFO    : Attempting to load TPU as usb
2024-11-12 10:57:27.152117911  [2024-11-12 11:57:27] frigate.detectors.plugins.edgetpu_tfl INFO    : TPU found
2024-11-12 10:57:27.152352992  [2024-11-12 11:57:24] frigate.app                    INFO    : Camera processor started for achtertuin: 402
2024-11-12 10:57:27.152969024  [2024-11-12 11:57:24] frigate.app                    INFO    : Camera processor started for voordeur: 410
2024-11-12 10:57:27.152976038  [2024-11-12 11:57:24] frigate.app                    INFO    : Capture process started for garage: 416
2024-11-12 10:57:27.152986167  [2024-11-12 11:57:24] frigate.app                    INFO    : Capture process started for achtertuin: 423
2024-11-12 10:57:27.152991612  [2024-11-12 11:57:24] frigate.app                    INFO    : Capture process started for voordeur: 428
2024-11-12 10:57:36.547000174  [2024-11-12 11:57:36] frigate.comms.dispatcher       INFO    : Turning off recordings for achtertuin
2024-11-12 10:57:37.047148874  [2024-11-12 11:57:37] frigate.comms.dispatcher       INFO    : Turning off snapshots for achtertuin
2024-11-12 10:57:40.778993730  [2024-11-12 11:57:40] frigate.comms.dispatcher       INFO    : Turning off recordings for garage
2024-11-12 10:57:41.184672911  [2024-11-12 11:57:41] frigate.comms.dispatcher       INFO    : Turning off snapshots for garage
2024-11-12 10:58:06.570854881  [2024-11-12 11:58:06] frigate.output.birdseye        WARNING : Unable to copy frame garage1731409084.925196 to birdseye.
2024-11-12 10:58:06.572047957  [2024-11-12 11:58:06] frigate.output.birdseye        WARNING : Unable to copy frame voordeur1731409084.834429 to birdseye.
2024-11-12 11:02:49.828643645  [h264 @ 0x7fac1418fe40] left block unavailable for requested intra4x4 mode -1
2024-11-12 11:02:49.828654021  [h264 @ 0x7fac1418fe40] error while decoding MB 0 53, bytestream 63393
2024-11-12 11:03:59.920799059  [h264 @ 0x7fac14780500] left block unavailable for requested intra4x4 mode -1
2024-11-12 11:03:59.920807613  [h264 @ 0x7fac14780500] error while decoding MB 0 52, bytestream 71288
2024-11-12 11:04:21.199968249  [2024-11-12 12:04:21] frigate.output.birdseye        WARNING : Unable to copy frame garage1731409362.131977 to birdseye.
2024-11-12 11:04:21.200403063  [2024-11-12 12:04:21] frigate.output.birdseye        WARNING : Unable to copy frame voordeur1731409362.051956 to birdseye.
2024-11-12 11:04:21.327832143  [2024-11-12 12:04:21] frigate.output.birdseye        WARNING : Unable to copy frame voordeur1731409362.051956 to birdseye.
2024-11-12 11:04:21.565584343  [2024-11-12 12:04:21] frigate.output.birdseye        WARNING : Unable to copy frame voordeur1731409362.051956 to birdseye.
2024-11-12 11:04:21.735655094  [2024-11-12 12:04:21] frigate.output.birdseye        WARNING : Unable to copy frame voordeur1731409362.051956 to birdseye.
2024-11-12 11:08:05.098358655  [h264 @ 0x7fac1477ac40] left block unavailable for requested intra4x4 mode -1
2024-11-12 11:08:05.098372761  [h264 @ 0x7fac1477ac40] error while decoding MB 0 23, bytestream 196026
2024-11-12 11:11:25.328302008  [h264 @ 0x7fac14113600] left block unavailable for requested intra mode
2024-11-12 11:11:25.328308092  [h264 @ 0x7fac14113600] error while decoding MB 0 57, bytestream 40897
2024-11-12 11:11:28.168686481  [2024-11-12 12:11:28] frigate.output.birdseye        WARNING : Unable to copy frame achtertuin1731409758.670577 to birdseye.
2024-11-12 11:11:28.172817920  [2024-11-12 12:11:28] frigate.output.birdseye        WARNING : Unable to copy frame voordeur1731409758.91426 to birdseye.

Relevant go2rtc log output

2024-11-12 10:57:19.922611595  [INFO] Preparing new go2rtc config...
2024-11-12 10:57:20.016184843  [INFO] Got IP address from supervisor: 192.168.178.10
2024-11-12 10:57:20.093156684  [INFO] Got WebRTC port from supervisor: 8555
2024-11-12 10:57:21.003430438  [INFO] Not injecting WebRTC candidates into go2rtc config as it has been set manually
2024-11-12 10:57:21.102412784  [INFO] Starting go2rtc...
2024-11-12 10:57:21.405822296  11:57:21.405 INF go2rtc platform=linux/amd64 revision=b2399f3 version=1.9.2
2024-11-12 10:57:21.405870944  11:57:21.405 INF config path=/dev/shm/go2rtc.yaml
2024-11-12 10:57:21.406928375  11:57:21.406 INF [api] listen addr=:1984
2024-11-12 10:57:21.408218774  11:57:21.406 INF [rtsp] listen addr=:8554
2024-11-12 10:57:21.408225993  11:57:21.407 INF [webrtc] listen addr=:8555
2024-11-12 10:57:29.913074900  [INFO] Starting go2rtc healthcheck service...
2024-11-12 11:04:16.166933673  12:04:16.166 WRN github.com/AlexxIT/go2rtc/internal/streams/producer.go:171 > error="read tcp 172.30.33.9:35842->192.168.178.10:35731: i/o timeout" url=rtsp://192.168.178.10:35731/608230810042825d
2024-11-12 11:04:18.596935955  12:04:18.593 WRN github.com/AlexxIT/go2rtc/internal/streams/producer.go:171 > error=EOF url=rtsp://192.168.178.10:35731/608230810042825d

Frigate stats

No response

Operating system

HassOS

Install method

HassOS Addon

docker-compose file or Docker CLI command

not applicable

Object Detector

Coral

Screenshots of the Frigate UI's System metrics pages

Any other information that may be helpful

I have almost the same setup in a different house, with the same camera and same config (just running everything on docker) and it all works exactly as it should.
I have other cameras in the same system (Wansview) which also work fine with the combination of high and low res streams with the same setup.

[NickM-27]

If you're running HA 2024.11 then you'll want to enable webrtc in the integration menu

[Remko76]

Thanks for the reply. webrtc is enabled and it is not a new issue. As mentioned, the second camera in the same setup works fine. Also, if I change the config to only use the low res stream everything works fine.
Therefore I initially suspected a network speed issue, but then watching the recordings or live stream from within the Frigate Addon it all is fine.

[NickM-27]

I'd suggest opening an issue on HA then, this doesn't seem to be related to Frigate

[Remko76]

I can try that too. Somehow it just does not make sense and I am not sure where the issue might be. It does not feel like a config issue, but it also does not feel like a Homeassistant issue since I have the same setup on another system working flawelessly. It is one which has been driving me absolutely crazy for over a year now, that is why I reached out for some help and thougths here.
For now I live with the workaround of only viewing the low-res stream through Homeassistant, but it is just annyoing.