0.15.0 Beta 1 #14653
Replies: 106 comments 397 replies
-
impressive pace over the last months! Frigate is now the best NVR tool |
Beta Was this translation helpful? Give feedback.
-
Beta Was this translation helpful? Give feedback.
-
Fantastic progress as ever! One point on Semantic Search - interested as to where the 16GB RAM requirement comes from for the CLIP model. I've been running 0.15 dev builds for a few weeks and my Frigate container (which is set to 16GB max RAM on a 32GB system) has never exceeded 4.5GB memory use. I also only have an Intel 10700 iGPU and don't see any real performance problems (I think it took about 20 minutes to re-encode 7,000 snapshots). Appreciate you might not want to lower the requirement, but just sharing my experience to avoid putting anyone else off... Of course, 0.16 sounds like a GPU could become more mandatory for face recognition, so whether the long term view is that it's necessary would be a fair one. |
Beta Was this translation helpful? Give feedback.
-
Is there an update to https://github.com/blakeblackshear/frigate-hass-integration or https://github.com/dermotduffy/frigate-hass-card required? I can see the clips in the card, but when I click one to play it just shows a loading spinner and doesn't play any clip. |
Beta Was this translation helpful? Give feedback.
-
Do you have plans to accept multiple languages? |
Beta Was this translation helpful? Give feedback.
-
First of all thank you to the team (and contributors) for all the time spent making Frigate so incredible! I was having some issues after upgrading, related to having birdseye enabled with restream.
Looks like as I don't have an ffmpeg>hwaccel_args config key, Seems like amending this line to the below (adding
|
Beta Was this translation helpful? Give feedback.
-
Found another issue related to Tracked Object Details interface, the left and right arrows at the bottom don't do anything so having to click on the icons in the middle section works but not the left or right: |
Beta Was this translation helpful? Give feedback.
-
So upgrading from 0.14.1 to this, for the first 10 minutes or so, the cameras seemed to load and then keep crashing over and over again. It seems to have stopped doing it for the next 10 minutes, so not sure yet if its just a temporary problem on startup/first upgrade, I can keep you updated... here's logs during the issue (we got the old "Unable to keep up with recording segments in cache for . Keeping the 6 most recent segments out of 8 and discarding the rest...": I haven't yet tried the new features, this was just a simple upgrade |
Beta Was this translation helpful? Give feedback.
-
Spun up my container using the beta and now i don't have the icon for frigate+ any longer on the left side of my screen. |
Beta Was this translation helpful? Give feedback.
-
great to see new release!!!
is it in my main config under each camera stream I need to add?
|
Beta Was this translation helpful? Give feedback.
-
Hmm, after fixing the birdseye restream ffmpeg config I now hit this:
|
Beta Was this translation helpful? Give feedback.
-
Impressive update, congratulations! I think I found a bug for the annotation offset. Otherwise, two suggestions:
|
Beta Was this translation helpful? Give feedback.
-
Was there a breaking change? I did the update and tried to start Frigate and now I'm getting the following within the logs. I update almost every time there is one so I had whatever was the most recent before this morning.
|
Beta Was this translation helpful? Give feedback.
-
Ok so semantic search is really cool. |
Beta Was this translation helpful? Give feedback.
-
Does Semantic Search detect intel iGPU support automatically or does a detector for OpenVINO need to be configured for ONIX support? If OpenVINO needs to be configured is there a way to specify which tasks to to which accelerator if I have a Coral for normal object detection already configured as well? |
Beta Was this translation helpful? Give feedback.
-
So this is a win for the AI versus the native detection! Could we maybe see in 0.16+ AI auto submitted, if toggled on of course, to Frigate+ when AI is right and the detector isn't? I know we have squirrel label options but I don't have that turned on at the moment but if it was a valid label just not added would be cool to train it properly. |
Beta Was this translation helpful? Give feedback.
-
A note for anyone running frigate on raspberry pi 5 with Hailo 8(L) chip: I randomly started getting bad inference times and found out I had to re-set the PCIe speed to 3 in rasp-config settings. I’m not sure why it reverted to 2 but this solved the inference time. |
Beta Was this translation helpful? Give feedback.
-
I just tried 0.15.beta1 and it didnt seem to come up fully. I had 1/12 cameras show up on the main dashboard, and despite multiple restarts it didnt seem to come up fully. Nothing obvious in the logs. I shutdown and deleted my old DB, and restarted hoping that a fresh install would fix things but to no avail. I switched back to 0.14.1, swapped out the configs and DB for the backups I took and 0.14.1 came right back up, with all feeds showing within 30s or so. Something is not right with 0.15.0-b1 |
Beta Was this translation helpful? Give feedback.
-
Anyone else notice that opening any specific life stream takes several seconds? I went to go look in Developer tools and what happens is there is activity for like 1s then a long pause of 2 seconds before something happens again. Opening a stream directly from go2rtc :1984/stream.html?src=doorbell is nearly instant so something seems to be happening when you click on the camera and then it seems to get stuck a little loading :5000/#doorbell |
Beta Was this translation helpful? Give feedback.
-
Hello, I am fiddling a bit with semantic search and genai - I have an (old) nvidia card available on my setup, so I started messing with ollama. My card is used also for stream encoding/deconding, and since it only has 4 GB of vram, I first started testing with I suspect there might be some timeout happening somewhere - I did not have the time to test the command line with vision, just chat, but I left the system going on its own for quite some time and none of the new events have a caption. I also monitor CPU usage when I request a caption, it pins to 100% for some time and then goes back to idle, so something is happening. Can anyone give any pointers as to how to debug/investigate this? Should I open an issue? Up to now it is not clear whether this is frigate timing out, ollama timing out, my machine shitting the bed or whatever, so I thought to ask here. Again thanks for this awesome piece of software. |
Beta Was this translation helpful? Give feedback.
-
Not sure what it means yet, but just had 15b1 crash two days in a row with logs saying it's out of space for /dev/shm/log which obviously got changed a bit for this release. I did not get a notification SHM was too small which is why I bring it up here. I was setting it to 512mb of memory backed volume, upped it to 1024 for now. Is there a way I run the calculation manually to see if what was calculated really was not enough or if I missed the warning to make it bigger? |
Beta Was this translation helpful? Give feedback.
-
Are you able to add Groq to this Frigate version by chance? I tried using it with the OpenAI provider and I get the following:
|
Beta Was this translation helpful? Give feedback.
-
Hi all, Does anyone know why I can't playback my video recording from the Media saved recording? Thank you |
Beta Was this translation helpful? Give feedback.
-
Hello I've increased my dev/shm from 256 to 512. Frigate ran fine for a couple days and I got the message about running out of space. So I upped to 1024 and the message went away for a couple days until today.. how high should this be set? I have 5 cameras. |
Beta Was this translation helpful? Give feedback.
-
So I am not sure exactly what is happing but on a LARGE number of my life cycle reviews the boxes and images don't come close. I was trouble shotting some false positives and found the boxes not clearly attached to anything. In others it looks like the boxes match the historic path of the object but the frames shown don't even include the object or it isn't even close. If I had to guess this got worse when I increased my detect FPS from 5 to 10 FPS to try and capture faster objects better however I think it has over all made tracking worse for all object? |
Beta Was this translation helpful? Give feedback.
-
I use nodered to mange notification frequency via HomeAssistant which includes following action to play the video clip related to the notification object. I am curious if similar link can be created so it will work like the native notification on 0.15 beta. I like how the native notification plays the recording inside the frigate explorer's review page |
Beta Was this translation helpful? Give feedback.
-
Looks like running out of SHM is still an issue, I am at a shm_size: "512mb" currently and things where running fine for a bit but I was doing lots of configs and restarts. left it for a day and sat down to find the UI hung and this going on again in the docker logs.
|
Beta Was this translation helpful? Give feedback.
-
Somebody else noticed that cars where accidently detected as Amazon or DPD? I've now had this on two occasions, on two different cameras. Looking in the debug screen gives a score of 96+%, the score the cars normally would have when being detected as actual cars. Restarting Frigate solves this; after the restart the cars were detected properly. |
Beta Was this translation helpful? Give feedback.
-
I'm getting a lot of hanging car tracking.. like 45min to hour long clips of parked cars in driveway.
A car will drive by which will trigger the detection but then it focuses on another parked car in the background and stays there. How could I eliminate this? |
Beta Was this translation helpful? Give feedback.
-
What's the normal cadence (if there is one) for beta releases? |
Beta Was this translation helpful? Give feedback.
-
Beta Documentation: https://deploy-preview-13787--frigate-docs.netlify.app/
Images
ghcr.io/blakeblackshear/frigate:0.15.0-beta1
ghcr.io/blakeblackshear/frigate:0.15.0-beta1-standard-arm64
ghcr.io/blakeblackshear/frigate:0.15.0-beta1-tensorrt
ghcr.io/blakeblackshear/frigate:0.15.0-beta1-tensorrt-jp4
ghcr.io/blakeblackshear/frigate:0.15.0-beta1-tensorrt-jp5
ghcr.io/blakeblackshear/frigate:0.15.0-beta1-rk
ghcr.io/blakeblackshear/frigate:0.15.0-beta1-rocm
ghcr.io/blakeblackshear/frigate:0.15.0-beta1-h8l
Major Changes for 0.15.0
Breaking Changes
There are several breaking changes in this release, Frigate will attempt to update the configuration automatically. In some cases manual changes may be required. It is always recommended to back up your current config and database before upgrading:
frigate.db
fileshm_size
is too low then a warning will be printed in the log stating that it needs to be increased.record
config has been refactored to allow for direct control of how longalerts
anddetections
are retained. These values will be automatically populated from your current config, but you may want to adjust the values that are set after updating. See the updated docs here.hwaccel
preset they are using (preset-vaapi
may need to now bepreset-intel-qsv-h264
orpreset-intel-qsv-h265
).ffmpeg
is no longer part of$PATH
. In most cases this is handled automatically, but go2rtcexec
streams will need to add the full path for ffmpeg which in most cases will be/usr/lib/ffmpeg/7.0/bin/ffmpeg
Explore
The new Explore pane in Frigate 0.15 makes it easy to explore every object tracked by Frigate. It offers a variety of filters and supports keyword and phrase-based text search, searching for similar images, and searching through descriptive text generated by AI models.
AI/ML Search
Frigate 0.15 introduces two powerful search features: Semantic Search and GenAI Search. Semantic Search can be enabled on its own, while GenAI Search works in addition to Semantic Search.
Semantic Search
Semantic Search uses a CLIP model to generate embeddings (numerical representations of images) for the thumbnails of your tracked objects, enabling searches based on text descriptions or visual similarity. This is all done locally.
For instance, if Frigate detects and tracks a car, you can use similarity search to see other instances where Frigate detected and tracked that same car. You can also quickly search your tracked objects using an "image caption" approach. Searching for "red car driving on a residential street" or "person in a blue shirt walking on the sidewalk at dawn" or even "a person wearing a black t-shirt with the word 'SPORT' on it" will produce some stunning results.
Semantic Search works by running an AI model locally on your system. Small or underpowered systems like a Raspberry Pi will not run Semantic Search reliably or at all. A dedicated GPU and 16GB of RAM is recommended for best performance.
See the Semantic Search docs for system requirements, setup instructions, and usage tips.
Generative AI
GenAI Search employs generative AI models to create descriptive text for the thumbnails of your tracked objects, which are stored in the Frigate database to enhance future searches. Supported providers include Google Gemini, Ollama, and OpenAI, so you can choose whether you want to send data to the cloud or use a locally hosted provider.
See the GenAI docs for setup instructions and use case suggestions.
Improved Tools for Debugging
Review Item Details Pane
A new Review Item Details pane can be viewed by clicking / tapping on the gray chip on a review item in the Review pane. This shows more information about the review item as well as thumbnails or snapshots for individual objects (if enabled). The pane also provides links to share the review item, download it, submit images to Frigate+, view object lifecycles, and more.
Object Lifecycle Pane
The Recordings Timeline from Frigate 0.13 has been improved upon and returns to 0.15 as the
Object Lifecycle
, viewable in the Review Details pane as well as the new Explore page. The new pane shows the significant moments during the object's lifecycle: when it was first seen, when it entered a zone, became stationary, etc. It also provides information about the object's area and size ratio to assist in configuring Frigate to tune out false positives.Native Notifications
Frigate now supports notifications using the WebPush protocol. This allows Frigate to deliver notifications to devices that have registered to receive notifications in the Frigate settings, delivering them in a timely and secure manner. Currently, notifications will be delivered for all review items marked as alerts. More options for native notifications will be supported in the future.
See the notifications docs.
New Object Detectors
ONNX
ONNX is an open model standard which allows for a single model format that can run on different types of GPUs. The
default
,tensorrt
, androcm
Frigate build variants include GPU support for efficient object detection via ONNX models, simplifying configuration and support more models. There are no default included ONNX models for object detection.AMD MiGraphX
Support has been added for AMD GPUs via ROCm and MiGraphX. Currently there is no default included model for this detector.
Hailo-8
Support has been added for the Hailo8 and Hailo-8L hardware for object detection on both arm64 and amd64 platforms.
Other UI Changes
Other Backend Changes
This discussion was created from the release 0.15.0 Beta 1.
Beta Was this translation helpful? Give feedback.
All reactions