-
-
Notifications
You must be signed in to change notification settings - Fork 53
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
per requested client fqdn/url metrics #91
Comments
The only way that I know we can possibly get information per URL in squid is analyzing squid logs. this exporter however only relies on squid cache object, which does not provide any information about the URLs. I also briefly looked into the cache digest, but it seems it provides information provided a URL and not the other way around. That said there might be way to get this information from the squid cache object, likely by modifying the cache object to include for example top 100 origins or something like that but that's a large project by itself. If you have more concrete ideas to implement this feature in this project, I'll be happy to discuss options. Cheers |
Thanks @boynux for your analysis. I started searching for ways to automatically parse the squid access logs and surface this as metrics. I so far only found the following (unmaintained repos):
Would it make sense for the squid-exporter to support optional parsing of the squid log in an expected controlled format and specified path ? |
Sorry for the delay. I think each of these have their own pros and cons. I need to find some time to put together a trade off analysis and make decision based on that. The general problem with log analysers is the added complexity to the code base and dependency on the host filesystem. One way [very hand wavy] to solve this is to make a separate interface between one of the above services and exporter is merely reading from that API and exposing it to the Prometheus instance. I think that's going to be a sizable project by itself. |
Thanks a lot for contributing this great work with the community and maintaining over time !
Describe the feature
I'm trying to get stats per requested FQDN (in the case of a CONNECT request) or Urls (in the case plain HTTP request) such as:
Currently, I understand that available metrics don't have labels with fqdn or urls.
I'm not yet so familiar with what squid offers in terms of stats/metrics/reports that could be used. I did the following research in the documentation to learn a bit more below.
Is there prior work on this topic ?
Expected behavior
A new flag passed to the exporter to turn on a feature which adds metrics labels with client requested FQDN or Url
As to avoid prometheus cardinality explosion, the flag could select the k top FQDN/URL to surface as labels, and the group the long tail into an
other
categoryAdditional context
Add any other context about the problem here.
Research in squid documentation about per FQDN/Url stats/report available
Squid report content
https://wiki.squid-cache.org/Features/CacheManager/Index
Cache Manager objects or reports
The text was updated successfully, but these errors were encountered: