Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Agent cannot connect after restart Fleet Server #5548

Closed
wp4711 opened this issue Sep 17, 2024 · 2 comments
Closed

Agent cannot connect after restart Fleet Server #5548

wp4711 opened this issue Sep 17, 2024 · 2 comments
Labels
bug Something isn't working

Comments

@wp4711
Copy link

wp4711 commented Sep 17, 2024

After a reboot of Fleet Server / Elastic Agents cannot connect correctly. They are in an Healthy state but dont send metric data. They all have following error in the log. After a restart of Agent, all works fine. Does anyone know why i have this issue?

{"log.level":"info","@timestamp":"2024-09-17T08:33:12.658Z","message":"Attempting to reconnect to backoff(elasticsearch(https://X.X.X.X:9200)) with 239 reconnect attempt(s)","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"http/metrics-monitoring","type":"http/metrics"},"log":{"source":"http/metrics-monitoring"},"log.origin":{"file.line":139,"file.name":"pipeline/client_worker.go","function":"github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*netClientWorker).run"},"service.name":"metricbeat","ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2024-09-17T08:33:15.064Z","message":"Non-zero metrics in the last 30s","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"log-default","type":"log"},"log":{"source":"log-default"},"log.logger":"monitoring","log.origin":{"file.line":192,"file.name":"log/log.go","function":"github.com/elastic/beats/v7/libbeat/monitoring/report/log.(*reporter).logSnapshot"},"service.name":"filebeat","monitoring":{"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2024-09-17T08:33:15.251Z","message":"Non-zero metrics in the last 30s","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"system/metrics-default","type":"system/metrics"},"log":{"source":"system/metrics-default"},"log.logger":"monitoring","log.origin":{"file.line":192,"file.name":"log/log.go","function":"github.com/elastic/beats/v7/libbeat/monitoring/report/log.(*reporter).logSnapshot"},"service.name":"metricbeat","monitoring":{"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2024-09-17T08:33:15.469Z","message":"Non-zero metrics in the last 30s","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"filestream-monitoring","type":"filestream"},"log":{"source":"filestream-monitoring"},"service.name":"filebeat","monitoring":{"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2024-09-17T08:33:15.628Z","message":"Non-zero metrics in the last 30s","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"beat/metrics-monitoring","type":"beat/metrics"},"log":{"source":"beat/metrics-monitoring"},"service.name":"metricbeat","monitoring":{"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2024-09-17T08:33:16.150Z","message":"Non-zero metrics in the last 30s","component":{"binary":"metricbeat","dataset":"elastic_agent.metricbeat","id":"http/metrics-monitoring","type":"http/metrics"},"log":{"source":"http/metrics-monitoring"},"log.logger":"monitoring","log.origin":{"file.line":192,"file.name":"log/log.go","function":"github.com/elastic/beats/v7/libbeat/monitoring/report/log.(*reporter).logSnapshot"},"service.name":"metricbeat","monitoring":{"ecs.version":"1.6.0"}}
{"log.level":"error","@timestamp":"2024-09-17T08:33:28.744Z","message":"Failed to connect to backoff(elasticsearch(https://X.X.X.X:9200)): Get "https://X.X.X.X:9200\": context canceled","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"filestream-monitoring","type":"filestream"},"log":{"source":"filestream-monitoring"},"service.name":"filebeat","ecs.version":"1.6.0"}}

@wp4711 wp4711 added the bug Something isn't working label Sep 17, 2024
@lucabelluccini
Copy link
Contributor

I think this is a duplicate of elastic/beats#40705

@cmacknz
Copy link
Member

cmacknz commented Sep 17, 2024

Agree, symptoms are the same. A restart may fix this but the recommendation is to stay on 8.15.0.

@cmacknz cmacknz closed this as completed Sep 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants