Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Filebeat] Improve documentation about file identifiers/device ID #34418

Closed
belimawr opened this issue Jan 30, 2023 · 6 comments · Fixed by #37959
Closed

[Filebeat] Improve documentation about file identifiers/device ID #34418

belimawr opened this issue Jan 30, 2023 · 6 comments · Fixed by #37959
Assignees
Labels
bug docs Team:Docs Label for the Observability docs team Team:Elastic-Agent-Data-Plane Label for the Agent Data Plane team

Comments

@belimawr
Copy link
Contributor

Filebeat by default uses a combination of inode and device ID to identify files on its registry, however in some cases the device ID can change during boot, leading to data duplication.

One of those cases is when using LVM according to Red Hat Enterprise documentation.

One know workaround for that is to set the file_identity to path as described on our documentation.

This issue is about better document this issue when using LVM.

@belimawr belimawr added bug Team:Elastic-Agent-Data-Plane Label for the Agent Data Plane team labels Jan 30, 2023
@elasticmachine
Copy link
Collaborator

Pinging @elastic/elastic-agent-data-plane (Team:Elastic-Agent-Data-Plane)

@pierrehilbert
Copy link
Collaborator

@karenzone: could you please add this to your backlog?

@botelastic
Copy link

botelastic bot commented Feb 7, 2024

Hi!
We just realized that we haven't looked into this issue in a while. We're sorry!

We're labeling this issue as Stale to make it hit our filters and make sure we get back to it as soon as possible. In the meantime, it'd be extremely helpful if you could take a look at it as well and confirm its relevance. A simple comment with a nice emoji will be enough :+1.
Thank you for your contribution!

@botelastic botelastic bot added the Stalled label Feb 7, 2024
@pierrehilbert pierrehilbert self-assigned this Feb 7, 2024
@botelastic botelastic bot removed the Stalled label Feb 7, 2024
@kilfoyle kilfoyle removed their assignment Feb 7, 2024
@geekpete geekpete added docs Team:Docs Label for the Observability docs team labels Feb 9, 2024
@geekpete
Copy link
Member

geekpete commented Feb 9, 2024

Do the docs changes as part of #35734 satisfy this docs requirement?

@belimawr
Copy link
Contributor Author

belimawr commented Feb 9, 2024

Do the docs changes as part of #35734 satisfy this docs requirement?

Maybe. This bit does help:

Enable this option if you're experiencing data loss or data duplication due to unstable file identifiers provided by the file system.

However my original thinking was to be more explicit about it in the main file identity section, mentioning the LVM issue instead of just being a small note in the fingerprint.

@kilfoyle
Copy link
Contributor

kilfoyle commented Feb 9, 2024

@belimawr Sorry it took me so long to get to this! Here's a PR for the docs change: #37959

Please let me know if I understood things correctly. :-)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug docs Team:Docs Label for the Observability docs team Team:Elastic-Agent-Data-Plane Label for the Agent Data Plane team
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants