Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

API addition: "stream handle" to support massive event traces. #41

Open
cdwdirect opened this issue Mar 8, 2018 · 0 comments
Open

API addition: "stream handle" to support massive event traces. #41

cdwdirect opened this issue Mar 8, 2018 · 0 comments

Comments

@cdwdirect
Copy link
Owner

SOS "pub handle" is not optimized for capturing VERY LARGE amounts of streaming event trace data.

Proposed additional "stream handle" that is engineered to optimize for MANY small simple data chunks, rather than a few large, complex, self-describing events.

Assuming that events arise from fixed annotations in code that do not change filename, line number, type (start/stop) or semantics, those details can be captured once and stored in a lookup table.

descriptions

Trace events can then be stored as the event's id, a timestamp, a relation_id, a parent_relation_id (to capture traces of recursive functions), etc.

events

This will dramatically cut down on the metadata overhead for logging event traces using SOS.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant