[Feature Request]:Threshold-Based Load Shedding Feature

[tsideridis]

Is your request related to a problem you have?

The feature would introduce the ability to configure specific thresholds for system metrics (e.g., CPU usage, memory usage, request rate), beyond which the middleware would start shedding loads. This approach allows for finer control over when load shedding should occur, ensuring critical resources are preserved for the most important operations and complementing auto-scaling by providing an additional layer of performance management.

Describe the solution you'd like

In a scenario where an ASP.NET Core application experiences sudden spikes in traffic, auto-scaling might not immediately accommodate the increased load, leading to potential performance degradation. By setting a CPU usage threshold at 75%, the load shedding can begin shedding less critical requests, maintaining the responsiveness of the application until auto-scaling can bring additional resources online.

Are you able to help bring it to life and contribute with a Pull Request?

No

Additional context

No response