APM Server 8.15 Test Plan

[inge4pres]

Manual Test Plan

Build Candidate Schedule

When picking up a test case, please add your name to this overview beforehand and tick the checkbox when finished.
Testing can be started when the first build candidate (BC) is available in the CFT region.

• Update apm-data and remap for OTel hostmetrics to elastic metrics #13196 [contains unit test but the UI side should be reviewed]
• build(deps): bump github.com/elastic/apm-data from 1.4.0 to 1.5.0 #13472
• feat: add reload listener for apm tracing config #13514
• fix: Add wrapper around libbeat instrumentation to propagate missing tracer config #13653
• Add additional config remapping for "api_key" and "secret_token" for libbeat instrumentation wrapper #13691
• monitoring: apm-server only ships a subset of monitoring metrics #13475
  • metricbeat: Update beat module with apm-server monitoring metrics fields beats#40127
  • Update stack monitoring mapping for apm-server metrics elasticsearch#110568
  • [elastic_agent] Add back apm-server metrics dropped due to TSDB integrations#10414

Smoke Testing ESS setup

Thanks to #8303 further smoke tests are run automatically on ESS now.
Consider extending the smoke tests to include more test cases which we'd like to cover

Is it worth adding a smoke test that sets up the Fleet output to a higher/smaller value?

go-docappender library

v1.1.1 -> v2.1.4

All changes between 8.14.2 (using go-docappender v1.1.1) and 8.15.0 (using go-docappender v2.2.0) are unit tested in the library.

apm-data library

v1.1.0 -> v1.8.0

• Enable k8s otel metrics remapping to elastic metrics apm-data#296

Test cases from the GitHub board

Add yourself as assignee on the PR before you start testing.

Regressions

• monitoring: apm-server only ships a subset of monitoring metrics #13475: Waiting for BC3 since we didn't merge the backport.

[inge4pres]

Suggesting assignments of manual test plan items as I will be on PTO for the next 2 weeks.
If you are unable to perform the testing in the upcoming weeks before 8.15 release please sync with another peer to complete the testing.

• Update apm-data and remap for OTel hostmetrics to elastic metrics #13196 @carsonip
• feat: add reload listener for apm tracing config #13514 @kruskall
• build(deps): bump github.com/elastic/apm-data from 1.4.0 to 1.5.0 #13472 @carsonip
• fix: Add wrapper around libbeat instrumentation to propagate missing tracer config #13653 @1pkg
• monitoring: apm-server only ships a subset of monitoring metrics #13475 @lahsivjar
• #Enable k8s otel metrics remapping to elastic metrics apm-data#296 @inge4pres @kyungeunni

[inge4pres]

Testing methodology elastic/apm-data#296 for is explained in the description in #13196

[carsonip]

elastic/apm-data#296 ✔️ test-plan-ok

[1pkg]

#13597 and related #13653 #13691 ✅ verified

[marclop]

Seems like all has been tested and marked as OK except for #13475. We're waiting for BC3 and will test once that's available.

[lahsivjar]

Tested #13475 with BC3 and is working as expcted.