feat: speedy scc (PRO-777 PRO-593 PRO-434)

[AlastairHolmes]

@j4m1ef0rd I'm going to close your PR's and integrate those comments and changes into this PR. Considering the behaviour is noticeably different then before.

[linear]

PRO-777 Speed up finalisation in APIs

Currently, after an API call (both LP-API and Broker-API) has submitted an extrinsic, the API call does not return until several blocks have been generated AFTER the block containing the submitted extrinsic. We should change it so that once the extrinsic is accepted in a block, the call returns.

[linear]

PRO-593 SCC fill nonce gap when using only submit_signed_extrinsic

Using only submit_signed_extrinsic (instead of finalize_signed_extrinsic) will not cause the nonce filling behaviour of the SCC to be used. This means the extrinsic submission can get stuck. finalize_signed_extrinsic is not always desirable as it many repeatedly submit any given extrinsic.

[AlastairHolmes]

I'd like to merge this as in a continue refactoring and adding tests (As this has been tested previously, and it an important improvement).

[codecov]

Codecov Report

Merging #3986 (865b3fe) into main (178df88) will decrease coverage by 0%.
Report is 7 commits behind head on main.
The diff coverage is 29%.

@@          Coverage Diff           @@
##            main   #3986    +/-   ##
======================================
- Coverage     72%     72%    -0%     
======================================
  Files        368     369     +1     
  Lines      58484   59264   +780     
  Branches   58484   59264   +780     
======================================
+ Hits       42327   42648   +321     
- Misses     14060   14500   +440     
- Partials    2097    2116    +19     

Files Changed	Coverage Δ
api/lib/src/lib.rs	31% <0%> (ø)
api/lib/src/lp.rs	0% <0%> (ø)
...ne/src/state_chain_observer/client/base_rpc_api.rs	1% <0%> (-<1%)	⬇️
...e/src/state_chain_observer/client/error_decoder.rs	88% <0%> (ø)
...tate_chain_observer/client/extrinsic_api/signed.rs	0% <0%> (ø)
.../client/extrinsic_api/signed/submission_watcher.rs	25% <16%> (-9%)	⬇️
engine/src/state_chain_observer/client/mod.rs	17% <18%> (-<1%)	⬇️
...t/extrinsic_api/signed/submission_watcher/tests.rs	96% <95%> (+2%)	⬆️
...gine/src/state_chain_observer/sc_observer/tests.rs	88% <100%> (+<1%)	⬆️

... and 29 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

[linear]

PRO-434 Add tracing to State Chain Client

We currently don't use tracing to log submitted extrinsics in the SCC, making it hard to debug some issues.

We should log what was requested from the SCC and what was actually submitted.