Generic Merge/Overwrite Query interface

[george-zubrienko]

Part of #61

Scope

Implemented:

• Ported SQL query generation from PySpark (Delta) and generalised it to work for across different sources
• Added skeleton for executing batch merges via Sql (jdbc) - more work to follow in the next PR

Checklist

• Unit tests added and they pass.

[s-vitaliy]

LGTM in general, with some comments

[github-actions]

File	Coverage
All files	62%	✅
models/ArcaneSchema.scala	61%	✅
models/app/StreamContext.scala	0%	❌
models/querygen/MergeQuery.scala	85%	✅
services/app/PosixStreamLifetimeService.scala	0%	❌
services/app/StreamRunnerServiceImpl.scala	0%	❌
services/app/logging/Enrichers.scala	0%	❌
services/app/logging/Enrichers.scala	0%	❌
services/app/logging/Enrichers.scala	0%	❌
services/app/logging/base/Enricher.scala	0%	❌
services/consumers/JdbcConsumer.scala	0%	❌
services/consumers/JdbcConsumer.scala	0%	❌
services/lakehouse/IcebergS3CatalogWriter.scala	0%	❌
services/lakehouse/IcebergS3CatalogWriter.scala	80%	✅
services/lakehouse/IcebergCatalogCredential.scala	56%	✅
services/lakehouse/SchemaConversions.scala	28%	❌
services/mssql/MsSqlDataProvider.scala	87%	✅
services/mssql/MsSqlDataProvider.scala	82%	✅
services/mssql/MsSqlConnection.scala	75%	✅
services/mssql/MsSqlConnection.scala	64%	✅
services/mssql/query/LazyQueryResult.scala	79%	✅
services/mssql/query/ScalarQueryResult.scala	66%	✅
services/storage/models/amazon/AmazonS3StoragePath.scala	80%	✅
services/streaming/BackfillGroupingProcessor.scala	0%	❌
services/streaming/VersionedDataGraphBuilder.scala	66%	✅
services/streaming/BackfillDataGraphBuilder.scala	0%	❌

Minimum allowed coverage is 40%

Generated by 🐒 cobertura-action against 4a5bf3e