[filbeat][azure-blob-storage] - Adding support for Microsoft Entra ID RBAC authentication

[ShourieG]

Type of change

• Enhancement
• Docs

Proposed commit message

Added support for Microsoft Entra ID RBAC authentication.
Added mock tests by injecting the gock transport layer in the azure client.
Added some config tests with the new config options.

Checklist

• My code follows the style guidelines of this project
• I have commented my code, particularly in hard-to-understand areas
• I have made corresponding changes to the documentation
  - [ ] I have made corresponding change to the default configuration files
• I have added tests that prove my fix is effective or that my feature works
• I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

Disruptive User Impact

No Impact

Live Testing

Live testing was performed using our internal Azure dev environment.
Process followed:

1. Fresh storage account and container created and then uploaded with dummy files.
2. New service principle app created.
3. blobOwner role granted to service app via Entra ID IAM configs.
4. client_id, tenant_id and client_secret of the service app used to poll poll the blob storage.
5. Records were output to a local file with success.

Author's Checklist

• [ ]

How to test this PR locally

Related issues

• Closes [filebeat][azure-blob-storage] - Add support for authorization via Microsoft Entra ID / RBAC  #40434

Testing

We performed live testing internally using an active azure account and the new authentication system is working properly after assigning the service principal app with the blobOwner permission level.

Use cases

Screenshots

Logs

[mergify]

This pull request does not have a backport label.
If this is a bug or security fix, could you label this PR @ShourieG? 🙏.
For such, you'll need to label your PR with:

• The upcoming major version of the Elastic Stack
• The upcoming minor version of the Elastic Stack (if you're not pushing a breaking change)

To fixup this pull request, you need to add the backport labels for the needed
branches, such as:

• backport-8./d is the label to automatically backport to the 8./d branch. /d is the digit

[mergify]

backport-8.x has been added to help with the transition to the new branch 8.x.
If you don't need it please use backport-skip label and remove the backport-8.x label.

[elasticmachine]

Pinging @elastic/security-service-integrations (Team:Security-Service Integrations)

[mergify]

This pull request is now in conflicts. Could you fix it? 🙏
To fixup this pull request, you can check out it locally. See documentation: https://help.github.com/articles/checking-out-pull-requests-locally/

git fetch upstream
git checkout -b abs/rbac upstream/abs/rbac
git merge upstream/main
git push upstream abs/rbac

[efd6]

nits only