[Hardware] [HPU]add mark_step for hpu

[jikunshang]

This PR add mark_step after each model's decoder layer, which could benefit performance and not break origin model files.
mark_step doc

cc @kzawora-intel

[github-actions]

👋 Hi! Thank you for contributing to the vLLM project.
Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run fastcheck CI which starts running only a small and essential subset of CI tests to quickly catch errors. You can run other CI tests on top of those by going to your fastcheck build on Buildkite UI (linked in the PR checks section) and unblock them. If you do not have permission to unblock, ping simon-mo or khluu to add you in our Buildkite org.

Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging.

To run CI, PR reviewers can do one of these:

• Add ready label to the PR
• Enable auto-merge.

🚀

[madamczykhabana]

Hi @jikunshang . Could the same functionality be implemented using stock PT functionalities like forward hooks (https://pytorch.org/docs/stable/generated/torch.nn.Module.html#torch.nn.Module.register_forward_hook)? I guess we only need to call mark_step() and there's no other complex logic involved.

[jikunshang]

Hi @jikunshang . Could the same functionality be implemented using stock PT functionalities like forward hooks (https://pytorch.org/docs/stable/generated/torch.nn.Module.html#torch.nn.Module.register_forward_hook)? I guess we only need to call mark_step() and there's no other complex logic involved.

nice catch, addressed your comments. please take a look again, thanks!

[WoosukKwon]

@madamczykhabana Please take a look. I will merge the PR once you approve it.

[madamczykhabana]

LGTM

[jikunshang]

@WoosukKwon Can we merge this now?

[DarkLight1337]

Sorry for missing this!