Core dump when call getDeviceMemorySizeForProfileV2

[tp-nan]

Description

Core dumped when call getDeviceMemorySizeForProfileV2. When use getDeviceMemorySizeForProfile, all work well.

Environment

TensorRT Version: 10.7

NVIDIA GPU: 3080TI

NVIDIA Driver Version: 530.41.03

CUDA Version: 11.8 in docker / 12.1 for system

Steps To Reproduce

Is a resnet18, with two profiles(1->4)

[lix19937]

Do you set BuilderFlag::kWEIGHT_STREAMING during engine building

[tp-nan]

Do you set BuilderFlag::kWEIGHT_STREAMING during engine building

No

[lix19937]

So you need add.

[tp-nan]

So you need add.

Thank you for the information. If designed this way, I would suggest to add relevant documentation. As WEIGHT STREAMING requires strongly-typed models, many models cannot be used.