Knowledge distillation related

[andynnnnn]

Hello, it's great to see your achievements. I've been working with large CV models similar to Yolo-world and Grounding Dino, training them on my own dataset to obtain pre-trained files. I'd like to know how I can derive pre-trained files with relatively smaller model parameters while still retaining the Zero-Shot detection capability of the models.