evaluate code doesn't exist

[mingtouyizu]

No description provided.

[mingtouyizu]

Could you plrease provide a configuration file for the model evaluation and the related code? I have found builders such as flickr, textvqa, nocaps, as well as the corresponding evaluation code. Although I have tried to write the evaluation code like LAVIS, it doesn't work.Thanks.

[mingtouyizu]

The issue is as follows:Lack of Q-former , llm-project and vision-projection weights:

[jiinhui]

Could you plrease provide a configuration file for the model evaluation and the related code? I have found builders such as flickr, textvqa, nocaps, as well as the corresponding evaluation code. Although I have tried to write the evaluation code like LAVIS, it doesn't work.Thanks.

NotImplemented
def evaluation(self, model, data_loader, cuda_enabled=True):
pass

[gordonhu608]

Sorry we didn't not incorporate the evaluation code into our codebase, it's a bit messy to put in here, and all the evaluation code is under the LAVIS repo.

[mingtouyizu]

Thank you, I have found the corresponding test code in the LAVIS repository and evaluated on NoCaps and Flickr30k, but the results are not ideal.