How to deal with CO3D's broken labels

[AlbertoRemus]

Hello !

I wanted to ask how the method deals (also for evaluation metrics) broken masks that are often present in the CO3D dataset

Thanks in advance,

Alberto

[AlbertoRemus]

By running the evalutation is possible to notice that in some case there are some target images unrelated to the target object, just consider these examples, how is this considered when assessing the metrics?

6th target image is wrong

first target image is wrong