You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am interested in using or developing an RoI head that takes a series of bbox proposals and predicted classes, takes their Cartesian product, extracts features for each bbox in the pair, and passes those along with the predicted classes to a model that makes some prediction about the pair of regions (e.g. is there a relation between the two regions?).
Is there an existing RoI head that does something like this? Looking at the base interface for BaseROIHead it appears its child classes' methods (in particular forward_train):
Do not ingest class predictions from previous layers.
Do not have support for pairs of bounding boxes.
If there is not an existing RoI head for this, what would be the best way to implement it? Should one extend an existing ROIHead class or create a separate family of classes with a different interface (i.e. not inheriting from BaseROIHead)? I assume the latter would be better rather than trying to force this into the existing interface. If so, what would these classes have to output and what methods do they need to implement to work with the rest of the framework? Or would the model building, training, and inference scripts need to be updated to make this work? Thanks for your insight!
This discussion was converted from issue #7738 on October 21, 2022 08:23.
Heading
Bold
Italic
Quote
Code
Link
Numbered list
Unordered list
Task list
Attach files
Mention
Reference
Menu
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
I am interested in using or developing an RoI head that takes a series of bbox proposals and predicted classes, takes their Cartesian product, extracts features for each bbox in the pair, and passes those along with the predicted classes to a model that makes some prediction about the pair of regions (e.g. is there a relation between the two regions?).
Is there an existing RoI head that does something like this? Looking at the base interface for
BaseROIHead
it appears its child classes' methods (in particularforward_train
):If there is not an existing RoI head for this, what would be the best way to implement it? Should one extend an existing ROIHead class or create a separate family of classes with a different interface (i.e. not inheriting from
BaseROIHead
)? I assume the latter would be better rather than trying to force this into the existing interface. If so, what would these classes have to output and what methods do they need to implement to work with the rest of the framework? Or would the model building, training, and inference scripts need to be updated to make this work? Thanks for your insight!Beta Was this translation helpful? Give feedback.
All reactions