With numerous technologies, seeking to utilize deep learning-based object detection algorithms, there is an increased need for an innovative approach to compare one model to another. Often, models are compared one of two over-arching ways: performance metrics or through statistical measures on the dataset. One common approach for training an object detector for a new problem is to transfer learn a model, often initially trained extensively on the ImageNet dataset; however, why one feature backbone was selected over another is overlooked at times. Additionally, while whether it was trained on ImageNet, COCO, or some other benchmark dataset is noted, it is not necessarily considered by many practitioners outside the deep learning research community seeking to implement a state-of-the-art detector for their specific problem. This article proposes new strategies for comparing deep learning models that are associated with the same task, e.g., object detection.
|