Nadeem, Shahroz, Kurugollu, Fatih, Saravi, Sara, Atlam, Hany F. and Franqueira, Virginia N. L. (2024) Deep labeller: automatic bounding box generation for synthetic violence detection datasets. Multimedia Tools and Applications, 83 (4). pp. 10717-10734. ISSN 1380-7501

Preview

Text Deep Labeller.pdf - Published Version Available under License Creative Commons Attribution. Download (2MB) | Preview

Abstract

Manually labelling datasets for training violence detection systems is time-consuming, expensive, and labor-intensive. Mind wandering, boredom, and short attention span can also cause labelling errors. Moreover, collecting and distributing sensitive images containing violence has ethical implications. Automation is the future for labelling sensitive image datasets. Deep labeller is a two-stage Deep Learning (DL) method that uses pre-trained DL object detection methods on MS-COCO for automatic labelling. The Deep Labeller method labels violent and nonviolent images in WVD and USI. In stage 1, WVD generates weak labels using synthetic images. In stage 2, the Deep labeller method is retrained on weak labels. USI dataset is used to test our method on real-world violence. Deep labeller generated weak and strong labels with an IoU of 0.80036 in stage 1 and 0.95 in stage 2 on the WVD. Automatically generated labels. To test our method’s generalisation power, violent and nonviolent image labels on USI dataset had a mean IoU of 0.7450.

Actions (login required)

View Item