{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T13:10:58Z","timestamp":1740143458727,"version":"3.37.3"},"reference-count":41,"publisher":"Association for Computing Machinery (ACM)","issue":"4","funder":[{"DOI":"10.13039\/501100001809","name":"Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61672273"],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Faculty","award":["GPF014D-2019"]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2021,11,30]]},"abstract":"\n Due to various applications, research on personal traits using information on social media has become an important area. In this paper, a new method for the classification of behavior-oriented social images uploaded on various social media platforms is presented. The proposed method introduces a multimodality concept using skin of different parts of human body and background information, such as indoor and outdoor environments. For each image, the proposed method detects skin candidate components based on R, G, B color spaces and entropy features. The iterative mutual nearest neighbor approach is proposed to detect accurate skin candidate components, which result in foreground components. Next, the proposed method detects the remaining part (other than skin components) as background components based on structure tensor of R, G, B color spaces, and\n Maximally Stable Extremal Regions (MSER<\/jats:bold>\n ) concept in the wavelet domain. We then explore Hanman Transform for extracting context features from foreground and background components through clustering and fusion operation. These features are then fed to an SVM classifier for the classification of behavior-oriented images. Comprehensive experiments on 10-class datasets of\n Normal Behavior-Oriented Social media Image (NBSI)<\/jats:bold>\n and\n Abnormal Behavior-Oriented Social media Image (ABSI)<\/jats:bold>\n show that the proposed method is effective and outperforms the existing methods in terms of average classification rate. Also, the results on the benchmark dataset of five classes of personality traits and two classes of emotions of different facial expressions (FERPlus dataset) demonstrated the robustness of the proposed method over the existing methods.\n <\/jats:p>","DOI":"10.1145\/3458051","type":"journal-article","created":{"date-parts":[[2021,11,12]],"date-time":"2021-11-12T21:16:06Z","timestamp":1636751766000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["A New Foreground-Background based Method for Behavior-Oriented Social Media Image Classification"],"prefix":"10.1145","volume":"17","author":[{"given":"Lokesh","family":"Nandanwar","sequence":"first","affiliation":[{"name":"Department of Computer System and Information Technology, University of Malaya, Kuala Lumpur, Malaysia"}]},{"given":"Palaiahnakote","family":"Shivakumara","sequence":"additional","affiliation":[{"name":"Department of Computer System and Information Technology, University of Malaya, Kuala Lumpur, Malaysia"}]},{"given":"Divya","family":"Krishnani","sequence":"additional","affiliation":[{"name":"International Institute of Information Technology (IIIT), Naya Raipur, Chhattisgarh, India"}]},{"given":"Raghavendra","family":"Ramachandra","sequence":"additional","affiliation":[{"name":"Faculty of Information Technology and Electrical Engineering, IIK, NTNU, Norway"}]},{"given":"Tong","family":"Lu","sequence":"additional","affiliation":[{"name":"National Key Lab for Novel Software Technology, Nanjing University, Nanjing, China"}]},{"given":"Umapada","family":"Pal","sequence":"additional","affiliation":[{"name":"Indian Statistical Institute, Baranagar, Kolkata, India Mohan Kankanhalli, Department of Computer Science, National University of Singapore, Singapore"}]},{"given":"Mohan","family":"Kankanhalli","sequence":"additional","affiliation":[{"name":"Department of Computer Science, National University of Singapore, Singapore"}]}],"member":"320","published-online":{"date-parts":[[2021,11,12]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2015.2460192"},{"key":"e_1_3_1_3_2","first-page":"595","volume-title":"Proc. AAAI","author":"Hu Y.","year":"2014"},{"volume-title":"Proc. ICWSM","year":"2016","author":"Liu L.","key":"e_1_3_1_4_2"},{"issue":"38","key":"e_1_3_1_5_2","article-title":"Multimodal multiplatform social media event summarization","volume":"14","author":"Tiwari A.","year":"2018","journal-title":"ACM. TOMM"},{"key":"e_1_3_1_6_2","first-page":"1584","volume-title":"Proc. ICDAMW","author":"Wang T.","year":"2017"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2016.2582166"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.2200\/S00659ED1V01Y201508HLT030"},{"issue":"32","key":"e_1_3_1_9_2","article-title":"Multi-level similarity perception network for person re-identification","volume":"15","author":"Shen C.","year":"2019","journal-title":"ACM. TOMM"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2014.2362759"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2017.09.029"},{"key":"e_1_3_1_12_2","article-title":"Score level fusion for cancelable multi-biometric verification","author":"Dwivedi R.","year":"2018","journal-title":"Pattern Recognition Letters"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2016.2608002"},{"key":"e_1_3_1_14_2","first-page":"1","volume-title":"IEEE. Trans. MM","volume":"8","author":"Huang X.","year":"2017"},{"issue":"5","key":"e_1_3_1_15_2","article-title":"Deep patch representation with shared codebook for scene classification","volume":"15","author":"Jiang S.","year":"2019","journal-title":"ACM. TOMM"},{"issue":"4","key":"e_1_3_1_16_2","article-title":"Structure-aware deep learning for product image classification","volume":"15","author":"Chen Z.","year":"2019","journal-title":"ACM. TOMM"},{"issue":"39","key":"e_1_3_1_17_2","article-title":"Structure-aware multimodal features fusion for RGB-D scene classification and beyond","volume":"14","author":"Wang A.","year":"2018","journal-title":"ACM. TOMM"},{"key":"e_1_3_1_18_2","unstructured":"A. G. Howard M. Zhu B. Chen D. Kalenichenko W. Wang T. Weyand M. Andreetto and H. Adam. 2017. Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 (2017)."},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206686"},{"volume-title":"Proc. AVSS","year":"2017","author":"Beeck K. V.","key":"e_1_3_1_20_2"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2011.2129370"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2016.2589859"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2017.2649019"},{"key":"e_1_3_1_24_2","first-page":"1231","volume-title":"IEEE Trans. CSVT","volume":"25","author":"Zhang Y.","year":"2015"},{"key":"e_1_3_1_25_2","first-page":"988","volume-title":"IEEE Trans. IFS","volume":"9","author":"Wang T.","year":"2014"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/AIPR.2015.7444523"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/IWAIT.2018.8369749"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/2993148.2993165"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-018-7030-1"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-019-08397-0"},{"key":"e_1_3_1_31_2","first-page":"594","volume-title":"Proc. ACPR","author":"Krishnani D.","year":"2019"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2017.08.016"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/WACV.2017.10"},{"key":"e_1_3_1_34_2","first-page":"1","volume-title":"IEEE Trans. CSVT","author":"Raghunandan K. S.","year":"2018"},{"key":"e_1_3_1_35_2","first-page":"185","article-title":"Fast training of support vector machines using sequential minimal optimization","author":"Platt J. C.","year":"1999","journal-title":"Advances in Kernel Methods"},{"key":"e_1_3_1_36_2","first-page":"1499","volume-title":"IEEE Signal Processing Letters","volume":"23","author":"Zhang K.","year":"2016"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2014.7025898"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.bspc.2016.02.008"},{"key":"e_1_3_1_39_2","first-page":"1","volume-title":"Proc. NIPS","author":"Krizhevsky A.","year":"2012"},{"key":"e_1_3_1_40_2","first-page":"1","volume-title":"Proc. ICLR","author":"Smonyan K.","year":"2015"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3458051","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,1]],"date-time":"2023-01-01T22:02:59Z","timestamp":1672610579000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3458051"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,12]]},"references-count":41,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,11,30]]}},"alternative-id":["10.1145\/3458051"],"URL":"https:\/\/doi.org\/10.1145\/3458051","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"type":"print","value":"1551-6857"},{"type":"electronic","value":"1551-6865"}],"subject":[],"published":{"date-parts":[[2021,11,12]]},"assertion":[{"value":"2019-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-11-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}