The extraction of description is important in audio-visual document retrieval. Although various approaches were proposed, extracting semiotic descriptions that reflect the content knowledge remains a challenging task. This paper proposes an approach for describing external and a semiotic description of audio-visual document. The main objective is to associate a set of semiotic descriptions to each filmic segment in order to facilitate the interrogation of huge quantities of the filmic document. The extraction description process relies mainly on the probabilistic LDA model and Dublin Core. To identify the description, a combination method applied both weighing score and position of each extracted theme. Qualitative and quantitative experiments were performed to evaluate the effectiveness of the proposed approach. The performance of the extracted semiotic description is better than that of the descriptions presented in the literature. The good results were obtained due to good choice of the information sources, the adaptation of the LDA, and the importance of the identification process.<\/p>","DOI":"10.4018\/ijiit.296239","type":"journal-article","created":{"date-parts":[[2022,3,11]],"date-time":"2022-03-11T21:31:14Z","timestamp":1647034274000},"page":"1-24","source":"Crossref","is-referenced-by-count":0,"title":["Semiotic and Thematic Process for Audiovisual Documents Description"],"prefix":"10.4018","volume":"18","author":[{"given":"Manel","family":"Fourati","sequence":"first","affiliation":[{"name":"MIR@CL Laboratory, University of Sfax, Tunisia"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-2441-9901","authenticated-orcid":true,"given":"Anis","family":"Jedidi","sequence":"additional","affiliation":[{"name":"High Institute of Computer Science and Multimedia, Tunisia"}]},{"given":"Faiez","family":"Gargouri","sequence":"additional","affiliation":[{"name":"University of Sfax, Tunisia"}]}],"member":"2432","reference":[{"key":"IJIIT.296239-0","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.70825"},{"key":"IJIIT.296239-1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-92673-3_18"},{"key":"IJIIT.296239-2","doi-asserted-by":"publisher","DOI":"10.3166\/dn.17.2.85-100"},{"key":"IJIIT.296239-3","first-page":"993","article-title":"Latent dirichlet allocation.","volume":"3","author":"D. M.Blei","year":"2003","journal-title":"Journal of Machine Learning Research"},{"key":"IJIIT.296239-4","doi-asserted-by":"publisher","DOI":"10.1109\/IPAS.2018.8708893"},{"key":"IJIIT.296239-5","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2017.11.050"},{"key":"IJIIT.296239-6","doi-asserted-by":"publisher","DOI":"10.1109\/MMUL.2003.1237551"},{"key":"IJIIT.296239-7","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298698"},{"key":"IJIIT.296239-8","doi-asserted-by":"publisher","DOI":"10.1109\/76.927421"},{"key":"IJIIT.296239-9","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2021.102531"},{"key":"IJIIT.296239-10","doi-asserted-by":"publisher","DOI":"10.1007\/s13740-016-0060-9"},{"key":"IJIIT.296239-11","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-3348"},{"key":"IJIIT.296239-12","first-page":"1381","article-title":"A graph based audio-visual document annotation and browsing system.","volume":"2","author":"E.Egyed-Zsigmond","year":"2000","journal-title":"Content-Based Multimedia Information Access-Volume"},{"key":"IJIIT.296239-13","doi-asserted-by":"crossref","unstructured":"Fourati, M., Chaari, A., Jedidi, A., & Gargouri, F. (2015). A semiotic semi-automatic annotation for movie audiovisual document. 15th International Conference on Intelligent Systems Design and Applications (ISDA).","DOI":"10.1109\/ISDA.2015.7489173"},{"key":"IJIIT.296239-14","doi-asserted-by":"publisher","DOI":"10.4018\/IJMDEM.2015040104"},{"key":"IJIIT.296239-15","doi-asserted-by":"crossref","unstructured":"Fourati, M., Jedidi, A., & Gargouri, F. (2014). Automatic Identification Genre of Audiovisual Documents. Computer Systems and Applications (AICCSA), 2014 IEEE\/ACS 11th International Conference On.","DOI":"10.1109\/AICCSA.2014.7073235"},{"key":"IJIIT.296239-16","doi-asserted-by":"crossref","unstructured":"Fourati, M., Jedidi, A., & Gargouri, F. (2017). Generic descriptions for movie document: an experimental study. 2017 IEEE\/ACS 14th International Conference on Computer Systems and Applications (AICCSA), 766\u2013773.","DOI":"10.1109\/AICCSA.2017.164"},{"key":"IJIIT.296239-17","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-020-09589-9"},{"key":"IJIIT.296239-18","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33018328"},{"key":"IJIIT.296239-19","first-page":"1290","article-title":"Scene-edge gru for video caption. 2020 IEEE 4th Information Technology, Networking","author":"X.Hao","year":"2020","journal-title":"Electronic and Automation Control Conference (ITNEC)"},{"key":"IJIIT.296239-20","doi-asserted-by":"publisher","DOI":"10.3115\/981732.981734"},{"key":"IJIIT.296239-21","doi-asserted-by":"publisher","DOI":"10.1109\/NCC.2019.8732253"},{"key":"IJIIT.296239-22","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-018-6894-4"},{"key":"IJIIT.296239-23","doi-asserted-by":"publisher","DOI":"10.1201\/b11723"},{"key":"IJIIT.296239-24","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2016.2614184"},{"key":"IJIIT.296239-25","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2020.2983360"},{"key":"IJIIT.296239-26","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.338"},{"key":"IJIIT.296239-27","first-page":"1975","article-title":"Anomaly detection in crowded scenes.","author":"V.Mahadevan","year":"2010","journal-title":"2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition"},{"key":"IJIIT.296239-28","unstructured":"Martin, J.-P. (2005). Description s\u00e9miotique de contenus audiovisuels. Universit\u00e9 de Paris-Sud. Facult\u00e9 des Sciences d\u2019Orsay (Essonne)."},{"key":"IJIIT.296239-29","unstructured":"Michard, A. (2001). XML langage et applications. Eyrolles."},{"issue":"4","key":"IJIIT.296239-30","article-title":"Methodological principles to create a metadata extension to the Darwin core standard for agrobiodiversity data.","volume":"14","author":"F.Miranda Soares","year":"2020","journal-title":"Brazilian Journal of Information Science"},{"key":"IJIIT.296239-31","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.117"},{"key":"IJIIT.296239-32","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.497"},{"key":"IJIIT.296239-33","first-page":"6504","article-title":"Video captioning with transferred semantic attributes.","author":"Y.Pan","year":"2017","journal-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition"},{"key":"IJIIT.296239-34","first-page":"360","article-title":"Identity-Aware Multi-Sentence Video Description.","author":"J. S.Park","year":"2020","journal-title":"European Conference on Computer Vision"},{"key":"IJIIT.296239-35","first-page":"91","article-title":"Faster r-cnn: Towards real-time object detection with region proposal networks.","author":"S.Ren","year":"2015","journal-title":"Advances in Neural Information Processing Systems"},{"key":"IJIIT.296239-36","first-page":"37","article-title":"Topictiling: a text segmentation algorithm based on lda.","author":"M.Riedl","year":"2012","journal-title":"Proceedings of ACL 2012 Student Research Workshop"},{"key":"IJIIT.296239-37","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2014.02.017"},{"key":"IJIIT.296239-38","first-page":"3202","article-title":"A dataset for movie description.","author":"A.Rohrbach","year":"2015","journal-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition"},{"key":"IJIIT.296239-39","doi-asserted-by":"publisher","DOI":"10.1007\/s00530-019-00610-2"},{"key":"IJIIT.296239-40","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2016.7532983"},{"key":"IJIIT.296239-41","doi-asserted-by":"publisher","DOI":"10.1145\/2810133.2810141"},{"key":"IJIIT.296239-42","unstructured":"Stockinger, P. (2003). Le document audiovisuel: proc\u00e9dures de description et exploitation. Herm\u00e8s Science Publications."},{"key":"IJIIT.296239-43","unstructured":"Stockinger, P. (2011). Les archives audiovisuelles\u202f: Description, indexation et publication. Lavoisier."},{"key":"IJIIT.296239-44","doi-asserted-by":"publisher","DOI":"10.1002\/9781118561980"},{"key":"IJIIT.296239-45","article-title":"Object detection in videos by high quality object linking.","author":"P.Tang","year":"2019","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"IJIIT.296239-46","unstructured":"Torabi, A., Pal, C., Larochelle, H., & Courville, A. (2015). Using descriptive video services to create a large data source for video annotation research. ArXiv Preprint ArXiv:1503.01070."},{"key":"IJIIT.296239-47","first-page":"4534","article-title":"Sequence to sequence-video to text.","author":"S.Venugopalan","year":"2015","journal-title":"Proceedings of the IEEE International Conference on Computer Vision"},{"key":"IJIIT.296239-48","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2018.07.024"},{"key":"IJIIT.296239-49","doi-asserted-by":"publisher","DOI":"10.1002\/bult.70"},{"key":"IJIIT.296239-50","unstructured":"Yaginuma, T., Pereira, T., & Baptista, A. A. (2003). Metadata elements for digital news resource description. Academic Press."},{"key":"IJIIT.296239-51","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2018.2855422"},{"key":"IJIIT.296239-52","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2019.2916757"},{"key":"IJIIT.296239-53","doi-asserted-by":"publisher","DOI":"10.1007\/s11063-019-10113-w"}],"container-title":["International Journal of Intelligent Information Technologies"],"original-title":[],"language":"ng","link":[{"URL":"https:\/\/www.igi-global.com\/viewtitle.aspx?TitleId=296239","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,7]],"date-time":"2024-02-07T14:28:48Z","timestamp":1707316128000},"score":1,"resource":{"primary":{"URL":"https:\/\/services.igi-global.com\/resolvedoi\/resolve.aspx?doi=10.4018\/IJIIT.296239"}},"subtitle":[""],"short-title":[],"issued":{"date-parts":[[2022,4,29]]},"references-count":54,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,1]]}},"URL":"https:\/\/doi.org\/10.4018\/ijiit.296239","relation":{},"ISSN":["1548-3657","1548-3665"],"issn-type":[{"value":"1548-3657","type":"print"},{"value":"1548-3665","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,4,29]]}}}