A Multi-expert System for Movie Segmentation | SpringerLink
Skip to main content
Springer Nature Link
Log in

A Multi-expert System for Movie Segmentation

  • Conference paper
  • First Online:
Multiple Classifier Systems (MCS 2002)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2364))

Included in the following conference series:

Abstract

In this paper we present a system for movie segmentation based on the automatic detection of dialogue scenes.

The proposed system processes the video stream directly in the MPEG domain: it starts with the segmentation of the video footage in shots. Then, a characterization of each shot between dialogue and not-dialogue according to a Multi-Expert System (MES) is performed. Finally, the individuated sequences of shots are aggregated in dialogue scenes by means of a suitable algorithm. The MES integrates three experts, which classifies a given shot on the basis of very complementary descriptions; in particular an audio classifier, a face detector and a camera motion estimator have been built up and employed.

The performance of the system have been tested on a huge MPEG movie database made up of more than 15000 shots and 200 scenes, giving rise to encouraging results.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 5719
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 7149
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. M. M. Yeung, B. Liu, “Efficient matching and clustering of video shots”, in Proc IEEE ICIP’95, vol II, pp. 260–263.

    Google Scholar 

  2. A. Hanjalic, R. Lagendijk, J. Biemond, “Automated high-level movie segmentation for advanced video-retrieval systems”, in IEEE Trans. on Circuits and Systems for Video Technology, vol. 9, No. 4, June 1999, pp. 580–588.

    Article  Google Scholar 

  3. S. Boykin, A. Merlino, “Machine learning of event segmentation for news on demand”, in Communications of the ACM, Feb. 2000, vol. 43, No. 2, pp. 35–41.

    Article  Google Scholar 

  4. M. Bertini, A. Del Bimbo, P. Pala, “Content-based Indexing and Retrieval of TV-news”, in Pattern Recognition Letters, 22, (2001), 503–516.

    Article  MATH  Google Scholar 

  5. C. Saraceno, R. Leopardi, “Identification of Story Units in Audio-Visual Sequences by Joint Audio and Video Processing”, in Proc. ICIP’98, pp. 363–367, 1998.

    Google Scholar 

  6. L. P. Cordella, P. Foggia, C. Sansone, F. Tortorella and M. Vento, Reliability Parameters to Improve Combination Strategies in Multi-Expert Systems, Pattern Analysis & Applications, Springer-Verlag, vol. 2, pp. 205–214, 1999.

    Article  Google Scholar 

  7. T.K. Ho, J.J. Hull, S.N. Srihari, “Decision Combination in Multiple Classifier Systems”, IEEE Transactions on Pattern Analysis and Machine Intelligence 1994; 16(1): 66–75.

    Article  Google Scholar 

  8. J. Kittler, J. Hatef, R.P.W. Duin, J. Matas, “On Combining Classifiers”, IEEE Trans. on PAMI, vol 20 n. 3 March 1998.

    Google Scholar 

  9. S.C. Pei, Y.Z. Chou, “Efficient MPEG compressed video analysis using macroblock type information”, in IEEE Trans. on Multimedia, pp. 321–333, Dec. 1999, Vol. 1, Issue: 4.

    Article  Google Scholar 

  10. H. Wang, S.F. Chang, “A Highly Efficient System for Automatic Face Region Detection in MPEG Video”, IEEE Trans. on Circuits and Systems for Video Technology, vol. 7, no. 4, August 1997, pp. 615–628.

    Article  MathSciNet  Google Scholar 

  11. Y.P. Tan, D.D. Saur, S.R. Kulkarni, P.J. Ramadge, “Rapid Estimation of Camera Motion from Compressed Video with Application to Video Annotation”, IEEE Trans. on Circuits and Systems for Video Technology, vol. 10, no. 1, February 2000, pp. 133–146.

    Article  Google Scholar 

  12. M. De Santo, G. Percannella, C. Sansone, M. Vento, “Classifying Audio of Movies by a Multi-Expert System”, Proc. of the 11th ICIAP, pp. 386–391, 2001.

    Google Scholar 

  13. M. De Santo, G. Percannella, C. Sansone, M. Vento, “Dialogue Scenes Detection in Mpeg Movies: a Multi-Expert Approach”, LNCS, vol. 2184, pp. 192–201, Sept. 2001.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Dipartimento di Informatica e Sistemistica, Università di Napoli “Federico II”, Via Claudio, 21 I-80125, Napoli, Italy

    L. P. Cordelia & C. Sansone

  2. Dipartimento di Ingegneria dell’Informazione e di Ingegneria Elettrica, Università di Salerno, Via P.te Don Melillo, 1 I-84084, Fisciano, SA, Italy

    M. De Santo, G. Percannella & M. Vento

Authors
  1. L. P. Cordelia
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M. De Santo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. G. Percannella
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. C. Sansone
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. M. Vento
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Dept. of Electrical and Electronical Engineering, University of Cagliari, Piazza D’Armi, 09123, Cagliari, Italy

    Fabio Roli

  2. Centre for Vision, Speech and Signal Processing, University of Surrey, Guilford, Surrey, GUZ 7XH, UK

    Josef Kittler

Rights and permissions

Reprints and permissions

Copyright information

© 2002 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Cordelia, L.P., De Santo, M., Percannella, G., Sansone, C., Vento, M. (2002). A Multi-expert System for Movie Segmentation. In: Roli, F., Kittler, J. (eds) Multiple Classifier Systems. MCS 2002. Lecture Notes in Computer Science, vol 2364. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45428-4_30

Download citation

  • DOI: https://doi.org/10.1007/3-540-45428-4_30

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-43818-2

  • Online ISBN: 978-3-540-45428-1

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation