Multimedia Computing and Computer Vision Lab












Student Theses


Source Code / Datasets




Prof. Dr. Rainer Lienhart

From Multimedia Computing Lab - University of Augsburg

  • Office Hours:
    • Wednesday
    • 14:00 - 15:00
  • Phone:
    • +49 (821) 598 5703
  • Admin:
    • +49 (821) 598 2378
  • Fax:
    • +49 (821) 598 4329
  • Room:
    • 1013 N

Research Interests:

  • Automatic content analysis, mining and retrieval of multimedia data
    (multimedia = multiple signals from different sources)
  • Computer vision
    (object detection/recognition, human pose estimation, image captioning, automated visual inspection and error classification)
  • Machine learning (esp. deep learning) & statistical computing
  • Automatic analysis of multimodal and multilingual documents


Rainer Lienhart is a full professor in the computer science department of the University of Augsburg and chair of the Multimedia Computing and Computer Vision Lab (MMC Lab). His group is focusing on all aspects of (1) large-scale image, video, humans pose, sensor and data mining algorithms, (2) object, human pose and action detection/recognition as well as (3) image, video, human pose and action retrieval.

Since April 2010, he is also the executive director of the Institute for Computer Science at the University of Augsburg. From August 2017 to March 2018 he spent his sabbatical at FXPAL, while in 2009, he spent his sabbatical at Willow Garage – a robotic company, which is working on laying the groundwork for the industry that will be needed to enable personal robotics applications by investing in open source such as OpenCV and open platform adoption models. Rainer Lienhart has always been an active contributor to OpenCV. From August 1998 to July 2004 he was a Staff Researcher at Intel's Microprocessor Research Lab in Santa Clara, California, where he worked on transforming a network of heterogeneous, distributed computing platforms into an array of audio/video sensors and actuators capable of performing complex DSP tasks such as distributed beamforming, audio rendering, audio/visual tracking, and camera array processing. In particular, this requires putting distributed heterogeneous computing platforms with audio -visual sensors into a common time and space coordinate system. At the same time, he was also continuing his work on media mining, where he is well known for his work in video content analysis with contributions in text detection/recognition, commercial detection, face detection (see also here), shot and scene detection, and automatic video abstraction. He received his Ph.D. in Computer Science from the University of Mannheim, Germany, in 1998, where he was a member of the Movie Content Analysis Project (MoCA).

The scientific work of Rainer Lienhart covers more than 80 refereed publications and more than 20+ patents. He was a general co-chair of ACM Multimedia 2017, ACM Multimedia 2007 and SPIE Storage and Retrieval of Media Databases 2004 & 2005. He serves in the editorial boards of 3 international journals. For more than a decade he is a committee member of ACM Multimedia, IEEE ICME, SPIE Storage and Retrieval of Media Databases, and many more conferences. From July 2009 till June 2017 he was the vice chair of SIGMM.

Top Selected Publications

  1. Rainer Lienhart and Jochen Maydt. An Extended Set of Haar-like Features for Rapid Object Detection. IEEE ICIP 2002, Vol. 1, pp. 900-903, Sep. 2002. [PDF]; see also MRL Technical Report Dec. 2002. [PDF]
    Cited more then 3400 times
  2. Rainer Lienhart. Comparison of Automatic Shot Boundary Detection Algorithms. In Image and Video Processing VII 1999, Proc. SPIE 3656-29, Jan. 1999. [PDF]
    Cited more then 600 times
  3. Rainer Lienhart, Silvia Pfeiffer, and Wolfgang Effelsberg. Video Abstracting. Communications of the ACM , Vol. 40, No. 12, pp.55-62, December 1997. [PDF]
    Cited more then 450 times
  4. Rainer Lienhart and Axel Wernicke. Localizing and Segmenting Text in Images, Videos and Web Pages. IEEE Transactions on Circuits and Systems for Video Technology, Vol. 12, No.4, pp. 256 -268, April 2002. [PDF]
    Cited more then 600 times
  5. Rainer Lienhart. Video OCR: A Survey and Practitioner’s Guide. In Video Mining, Kluwer Academic Publisher, pp. 155-184, Oct. 2003. [PDF]
  6. Simon Hoffmann and Rainer Lienhart. OpenMP: Eine Einführung in die parallele Programmierung mit C/C++, Springer Verlag, April 2008, ISBN: 978-3-540-73122-1. (zur Verlagsseite) (Errata)
  7. Rainer Lienhart, Alexander Kuranov, and Vadim Pisarevsky. Empirical Analysis of Detection Cascades of Boosted Classifiers for Rapid Object Detection. MRL Technical Report, Intel Labs, May 2002, revised Dec. 2002. [PDF]
    Cited more then 1000 times
  8. Rainer Lienhart. Reliable Transition Detection In Videos: A Survey and Practitioner's Guide. International Journal of Image and Graphics (IJIG), Vol. 1, No. 3, pp. 469-486, 2001. [PDF]
  9. Eva Hörster, Rainer Lienhart, Malcolm Slaney. Image Retrieval on Large-Scale Image Databases. ACM International Conference on Image and Video Retrieval (CIVR) 2007, pp. 17-24, Amsterdam, Netherlands, July 2007. [PDF]
  10. Rainer Lienhart, Eva Hörster, Stefan Romberg. Multilayer pLSA for Multimodal Image Retrieval. ACM International Conference on Image and Video Retrieval (CIVR 2009), Greece, July 8-10, 2009.
    Also Technical Report 2009-02, University of Augsburg, Institute of Computer Science Apr. 2009. [PDF]
  11. Ina Döhring and Rainer Lienhart. Mining TV Broadcasts for Recurring Video Sequences. ACM International Conference on Image and Video Retrieval (CIVR 2009), Greece, July 8-10, 2009.
    Also Technical Report 2009-03, University of Augsburg, Institute of Computer Science Apr. 2009. [PDF]

A complete publication list can be found here.

Editorial Boards

  1. IEEE Transactions on Circuits and Systems for Video Technology
  2. ACM Computing Surveys
  3. ACM Transactions on Multimedia Computing Communications and Applications.