direkt zum Inhalt springen

direkt zum Hauptnavigationsmenü

Sie sind hier

TU Berlin

Page Content

Multimedia Applications

Lupe
© Sebastian Knorr

The Communication Systems Group of the TU Berlin, led by Prof. Dr. Thomas Sikora, employed their results of multimedia analysis and processing in a couple of innovative multimedia applications and was involved in many national and international funded projects related to multimedia applications. The following list gives an overview of research areas we are involved in:

  • 2D-to-3D conversion of videos (automatic and interactive)
  • Geo-tagging in social networks
  • Genre detection in TV broadcast
  • Security in public transportation systems
  • Information exploitation of forensic data
  • Security at big events using drones
  • Privacy protection in video data
  • etc.

    Research Activities

    DeepStereoBrush: Interactive Depth Map Creation

    Bild
    © Sebastian Knorr

    In this paper, we introduce a novel interactive depth map creation approach for image sequences which uses depth scribbles as input at user-defined keyframes. These scribbled depth values are then propagated within these keyframes and across the entire sequence using a 3-dimensional geodesic distance transform (3D-GDT). In order to further improve the depth estimation of the intermediate frames, we make use of a con-volutional neural network (CNN) in an unconventional manner. Our process is based on online learning which allows us to specifically train a disposable network for each sequence individually using the user generated depth at keyframes along with corresponding RGB images as training pairs. more to: DeepStereoBrush: Interactive Depth Map Creation

    Privacy Preserving Technologies

    Bild
    © Communications Systems Group (TU-Berlin)

    The ever increasing number of surveillance camera networks being deployed all over the world has resulted in a high interest in the development of algorithms to automatically analyze the video footage, but has also opened new questions as how to efficiently manage the vast amount of information generated and, more important, how to protect the privacy of the individuals being recorded in their daily life. An technical approach are the Privacy Preserving Technologies (PET) which are algorithm to filter personal privacy related information and/or adapt the protection level of personal privacy in videos. more to: Privacy Preserving Technologies

    Multimodal Geo-tagging in Social Media Websites using Hierarchical Spatial Segmentation

    Bild
    FG NUE
    © FG NUE

    These days the sharing of photographs and videos is very popular in social networks. Many of these social media web- sites such as Flickr, Facebook and Youtube allows the user to manually label their uploaded videos with geo-information using a interface for dragging them into the map. However, the manually labelling for a large set of social media is still borring and error-prone. For this reason we present a hierarchical, multi-modal approach for estimating the GPS information. Our approach makes use of external resources like gazetteers to extract toponyms in the metadata and of visual and textual features to identify similar content. more to: Multimodal Geo-tagging in Social Media Websites using Hierarchical Spatial Segmentation

    Awards

    We were awarded the Lumiére Award 2018 for the Best Paper

    Bild
    © Michel Houet

    We are delighted to announce that we were awarded the Lumiere Award for the Best Paper at the International Conference on 3D Immersion/Stereopsia in Brussels in Dec. 2018! On behalf of the Advanced Imaging Society based in Hollywood, CA, Stereopsia organizes the competitions for the “Lumiere Awards” for the territory consisting of Europe, the Middle East, and Africa (EMEA). more to: We were awarded the Lumiére Award 2018 for the Best Paper

    Runner Up Best Full Paper Award @ ICIDS 2018

    Bild
    © Copyright??

    We are delighted to announce that our paper "Director’s Cut - Analysis of Aspects of Interactive Storytelling for VR Films" won the Runner Up Best Full Paper Award at the International Conference on Interactive Digital Storytelling, 05.12.2018 - 08.12.2018. more to: Runner Up Best Full Paper Award @ ICIDS 2018

    Scott Helt Memorial Award 2012

    Bild
    © FG NUE

    We are delighted to announce that Dr. Sebastian Knorr won the Scott Helt Memorial Award 2012 for the best journal paper published in the IEEE Transactions on Broadcasting in 2011. The title of the paper is "3D-TV Content Creation: Automatic 2D-to-3D Video Conversion". Congratulations to Dr. Knorr and the co-authors. more to: Scott Helt Memorial Award 2012

    Related Publications

    2019

    2018

    • Sebastian Knorr, Cagri Ozcinar, Colm O Fearghail, Aljosa Smolic
      Director’s Cut - A Combined Dataset for Visual Attention Analysis in Cinematic VR Content
      The 15th ACM SIGGRAPH European Conference on Visual Media Production, London, UK, 13.12.2018 - 14.12.2018
      Details BibTeX
    • Kai-Ole Ide
      Hybrid 3D Reconstruction for Geometry-Based Free Viewpoint Video
      2018
      Details BibTeX
    • Colm O Fearghail, Cagri Ozcinar, Sebastian Knorr, Aljosa Smolic
      Director’s Cut - Analysis of Aspects of Interactive Storytelling for VR Films
      International Conference for Interactive Digital Storytelling, Dublin, Ireland, 05.12.2018 - 08.12.2018
      Received the runner up best full paper award
      Details BibTeX
    • Declan Dowling , Colm O Fearghail , Aljosa Smolic, Sebastian Knorr
      Faoladh : A Case Study in Cinematic VR Storytelling and Production
      International Conference for Interactive Digital Storytelling, Dublin, Ireland, 05.12.2018 - 08.12.2018
      Details BibTeX
    • Sebastian Knorr, Matis Hudong, Julian Cabrera, Thomas Sikora, Aljosa Smolic
      [Lumiere Award] DeepStereoBrush: Interactive Depth Map Creation
      International Conference on 3D Immersion, Brussels, Belgium, 05.12.2018 - 06.12.2018
      Received the Lumiere Award for the best scientific paper
      Details BibTeX
    • Colm O Fearghail, Cagri Ozcinar, Sebastian Knorr, Aljosa Smolic
      Director´s Cut - Analysis of VR Film Cuts for Interactive Storytelling
      International Conference on 3D Immersion, Brussels, Belgium, 05.12.2018 - 05.12.2018
      Details BibTeX
    • Siwei Lyu, Ming-Ching Chang, Dawei Du, Wenbo Li, Yi Wei, Marco Del Coco, Pierluigi Carcagnì, Arne Schumann, Bharti Munjal, Dinh-Quoc-Trung Dang, Doo-Hyun Choi, Erik Bochinski, Fabio Galasso, Filiz Bunyak, Guna Seetharaman,Jang-Woon Baek, Jong Taek Lee, Kannappan Palaniappan, Kil-Taek Lim, Kiyoung Moon, Kwang-Ju Kim, Lars Sommer, Meltem Brandlmaier, Min-Sung Kang, Moongu Jeon, Noor M. Al-Shakarji, Oliver Acatay, Pyong-Kun Kim, Sikandar Amin, Thomas Sikora, Tien Dinh, Tobias Senst, Vu-Gia-Hy Che, Young-Chul Lim, Young-min Song, and Yun-Su Chung
      UA-DETRAC 2018: Report of AVSS2018 & IWT4S Challenge on Advanced Traffic Monitoring
      IEEE International Conference on Advanced Video and Signals-based Surveillance, Auckland, New Zealand, 27.11.2018 - 30.11.2018
      ISBN: 978-1-5386-9294-3/18
      Details BibTeX
    • Markus Küchhold, Maik Simon, Volker Eiselein, Thomas Sikora
      Scale-Adaptive Real-Time Crowd Detection and Counting for Drone Images
      25th IEEE International Conference on Image Processing (ICIP), Athens, Greece, 07.10.2018 - 10.10.2018
      Details BibTeX
    • Pengfei Zhu, Longyin Wen, Dawei Du, Xiao Bian, Haibin Ling, Qinghua Hu, Hao Cheng, Chengfeng Liu, Xiaoyu Liu, Wenya Ma, Qinqin Nie, Haotian Wu, Lianjie Wang, Arne Schumann, Dan Wang, Diego Ortego, Elena Luna, Emmanouil Michail, Erik Bochinski, Feng Ni, Filiz Bunyak, Gege Zhang, Guna Seetharaman, Guorong Li, Hongyang Yu, Ioannis Kompatsiaris, Jianfei Zhao, Jie Gao, Jose Martinez, Juan Miguel, Kannappan Palaniappan, Konstantinos Avgerinakis, Lars Sommer, Martin Lauer, Mengkun Liu, Noor Al-Shakarji, Oliver Acatay, Panagiotis Giannakeris, Qijie Zhao, Qinghua Ma, Qingming Huang, Stefanos Vrochidis, Thomas Sikora, Tobias Senst, Wei Song, Wei Tian, Wenhua Zhang, Yanyun Zhao, Yidong Bai, Yinan Wu, Yongtao Wang, Yuxuan Li, Zhaoliang Pi, Zhiming Ma
      VisDrone-VDT2018: The Vision Meets Drone Video Detection and Tracking Challenge Results
      ECCV 2018 Workshops, volume Part V, Munich, Germany, 08.09.2018 - 14.09.2018, pp. 496-518
      Details BibTeX
    • Simone Croci, Mairead Grogan, Sebastian Knorr, Aljosa Smolic
      Colour Correction for Stereoscopic Omnidirectional Images
      Irish Machine Vision and Image Processing Conference, Belfast, North Ireland, 29.08.2018 - 31.08.2018
      ISBN: 978-0-9934207-3-3
      Details BibTeX

    2017

    2015

    2014

    2013

    2012

    • Working Notes Proceedings of the MediaEval 2012 Workshop
      Martha A. Larson, Sebastian Schmiedeke, Pascal Kelm, Adam Rae, Vasileios Mezaris, Tomas Piatrik, Mohammad Soleymani, Florian Metze, Gareth J.F. Jones (ed(s).), CEUR-WS.org, 25.10.2012
      ISSN 1613-0073 URN: urn:nbn:de:0074-927-7
      Details BibTeX
    • Adam Rae, Pascal Kelm
      Working Notes for the Placing Task at MediaEval 2012
      Working Notes Proceedings of the MediaEval 2012 Workshop, volume 927, Santa Croce in Fossabanda Piazza Santa Croce, 5 - 56125 - Pisa - Toscana - Italia, 04.10.2012 - 05.10.2012, pp. 1-2
      ISSN 1613-0073
      Details BibTeX
    • Sebastian Schmiedeke, Christoph Kofler, Isabelle Ferrane
      Overview of the MediaEval 2012 Tagging Task
      Working Notes Proceedings of the MediaEval 2012 Workshop, volume 927, Santa Croce in Fossabanda Piazza Santa Croce, 5 - 56125 - Pisa - Toscana - Italia, 04.10.2012 - 05.10.2012, pp. 75-76
      ISSN 1613-0073
      Details BibTeX
    • Sebastian Schmiedeke, Pascal Kelm, Thomas Sikora
      TUB @ MediaEval 2012 Tagging Task: Feature Selection Methods for Bag-of-(visual)-Words Approaches
      Working Notes Proceedings of the MediaEval 2012 Workshop, volume 927, Santa Croce in Fossabanda Piazza Santa Croce, 5 - 56125 - Pisa - Toscana - Italia, 04.10.2012 - 05.10.2012, pp. 79-80
      ISSN 1613-0073
      Details BibTeX
    • Sebastian Knorr, Kai Ide, Matthias Kunter, and Thomas Sikora
      THE AVOIDANCE OF VISUAL DISCOMFORT AND BASIC RULES FOR PRODUCING “GOOD 3D” PICTURES
      SMPTE Motion Imaging Journal, Society of Motion Picture & Television Engineers, October 2012, pp. 72-79
      Details BibTeX
    • Pascal Kelm
      Where in the World?: The State of Automatic Geotagging of Video (invited lecture)
      DGA workshop, École nationale supérieure des techniques avancées (ENSTA), 32 bd Victor, Paris 15`eme, 25.06.2012
      The DGA workshop on multimedia information processing aims at presenting the technological state of the art together with the organization underlying progress in the domain. It also aims at fostering exchanges between government, industry and academic personnel interested in the domain.
      Details BibTeX

    2011

    2010

    2008

    • Juan José Burred, Martin Haller, Shan Jin, Amjad Samour, Thomas Sikora
      Audio Content Analysis
      in Semantic Multimedia and Ontologies: Theory and Applications, Yiannis Kompatsiaris, Paola Hobson (ed(s).), Springer Verl., London, UK, January 2008, pp. 123-161
      ISBN 978-1-84800-075-9
      Details BibTeX

    2007

    2005

    Zusatzinformationen / Extras