direkt zum Inhalt springen

direkt zum Hauptnavigationsmenü

Sie sind hier

TU Berlin

Inhalt des Dokuments

Compression and Transmission

Lupe
© NUE

In the past years our research group has been investigating algorithms that drastically depart from “Motion Compensated DPCM/Transform (MC-DPCM)”. Our prime intention is to allow ourselves a completely “fresh view” on how non-linear dependencies between pixels and motion in images and video can be described and harvested for compression. To this end we employ non-linear machine learning algorithms that explore dependencies between vast amounts of pixels in images and video sequences. Our current approaches are based on non-linear Kernel methods, Steered Mixture of Experts networks (MoE) and Restricted Boltzmann Machines and show strong resemblance to recent work on deep neural networks. Our experiments give hope that our networks may provide far better visual quality compared to DPCM/Transform approaches in the long run. 

Research Activities

Compression of Images and Video with SMoE Gating Networks

Bild
Figure 1: Swarm of steered atoms of a SMoE Gating Network for a video sequence with 64 frames.
© Communication Systems Group (TU-Berlin)

Our challenge is to efficiently identify and harvest longest-range correlations in images and video - to allow for leaps in compression. Our strategies completely depart from current JPEG and MPEG/ITU type compression approaches with block processing, block transforms and motion vectors. In our recent work we develop specifically designed SMoE Gating Networks for compression. These networks are based on Steered Mixture-of-Experts (SMoE) networks that distribute swarms of N steered “atoms” into arrays of image pixels (for images) or into 3D stacks of video pixels (for video). Simple “atoms” may comprise of steered 2D Gaussian Kernels (for images) or of steered 3D Gaussian Kernels (for video). Kernel parameters include location of individual Kernels as well as steering and bandwidth parameters. mehr zu: Compression of Images and Video with SMoE Gating Networks

Sparse Steered Mixtureof-Experts (SMoE) regression networks for Image and Video compression

Bild
© Communications Systems Group (TU-Berlin)

Kernel regression has been proven successful for image denoising, deblocking and reconstruction. These techniques lay the foundation for new image coding opportunities. We introduce a novel compression scheme: The sparse Steered Mixtureof-Experts (SMoE) regression network for coding image and video data. mehr zu: Sparse Steered Mixtureof-Experts (SMoE) regression networks for Image and Video compression

Motion Modeling for Motion Vector Coding in HEVC

Bild
© CSG

Motion Modeling for Motion Vector Coding in HEVC" Tok, M.; Sikora, T.submitted to the Picture Coding Symposium (PCS) 2015 Abstract During the standardization of HEVC, new motion information coding and prediction schemes such as temporal motion vector prediction have been investigated to reduce the spatial redundancy of motion vector fields used for motion compensated inter prediction. In this paper a general motion model based vector coding scheme is introduced. This scheme includes estimation, coding and dynamic recombination of parametric motion models to generate vector predictorsand merge candidates for all common HEVC inter coding settings. Bit rate reductions of up to 4.9% indicate that higher order motion models can increase the efficiency of motion information coding in modern hybrid video coding standards. mehr zu: Motion Modeling for Motion Vector Coding in HEVC

Theoretical Considerations Concerning Pixelwise Temporal Filtering

Bild
BlowingBubbles
© JCT-VC

The following zip-files contain exemplary groundtruth motion vector data for the test sequences. Due to website restrictions the filesize is limited to 20MB. If you want to obtain the complete motion vector fields please contact esche@nue.tu-berlin.de. mehr zu: Theoretical Considerations Concerning Pixelwise Temporal Filtering

Video Coding Group

Bild
ITU/ISO/IEC
© CSG

The working group "Video Coding" deals with approaches of global and local motion estimation and compensation with the aim to improve existing video codecs like e.g. H.264 / AVC. Currently, the working group is active in particular within the framework of the ITU / ISO / IEC standardization effort "HEVC". This has already resulted in numerous publications and input documents for MPEG. The sub-projects listed below have been processed so far. mehr zu: Video Coding Group

MPEG-4 Audio Lossless Coding (ALS)

Bild
© -

Der MPEG-4 ALS Standard gehört zur Familie der MPEG-4 Audiocodierstandards, die von der ISO (www.iso.org) herausgegeben werden. Im Gegensatz zu verlustbehafteten Verfahren wie MP3 und AAC, die lediglich die subjektiv empfundene Qualität zu erhalten versuchen, erlaubt die verlustlose Codierung jedoch eine exakte Wiederherstellung jedes einzelnen Bits der ursprüglichen Audiodaten. Das grundlegende Verfahren von MPEG-4 ALS wurde am Fachgebiet Nachrichtenübertragung der Technischen Universität Berlin entwickelt. Die erste Version des MPEG-4 ALS Standards wurde 2006 veröffentlicht, und die aktuelle Beschreibung ist inzwischen Teil der 4. Edition (2009) des übergreifenden MPEG-4 Audiostandards (ISO/IEC 14496-3:2009). Eine neue Version (RM23) der MPEG-4 ALS Referenzsoftware und des Codecs ist jetzt verfügbar. Mehr dazu hier (in English)... MPEG-4 ALS wird mittlerweile von FFmpeg, MPlayer, VLC Media Player und weiteren Anwendungen unterstützt. Mehr dazu hier (in Englisch)... mehr zu: MPEG-4 Audio Lossless Coding (ALS)

Software

Regularized Gradient Descent Training of Steered Mixture of Experts for Sparse Image Representation (tf-smoe)

Bild
© Communications Systems Group (TU-Berlin)

A Tensorflow-based implementation of the Steered Mixture-of-Experts (SMoE) image modelling approach described in the ICIP 2018 paper Regularized Gradient Descent Training of Steered Mixture of Experts for Sparse Image Representation. This repository contains the implementation of a reference class for training and regressing a SMoE model, an easy to use training script as well as a jupyter notebook which helps you getting started writing you own code with a more elaborate example. mehr zu: Regularized Gradient Descent Training of Steered Mixture of Experts for Sparse Image Representation (tf-smoe)

Awards

Best Student Paper Award @ IEEE ICME 2017

Bild
© FG NUE

We are delighted to announce that our paper "Steered mixture-of-experts for light field coding, depth estimation, and processing" won the Best Student Paper Award at the IEEE International Conference on Multimedia and Expo, 10.07.2017 - 14.07.2017. Congratulations to Ruben Verhack and the co-authors. mehr zu: Best Student Paper Award @ IEEE ICME 2017

Prof. Thomas Sikora of Technical University Berlin receives prestigious 2016 Google Faculty Research Award in Machine Perception

Bild
© NUE

Congrats to Prof. Sikora and his Communication Systems Lab members at TU Berlin, Lieven Lange, Rolf Jongebloed, and the colleagues from Uni Ghent/iMinds Lab, Ruben Verhack (joint PhD between TUB & iMind Lab Uni Ghent), Prof. Peter Lambert and Dr. Glenn van Walllendael. The award was given for his work on Video Compression with Steered-Mixture-of-Experts Networks. mehr zu: Prof. Thomas Sikora of Technical University Berlin receives prestigious 2016 Google Faculty Research Award in Machine Perception

Highly Recommended Paper Award @ PCS 2015

Bild
© FG NUE

We are delighted to announce that our paper "Lossless Image Compression based on Kernel Least Mean Squares" won the Highly Recommended Paper Award at the IEEE Picture Coding Symposium, 31.05.2015 - 03.06.2015. Congratulations to Ruben Verhack and the co-authors. mehr zu: Highly Recommended Paper Award @ PCS 2015

Top 10% Paper Award @ ICIP 2014

Bild
© Copyright??

We are delighted to announce that our paper "LOSSY IMAGE CODING IN THE PIXEL DOMAIN USING A SPARSE STEERING KERNEL SYNTHESIS APPROACH" won the Top 10% Paper Award at the IEEE International Conference on Image Processing, 27.10.2014 - 30.10.2014. Congratulations to Ruben Verhack and the co-authors. mehr zu: Top 10% Paper Award @ ICIP 2014

Related Publications

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2000

1999

1997

  • Peter Noll
    MPEG Digital Audio Coding - Setting the Standard for High-Quality Audio Compression (invited)
    IEEE Signal Processing Magazine, Special Issue on MPEG Audio and Video Coding, vol. 14, no. 5, September 1997, pp. 59 - 81
    Details BibTeX

1996

  • Peter Noll
    Source Compression: Audio Coding
    in The Communications Handbook, J. Gibson, Texas A&M University (ed(s).), CRC, Inc., 1996, pp. 1475-1487
    Details BibTeX

1995

1990

  • Peter Noll
    Data Compression Techniques (invited)
    1st Working Conference on Common Standards for Quantitative Electrocardiography, "Digital ECG Data: Communication, Encoding and Storage", Leuven (Belgien), 1990, pp. 39 - 57
    Details BibTeX
  • Peter Noll
    Data Compression Techniques for New Standards in Speech and Image Coding
    VI. Internationales Weiterbildungsprogramm Berlin '90, TU Berlin, Zentrum für Technologische Zusammenarbeit, 1990, pp. 245 - 264
    Details BibTeX

Zusatzinformationen / Extras