Internship at Sony Deutschland GmbH in Stuttgart, Germany


TV Commercial Detection based on video and audio feature integration.

For automatic TV Commercial detection there are different approaches that can be considered, depending on various factors. According to the type of corpora available, TV Commercial Detection can be realized for a particular country, for a region or as a world-wide solution. According to the type of input used for the feature acquisition techniques, the TV Commercial Detection can be based on audio – where only the audio stream properties are used, or on video, where only the video properties are used.

The Internship will concentrate on the pre-processing of already existing audio features on a European corpora, as well as the combination of those audio features with the video features into a classifier, since from the classification point of view, it makes more sense to make use both audio and video features in a joint classifier.

This work includes developing new pre-processing and post-processing techniques, as well as acquiring familiarity with different classification approaches such as regression trees, Gaussian Mixture Models (GMM) and support vector machines (SVM), and a practical implementation of those using Matlab.

The ideal candidate for this internship will have some knowledge of digital signal processing as well as practical programming experience in Matlab. Knowledge of search algorithms and complexity analysis is a plus. Working language is English.
Start: March / April 2008
Duration: 6 months, full-time internship (38.5 hours / week).
Remuneration: 1000 Euro gross / month.

The main tasks of the internship will be:

• Optimization of audio features by pre-processing and post-processing (digital signal processing). Implementation in Matlab.
• Simulation of the performance of the audio features (single feature classifier) and of more complex classifiers (tree, GMM, SVM) based on several input features, also including video features.
• Simulation of the performance of the system for different European markets such as UK, Germany, or Spain with a view to country-specific optimization as well as to a global European solution.
• Detailed documentation of the algorithms implemented and the results obtained.
• Labeling of new corpora if required
• Optimization and further development of the overall Commercial Detection system.

If interested please send your CV in English or German to (please include a list of grades):

Dipl.-Ing. Javier Alonso García
Tel.: +49 711-5858 501
Sony Deutschland GmbH
Stuttgart Technology Center
Hedelfinger Str. 61, D-70327 Stuttgart (Germany)