Multimedia Signal Processing Research Group
Objective Research Activities Staff Members Ongoing Research Project Milestone Achievements & Awards  Distinguish Services Thesis Publication
 
EEE3
School of EEE
NTU

 
 
Objective
The research in this group span all types of digital media  text, data, audio, speech, image and graphics, video and animation. In addition, we address integrated usage of these media for versatile multimedia applications as well as technical aspects of their reliable end-to-end transmission over heterogeneous networks and wireless channels.

Highlights of Research Activities                                                                                            TOP
In 1999, there are 10 ongoing research projects with an aggregate funding of $820k, together with 23 ongoing MEng and PhD projects. The group graduated 2 MEng students in 1999. 
 
Our research thrust on digital video emphasizes international 
video standards, namely ITU’s H.26x and ISO/IEC’s MPEGs, and cover a wide spectrum from analysis, compression, indexing and retrieval, to the Internet applications. In MPEG-4, our work is on encoder optimisation issues, while in MPEG-7 our endeavors 
are to perform effective indexing and retrieve relevant digital videos over raw video data as well as a compressed domain. In addition, we have been engaged in the development of proprietary image and video encoder and investigating the fundamental issues of digital imaging.
  We continue to participate in international MPEG standardization meetings, as well as contributing technical efforts to the international MPEG community by conducting MPEG’s Core Experiments and VM software integration.  In a recent MPEG meeting, our fast motion estimation technology has been included as part of MPEG-4 standards, after more than a year of thorough tests and tough competitions. Besides the source coding, we examine the transmission aspects of digital videos, particularly on the wireless and mobile environment, by investigating fundamental issues such as error resilience, joint source and channel coding, error concealment, etc. 

 (Left) Still Frame of Video Sequence "Singer"
 (Right) Fast Polygonal Approximation of the Boundary 
of the Extracted Video Object Using only 58 Vertices

(Top) MPEG Generated Motion Vector Field (Bottom) Video Object Tracking based on Motion Vector Field
For multimedia applications, a project on interactive multimedia in electronics engineering education is under investigation, which aims to develop and implement interactive multimedia instructional materials for electronics courses. The objectives of this project are to examine the application of innovative IT to support the effective dissemination of learning materials, and formulate guidelines for creating interactive multimedia based materials for classroom instruction. 

One of the image processing topics is to use Markov random fields to model texture images. The model integrates the concept of spatial frequency filters and random fields in order to provide an effective way for color image classification and segmentation.

  Applications are found in content based image indexing and retrieving for medical application. For spatial audio signal processing, our research is on various areas of the virtual surround sound system for home entertainment and PC multimedia applications. These include sweetspot steering and signal processing techniques to enhance spatial sound effects. Some of our completed projects included creating a 
dual channel Dolby digital audio system based on psycho acoustical signal processing techniques, and developing a personalized 3D audio system that suits the individual listener. 

In speech signal processing research, the current focus is on techniques for removing background noise, which is inherently present in any speech processing system, such as voice recognition systems or vocoders. The presence of such background noise will inevitably reduce the accuracy of the voice recognition systems and increase vocoder noise.

Staff Members                                                                                                                        TOP

Ma, Kai-Kuang
Coordinator




Kot Chichung, Alex

Bi Guoan 

 



Gan Woon Seng

 



Chan Choong Wah
 




Chan Kap Luk



Chua Hock Chuan



Chong Yong Kim





Falkowski, Bogdan Jaroslaw


Sattar Farook



Siyal, Mohammed Yakoob 


Soon Ing Yann



Toh Guan Nge



Tan Yap Peng
Head, Div. of Information Engineering


Xue Ping

Yang Jun

 

On-going Research Project                                                                                                        TOP
Project Title Principal Investigator Funding
Applied technology of microcontrollers (multimedia devices) Chan Choon Wah  Siemens ($28k)
Audio signal processing using TI DSP  Gan Woon Seng Texas Instruments (5k)
Development of a versatile and intelligent 3D auditory system. Gan Woon Seng  NTU ($68k)
Real-time implementation and analyses of the H.263 video conferencing system Gan Woon Seng  NTU ($61k)
Develop a colour image classification system Liu Jun  NTU ($52k)
Content based intelligent video coding and processing Ma Kai Kuang NTU ($99k)
Subband coding of digital video Ma Kai Kuang NTU ($225k)
MPEG-4 system development and trial investigation  Tan Yap Peng SingTel ($60k)
Real time speech enhancement  Soon Ing Yann   NTU ($2.2k)
Parallel fractal image compression  Toh Guan Nge  NTU ($220k)

 

Milestone Achievements & Awards                                                                                           TOP
A fast motion estimation technology developed by Associate Professor Kai-Kuang Ma and his research student Prabhudev Irappa Hosur are adopted by MPEG-4 in March 2000 as the core technology standard for fast motion estimation. This work also embarks as the first Technical Report (TR1) of newly created Part 7 (officially called Optimization Model) in MPEG-4.

                                                                                                                                                      TOP
Distinguish Services
Service
Name
Date
Chairman & Head of Delegation,
Singapore National Body, ISO/IEC JTC1/SC29/WG11  (MPEG) and WG1 (JBIG/JPEG)
Kai-Kuang Ma
Since 1997
Editor,
IEEE Transactions on Communications (area: Video and Signal Processing)
Kai-Kuang Ma
Since 1997
Associate Editor,
IEEE Transactions on Signal Processing
Alex Kot
2000
Associate Editor,
IEEE Transactions on Circuits and Systems for Video Technology
Alex Kot
2000
Associate Editor,
IEEE Transactions on Signal Processing
Er Meng Hwa
1997

 

MEng and PhD Thesis Completed in 1999                                                                                  TOP
Project Title Degree Student Supervisor(s)
Parallel image segmentation using parallel digital signal processors MEng Cai Jian Chong Yong Kim
Perceptually based hybrid AMBTC video coding with motion compensation MEng    Huang Lei  Ma Kai Kuang

 

Selected Publicatons in 1999                                                                                                       TOP
1. Bi G and Chen Y Q, “Fast DHT algorithms for length 
N=q*2 m ”, IEEE Trans. on Signal Processing, US, Vol. 
47, no. 3, Mar1999, pp. 900-903.
11. Tan C J and Gan W S, “Concha excitation as a mean of 
introducing individual cues for spatial hearing”, 106 th 
Audio Engineering Society Convention, Munich, 
Germany, 8-11 May 1999.
2. Bi G, “On computation of the discrete W transform,” IEEE 
Transactions on Signal Processing, Vol. 47, no. 5, May 
1999, pp. 1450-1453.
12. Toh C W and Gan W S, “Bass management for virtual 
Dolby digital (VDD) and virtual Dolby pro-logic 
(VDPL)”, 1999 International Conference on Signal 
Processing Applications and Technology, Nov 1-4, 1999, 
Orlando, USA.
3. Bi G, “Fast algorithms for type III DCT of composite 
sequence lengths,” IEEE Transactions on Signal 
Processing, US, Vol. 47, no. 7, Jul 1999, pp. 2053-2059.
13. Soon I Y, Koh S N and Yeo C K, “Improved noise 
suppression filter using self adaptive estimator of probability of 
speech absence”, Signal Processing, Vol. 75, No. 2, June 
1999, pp. 151-159.
4. Wang L and Liu J, “Texture classification using 
multiresolution Markov random field models”, Pattern 
Recognition Letters, Vol. 20, No. 2, p171-182, 1999.
14. Chen C, Koh S N and Soon I Y, “An associatively 
classified partitioned vector quantizer”, Signal Processing, Vol. 
76, No. 3, Aug 1999, pp. 311-322.
5. Deng H W and Liu J, “A general Markov random field 
model by partial differential equations method”, 
Proc-Vision Interface ’99, 461-467, 1999.
15. Ruan Y X, Toh G N, “Region evolution with non-linear 
block transformations for fractal image coding”, 
Proc-5 th International Symposium on Signal Processing and 
its Applications (ISSPA’99), Brisbane, Australia, Aug 22- 
25, 1999.
6. Yang X Y and Liu J, “Maximum entropy random field 
model for texture analysis”, Proc-Vision Interface ’99, 
pp. 138-142, 1999.
16. Ruan Y X, Toh G N, “An improved fractal image 
compression scheme embedding DCT encoder”, IPA 99, IEE 
7 th International Conf. on Image Processing and its 
Applications, University of Manchester, UK, 12-15 July 
1999.
7. Gan W S, Chong Y K and Er M J, “A low cost DSP based 
earmuff using adaptive active noise control”, 
Microprocessor and Microsystems Journal, Vol 22, No.7, Jan 1999, 
pp. 412 – 422.
17. Zhang Y, Zhou F and Yao Q D, “Research on multimedia 
RISC core design”, Journal of Image and Graphics, Vol. 
4, No. 1, Jan 1999.
8 Ma K K and Zhu S, ‘’Fundamental error analysis of block
truncation coding techniques,’’ to appear in Signal 
Processing: Image Communication, Elsevier Science.
18. Zhang Y, Yu L and Yao Q D, “Hierarchical search motion 
estimation algorithms for real-time video coding”, 
Journal of China Institute of Communications, Vol. 19, no. 5, 
May 1998.
9. Zhu S and Ma K K, ‘’A new diamond search algorithm 
for fast block matching motion estimation,’’ to appear in 
IEEE Trans. on Image Processing.
19. Yu L, Zhang Y and Yao Q D, “Hierarchical motion 
estimation algorithm with especially low hardware cost”, 
IEEE Trans. on Comsumer Electronics, Feb 1998.
10. Eng H L and Ma K K, ‘’Bidirectional motion tracking for 
video indexing,’’ IEEE International Workshop on 
Multimedia Signal Processing (MMSP’99), Copenhagen, 
Denmark, 13-15 Sep 1999.
                                                                                                                                                                                            TOP