Image Fusion paper, 2005

Home > Publications > By topic

Title

Multimodal image registration with applications to image fusion

Abstract:

This paper presents an algorithm for accurately aligning two images of the same scene captured simultaneously by sensors operating in different wavebands (e.g. TV and IR).

Such a setup is common in image fusion systems where the sensors are physically aligned as closely as possible and yet significant image mis-alignment remains due to differences in field of view, lens distortion and other camera characteristics.

Our proposed registration method involves numerically minimising a global objective function defined in terms of local normalised correlation measures.

The algorithm is demonstrated on real multimodal imagery and applications to image fusion are considered. In particular we illustrate that fused image quality is closely related to the degree of registration accuracy achieved.

To maintain this accuracy in real systems it is often necessary to continuously update the transform over time.

Thus we extend our registration approach to execute in real time on live imagery, providing optimal fused imagery in the presence of relative sensor motion and parallax effects.

Download:

[Adobe Acrobat icon] Adobe Acrobat document, 964KB

If you have problems viewing the PDF document, you may need to update Acrobat Reader to a more recent version. Click on the image below to visit the Adobe download site.

[Download Adobe Acrobat]

Authors:

J. P. Heather, Waterfall Solutions, UK;
M. I. Smith, Waterfall Solutions, UK;

Conferences:

Information Fusion 2005, Philadelphia, PA, 25 - 28 July