A Combined PMHT and IMM Approach to Multiple-Point Target Tracking in Infrared Image Sequence

1687-5281-2007-019139 1687-5281 Research Article A Combined PMHT and IMM Approach to Multiple-Point Target Tracking in Infrared Image Sequence ZaveriMukeshAmazaveri@gmail.com MerchantSNmerchant@ee.iitb.ac.in DesaiUdayBubdesai@ee.iitb.ac.in

Computer Engineering Department, Sardar Vallabhbhai National Institute of Technology, Surat 395007, India

SPANN Laboratory, Electrical Engineering Department, Indian Institute of Technology-Bombay, Powai, Mumbai 400076, India

EURASIP Journal on Image and Video Processing 1687-5281 2007 2007 1 019139 http://jivp.eurasipjournals.com/content/2007/1/019139 10.1155/2007/19139 1882006284200730720071092007 2007Zaveri et al.This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Data association and model selection are important factors for tracking multiple targets in a dense clutter environment. In this paper, we provide an effective solution to the tracking of multiple single-pixel maneuvering targets in a sequence of infrared images by developing an algorithm that combines a sequential probabilistic multiple hypothesis tracking (PMHT) and interacting multiple model (IMM). We explicitly model maneuver as a change in the target's motion model and demonstrate its effectiveness in our tracking application discussed in this paper. We show that inclusion of IMM enables tracking of any arbitrary trajectory in a sequence of infrared images without any a priori special information about the target dynamics. IMM allows us to incorporate different dynamic models for the targets and PMHT helps to avoid the uncertainty about the observation origin. It operates in an iterative mode using expectation-maximization (EM) algorithm. The proposed algorithm uses observation association as missing data.

[1234567891011121314151617181920212223242526272829303132333435363738394041]

Bar-ShalomYFortmannTETracking and Data AssociationAcademic Press, San Diego, Calif, USA1988BlackmanSPopoliRDesign and Analysis of Modern Tracking SystemsArtech House, Boston, Mass, USA1999Kalman filter applications in airborne radar trackingPearsonJBStearEBIEEE Transactions on Aerospace and Electronic Systems1974103319329Information type filters for tracking a maneuvering targetFarooqMBruderSIEEE Transactions on Aerospace and Electronic Systems199026344145410.1109/7.106121Tracking a maneuvering target using input estimationBoglerPLIEEE Transactions on Aerospace and Electronic Systems1987233298310Manoeuvring-target tracking with the Viterbi algorithm in the presence of interferenceDemirbasKIEE Proceedings F: Radar and Signal Processing1989136626226810.1049/ip-f-2.1989.0040A tracking algorithm for maneuvering targetsWangTCVarshneyPKIEEE Transactions on Aerospace and Electronic Systems199329391092410.1109/7.220939Maneuvering target tracking with colored noiseWuW-RChangD-CIEEE Transactions on Aerospace and Electronic Systems19963241311132010.1109/7.543852Enhanced variable dimension filter for maneuvering target trackingCloutierJRLinC-FYangIEEE Transactions on Aerospace and Electronic Systems199329378679710.1109/7.220930A maximum likelihood approach to data associationAvitzourIEEE Transactions on Aerospace and Electronic Systems199228256056610.1109/7.144581Maximum likelihood method for probabilistic multihypothesis trackingStreitRLLuginbuhlTESignal and Data Processing of Small Targets, April 1994, Orlando, Fla, USA, Proceedings of SPIE2235394405A formulation of multitarget tracking as an incomplete data problemGauvritHLe CadreJPJauffretCIEEE Transactions on Aerospace and Electronic Systems199733412421257On maneuvering target tracking via the PMHTLogothetisAKrishnamurthyVHolstJProceedings of the 36th IEEE Conference on Decision and Control, December 1997, San Diego, Calif, USA550245029The PMHT for maneuvering targetsWillettPKRuanYStreitRLSignal and Data Processing of Small Targets, April 1998, Orlando, Fla, USA, Proceedings of SPIE3373416427PMHT: problems and some solutionsWillettPRuanYStreitRIEEE Transactions on Aerospace and Electronic Systems200238373875410.1109/TAES.2002.1039396The interacting multiple model algorithm for systems with Markovian switching coefficientsBlomHAPBar-ShalomYIEEE Transactions on Automatic Control198833878078310.1109/9.1299IMM algorithm for tracking targets that maneuver through coordinated turnsWatsonGABlairWDSignal and Data Processing of Small Targets, April 1992, Orlando, Fla, USA, Proceedings of SPIE1698236247Evaluation of IMM filtering for an air defense system applicationBuschMTBlackmanSSSignal and Data Processing of Small Targets, July 1995, San Diego, Calif, USA, Proceedings of SPIE2561435447Interacting multiple model methods in target tracking: a surveyMazorEAverbuchABar-ShalomYDayanJIEEE Transactions on Aerospace and Electronic Systems199834110312310.1109/7.640267Numerically robust implementation of multiple-model algorithmsLiXRZhangYIEEE Transactions on Aerospace and Electronic Systems200036126627810.1109/7.826329Comparison of various schema of filter adaptivity for the tracking of maneuvering targetsJouanABosséESimardM-AShahbazianESignal and Data Processing of Small Targets, April 1998, Orlando, Fla, USA, Proceedings of SPIE3373247258Kalman filter versus IMM estimator: when do we need the latter?KirubarajanTBar-ShalomYIEEE Transactions on Aerospace and Electronic Systems20033941452145710.1109/TAES.2003.1261143PMHT based multiple point targets tracking using multiple models in infrared image sequenceZaveriMADesaiUBMerchantSNProceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance (AVSS '03), July 2003, Miami, Fla, USA7378McLachlanGJKrishnanTThe EM Algorithm and ExtensionsJohn Wiley & Sons, New York, NY, USA1997Maneuvering PMHTsRuanYWillettPKSignal and Data Processing of Small Targets, July 2001, San Diego, Calif, USA, Proceedings of SPIE4473186197Multiple model PMHT and its application to the second benchmark radar tracking problemRuanYWillettPKIEEE Transactions on Aerospace and Electronic Systems20044041337135010.1109/TAES.2004.1386885Interacting multiple model integrated probabilistic data association filters (IMM-IPDAF) for track formation on maneuvering targets in cluttered environmentsHelmickREWatsonGASignal and Data Processing of Small Targets, April 1994, Orlando, Fla, USA, Proceedings of SPIE2235460471Comparison of IMMPDA and IMM-assignment algorithms on real air traffic surveillance dataKirubarajanTYeddanapudiMBar-ShalomYPattipatiKRSignal and Data Processing of Small Targets, April 1996, Orlando, Fla, USA, Proceedings of SPIE2759453464Tracking a 3D maneuvering target with passive sensorsDufourFMaritonMIEEE Transactions on Aerospace and Electronic Systems199127472573910.1109/7.85047IMM/MHT applications to radar and IR multitarget trackingBlackmanSSDempsterRJRoszkowskiSHSignal and Data Processing of Small Targets, July 1997, San Diego, Calif, USA, Proceedings of SPIE3163429439IMM-JVC and IMM-JPDA for closely maneuvering targetsHadzagicMMichalskaHJouanAProceedings of the 35th Asilomar Conference on Signals, Systems and Computers, November 2001, Pacific Grove, Calif, USA212781282Combining IMM and JPDA for tracking multiple maneuvering targets in clutterBlomHAPBloemEAProceedings of the 5th International Conference on Information Fusion, July 2002, Annapolis, Md, USA1705712Tracking of multiple maneuvering targets in clutter using multiple sensors, IMM, and JPDA coupled filteringTugnaitJKIEEE Transactions on Aerospace and Electronic Systems200440132033010.1109/TAES.2004.1292168PDAF with multiple clutter regions and target modelsColegroveSBDaveySJIEEE Transactions on Aerospace and Electronic Systems200339111012410.1109/TAES.2003.1188897The expectation-maximization algorithmMoonTKIEEE Signal Processing Magazine1996136476010.1109/79.543975Maximum likelihood from incomplete data via the EM algorithmDempsterAPLairdNMRubinDJournal of the Royal Statistical Society1977391138Synthetic IR scene simulation of air-borne targetsMoreSTPanditAAMerchantSNDesaiUBProceedings of the 3rd Indian Conference on Computer Vision, Graphics & Image Processing (ICVGIP '02), December 2002, Ahmadabad, India108113Multiple single pixel dim target detection in infrared image sequenceZaveriMAMerchantSNDesaiUBProceedings of the International Symposium on Circuits and Systems (ISCAS '03), May 2003, Bangkok, Thailand2380383Wavelet based detection and its application to tracking in IR sequenceZaveriMAMerchantSNDesaiUBto appear in IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and ReviewsEstimating optimal tracking filter performance for manned maneuvering targetsSingerRAIEEE Transactions on Aerospace and Electronic Systems197064473483Bar-ShalomYLiXRKirubarajanTEstimation with Applications to Tracking and NavigationJohn Wiley & Sons, New York, NY, USA2001