Estimation of a nonvisible field-of-view mobile target incorporating optical and acoustic sensors

This paper presents a nonvisible field-of-view (NFOV) target estimation approach that incorporates optical and acoustic sensors. An optical sensor can accurately localize a target in its field-of-view whereas the acoustic sensor could estimate the target location over a much larger space, but only with limited accuracy. A recursive Bayesian estimation framework where observations of the optical and acoustic sensors are probabilistically treated and fused is proposed in this paper. A technique to construct the observation likelihood when two microphones are used as the acoustic sensor is also described. The proposed technique derives and stores the interaural level difference of observations from the two microphones for different target positions in advance and constructs the likelihood through correlation. A parametric study of the proposed acoustic sensing technique in a controlled test environment, and experiments with an NFOV target in an actual indoor environment are presented to demonstrate the capability of the proposed technique.