Optimal coherent detection of FSK signals with imbalance amplitudes in the presence of colored gaussian noise

The problem of optimal coherent detection of frequency-shift keying (FSK) signals transmitted over an additive colored Gaussian noise channel with imbalance gains in different frequencies (IGDF-ACGN channel) is studied. The structure of the optimal coherent detector is derived. Theoretical analysis and computer simulation results show that the detector is optimal in either additive colored Gaussian noise environment or additive white Gaussian noise environment.