The present invention relates generally to video processing apparatus and methods for use with imaging systems and the like, and more particularly to a system and method which implements scene based nonuniformity compensation of the detector elements of a staring infrared focal plane array imaging system.