The System and Method for Three-Dimensional Estimation Based on Image Data invention is a method and apparatus for extracting a dense 3D model of an observed scene or object from one or more sequences of images which are acquired with an imaging device such as a camera or camcorder, or clusters of cameras and/or camcorders. 3D models that are extracted from each image sequence are combined and mer