In laboratory or actual engineering applications, traditional contact sensors are usually destroyed along with structure damage. To deal with this problem, on the parallel stereovision model, the efficient largescale stereo matching algorithm (ELAS) was combined with the DIC method to measure structural vibration response. MATLAB was chosen to compile the stereovision 3D deformation measurement software based on the proposed algorithm, and a threestory frame model subjected to El Centro earthquake wave at different peak acceleration was measured by the stereovision system in this work. Experiment results show the proposed method has a good agreement with LVDT in time history curves during the stage of small deformations, and this testifies the effectiveness of the proposed method. LVDT sensors were taken away during the collapse stage, the collapse curves of a threefloor frame model were obtained only by the proposed method, and this indicates the capability of the proposed stereovision approach monitoring collapse of structure.