In order to analyze the effects of vibrations from different excitation sources on ancient architecture, e.g., the Yu Han Tang acnient buildings in the Suzhou provincial cultural relics protection unit were analyzed. The signals of four vibration sources—the environmental, subway, people’s social activities and sound box—were recorded in a two-story brick-wooden loft. It was found that the effect to ancient buildings of vibration contributed by a subway system having strict vibration controls can be neglected. In Yu Han Tang, the transverse vibration velocities of the environmental vibrations and sound box excitation periods reached the standard level, while the vibrations due to people social in activities exceeded the standard. The structure and function of ancient architecture and the vibration effects of people (which are usually ignored) are discussed, and some suggestions for damping these vibration are proposed. This study provides data for protection of similar ancient two-story brick-wooden lofts.