Based on the investigation and study of the architectural form of Baiju Tower, we analyzed the stability of its coupled structure with both mountain body distinguishing the two situations of tall and low mountain body embedded in the tower body under gravity action and gravity and seismic coupling conditions respectively, on the basis of the Mohr-Coulomb constitutive model of rock and soil and finite element analysis technology. The following conclusions are drawn:under the action of self-weight, the overall structure safety satisfies with a high safety and stability coefficient; the stiffness of Baiju Tower is high, and the whole structure system belongs to the aseismic favorable system; the basic frequency mode of the whole structure of Baiju Temple prefers inclined model; under the action of 7 degrees (basic acceleration 0.15 g), the seismic stability of the two models is good; the main structure of the higher mountain model is basically in a safe state under 8 degree (basic acceleration 0.3 g) earthquakes, and that of the lower mountain model does not meet the requirements of stability; the model of the higher mountain body has higher safety level and stability than that of the lower mountain body model.