Most of the jade artifacts unearthed from Fuquanshan site in Qingpu District of Shanghai have not been tested scientifically. In this study, six jade artifacts of Songze culture and 478 jade artifacts of Liangzhu culture were microscopically observed and nondestructively analyzed using Fourier transform infrared (FTIR), portable X-ray fluorescence (pXRF) and Raman spectrometry. The results show that jade artifacts of Songze culture are made of tremolite, serpentine and fluorite, while those of Liangzhu culture are made of tremolite, serpentine, quartz, illite, fluorite, steatite and turquoise. It is confirmed that some tremolite samples have graphite inclusions, and the Sr contents of all tremolite samples are lower than 50 μg/g, which is inconsistent with the known Meiling jade from Jiangsu Province. It is also revealed that the tremolite jades and serpentine jades both have two genetic types—ultrabasic rock type and marble type, indicating that the jade materials used from Songze to Liangzhu periods have the characteristics of multiple sources. This finding provides an important new material for the comprehensive understanding of the development of prehistoric cultures in south China from the perspective of jade use.