Hyperspectral imaging can acquire information on the surfaces of cultural relics in a contactless and nondestructive way. Processing and analysis of the information is very helpful for the discovery and restoration of painted patterns on the surfaces of cultural relics. Based on damage to the painted patterns on the No. 2 Qin bronze chariot unearthed from the Emperor Qinshihuang’s Mausoleum Site, we propose a digital restoration method combining hyperspectral imaging and computer image technology. On one hand, the near-infrared hyperspectral image was used to detect and recover the edges of the patterns which are difficult to recognize; on the other hand, the spectra of the unknown pigments on the painted patterns were matched with those in an established standard library of mineral pigments to identify the type of pigments (realgar 1, azurite 5, malachite 1, yellow lead and lead white, etc.) used in the painting of the bronze chariot. The results show that the method can obtain a complete digital restoration image of the painted patterns, which can provide favorable support for further research on the bronze chariot and its application.