Dzong fortress lies at Dzong Hill at the center of Gyangtse. In 1904, British troops invaded into Tibet and occupied parts of Tibetan territory. However they met with strong and hard resist in Gyangtse at the small hill which was the seat of the local Dzong government. Brave and unyielding Gyangtse people using primitive weapons fought British invaders equipped with advanced guns. The hard defense lasted for 8 months and finally failed. Tibetan warriors exhausted stones on the hill, which were their last ammunitions. They jumped out of cliffs, never surrendering.

Emplacements in the ruins still overlook the valley now. Dzong government of the feudal serf system is still well kept, giving visitors a better understanding of the serf system in old Tibet. Four steles erected by Qing ministers during the reign of Emperor Qianlong are well preserved.