Khao Noi Palace, located at the foothills of Khao Noi to the south along Sadao Road, was constructed in 1911 as a residence for General Somdet Phra Chao Boromwong Thoe Chaofa Yuklathikhamporn, Prince of Lopburi Rameswor, during his term as the governor of Nakhon Si Thammarat Province (1910-1915) and subsequently as the vice governor for the southern provinces of Nakhon Si Thammarat, Surat Thani, Pattani, and Chumphon (1915-1925). The palace was built in the Year of the Pig in November 1911, with a chief French architect leading the construction from Bangkok. In 1994, the Fine Arts Department officially declared it a national historical site in the Royal Gazette. King Prajadhipok, during his visit to Songkhla, stayed at Khao Noi Palace from June 13 to 19, 1915. This site also served as a political refuge for several members of the royal family following the change in governance, including Her Royal Highness Princess Suvadhana, Princess Consort, and Somdet Phra Chao Phakthinee, Chaofa Phet Rattanaratchasuda Sirisobharat. Additionally, Khao Noi Palace was the lodging for His Majesty King Bhumibol Adulyadej and Her Majesty Queen Sirikit during their visit to southern provinces in March 1959. Afterwards, the palace was maintained by Songkhla Province, remaining uninhabited until 1964 when it underwent renovations to serve as the governor's residence (M.R. Thongkamphaew Thongyai) and has continued to function as the governor's accommodation to this day.