Chen is well known as an art collector. He has started collecting since 1976. One of the paintings in his collection is Tamsui, an oil painting by Japanese-period Taiwanese Artist Tan Ting-pho. It fetched $4.5 million (NT$144 million), setting the latest world record for a ‘NT $100 million’ purchase of an oil painting by an ethnic Chinese Artist. Chen's art collection is administered through the Yageo Foundation.
He was married to an Actress Rosamund Kwan. They got divorced in 2015 after 8 years of being together.
He is the owner of nine factories and offices in 17 countries, and is daily in charge of in Yageo’s day-to-day management.