It is strictly true. The law states: "illegal to access foreign internet without government permission first."

The government opening up businesses to connect to services such as facebook or twitter to promote china businesses and so on is just the government giving permissions.

But for the every-day citizen, the use of a VPN is technically illegal as it circumvents the law.