While the consequences, if caught may not be dire, causing an accident may hurl you into a world of pain, since your insurer won't pay squat. Or they may pay and hound you for the rest of your life in order to get reimbursed.
Being responsible for personal injury can get very, very expensive.
If you cause the damage by using an illegal device your insurer will not pay for the damage.
It's not a matter of being slightly faster, it's a matter of the device not being certified for use on public grounds.
What "third party liability insurance"? Do I have some insurance that I don't know about? Or are you suggesting that somehow my car insurance(which does have third party liability cover) somehow covers me when walking around/cycling?
Third party liability won't cover usage of a motor vehicle (needs to be insured seperately, and is mandatory). It does cover damages caused by riding a bicycle, though.