I've only found a lack of public toilets in conbini in notorious party areas/tourist locations (Shinjuku, Ikebukuro, Shibuya, etc). Any conbini outside of those, or even just on the outskirts have usable toilets.