Duty is not necessarily to the state; it can be to society as well. In fact, there's a large fraction of neoliberals who would argue that individuals following their duty to society should displace the state in many areas.