You wouldn't have to be isolated. You could make connections, just not ones that depend on a centralized ISP.

But "off-the-grid" typically is talking about physical delivery over wires and pipes, not about things like wireless internet.