I replaced my landline with an Ooma (a VOIP phone which let me port my old landline number) which sounds WORLDS better, lets me manage personal blocklists, aggregates community blocklists to automatically filter incoming calls from telemarketers, political parties, etc, sends voicemails to my email, integrates with Google Voice, can ring on multiple phones or devices, and other such things. It's in a completely different class of service, and it costs a fraction of what my competing local offerings do.
However, your VOIP will not work during a power outage, during an internet outage, or any other time the VOIP company's servers are down.
Landlines work during power outages, during internet outages, and they provide around 5 nines of uptime (that's less than 6 minutes of downtime a year).
Those are the things your $35 a month buys you. How important that reliability is to you generally depends on your health. I know more than a few folks who would never give up their landline, because they have medical conditions which depend on reliable access to 911.
That leaves only VOIP provider outages as a concern, and I've yet to experience one of those in a few years.
The single time I had a problem with how it was billed, I called the state regulator who worked with my telco to sort out how taxes were being calculated. It turned out that they were billing me correctly, but couldn't explain it over the phone.