You can totally do that in rural areas. I'm talking at least 1/4 mile separation between houses.
If you're not in that kind of area and you still expect it, it's because you don't understand the physics. I don't mean that as an insult, just a statement of fact. I went to school for electrical engineering and that statement you made above is laughable for anyone who knows the trade. To me, a similar statement might be "Why can't I have a car that makes 1000 HP, gets 100 MPG and costs $10k?" Yes someday that might be a reality but with the tech we have now, it's definitely not.
Bandwidth over the air is fixed and it's split between everyone who is within "earshot" and similar to how it eventually gets impossible to hear anyone at a party once the room is packed and everyone is talking, so it goes with wireless. There's just not enough spectrum to go around. That's why people use wires; every wire has (roughly) a whole spectrum all to itself. Pull 100 wires? Get 100x bandwidth. Put up 100 wireless transmitters? Get 1/100 the bandwidth on each one. The math there heavily, heavily favors wires. Ethernet, coax, fiber, whatever. If you make a new signal propagation domain you can use as much of it as it'll allow you. If you use the big signal propagation domain that everyone has access to, prepare to share.
No, you're just using subjective feelings rather than objective measurements. 4K doesn't specify a particular bit rate. If there is going to be a productive discussion, it needs to be acknowledged that there is a huge difference between streaming 1080p and Bluray 1080p.
Also, I have gotten wifi working well in non-rural areas using Ubiquiti Unifi AC Lite APs. In suburban New York, a couple of them blanket my home. In my grandmother's Shanghai apartment in a building that is a mix of concrete and plaster, just 1 is sufficient (although for a much smaller volume), despite dozens of nearby APs. Admittedly, I moved to 5GHz there because I was literally the only one using it, but 2.4GHz had worked fine when I tried it. Peak throughout is higher on 5GHz due to higher channel widths though.
OK, now take your dog to a place full of dogs and other dog whistles. See how well it works.
Once the spectrum gets noisy, interference happens. Just because you found a quiet spot in the spectrum doesn't mean that spectrum sharing isn't a physical reality anymore. It just means you found some to keep all to yourself! Until someone else starts using 5GHz too.
In fairness, I had made tweaks to iwlwifi's kernel module options in order to have usable wifi on my laptop. Until a year ago, I was accustomed to have a hellish experience in congested areas until I turned off Bluetooth coexistence support in the iwlwifi driver. That feature would almost always cause severe packet loss on my T520 in crowded environments even when there did not appear to be any Bluetooth traffic.
Anyway, it is possible to get wifi working well for certain workloads in crowded environments. Making it work well in general might require better drivers and better equipment than one might have at first though. For example, I understand that ath9k was a disaster when it was first made, but it is fairly decent now. I ran an AP off an ath9k USB wifi dongle in China at one point and it worked well too. I doubt that would have worked as well with drivers from 5 years ago.
Also, from what I understand, a used Ruckus Zoneflex 7982 off eBay ought to be able to handle just about any environment fairly well. Their proprietary beam forming hardware is special because it attenuates signals coming from other directions than that of the client. The only exception from what I have read is when other wifi equipment is right next to it (e.g. practically touching). Some review of it said that it failed to work until they moved other equipment away after consulting Ruckus. I cannot find a link to it though.
I placed an order with an eBay merchant that I expect to receive soon. $90 per used Zoneflex 7982 (that had a $1099 MSRP when new) is a bargain considering that these still provide some of the best wifi in the world. There are reports of these getting good throughout through multiple concrete walls:
http://www.cio.com/article/2388827/wireless-networking/revie...
A newer version of the midrange model in their product line (that has inferior radio specifications to the top end model) was able to give a cell phone decent throughput from 225 yards away when the (omnidirectional) AP was in doors:
http://www.evdoinfo.com/content/view/5077/64/
As far as I know, the only better access points are the newer Ruckus models that replaced it. I am really excited to be getting one later this week. :)
If you meant to imply that I am somehow paid to say such things, I assure that I am not. I am a fairly well known OSS developer and such a thing would be damaging to my reputation. I just happen to be genuinely excited about this topic for the first time in years at this moment.
I just returned from visiting my grandmother in China, who is in the hospital. I stayed at the concrete and plaster apartment complex where my grandmother's apartment is. The horrible pentetration of wifi signals made me think plenty about wifi and that eventually lead me to discover that Ruckus's old equipment would work far better and is selling used on eBay at pricepoints seen in consumer grade gear. There really is not much benefit to Ruckus from the free advertisement of me talking about the used Ruckus equipment on eBay. They are not making any money off the used hardware market while the pricing for new Ruckus equipment is so high that it might as well not exist as far as the majority of people are concerned.
You managed to achieve good network performance by using your specialized skills.
Most people don't have the skills and aren't interested in learning them. This is the market for Apple's APs. The interesting description of what you did to get stuff working is close to meaningless to most people, and hence by contrast makes the trusted-brand easy-peasy gear look even more valuable.
I've wrestled with wireless gear since before 802.11 existed, including writing my own radio firmware, and I have an Airport at home which in practice means I don't need to do any of that awful stuff any more. In my lab we throw away about half the APs we buy due to mystery incompatibilities. Radio is still hard compared to most other things.
It would do strange things to cellular and broadcast radio, but it wouldn't destroy them, I think.
The "real" solution is for people in dense apartment buildings to just turn their damn Tx power down, but that's a prisoner's dilemma if I've ever seen one.
So with the craptastic firemware of most consumer wifi APs, the AP hops on channels 1, 6 or 11, and stays there, screaming at full power. And the consumer, even if they know enough about radio to realize such is suboptimal, can't do anything about it without changing the firmware or buying a more expensive device.
So, people on the same channel silence each other (CTS/RTS), but on other channels it is simply seen as noise. If there are lots of people on 1/6/11, you're going to spend a lot of time silenced.
It's one of those things that you just have to try out in your own particular circumstances. Will you get better performance if frequently silenced, or better performance dealing with a high level of 'noise'?
In the case where the building is served by one major ISP, and they provide combination gateway+APs, I could see the ISP deciding to "solve" the problem by turning the whole building into one AP mesh (with only one AP actually active per unit sphere) where each client gets a VLAN with tagged QoSing over the last-mile "backplane" back to their own gateway.
Though, if you're going that far, you may as well just call yourself a WiMAX provider and tell people their gateways are just extension picocells for the network, rather than end-user equipment. Which is basically what you get already from the ISPs that offer "public wi-fi for customers at our hotspots" (i.e. broadcast by all APs on our business plan), except that said wi-fi would be the only product, and would be served by residential gateways as well.
What's wrong with expecting WIFI to work well enough to enjoy low latency high definition/4k content?