News for hackers. Stuff that matters.
Re:Beyond bufferbloat: End-to-end congestion control cannot ... by flapjack on Tuesday July 09, 2024 @10:28AM (#40916554)
One of the solutions they mention is underutilizing links. This is probably a good time to mention my thesis work, where we showed that streaming video traffic (which is the majority of the traffic on the internet) can pretty readily underutilize links on the internet today, without a downside to video QoE! https://sammy.brucespang.com
Re:Beyond bufferbloat: End-to-end congestion control cannot ... by clbrmbr on Tuesday July 09, 2024 @11:51AM (#40917525)
Can you comment on latency-sensitive video (Meet, Zoom) versus latency-insensitive video (YouTube, Netflix)? Is only the latter “streaming video traffic”?
Re:Beyond bufferbloat: End-to-end congestion control cannot ... by flapjack on Tuesday July 09, 2024 @12:25PM (#40917953)
We looked at latency-insensitive like YouTube and Netflix (which were a bit more than 50% of internet traffic last year [1]).

I'd bet you could do something similar with Meet and Zoom–my understanding is video bitrates for those services are lower than for e.g. Netflix which we showed are much lower than network capacities. But it might be tricky because of the latency-sensitivity angle, and we did not look into it in our paper.

[1] https://www.sandvine.com/hubfs/Sandvine_Redesign_2019/Downlo...

Re:Beyond bufferbloat: End-to-end congestion control cannot ... by mikepavone on Tuesday July 09, 2024 @09:35PM (#40922967)
> Meet and Zoom–my understanding is video bitrates for those services are lower than for e.g. Netflix

For a given quality, bitrate will generally be higher in RTC apps (though quality may be lower in general depending on the context and network conditions obviously) because of tradeoffs between encoding latency and efficiency. However, RTC apps generally already try to underutilize links because queuing is bad for latency and latency matters a lot for the RTC case.

Re:Beyond bufferbloat: End-to-end congestion control cannot ... by sulandor on Wednesday July 10, 2024 @03:06AM (#40924400)
the term “streaming video" usually refers to the fact that the data is sent slower than the link capacity (but intermittently faster than the content bitrate)

op used the term presumably to describe "live content" eg. the source material is not available as a whole (because the recording is not finished); which can be considered a subset of "streaming video"

the sensitivity in regard to transport characteristics stems from the fact that "live content" places an upper bound for the time required for processing and transferring the content-bits to the clients (for it to be considered "live").

Re:Beyond bufferbloat: End-to-end congestion control cannot ... by aidenn0 on Tuesday July 09, 2024 @06:22PM (#40921884)
Packet switching won over circuit switching because the cost-per-capacity was so much lower; if you have to end up over-provision/under-utilize links anyways, why not use circuit switching?
Re:Beyond bufferbloat: End-to-end congestion control cannot ... by crest on Tuesday July 09, 2024 @07:43PM (#40922449)
Because the cost is a lot lower. Paying a few percent of overcapacity doesn’t change that.
Re:Beyond bufferbloat: End-to-end congestion control cannot ... by aidenn0 on Tuesday July 09, 2024 @07:48PM (#40922502)
TFA suggest a 900% overcapacity, not a few percent. I just skimmed GP's article but it seems to suggest a ~100% overcapacity for streaming-video specifically.
Re:Beyond bufferbloat: End-to-end congestion control cannot ... by nine_k on Tuesday July 09, 2024 @11:11PM (#40923359)
"100% overcapacity" is also known as "50% load factor".

It's common knowledge to run your API nodes at 20%-60% CPU load, no more, exactly to curb tail latency.

Re:Beyond bufferbloat: End-to-end congestion control cannot ... by sambazi on Wednesday July 10, 2024 @05:10AM (#40925063)
just think about your competitive edge if you could manage to cramp more load w/o affecting latency
Re:Beyond bufferbloat: End-to-end congestion control cannot ... by jdougan on Thursday July 11, 2024 @05:05PM (#40940601)
Depends on what you have to pay (and not just in money) to get there.
Re:Beyond bufferbloat: End-to-end congestion control cannot ... by nine_k on Tuesday July 09, 2024 @11:07PM (#40923338)
A physical circuit costs a lot, so much more that it's not even funny.

You can deploy a 24-fiber optical cable and allow many thousand virtual circuits to run on it in parallel using packet switching. Usually orders of magnitude more when they share bandwidth opportunistically, because the streams of packets are not constant intensity.

Running thousands of separate fibers / wires would be much more expensive, and having thousands of narrow-band splitters / transcievers, also massively expensive. Phone networks have tried that all, and gladly jumped off the physical circuits ship as soon as they could.

Re:Beyond bufferbloat: End-to-end congestion control cannot ... by wmf on Wednesday July 10, 2024 @12:35AM (#40923734)
These days I think circuit switching means virtual circuits with guaranteed bandwidth at each hop. Even the phone network used FDM/TDM for circuits, not separate wires. Anyway, circuits are more expensive than just running a packet-switched network lightly loaded. See http://www.stuartcheshire.org/rants/Networkdynamics.html and https://www-users.cse.umn.edu/~odlyzko/doc/network.utilizati...
Re:Beyond bufferbloat: End-to-end congestion control cannot ... by ahartmetz on Wednesday July 10, 2024 @03:13AM (#40924425)
The old and new standard ways to do virtual circuit switching are ATM (heavily optimized for low latency voice - 53 byte packets!) and MPLS (seems to be a sort of flow labeling extension to "host" protocols such as IP - clever!).

Both are technologies that one rarely has any contact with as an end user.

Sources: Things I've read a long time ago + Wikipedia for ATM, Wikipedia for MPLS.

Re:Beyond bufferbloat: End-to-end congestion control cannot ... by aidenn0 on Wednesday July 10, 2024 @12:20PM (#40928538)
> Anyway, circuits are more expensive than just running a packet-switched network lightly loaded.

This was undoubtedly true (and not even close) 20 years ago. As technology changes, it can be worth revisiting some of these axioms to see if they still hold. Since virtual circuits require smart switches for the entire shared path, there are literal network effects making it hard to adopt.

Re:Beyond bufferbloat: End-to-end congestion control cannot ... by sambazi on Wednesday July 10, 2024 @05:07AM (#40925050)
> my thesis work, where we showed that streaming video traffic [...] can pretty readily underutilize links on the internet today, without a downside to video QoE!

was slightly at a loss in what exactly needed to be shown here until i clicked the link and came to the conclusion that you re-invented(?) pacing.

https://man7.org/linux/man-pages/man8/tc-fq.8.html

Re:Beyond bufferbloat: End-to-end congestion control cannot ... by nsteel on Wednesday July 10, 2024 @09:32AM (#40926717)
Did you read the linked paper which talks a lot about TCP pacing?

https://sammy.brucespang.com/sammy.pdf

Re:Beyond bufferbloat: End-to-end congestion control cannot ... by sambazi on Thursday July 11, 2024 @07:41AM (#40935577)
i did not read that paper with a focus on adaptive bitrate selection for video streaming services that came out 8 years after the pacing implementation hit the kernel. thx thou
Re:Beyond bufferbloat: End-to-end congestion control cannot ... by nsteel on Tuesday July 23, 2024 @10:09AM (#41046188)
It uses that implementation, so yes, it came out afterwards. Section 2 and 3 might help.
Re:Beyond bufferbloat: End-to-end congestion control cannot ... by flapjack on Thursday July 11, 2024 @01:36PM (#40938858)
I would definitely not say that we re-invented pacing! One version of the question we looked at was: how low a pace rate can you pick for an ABR algorithm, without reducing video QoE? The part which takes work is this "without reducing video QoE" requirement. If you're interested, check out the paper!
Re:Beyond bufferbloat: End-to-end congestion control cannot ... by sambazi on Friday July 12, 2024 @05:20AM (#40943973)
> One version of the question we looked at was: how low a pace rate can you pick for an ABR algorithm, without reducing video QoE?

that is certainly an interesting economical optimization problem to reason about, though imho somewhat beyond technical merit, as simply letting the client choose quality and sending the data full speed works well enough.

addition:

i totally agree that things have to look economical in order to work and that there are technical edge-cases that need to be handled for good ux, but i dont't quite see how client-side buffer occupancy in the seconds range is in the users interest.