News for hackers. Stuff that matters.
Re:High-speed 10Gbps full-mesh network based on USB4 for jus... by nickstinemates on Monday January 15, 2024 @01:58PM (#39004624)
Can you provide links? I'll upgrade my home lab from 10g to 40g immediately at that price.
Re:High-speed 10Gbps full-mesh network based on USB4 for jus... by willglynn on Monday January 15, 2024 @02:28PM (#39005013)
In 2024 I would suggest deploying 2x25G instead, via e.g. MCX4121. Pricing is similar (<$30 NICs), but:

* 2x25G throughput is higher than 40G,

* 25G latency is lower than 40G,

* you can use 25G ports as 10G ports, and

* you can use DACs to connect 4x25G <=> 100G

That last point is particularly relevant given the existence of switches like the Mikrotik CRS504, providing 4x100G ports on 25W.

Re:High-speed 10Gbps full-mesh network based on USB4 for jus... by Palomides on Monday January 15, 2024 @02:38PM (#39005127)
those are all reasonable points, if I were doing mine again I would spend a little more and go up to 100gbe

if you run all older mellanox gear the cx3 can do the kinda nonstandard 56gbe as well

Re:High-speed 10Gbps full-mesh network based on USB4 for jus... by bombela on Monday January 15, 2024 @04:35PM (#39006394)
What are you doing that you need 100gbe?

I am still on 1gbe... I guess I don't transfer anything bigger than a few GiB time to time.

Re:High-speed 10Gbps full-mesh network based on USB4 for jus... by nickstinemates on Tuesday January 16, 2024 @02:16AM (#39010361)
No individual connection other than like a cr tral storage server needs 100gbe, at least for me, but a 100gbe backplane is good for a lot of 1gbe poe devices as an example. With residential fiber/coax reaching 5gb, 1gb is not enough.
Re:High-speed 10Gbps full-mesh network based on USB4 for jus... by Palomides on Monday January 15, 2024 @02:39PM (#39005145)
cx353a and cx354a, prefer the fcbt models, but you can reflash them all to fcbt
Re:High-speed 10Gbps full-mesh network based on USB4 for jus... by crotchfire on Monday January 15, 2024 @03:27PM (#39005626)
What does fcbt stand for and why would I want it?
Re:High-speed 10Gbps full-mesh network based on USB4 for jus... by Palomides on Monday January 15, 2024 @03:47PM (#39005885)
the same hardware was sold at different prices with different capabilities enabled based on the exact model variant, stuff like higher speeds and infiniband support

you can see them all in the datasheet, I believe fcbt is the one with all the stuff enabled

Re:High-speed 10Gbps full-mesh network based on USB4 for jus... by Hikikomori on Monday January 15, 2024 @02:18PM (#39004890)
Mellanox connect-x 3 probably.