News for hackers. Stuff that matters.
Re:Hacking Ethernet out of Fibre Channel cards by noja on Wednesday September 09, 2020 @10:49AM (#24421625)
"I have roughly 2 tesco bags of Emulex FC 8Gbit cards and 1 tesco bag of QLogic."

Brilliant.

Re:Hacking Ethernet out of Fibre Channel cards by nicktelford on Wednesday September 09, 2020 @11:15AM (#24421938)
If anyone is wondering about this standard unit of measure, the volume of 1 tesco carrier bag is equivalent to 17.9L (litres)[1]

1: https://www.reddit.com/r/AskUK/comments/3tt95u/how_many_litr...

Re:Hacking Ethernet out of Fibre Channel cards by jdsnape on Wednesday September 09, 2020 @02:57PM (#24424470)
Ah, well it depends a bit if it’s a standard carrier bag or a bag for life - I think the bag for life is bigger.
Re:Hacking Ethernet out of Fibre Channel cards by philjohn on Wednesday September 09, 2020 @03:55PM (#24425209)
Which bag for life? One of the sturdy plastic ones, or the hessian variety?
Re:Hacking Ethernet out of Fibre Channel cards by OJFord on Thursday September 10, 2020 @04:16AM (#24430054)
'Oh yeah, a hessian bag for life maybe, but not a sturdy plastic one, that's my point.'
Re:Hacking Ethernet out of Fibre Channel cards by kwiens on Wednesday September 09, 2020 @05:35PM (#24426193)
This is so fantastic.
Re:Hacking Ethernet out of Fibre Channel cards by eqvinox on Wednesday September 09, 2020 @03:03PM (#24424554)
Fun fact: you can connect more than 2 systems in FC without a switch. Just hop along from one TX to the next RX and build a ring. (It's called FC-AL, "Arbitrated Loop".) Works with fibre if you break the duplex cables apart to make simplex connections.

Obviously the entire thing fails if any node is powered off or has any kind of problem, but it's quite funny to do ;)

Re:Hacking Ethernet out of Fibre Channel cards by adrianmonk on Wednesday September 09, 2020 @05:57PM (#24426404)
Fiber in a ring? Now you've given me flashbacks of FDDI (https://en.wikipedia.org/wiki/Fiber_Distributed_Data_Interfa...).

The nice thing about FDDI was it could tolerate one node failure, because it has two rings. (Each node has two fiberoptic cables to both its neighbors.) If a node fails, its neighbors just send traffic the other direction.

Re:Hacking Ethernet out of Fibre Channel cards by wyldfire on Wednesday September 09, 2020 @03:13PM (#24424671)
> Obviously the entire thing fails if any node is powered off or has any kind of problem, but it's quite funny to do

Indeed it was funny enough to have that be a very common network topology back in the day. I've never had to investigate a token ring network failure but I can pretty much guarantee it was a frustrating exercise.

Re:Hacking Ethernet out of Fibre Channel cards by phs2501 on Wednesday September 09, 2020 @03:49PM (#24425127)
I was going to say that I thought token ring MAUs handled disconnected stations but then I read this (including the "setup aid" with an included battery) and now I'm not sure any more:

https://en.wikipedia.org/wiki/Media_access_unit

(un)fortunately I didn't experience this period of network history first hand. :)

Re:Hacking Ethernet out of Fibre Channel cards by anilakar on Wednesday September 09, 2020 @11:21AM (#24421996)
A few years ago I and a few friends found a pile of old PCI Express Fibre Channel cards from some manufacturer I can no longer remember. 2.5 gigabits per second being faster than one and people being on an undergrad budget, we soon started wondering whether they could be repurposed as network interface cards in our ad hoc server colo built in an old abandoned storage room, which didn't even exist in the original dorm floor plans.

A bit of googling turned out that it was possible and supported by the manufacturer - if you ran Linux 2.6 and were prepared to compile the kernel drivers yourself. We quickly ditched the project when we found out that the old driver made newer kernels panic and setting up link aggregation on normal gigabit ethernet cards wasn't that much of a hassle anyway.

Re:Hacking Ethernet out of Fibre Channel cards by non-entity on Wednesday September 09, 2020 @12:20PM (#24422603)
> We quickly ditched the project when we found out that the old driver made newer kernels panic

I'm suprised they ever compiled on a newer kernel.

Re:Hacking Ethernet out of Fibre Channel cards by duxup on Wednesday September 09, 2020 @12:25PM (#24422664)
I worked with FC for a while, and IP over FC was always a wonky kinda situation. It really made no sense that if you had a big expensive FC fabric, that you'd funnel your IP traffic through it.

It wasn't that much of a lift for most organizations to just have an IP network for IP type traffic, and leave their high performance FC fabric alone to do its thing.

The few situations when it was done was when someone had some rando traditional IP systems that you'd connect just because, but these were corner cases / kinda forgotten bit of equipment that you just were waiting to replace / time out kinda situations.

Re:Hacking Ethernet out of Fibre Channel cards by itsjustjoe on Wednesday September 09, 2020 @01:21PM (#24423323)
FCoE (fibre channel over ethernet) was similar. Not only was it an amalgamation of arguably incompatible standards, but it was an unusual use case. If you needed data security / reliability, etc you could go FC. If you needed a cheap data protocol you could go iSCSI.
Re:Hacking Ethernet out of Fibre Channel cards by ArchOversight on Wednesday September 09, 2020 @01:57PM (#24423782)
FCoE was (and may still be) pushed heavily by Cisco. It was neat, being able to have your Cisco UCS devices talk to both Fibre Channel NetApp and Ethernet all on the same link.

It worked fairly well once it was up and running, and you set the QoS correctly so that FC traffic won out over Ethernet because Fiber Channel does NOT tolerate drops very well.

Re:Hacking Ethernet out of Fibre Channel cards by duxup on Wednesday September 09, 2020 @02:21PM (#24424055)
Cisco's FC solutions were always a weird effort to merge their own IP tech in here or there and it just always felt half thought through to me.
Re:Hacking Ethernet out of Fibre Channel cards by ArchOversight on Wednesday September 09, 2020 @07:54PM (#24427374)
Bugs... so many bugs in the various pieces. But I can say it was fairly rock solid once it was up and running.
Re:Hacking Ethernet out of Fibre Channel cards by duxup on Thursday September 10, 2020 @08:49AM (#24431800)
Yeah Cisco's FC products were pretty buggy. I preferred Brocade.

FC is solid generally once you've got it running, the protocol kinda ensures that.

Re:Hacking Ethernet out of Fibre Channel cards by duxup on Wednesday September 09, 2020 @01:30PM (#24423450)
Yeah FCoE could be wonky. It was a pipe dream that was a no win balancing act.

I worked with some FCIP and given the right case and planning, that could work, within the right context.

Re:Hacking Ethernet out of Fibre Channel cards by itsjustjoe on Thursday September 10, 2020 @12:35PM (#24433892)
It was a cool idea in theory. One cable for everything! And then you realize that you still have to worry about power, KVM (or a dedicated IPMI), and any other potential add ons. Emulex worked on getting their chips as on board NICs, which would have been neat for that, but honestly the performance and lack of upgradability couldn't compete with add-on cards.
Re:Hacking Ethernet out of Fibre Channel cards by benlivengood on Wednesday September 09, 2020 @06:55PM (#24426868)
When the 8Gbps FC network used one color and the old routers only managed a couple 1Gbps links on the other available colors IPoFC seemed like a pretty good idea, especially when NetApp would only snapmirror over IP.

I certainly hope someone has turned that off by now.

Re:Hacking Ethernet out of Fibre Channel cards by jandrese on Wednesday September 09, 2020 @01:43PM (#24423615)
I managed to get IP over Firewire working once but came to the same realization. There is never a time when it makes sense to deploy it. The solution was just unreliable enough that even if it was a bit faster you'd lose more hair trying to keep it working than it was worth.
Re:Hacking Ethernet out of Fibre Channel cards by nigwil_ on Wednesday September 09, 2020 @06:02PM (#24426443)
IBM AIX (IBM's variant of the UNIX operating system) has long supported IPoFC (IP over Fibre Channel). https://en.wikipedia.org/wiki/IBM_AIX
Re:Hacking Ethernet out of Fibre Channel cards by erinnh on Wednesday September 09, 2020 @11:58AM (#24422377)
I have used FC 8Gbit transceivers before in my homelab as a replacement for Multimode 10Gbit transceivers. They work quite well. No problems with those Ive still got running.
Re:Hacking Ethernet out of Fibre Channel cards by mmastrac on Wednesday September 09, 2020 @12:39PM (#24422819)
Any recommendations on card brand? One of these days I'd love to give this a shot.
Re:Hacking Ethernet out of Fibre Channel cards by erinnh on Thursday September 10, 2020 @03:33AM (#24429839)
I used whichever were cheapest to buy on ebay. WHich currently were Mellanox ConnectX-3 and HP branded Qlogic cards. Both work without a problem in my homelab.

I do have one server with a built-in Intel card, that is more annoying, so I'd steer away from those in the future. The Intel card did not take all transceivers. They only wanted Cisco branded transceivers (from the ones I had available. I'm gonna guess, Intel ones would be fine too).

Re:Hacking Ethernet out of Fibre Channel cards by ShradhaSingh on Thursday September 10, 2020 @04:37AM (#24430166)
Here we have a network card which normally pretends to be a disk, but here it's a network card pretending to be a scanner pretending to be a network card.

Top-tier stuff.

Re:Hacking Ethernet out of Fibre Channel cards by quercusa on Wednesday September 09, 2020 @11:36AM (#24422153)
This is a great hack! Searching for "over fibre channel" and "fibre channel over" will demonstrate that FC was seen as the answer to every need.