News for hackers. Stuff that matters.
Re:LoRA: Low-Rank Adaptation of Large Language Models by muny on Friday March 24, 2023 @09:25AM (#35288730)
Why use the same name as LoRa? https://lora-alliance.org/

Edit: Microsoft is even a member of the LoRa alliance: https://lora-alliance.org/lora-alliance-press-release/micros...

Re:LoRA: Low-Rank Adaptation of Large Language Models by anthk on Friday March 24, 2023 @09:45AM (#35288995)
Also Guix vs Guix...
Re:LoRA: Low-Rank Adaptation of Large Language Models by elcomet on Friday March 24, 2023 @09:47AM (#35289032)
There are many more things called lora.

https://en.m.wikipedia.org/wiki/Lora

It doesn't really matter as long as it's not in the same field. No one will be confused between the two.

Re:LoRA: Low-Rank Adaptation of Large Language Models by magicalhippo on Friday March 24, 2023 @10:02AM (#35289185)
> No one will be confused between the two.

Except search engines...

Re:LoRA: Low-Rank Adaptation of Large Language Models by Filligree on Friday March 24, 2023 @11:02AM (#35289948)
That's okay, Bing-GPT doesn't get confused.
Re:LoRA: Low-Rank Adaptation of Large Language Models by FlyingRobot on Friday March 24, 2023 @10:09AM (#35289260)
I had to scan the readme to make sure this story wasn’t about applying machine learning to radio communication.
Re:LoRA: Low-Rank Adaptation of Large Language Models by ChancyChance on Friday March 24, 2023 @11:24AM (#35290273)
Small CNNs can be used for BLE channel hopping and body detection.
Re:LoRA: Low-Rank Adaptation of Large Language Models by brodouevencode on Friday March 24, 2023 @10:34AM (#35289570)
https://en.wikipedia.org/wiki/LoRa for the communications architecture
Re:LoRA: Low-Rank Adaptation of Large Language Models by StingyJelly on Friday March 24, 2023 @10:45AM (#35289714)
At least could have been LoRaA
Re:LoRA: Low-Rank Adaptation of Large Language Models by renewiltord on Friday March 24, 2023 @10:55AM (#35289850)
Why did the radio guys use the same name as this hotel from Minnesota that existed for years before? https://www.lorahotel.com/

I bet some of them have even been to Minnesota and they still didn't pick a unique name.

Though both of them have to answer to why they picked the name of a Google Font that preceded both and is currently available https://web.archive.org/web/20170210001724/https://fonts.goo...

Is it because Microsoft is competing with Google in the AI space?

Re:LoRA: Low-Rank Adaptation of Large Language Models by reportgunner on Friday March 24, 2023 @11:43AM (#35290590)
Context. Individual hotels are not technology.
Re:LoRA: Low-Rank Adaptation of Large Language Models by renewiltord on Friday March 24, 2023 @01:28PM (#35292507)
Indeed. And LLMs are not radios or fonts.
Re:LoRA: Low-Rank Adaptation of Large Language Models by reportgunner on Monday March 27, 2023 @03:45AM (#35323984)
Radios and fonts and LLMs are technology though.
Re:LoRA: Low-Rank Adaptation of Large Language Models by tylerekahn on Friday March 24, 2023 @11:08AM (#35290028)
Low Rank Adaption is a mathematical technique, it's not a technology standard
Re:LoRA: Low-Rank Adaptation of Large Language Models by samtho on Friday March 24, 2023 @11:37AM (#35290493)
It’s still a currently-in-use acronym/term that a sufficiently large tech company could conceivably be using both meanings concurrently. This causes confusion and muddies the water of a general web search experience.

Not the same situation, but I remember when “Electron” was called “Atom Shell” because it was built for the (now defunct) text editor by the same name. For the longest time, I had an unsubstantiated thought that it was a new Unix shell that was based around a text editor somehow (yes, dumb). In hindsight, they just had named this cleverly to reference the various layers or shells of electrons orbiting atomic nuclei, thus the eventual name of Electron.

On the other hand, a wireless technology standard is very different than a known mathematical technique that likely predates the wireless meaning anyway.

Re:LoRA: Low-Rank Adaptation of Large Language Models by krolden on Friday March 24, 2023 @01:13PM (#35292240)
Then call it LoRad
Re:LoRA: Low-Rank Adaptation of Large Language Models by stu2b50 on Friday March 24, 2023 @11:52AM (#35290777)
You’re assuming a lot more intercompany coordination than would exist. Even though it’s research by Microsoft labs, the researchers themselves are to a large extent autonomous and also narrow experts in their fields.

This process involves low rank approximations -> Lora is a namey sounding term that uses characters from low and rank -> call it LoRA in the paper. That’s all there was to it. Probably didn’t even know the other lora existed.

Re:LoRA: Low-Rank Adaptation of Large Language Models by edwardjhu on Friday March 24, 2023 @04:15PM (#35294821)
Yup. That's exactly what happened.
Re:LoRA: Low-Rank Adaptation of Large Language Models by kkielhofner on Friday March 24, 2023 @12:34PM (#35291573)
In all seriousness there should be ML project naming approaches (I should try ChatGPT). Naming a project or a company is very difficult so I can’t blame anyone here.

That said some of these ML project names are especially horrendous (kind of ironic for the current emphasis on generative AI). Transformers? A good chunk of the time I get results about the toys and cartoons from my childhood. Don’t get me wrong, I still think Optimus Prime is cool and the name “transformers” make sense given the function but it’s somehow simultaneously generic AND the name of a decades long multi-billion dollar media franchise…

LoRA is another example, name makes sense but the collision with LoRa is problematic. I, for one, am interested in and have/would apply both. Queue google searches for “Lora radio…” vs “Lora ml…”.

Project naming is hard and I’m just glad to see the activity and releases. BUT project naming is essentially a base usability condition and should be considered as such: just like creating a README, getting started, providing code examples, etc.

It reminds me of trademarks: if you’re looking for trademark protection it won’t be issued if it is overly generic or likely to “cause confusion in the marketplace” with an existing trademark (basically same or similar name in a somewhat similar/adjacent field) - you can even reuse names but only if it’s obvious to people from basic context that they refer to different things. I’m not a trademark attorney but I think LoRa vs LoRA would get refused because it’s “computer stuff”, while a shampoo named Lora would be fine (as an example). If you’re curious there are official categories/areas from the USPTO that break these down.

Both of these examples wouldn’t have a chance at trademark protection. Note I’m not saying they should have trademark protection, just that it’s an example of a reasonable standard that should be considered/compared to for good open source project naming.

Re:LoRA: Low-Rank Adaptation of Large Language Models by AdamH12113 on Friday March 24, 2023 @01:33PM (#35292622)
"LoRAd" was right there.
Re:LoRA: Low-Rank Adaptation of Large Language Models by edwardjhu on Friday March 24, 2023 @04:10PM (#35294763)
Good question! I came up with the name because the idea is best described as low-rank adaptation. I know very little about radio communication and didn't anticipate the visibility my repo has today :)