News for hackers. Stuff that matters.
Re:Microsoft Ubuntu repositories are broken because of space... by yrro on Thursday June 17, 2021 @07:30AM (#27538458)
Microsoft's dpkg packages themselves do some fairly weird/annoying stuff in their maintainer scripts.

e.g., azuredatastudio contains code that manages a /usr/local/bin/code symlink...

... and it contains code that converts a PGP key in armored form to binary form and dumps it in /etc/apt/trusted.gpg.d, even if the sysadmin already took the time to verify the PGP key and put it into their own .asc file in the same directory (ok, I guess at least they aren't force-appending their key to the old/deprecated/monolithic /etc/apt/trusted.gpg file like many others)...

... oh and in doing so they dump out microsoft.gpg to the current directory, whatever that may be... they should at least be using mktemp!

... and they are doing other things that they should be relying on debhelper to do for them, e.g. installing shared-mime-info-spec files manually rather than with dh_installmime; installing desktop-entry-spec files manually rather than relying on the triggers that already handle installation of such files...

As for teams, it has its own oddball way of monkeying with /etc/apt, and one other weirdness: it explicitly changes /usr/share/teams/chrome-sandbox to be setuid. If that file is supposed to be setuid then ship it as such... shipping it non-setuid and then modifing it in a maintainer script sets off alarm bells and breaks dpkg-statoverride...

Re:Microsoft Ubuntu repositories are broken because of space... by Nux on Thursday June 17, 2021 @08:19AM (#27538790)
I have zero trust on how they handle this, judging by your post it is justified.

This is why I decided to bite the bullet and go flatpak for the likes of teams, slack and other proprietary software.

Re:Microsoft Ubuntu repositories are broken because of space... by mcny on Thursday June 17, 2021 @08:42AM (#27538956)
> This is why I decided to bite the bullet and go flatpak for the likes of teams, slack and other proprietary software.

I always recommend this now if it is an option. Even if Microsoft does nothing wrong, it is way too easy for me to make an error and somehow enable Microsoft antivirus stuff on my Fedora machine which I still don't know how I managed to do.

Re:Microsoft Ubuntu repositories are broken because of space... by yrro on Thursday June 17, 2021 @10:07AM (#27539715)
Flatpak is best iff the vendor is producing the packages. I have found all too often than I'm stuck on an outdated version of a orphaned, unofficial pacakge...
Re:Microsoft Ubuntu repositories are broken because of space... by stinos on Thursday June 17, 2021 @12:11PM (#27541234)
Still I wonder if you'd author all non-proprietary packages how many of these violations you'd find. Especially in smaller projects. Don't have any examples ready since I also try to avoid anything but established software, but I'm certain in the past I've had issues like mentioned above, even persisting after removal of the package.
Re:Microsoft Ubuntu repositories are broken because of space... by swiley on Thursday June 17, 2021 @09:58AM (#27539629)
>explicitly changes /usr/share/teams/chrome-sandbox to be setuid

These kinds of hacks are pretty consistant with my few experiences with Microsoft (and other vendor's) closed software on Linux. It's all best avoided for community maintained solutions.

Re:Microsoft Ubuntu repositories are broken because of space... by markkrj on Thursday June 17, 2021 @08:55PM (#27546188)
/etc/apt/trusted.gpg.d is being deprecated also in favour of signed-by=/usr/share/keyrings/keyfile.gpg

https://www.linuxuprising.com/2021/01/apt-key-is-deprecated-...

Re:Microsoft Ubuntu repositories are broken because of space... by yrro on Friday June 18, 2021 @10:28AM (#27550684)
Thanks for reminding me. I really wish apt-secure(8) and apt-key(8) would mention this!
Re:Microsoft Ubuntu repositories are broken because of space... by phab on Thursday June 17, 2021 @05:51AM (#27537902)
The packages.microsoft.com repositories are regularly broken, which results in perennial build failures if you use GitHub Actions which includes it by default.

GitHub's response to "your default configuration is broken" was basically "welp, NOMFP":

https://github.com/actions/virtual-environments/issues/3410

Re:Microsoft Ubuntu repositories are broken because of space... by unwind on Thursday June 17, 2021 @06:58AM (#27538261)
Uh somewhat off topic but is NOMFP a typo of NMFP (="not my fine problem")?

Hadn't seen it before and big G suggests NMFP is way more common, with no hit that I saw explaining the 'O'.

Re:Microsoft Ubuntu repositories are broken because of space... by phab on Thursday June 17, 2021 @07:07AM (#27538316)
https://www.google.com/search?client=firefox-b-d&q=NOMFP

(It's a quote from the UK political satire series "The Thick Of It", in which the character Malcolm Tucker remarks, "NOMFP. N-O-M-F-P. Not My Fucking Problem. I quite like that. Did you like that? I'll use that quite a lot today.")

Re:Microsoft Ubuntu repositories are broken because of space... by scrapcode on Thursday June 17, 2021 @08:02AM (#27538647)
At first glance I thought "Not Our MFing Problem." Thanks.
Re:Microsoft Ubuntu repositories are broken because of space... by dhimes on Thursday June 17, 2021 @08:55AM (#27539048)
This seems quite plausible- moreso than using the first two letters of "Not."
Re:Microsoft Ubuntu repositories are broken because of space... by unwind on Thursday June 17, 2021 @07:43AM (#27538516)
Aha, that was a couple of fathoms below my radar. Thanks!
Re:Microsoft Ubuntu repositories are broken because of space... by Aeolun on Thursday June 17, 2021 @07:00AM (#27538281)
Is this another typo? NFMP = Not Fine My Problem?

That said, I’d also like to know.

Re:Microsoft Ubuntu repositories are broken because of space... by unwind on Thursday June 17, 2021 @07:42AM (#27538510)
Typo yes, that's what I get from HN:ing on my phone. Thanks, and fixed.
Re:Microsoft Ubuntu repositories are broken because of space... by CallMeMarc on Thursday June 17, 2021 @07:08AM (#27538320)
I’d have guessed „none of my fucking problems“
Re:Microsoft Ubuntu repositories are broken because of space... by bitwize on Thursday June 17, 2021 @07:11AM (#27538342)
I thought it was "not our motherfucking problem".
Re:Microsoft Ubuntu repositories are broken because of space... by cghendrix on Thursday June 17, 2021 @07:57AM (#27538609)
Not sure why but thought it was: not on my f*cking premises
Re:Microsoft Ubuntu repositories are broken because of space... by Cthulhu_ on Thursday June 17, 2021 @08:09AM (#27538706)
You don't need to self-censor, we're all adults, we know what you mean, the US government won't deplatform you for typing an u.
Re:Microsoft Ubuntu repositories are broken because of space... by comradesmith on Thursday June 17, 2021 @07:30AM (#27538455)
Maybe “Not on my fucking plate”?
Re:Microsoft Ubuntu repositories are broken because of space... by shrikant on Thursday June 17, 2021 @07:08AM (#27538323)
The packages.microsoft.com repositories are by far THE SLOWEST for `apt` updates. I wonder if there's a way to pick a faster mirror.
Re:Microsoft Ubuntu repositories are broken because of space... by G3rn0ti on Thursday June 17, 2021 @07:29AM (#27538450)
If you are on Ubuntu you could install from Canonical‘s snap repo hosted by Canonical and not MS.
Re:Microsoft Ubuntu repositories are broken because of space... by shrikant on Thursday June 17, 2021 @08:37AM (#27538910)
I don't use snaps though...
Re:Microsoft Ubuntu repositories are broken because of space... by ilaksh on Thursday June 17, 2021 @06:57AM (#27538246)
Is there a way to easily change the default and if so what is a good mirror?
Re:Microsoft Ubuntu repositories are broken because of space... by phab on Thursday June 17, 2021 @07:09AM (#27538329)
I have no need for MS packages, and so I simply

  for broken_apt_repository in `grep -lr microsoft /etc/apt/sources.list.d/`; do sudo rm $broken_apt_repository; done
before I do anything else. Others are not so lucky.
Re:Microsoft Ubuntu repositories are broken because of space... by paulcarroty on Thursday June 17, 2021 @06:58AM (#27538263)
Oh, had this several times and removed MS repos in some projects. Maybe it worth to create the extension.
Re:Microsoft Ubuntu repositories are broken because of space... by throwawaybutwhy on Thursday June 17, 2021 @05:22AM (#27537696)
Not only Ubuntu. And not for the first time [0], [1], [3] (Stack Overflow). Would be surprised, however, if the servers are in space instead of under water [2].

[0] https://social.msdn.microsoft.com/Forums/en-US/5d090bb8-6c22...

[1] https://github.com/MicrosoftDocs/windowsserverdocs/issues/50...

[2] https://news.microsoft.com/innovation-stories/project-natick...

[3] https://stackoverflow.com/questions/59624773/failed-to-fetch...

Re:Microsoft Ubuntu repositories are broken because of space... by TimSchumann on Thursday June 17, 2021 @09:34AM (#27539391)
Just to clarify the title, Space in this context is the 'Biggest Key on your Keyboard' kind not the 'On Disk' kind.

It looks like a parsing issue where something in MS's automated process is replacing various parts of filenames with spaces. Looks like / and _ at a glance, but there could be more.

Just trying to prevent this type of comment, which I can only assume came from HN as nowhere in the Github issue does anyone mention disk space. -- https://github.com/dotnet/core/issues/6381#issuecomment-8631...

Re:Microsoft Ubuntu repositories are broken because of space... by tyingq on Thursday June 17, 2021 @09:54AM (#27539588)
"nowhere in the Github issue does anyone mention disk space"

What is mentioned is ambiguous. So while disk space isn't specifically mentioned, neither is spaces in the context of filenames.

Here's what people are reading in that issue:

"Update: our infra team is still working to resolve this issue. They ran into some space issues but this issue should be resolved quickly. Unfortunately, I do not have an ETA yet."

There isn't enough context to know what it means.

Re:Microsoft Ubuntu repositories are broken because of space... by jbverschoor on Thursday June 17, 2021 @10:29AM (#27539957)
"escaping space characters" would be clear.

I thought there was some diskspace issue

Re:Microsoft Ubuntu repositories are broken because of space... by fabbari on Thursday June 17, 2021 @06:44AM (#27538178)
None commented yet on the suggested issue? They ran out of space? Really? Azure Monitoring, Azure Sentinel - surely they have the simplest metric: used vs remaining space.

Or did they hit a limit in the blob/file storage. Still: no monitoring?

You may have noticed I have so many questions on Microsoft Ops.

Re:Microsoft Ubuntu repositories are broken because of space... by throwawaybutwhy on Thursday June 17, 2021 @06:47AM (#27538192)
rm -rf --no-preserve-root is a space issue, too.
Re:Microsoft Ubuntu repositories are broken because of space... by rvanlaar on Thursday June 17, 2021 @08:54AM (#27539044)
Reminds me of an F1 story. A car was able to finish the race but stopped before reaching the pit lane. The team communicated it as being a fuel pick up problem. The underlying cause was that there was no fuel left to be picked up.
Re:Microsoft Ubuntu repositories are broken because of space... by enriquto on Thursday June 17, 2021 @07:57AM (#27538615)
> because of space issues

yeah, spaces in filenames. A well-known yet insidious problem.

Is there any mount option to change raw spaces in the exposed filesystem with an unicode non-breaking space, or something?

Re:Microsoft Ubuntu repositories are broken because of space... by craftinator on Thursday June 17, 2021 @08:08AM (#27538702)
> yeah, spaces in filenames. A well-known yet insidious problem.

It'll be fixed as soon as they finish their Backslash Conversion Project!

Re:Microsoft Ubuntu repositories are broken because of space... by G3rn0ti on Thursday June 17, 2021 @05:53AM (#27537912)
Wanted to update my Teams on Ubuntu 20 in the morning (after coming to office after months working from home) and had the same issue. Removed the package and installed it from snap. Works like charm so far.
Re:Microsoft Ubuntu repositories are broken because of space... by vmception on Thursday June 17, 2021 @06:23AM (#27538075)
Of all the social issues in the world, apt-get and wget 404ing for my version of linux are the only things that trigger me
Re:Microsoft Ubuntu repositories are broken because of space... by merb on Thursday June 17, 2021 @05:54AM (#27537915)
it's not just ubuntu, it's basically all of them. basically my debian docker build failed because of that.
Re:Microsoft Ubuntu repositories are broken because of space... by Scandiravian on Thursday June 17, 2021 @06:53AM (#27538223)
Same. More or less all of my company's pipelines are currently broken
Re:Microsoft Ubuntu repositories are broken because of space... by azalemeth on Thursday June 17, 2021 @04:08AM (#27537247)
What SLA are Ubuntu mirrors held to? This doesn't seem great, but won't a quick run of mirrorselect remove the offending repos and let you get on with life?
Re:Microsoft Ubuntu repositories are broken because of space... by NiekvdMaas on Thursday June 17, 2021 @04:27AM (#27537344)
For your home setup: sure, it should be resolved soon, not too big of an issue.

What's much more annoying is that this breaks CI/Docker builds. Right now you can't deploy new container images that depend on a MS repository. I hope it's resolved soon.

Re:Microsoft Ubuntu repositories are broken because of space... by dvfjsdhgfv on Thursday June 17, 2021 @04:52AM (#27537483)
We had the same problems already in the 90s and resolved them by caching, it's unthinkable that the whole build is broken by a problem with an external dependence - if you assume everything will be 100% available you basically make sure a problem will happen.
Re:Microsoft Ubuntu repositories are broken because of space... by rkeene2 on Thursday June 17, 2021 @07:58AM (#27538622)
I wrote "hashcache" [0] [1] for this for my Linux distribution (which is the build from source variety) to avoid issues with upstream going away, or worse changing the contents of a file.

Many different caches can be used, in case one is down as well.

Simple example download script at [2].

[0] http://hashcache.rkeene.org/ [1] https://chiselapp.com/user/rkeene/repository/hashcache/ [2] https://kitcreator.rkeene.org/fossil/artifact/d546c4b48dfce8...

Re:Microsoft Ubuntu repositories are broken because of space... by creshal on Thursday June 17, 2021 @05:00AM (#27537521)
https://wiki.debian.org/AptCacherNg still exists and still works fine.
Re:Microsoft Ubuntu repositories are broken because of space... by tambre on Thursday June 17, 2021 @05:53AM (#27537909)
Aptly [0] is also really nice for maintaining mirrors and one's own Apt repositories though it is unmaintained.

[0]: https://github.com/aptly-dev/aptly

Re:Microsoft Ubuntu repositories are broken because of space... by silon42 on Thursday June 17, 2021 @07:29AM (#27538452)
Not caching... mirroring or vendoring.
Re:Microsoft Ubuntu repositories are broken because of space... by ohgodplsno on Thursday June 17, 2021 @05:00AM (#27537526)
As the other comment says: cache it yourself. Not only will you save time downloading it, avoid sudden version changes, your build environment should really not depend on pulling things out of your control every single time
Re:Microsoft Ubuntu repositories are broken because of space... by iso1631 on Thursday June 17, 2021 @05:18AM (#27537669)
The modern argument would be that you're more likely to have problems with your own cache than someone else, and you should just use caching as a service.
Re:Microsoft Ubuntu repositories are broken because of space... by pdpi on Thursday June 17, 2021 @05:45AM (#27537863)
It's a lot easier to remove yourself from the critical path if your cache has problems than it is to add the caching after the fact when a third party is having problems, though.
Re:Microsoft Ubuntu repositories are broken because of space... by hnlmorg on Thursday June 17, 2021 @07:15AM (#27538374)
Exactly this!

You plan for failure. What happens if your cache fails? You fall back to Microsoft. But what happens if Microsoft fails and you don't have a cache? Well you build a cache in advance and default to that.

Caches can also improve build time, allow for security tools to scan, and other such benefits too. So there are other benefits outside of creating a redundancy.

Re:Microsoft Ubuntu repositories are broken because of space... by coredog64 on Thursday June 17, 2021 @09:38AM (#27539430)
We do local caching, and it’s caused more outages, downtime, headaches and lost productivity than I can count. Although the hardware requirement is minimal, all that other stuff makes it expensive. So run a risk calculation for your own use case.
Re:Microsoft Ubuntu repositories are broken because of space... by ohgodplsno on Thursday June 17, 2021 @05:23AM (#27537706)
The modern argument is most likely made by people who sell caching as a service and have an interest in you blowing $500/month on a glorified FTP or a script to setup Artifactory.
Re:Microsoft Ubuntu repositories are broken because of space... by Symbiote on Thursday June 17, 2021 @05:36AM (#27537811)
But this is Microsoft's cache, so it is already essentially on the same network, and is free.
Re:Microsoft Ubuntu repositories are broken because of space... by merb on Thursday June 17, 2021 @05:56AM (#27537925)
well we cached the final docker images ;-) unfortunatly if you need to add another dependency for our build image were done. (well we could pull the old one and add the dependency and repush this image)

also there are cache misses :-(

Re:Microsoft Ubuntu repositories are broken because of space... by lathiat on Thursday June 17, 2021 @08:06AM (#27538690)
The “mirrors” in this case are Microsoft run servers specifically for Microsoft made packages for Ubuntu. Rather than the actual Ubuntu mirrors for all Ubuntu packages.
Re:Microsoft Ubuntu repositories are broken because of space... by judge2020 on Thursday June 17, 2021 @08:20AM (#27538795)
Those actually work pretty well from my experience and are usually faster than the default archive in docker containers.
Re:Microsoft Ubuntu repositories are broken because of space... by alfiedotwtf on Thursday June 17, 2021 @06:40AM (#27538156)
I've also found the ':' character in filenames also breaks Linux under Windows :(
Re:Microsoft Ubuntu repositories are broken because of space... by jijji on Thursday June 17, 2021 @08:00AM (#27538637)
its probably a silly question, but why are people using microsoft to fetch debian packages?
Re:Microsoft Ubuntu repositories are broken because of space... by userbinator on Thursday June 17, 2021 @09:16AM (#27539246)
Microsoft's packages of its own software for Debian.
Re:Microsoft Ubuntu repositories are broken because of space... by krautsourced on Thursday June 17, 2021 @08:28AM (#27538853)
I'd assume they host some of their own packages plus it's probably the default for the Azure space. (just an assumption)
Re:Microsoft Ubuntu repositories are broken because of space... by fapjacks on Thursday June 17, 2021 @09:25AM (#27539306)
Microsoft repos were silently added to Raspberry Pi OS earlier this year, ostensibly "in case anyone wants to use VSCode" and definitely not just as a super shitty way of adding telemetry to every Raspberry Pi OS install without asking the user if they were cool with this.
Re:Microsoft Ubuntu repositories are broken because of space... by minedwiz on Thursday June 17, 2021 @12:53PM (#27541707)
For example, my team's services run on Debian, but are .NET Core-based, so our dev boxes & CI machines rely on Microsoft deb repos.
Re:Microsoft Ubuntu repositories are broken because of space... by mixxit on Thursday June 17, 2021 @04:19AM (#27537297)
had this last night :( thanks for posting