News for hackers. Stuff that matters.
Re:EDPS: European Commission's use of Microsoft 365 infringe... by brnt on Monday March 11, 2024 @08:13AM (#39667159)
Let's start with the use of OpenDocument formats. Much of Brussels operates on the exchange-by-mail of .docx files (unfortunately, this is part of my job, it's true for other governments too). I so wish that would change. My ideal would be version-tracked LaTeX of course, but let's begin with a small step. By the way, is there any good tooling of e.g. diffing .odt? I haven't found that, but maybe I'm overlooking something.
Re:EDPS: European Commission's use of Microsoft 365 infringe... by plextoria on Monday March 11, 2024 @08:16AM (#39667200)
Are .docx files routinely version-tracked and "diffed"?
Re:EDPS: European Commission's use of Microsoft 365 infringe... by FirmwareBurner on Monday March 11, 2024 @08:29AM (#39667333)
Word (offline) has had a built-in diff feature for over 10 years, and offline versioning is most likely handled like this: work_document_24_Dec_2023_Changes_from_William_final2-Copy(1).docx

But most likely collaboration is now done via SharePoint and the cloud version where you can track changes live.

Re:EDPS: European Commission's use of Microsoft 365 infringe... by shabble on Monday March 11, 2024 @08:54AM (#39667602)
maybe I'm just doing it wrong, but having looked at these capabilities occasionally, they seem pretty weak.

- There's no equivalent of "git blame" that I can find to see who/when a particular line/paragraph/section changed.

- I can't see if there's a way to view my changes separate from other edits to the document, or isolate changes by single authors generally.

- "diffing" via the "compare documents" action seems to want to generate a new document with track-changes edits for changes from old/new, but mangles the histories to present all changes as by the invoker of the diff, at that time, which isn't all that useful.

It's definitely better than nothing at all, but a long way short of where I'd hoped we'd be regarding collaborative document authoring at this point.

Re:EDPS: European Commission's use of Microsoft 365 infringe... by ClumsyPilot on Monday March 11, 2024 @09:08AM (#39667754)
I’m think your expectations are a bit unrealistic, in terms of complexity for an average office worker.

First of all, most developers can’t use git blame

Secondly, there hasn’t really been a good diffing / compare documents experience for complex documents, with images and tables. The experience we have with HTML occasionally breaks the document itself, it’s not suitable for an average office worker.

You have to keep in mind that the tools being complicated are a not just a training problem - every time I see a developer making a blog, they spend more time on the technology than on the content they want to write. That’s why I don’t host my blog, I need the tool to get out of the way so that I can think about the relevant issue - communication.

Re:EDPS: European Commission's use of Microsoft 365 infringe... by shabble on Monday March 11, 2024 @09:38AM (#39668084)
I don't think some sort of vaguely granular "last edited by XXX at YYY" annotations/tooltips/whatever would be too outrageous a feature to confuse everyone.

If necessary, could treat tables or other complicated compound entries as a single editable item, although given the mysterious passion everyone I've ever worked with seems to have for putting just about everything into a table regardless of need, I'd hope it could be granular to a cell-level, at least.

Trying to collaboratively write complicated documents with a bunch of inter-relations between sections, from different people (in my case, documentation & regulatory paperwork for medical devices) is a massive pain, and I feel like it's too obvious a problem to be confined to my particular niche.

I vaguely recall Word is widely used for preparing huge legal documents, where the content and stakes are probably similar, so maybe there are some solutions, unless they're just "throw interns at it".

Re:EDPS: European Commission's use of Microsoft 365 infringe... by eptcyka on Monday March 11, 2024 @09:24AM (#39667927)
I think you underestimate most developers.
Re:EDPS: European Commission's use of Microsoft 365 infringe... by brnt on Monday March 11, 2024 @09:44AM (#39668146)
Sharepoint is in-org, and lo and behold, that's not always, or not even usually how documents are formed.

Plus, Sharepoint still has no concept of concurrent editing, so you better hope that nobody works on the same document at the same time. Also, it doesn't track changes.

It is only better than a file on a Windows share by a hair. A very thin hair.

Word's diff is Not Great (tm), but yes, at least it's there. Have you tried using it with more than 1 other changeset?

Re:EDPS: European Commission's use of Microsoft 365 infringe... by JonAtkinson on Monday March 11, 2024 @09:53AM (#39668251)
These assertions are just not true. I'm working right now on a document with coworkers, concurrently, via a Sharepoint server. Change tracking is enabled and can even be enabled by default by the Sharepoint admin.

I share a lot of your sentiment about open formats in previous comments, but this is classic FUD and demonstrably wrong.

Re:EDPS: European Commission's use of Microsoft 365 infringe... by brnt on Monday March 11, 2024 @10:22AM (#39668629)
Then our Sharepoint server must have disabled sth. I regularly get a message on save that the document has changed meanwhile, with the option to overwrite those changes or discard my own...

No change tracking is visible to me, other than a timestamp and name of last edited.

FUD is isn't. Please don't use buzzword gratuitously, I know _a lot_ more about the deployment here than you. Also, you didn't counter the statement that it doesn't do concurrent editing (like Google Docs, OnlyOffice), which in 2024 is a major gap imho.

Re:EDPS: European Commission's use of Microsoft 365 infringe... by JonAtkinson on Monday March 11, 2024 @02:58PM (#39672040)
Your original comment was speaking in general terms, about all Sharepoint services. Not your specific deployment. Details matter or your argument falls down.

As for concurrency, read my comment again, I use the specific word.

Re:EDPS: European Commission's use of Microsoft 365 infringe... by brnt on Monday March 11, 2024 @03:07PM (#39672124)
If you see that I talk about a certain config of Sharepoint, it's much faster to point that out than being argumentative.

What did you do to have concurrent editing (or what did you not do), and how does it integrate the various diffs?

Re:EDPS: European Commission's use of Microsoft 365 infringe... by szundi on Monday March 11, 2024 @09:39AM (#39668090)
Forgot the _final_final2
Re:EDPS: European Commission's use of Microsoft 365 infringe... by ano-ther on Monday March 11, 2024 @08:51AM (#39667559)
Oh yes. For everyone who is collaboratively editing texts, track changes is a much used function. Also the diff to create so-called redline versions. And commenting.

Sharepoint also tracks all versions automatically which is quite handy.

Haven’t yet found anything resembling this in the LaTeX world. Does OpenOffice offer this?

Re:EDPS: European Commission's use of Microsoft 365 infringe... by shabble on Monday March 11, 2024 @08:59AM (#39667653)
I've not really seen much actually using it in the wild, but I came across CriticMarkup[1] at some point in the past and had some idea of using it in some sort of copyediting workflows.

[1] https://github.com/CriticMarkup/CriticMarkup-toolkit

Re:EDPS: European Commission's use of Microsoft 365 infringe... by sam_lowry_ on Monday March 11, 2024 @09:10AM (#39667771)
> Haven’t yet found anything resembling this in the LaTeX world. Does OpenOffice offer this?

git

Re:EDPS: European Commission's use of Microsoft 365 infringe... by mavhc on Monday March 11, 2024 @08:48AM (#39667525)
Why would you not use online editors with real time merging, like Word online and Google Docs? Going back to ye olden times of diffs seems like a nightmare
Re:EDPS: European Commission's use of Microsoft 365 infringe... by mglz on Monday March 11, 2024 @09:34AM (#39668037)
Both are even worse for data protection and would immediately leak EU data onto US servers.
Re:EDPS: European Commission's use of Microsoft 365 infringe... by mavhc on Monday March 11, 2024 @09:53AM (#39668245)
You can specify which countries your data is held in.

Seems like Libreoffice needs this feature soon

Re:EDPS: European Commission's use of Microsoft 365 infringe... by steve1977 on Monday March 11, 2024 @08:50AM (#39667549)
How would ODF be better? Office Open XML standards are also publicly available if you need them.
Re:EDPS: European Commission's use of Microsoft 365 infringe... by thomaszander on Monday March 11, 2024 @09:23AM (#39667913)
Hi,

co-author of the ODF spec (2006 ISO) here, I also got involved via NLNet to work with my local standards office to improve OOXML.

The OOXML spec was offered to the ISO standard along an unusual path, a fast standardization lane. Where there was no option for any of the people reviewing it to actually change anything. It was rubber-stamped in other words.

That fact alone doesn't mean it is a bad, but it is a bit of a red flag. The fact is, it is a really bad specification. It is a full 7000 pages long with lots of conflicting details. On top of that it is full of references like "this works like wordperfect version-n". While references are useful in specifications, they need to be to existing open standards to be meaningful. Wordperfect has never standardized its format, so referring to it is meaningless.

To implement a competing application that can use this format you'd not be able to do that from this specification alone. Next to that it is so massive that it is essentially an undertaking that makes no sense. Compare it to ODF which is 1/10th of the size. Has a lot of reuse of concepts and was written under OASIS, a standards organization, unlike the OOXML spec which was written by Microsoft and the full 7000 pages dropped on the world.

I stopped looking at the OOXML stuff for some years, so the next part may be outdated. I noticed that after MS got this ratified by OSI, and thus they dodged the threat of law requiring governments to switch to ODF, they never did an update to the spec even though the applications have seen plenty of new features.

Re:EDPS: European Commission's use of Microsoft 365 infringe... by tzs on Monday March 11, 2024 @11:45AM (#39669611)
> It is a full 7000 pages long with lots of conflicting details > [...] > Compare it to ODF which is 1/10th of the size

A few things worth noting. First, the size comparison was done by counting pages in the PDFs of the two from their respective standards committees. The OOXML PDF used something like twice the line spacing of the ODF PDF, and may have also had a larger font size. Print the two with the same settings and OOXML still was a lot bigger.

Second, ODF deferred some important things to be done in later revisions of the spec. For example spreadsheet formulas. OOXML on the other hand had hundreds of pages covering spreadsheet formulas, including detailed mathematical definitions and explanations for functions.

> On top of that it is full of references like "this works like wordperfect version-n". While references are useful in specifications, they need to be to existing open standards to be meaningful. Wordperfect has never standardized its format, so referring to it is meaningless.

I believe those were in a draft but taken out in the final spec. Also, I think you might be overlooking what those references were meant to be used for.

There were lots of organizations with lots of documents that were created in older proprietary products like WordPerfect, Lotus, etc, and many of those organizations had reverse engineered or partly reverse engineered those formats and built toolchains around them.

Let's say such an organization would like to switch to ODF. They would have to rewrite their tools but they are willing to do that because an XML format will make future development easier. They will also have to convert their existing documents to ODF, which they can do.

But there are things in those documents that must work like they worked in WordPerfect. For example if they print an old document it may be essential that it has the same line breaks that it did when WordPerfect printed it.

They accept that StarOffice or OpenOffice won't be able to do WordPerfect line breaks but that's fine. Their toolchain can handle document printing. And for new documents that they create in StarOffice or OpenOffice using whatever line breaks those programs use is fine--it is just dealing with legacy documents that requires matching what those old programs did.

What they want, then, is when using ODF as a storage format for their legacy documents for some way to mark in the ODF that the document needs WordPerfect line breaks.

Now imagine two different organizations both are doing this. So they both come up with some way to add to their ODF files that some text needs WordPerfect line breaks. But one of them calls it "WP6LineBreak" and one calls it "LB_LIKE_WP6".

Wouldn't it be nicer if all the organizations that are adding a "Use WordPerfect 6 line break" indicator to their converted-to-ODF legacy files did it the same way? It would make it easier if they ever exchanged legacy files, and it would be less confusing to the rest of is if one of these files ever got into the wild.

I remember some people brought up adding support to ODF for legacy documents early in ODF standardization but Sun was not interested. Their attitude generally was ODF was going to support everything StarOffice needed and nothing more.

Microsoft on the other hand did want to support people using OOXML for legacy document storage, and so they made a big list of the various things from the most popular earlier word processors and spreadsheets that they thought people would be wanting to extend OOXML to store, and reserved some names and markup for them.

They were quite clear that these were not meant to be used by general purpose OOXML word processors or spreadsheets. They were just for people in the scenario described above.

Re:EDPS: European Commission's use of Microsoft 365 infringe... by steve1977 on Monday March 11, 2024 @01:25PM (#39670978)
Thanks for the comment. I could imagine that some of the points you mentioned might be related to Microsofts focus on backward compatibility. Some of the points certainly might also have less noble reasons.
Re:EDPS: European Commission's use of Microsoft 365 infringe... by rstuart4133 on Monday March 11, 2024 @10:25PM (#39675567)
So less noble that the Swedes invalided their own yes vote on the acceptance of OOXML once they discovered how it was obtained: http://www.groklaw.net/article.php?story=20070830155109351

Quoting the article:

   "Microsoft Corp. admitted Wednesday that an employee at its Swedish
   subsidiary offered monetary compensation to partners for voting in
   favor of the Office Open XML document format's approval as an ISO standard."
Re:EDPS: European Commission's use of Microsoft 365 infringe... by nabla9 on Monday March 11, 2024 @09:15AM (#39667830)
> Office Open XML standards are also publicly available if you need them.

Those "standards" are just Office vomit in XML format. The standardization process was really controversial. IBM once threatened to leave ISO/IEC over this. It's not a good standard. It's bad faith effort from Microsoft.

Re:EDPS: European Commission's use of Microsoft 365 infringe... by brnt on Monday March 11, 2024 @10:30AM (#39668714)
Although there's not much tooling around it, being a better spec (see sibling) would mean it's easier to write such tooling. Also, ODF is supported in a wider variety of software, MSO included, than ooxml (at least for a sufficiently advanced feature set of ooxml)
Re:EDPS: European Commission's use of Microsoft 365 infringe... by Spooky23 on Monday March 11, 2024 @09:30AM (#39667994)
What purpose would having government employees futzing around with LaTeX serve?

The crazy dogma around these issues hurt everyone.

The smart move is the pragmatic one - just like I can access any of the billions of US Federal Court filings in the intended presentation, mandate production of documents in a standards based PDF or PDF/A format. Then history gets accessible documents for eternity, and entities can choose to use what application makes sense for them.

Or we can bikeshed over the format dick-measuring contest.

Re:EDPS: European Commission's use of Microsoft 365 infringe... by brnt on Monday March 11, 2024 @09:39AM (#39668101)
I'm not talking about final documents. Sure, only PDF/A makes sense (handily outputted in the LaTeX flow btw).

I'm talking about what comes before. Most don't have the luxury of a publishing department producing a clean pdf from what's no doubt a handful of Word inputs. Apart from horrendous formatting issues introduced by incompetency and variety of Word versions (including limited mobile/online versions), the purpose would be astronomically better change integration when 10 people concurrently review for starters. If you've never had to integrate changes from a handful of people for 100+ page documents, praise your deity.

Re:EDPS: European Commission's use of Microsoft 365 infringe... by dghlsakjg on Monday March 11, 2024 @10:30AM (#39668717)
You’re talking to programmers here. We trivially add thousands of lines of changes to text documents that we all collaborate on daily and can tell you the history of every line going back for years.

The trick is to use open source version tracking and a simpler text editor. I suspect that markdown in a gui editor could do everything that actually needs doing.

Re:EDPS: European Commission's use of Microsoft 365 infringe... by Spooky23 on Monday March 11, 2024 @12:01PM (#39669824)
I’ve worked in public sector in various capacities forever. Nobody cares about in-process work products, even within organizations. They usually aren’t subject to FOIA or similar and only apply in limited circumstances.

Every employee with a reasonably recent office suite can produce a high quality PDF of whatever they are producing.

I actually have done such things. It’s not that bad - the process of review is the painful part.

Nobody has the skillsets to manage latex source code in a collaborative environment. I actually did a pilot a few years ago with Markdown and GitHub to collaborate on a large report for a multi-organization project. We quickly abandoned it for Word/Sharepoint and it worked fine.

The only practical exceptions I can think of are typesetting for publishing and bill drafting. Both are narrow use cases with specialized staff and tools. I definitely see where having a system output LaTeX could be useful for those use cases. But not the the collaborative aspects.

Re:EDPS: European Commission's use of Microsoft 365 infringe... by brnt on Monday March 11, 2024 @03:04PM (#39672100)
'out' sharepoint does nothing for chance resolution, therefore concurrent editing is always problematic. Can you explain how you tackled this? This is a huge problem for us, but maybe I should ask someone yo enable something on the SharePoint share?
Re:EDPS: European Commission's use of Microsoft 365 infringe... by belter on Monday March 11, 2024 @10:06AM (#39668400)
> Much of Brussels operates on the exchange-by-mail of .docx files

You have your problem right there...Would the Commissioners ramblings be less brilliant in .odt ??

Re:EDPS: European Commission's use of Microsoft 365 infringe... by kkfx on Monday March 11, 2024 @12:07PM (#39669910)
Ehm... Most computer users on gov, edu and so on fails to comprehend the difference between a native pdf and a scanned image to a pdf or the meaning of "digital signature", that's even if we have formal lawful definition of PADES/XADES/JADES signatures, "certified emails", e-billing and so on.

That's the level of the issue. I regularly bark against some executive sending a doc printed, then scanned, then mailed, and they do not understand...

Re:EDPS: European Commission's use of Microsoft 365 infringe... by kkfx on Monday March 11, 2024 @12:03PM (#39669852)
Most computer users are totally IT-illiterate, they do not even know something like diff exists in software/concept terms... That's why they still use spreadsheets and office automation suites...

This kind of problem should be solved from schools, but to happen we need the masses feel the need of that, and they do not even know that's a problem, most fails to understand the difference of local/remote contents, have no clue about what is a file https://www.theverge.com/22684730/students-file-folder-direc... so there are few Alphabet-s, owning Meta-information, being Oracle-s of a large mass of illiterates...