News for hackers. Stuff that matters.
Re:Stencila: An open source office suite for reproducible re... by osrec on Friday July 13, 2018 @07:47PM (#17527774)
This looks interesting. I'm actually rather surprised at the lack of quality in most open source 'office' alternatives. I'm not sure why, but open/libreoffice is almost unusable for heavy duty office work. Microsoft products are the clear winners if you require productivity and stability. I really hope that changes soon, because I feel it's a major factor that holds back widespread Linux adoption.
Re:Stencila: An open source office suite for reproducible re... by sheetjs on Friday July 13, 2018 @09:58PM (#17528348)
There's a ton of mindnumbing testing and grinding work that honestly no one really wants to do, involving bit-level accuracy in many cases. We (https://sheetjs.com/) are attacking the file compatibility problem (our major open source project is https://github.com/sheetjs/js-xlsx, used in stencila's spreadsheet converters) and it is painfully obvious that OO/LO cuts corners at certain places. For example, the mathematics of Calc is intentionally bugged:

> ignore the last two bits for many stuff to improve the user experience.

https://bugs.documentfoundation.org/show_bug.cgi?id=83511

A successful alternative to Microsoft Office has to start from a level of compatibility that no current developer in existing solutions has expressed interest in attaining.

Re:Stencila: An open source office suite for reproducible re... by erAck on Monday July 16, 2018 @01:00PM (#17542847)
As you referenced that bug and there also gave an example involving fractions and =0.1+0.2 you would certainly also agree that the binary floating point representation of =0.1+0.2-0.3 is not 0.0, still Excel displays 0 as result (and so does Calc) instead of 5.551115123125783E-17 because users expect that.

Your bit-level accuracy approach isn't as simple when it comes to user experience and Excel compatibility.

Re:Stencila: An open source office suite for reproducible re... by erAck on Monday July 16, 2018 @01:17PM (#17542986)
Regarding your fraction example there:

=RAWSUBTRACT(0.1,-0.2,1/3) => -0.033333333333333

=RAWSUBTRACT(0.1,-0.2,2/7) => 0.014285714285714

So which one is closer to 0.3?

Re:Stencila: An open source office suite for reproducible re... by nokome on Sunday July 15, 2018 @06:58PM (#17537568)
Just a quick word of thanks for SheetJs from a Stencila dev! All the "mindnumbing testing and grinding work that honestly no one really wants to do" is obvious and much appreciated. Your efforts are so important for the ensuring interoperability but are often not recognised because they are "in the backend".
Re:Stencila: An open source office suite for reproducible re... by dorfsmay on Saturday July 14, 2018 @09:33AM (#17530270)
> it is painfully obvious that OO/LO cuts corners at certain places. For example, the mathematics of Calc is intentionally bugged

What about Gnumeric?

My understanding is that the dev team (mainly Jody Goldberg really) have focused on accuracy. The gnumeric.org site has links to studies related to its accuracy.

Re:Stencila: An open source office suite for reproducible re... by osrec on Friday July 13, 2018 @10:05PM (#17528370)
Interesting. In your experience, do you think heavy duty, in-browser office applications are now viable? I'm beginning to think they are, especially with the likes of web assembly becoming more ubiquitous.
Re:Stencila: An open source office suite for reproducible re... by mindcrime on Friday July 13, 2018 @09:05PM (#17528152)
I'm not sure why, but open/libreoffice is almost unusable for heavy duty office work.

What do you define as "heavy duty office work"? What would make OpenOffice more suitable to you needs? Asking as an AOO contributor. I'm genuinely curious to know what you think the project is lacking or how it needs to be improved.

Re:Stencila: An open source office suite for reproducible re... by osrec on Friday July 13, 2018 @09:24PM (#17528219)
Firstly, I would like to thank you for your work. Open office has served me very well during my school and university days.

Since joining the world of work, I've struggled with the following:

- Random crashes every couple of hours when files become large. Especially in Impress and Calc.

- I do a lot of diagrams in OODraw. Sometimes I'll reopen the file to find arrows and connectors have moved.

- The interface could be more intuitive. For example, the colour selector is limited and clunky, as is the gradients widget. Why can't we add any colour we like without going to the options menu?

- Application speed is slow when files get large, especially Calc. I've even tried increasing memory per object.

- Filtering and sorting in Calc not as fully featured or easy to use as Excel.

- Conditional formatting not as easy to use.

- Calc shortcuts not as easy to use as Excel (eg, I don't think there's an easy way to select a column without a mouse, or transpose a selection, or remove blanks etc etc). With Excel, I can pretty much achieve most things without touching a mouse (I'm an ex investment banker, and we get pretty familiar with the keys). OO seems to lack these critical shortcuts.

- Poor documentation of OO scripting environment. It's tough to figure out how to automate simple things in Calc.

This is not an exhaustive list, but it's all I can think of currently.

Again, I am very supportive of the AOO/LO effort, but I wished it would start giving Microsoft more competition in the power user category.

Thanks!

Re:Stencila: An open source office suite for reproducible re... by antt on Friday July 13, 2018 @09:43PM (#17528290)
> investment banker

As someone who was a software engineer in a brokerage and had to deal with clients excel sheets: open/libre office not letting you do that is a feature.

We would be given excel sheet that would depend on a specific version of Excel. We had sheets in the hundreds of megabytes. We had sheets that would take overnight to run. We had sheets with sheet dependencies. We had sheets that needed to be run in a specific order manually. We had sheets with 13,000 manually entered rows, each with 53 columns.

These things, and I use the term thing since eldritch abominations does not convey the horror of using them, were responsible for investing hundreds of millions of dollars.

The day excel dies is a day I will celebrate.

Re:Stencila: An open source office suite for reproducible re... by watersb on Friday July 13, 2018 @09:59PM (#17528349)
Before Python, before Perl, before I grew up and got a real job, I worked in a lab that relied upon the Ingres spreadsheet application to reduce experimental data. At the time, it was a Macintosh-only application, and its scripting support was actually very good, but validating the dsta was a very slow process and ran overnight.

I re-wrote the process in AWK, and was able to complete the data-reduction task in about 60 seconds on a DEC 5000 workstation. But my numbers did not match the spreadsheet results, and finding out why was an interesting process.

I then encountered small, remote offices of big international firms -- usually real-estate, insurance companies -- that had limited local IT support. It was Excel macros all the way down.

And then a large biotech firm, where it took KPMG analysts a few months to determine that our entire business relied upon this one guy's spreadsheet.

So yeah.

But:

Excel dies, let us suppose... What will these people come up with? Alexa queries?

I have preferences other than Python, but mostly I csn read code written by the scientists who wrote them. They may be abominations, like global state variables and magic numbers, but they are readable.

Is Python any reason to hope for a better world?

(Hmm. Off-topic, perhaps. Your story woke some memories of tough IT experiences.)

Re:Stencila: An open source office suite for reproducible re... by viraptor on Friday July 13, 2018 @11:04PM (#17528569)
> Excel dies, let us suppose... What will these people come up with?

Ideally, excel with separated actual use cases, which the original app merges into one thing:

- data entry into tables

- auto-generated tables over some ranges (dates, counts)

- constants / described values (they end up on a side, sometimes in a named cell if you're lucky)

- presentation/report layer

I think Access did some good things, but is too close to be database to be comfortable. BI to is great for the last part, but it's a separate/expensive product.

Re:Stencila: An open source office suite for reproducible re... by osrec on Friday July 13, 2018 @09:53PM (#17528329)
Yes, I too have seen those spreadsheets, but it's not Excel that's at fault, it's the users. I've taken XLS behemoths and trimmed them down to a fraction of their size and optimised sheets that ran overnight, to recalculate in seconds. I get what you're saying about Excel giving too much power in incapable hands, but I feel, for certain use cases, OO is too little power in even the most capable hands.
Re:Stencila: An open source office suite for reproducible re... by m_sahaf on Saturday July 14, 2018 @04:38AM (#17529428)
I keep saying this to my friends: I dream of the day when people exchange SQLite files instead of XLS(X), and Excel, and the like, are just an interface to that database. This way you get data integrity (Excel randomly truncating digits or converting numbers to scientific notation is the bane of my existence), data present in raw form, and being interface/view layer agnostic.
Re:Stencila: An open source office suite for reproducible re... by mindcrime on Friday July 13, 2018 @09:31PM (#17528249)
- I do a lot of diagrams in OODraw. Sometimes I'll reopen the file to find arrows and connectors have moved.

Interesting. I use Draw a lot and haven't had that hit me yet. Any chance I could convince you to post something about this to the AOO mailing list, or open an issue in Jira about it? (that is, assuming there isn't already an issue for this).

Poor documentation of OO scripting environment. It's tough to figure out how to automate simple things in Calc.

Agreed. I just went through that exercise myself, when I was working on a thing at work to use the Jira API to query stories, and pull stuff into a spreadsheet for analysis. I was able to figure it out, but it wasn't easy. From what I've seen, the information is all there, but it's not necessarily organized / accessible enough. There's also not enough tutorial format stuff. Hopefully I can write up some stuff based on my recent experience and get it out there.

but I wished it would start giving Microsoft more competition in the power user category.

Same here. I have a laundry list of things I'd like to try and add to Calc to make it more powerful for complex analytics and what-not, but I am so busy on other projects I haven't had time to pursue those ideas much.

Re:Stencila: An open source office suite for reproducible re... by hjek on Sunday July 15, 2018 @04:44AM (#17534401)
For the last few years most of the work has been happing in the LibreOffice fork. If OO crashes on you, try LO.

https://lwn.net/Articles/699755/

Re:Stencila: An open source office suite for reproducible re... by sametmax on Saturday July 14, 2018 @08:09AM (#17529995)
I use it almost exclusively.

And it crashes. It crashes and loose your work.

Regularly.

I love that such product exists. I donate to libre office.

But it's nowhere as reliable as msoffice. Any complex enought document will make it crash at some point.

It's not even reproductible. You can't pinpoint the action that made it crash. Sometime you do the same other and other and it's fine. Then it destroy work and crush your soul.

Re:Stencila: An open source office suite for reproducible re... by basiliskparty on Saturday July 14, 2018 @01:48PM (#17531390)
Not disagreeing with you, as everyone has different workflows etc. but my experience is really different. I've found LibreOffice entirely suitable for heavy duty work, completely fine.

Microsoft products crash inexplicably on our systems too, and in fact, we have much weirder problems with corrupted instances and things than we've ever had when using LibreOffice. I also have serious problems with the Office UI, basically that the ribbon UI as it's implemented is inconsistent and incoherent, which is frustrating as hell. If you're going to have a ribbon/tab UI, make it consistent throughout, and don't have special exceptions for some functions.

Having said that, I do think LibreOffice loses to Microsoft's edge in some areas of polish, like in implementing equations, and in drawing figures. Some of the UI with the drawing actions are much more intuitive in Office.

Re:Stencila: An open source office suite for reproducible re... by jk27277 on Saturday July 14, 2018 @08:20AM (#17530029)
Try softmaker office