News for hackers. Stuff that matters.
Re:GitHub is down by kchoudhu on Tuesday April 05, 2016 @04:44AM (#11428828)
If only we had a version control system that didn't rely on a central hub...
Re:GitHub is down by cytzol on Tuesday April 05, 2016 @05:11AM (#11428973)
We do, it's called Fossil! http://fossil-scm.org/

Fossil tracks issues (tickets), documentation, and wiki pages at the same level as it tracks code, so when you clone a Fossil repo, everything gets downloaded to your local computer. You can then respond to tickets and perform repo maintenance offline, syncing everything to the server when you're back up.

Edit: A few weeks ago I got a job a one-hour train ride away. I can commit, close tickets, and write docs on my way in, sync everything to the internet when I get to work, then do the same on my way back - even though I don't have a net connection during my commute. It works great. (Ok, not as good as not having to travel at all, but great nonetheless!)

Re:GitHub is down by thecatspaw on Tuesday April 05, 2016 @05:21AM (#11429036)
the parent commentator was joking that git _is_ decentralised, but that we made it centralised again by relying on a small number of hosters (github, bitbucket and others)
Re:GitHub is down by cytzol on Tuesday April 05, 2016 @05:26AM (#11429065)
Heh, don't worry, I got the joke. But I also got the joke the last time this was posted, and the time before that, and the time before that...

This just keeps happening. It's not GitHub's fault that they keep getting DDoSed or have a network outage every now and again. But it's not a problem with no solution.

Re:GitHub is down by popey456963 on Tuesday April 05, 2016 @07:04AM (#11429416)
To be honest, I can cope with Github's downtime, it is probably less than if I was hosting a Git solution myself and the service is much more reliable than all the other solutions I've tried (which are either lacking features or have bugs or have massive downtimes).

Github is trying their best as far as I can see, they manage to fix the majority of issues within three hours and even during those three hours its not the end of the world because you can still code.

Re:GitHub is down by gkya on Tuesday April 05, 2016 @06:24AM (#11429275)
> Fossil tracks issues (tickets), documentation, and wiki pages at the same level as it tracks code, so when you clone a Fossil repo, everything gets downloaded to your local computer.

Issue tracking and wikis are not a version control problem. Sure, their data can be version controlled. And documentation has been version controlled since Sccs, why would it require special care?

Re:GitHub is down by cytzol on Tuesday April 05, 2016 @06:46AM (#11429355)
> why would it require special care?

It doesn't, really, but it's in the same place as the code and everything else (this is what I meant as being "on the same level"). You don't need to clone the code and then clone the tickets, for instance. When you run "fossil timeline" on your local machine, you'll see entries for tickets being closed and wiki pages being updated interspersed among the actual code commits. This is useful to me as they're as much a part of the project as the code itself. Does this answer your question?

Re:GitHub is down by gkya on Tuesday April 05, 2016 @10:23AM (#11430573)
No, unfortunately. How is this different to and / or better than having a "wiki/" subfolder, and, e.g. an Org-mode file (need not be org-mode, even a plain text file is o.k., and there are wiki systems and todo managers that use plain text) for issues on the project root? I can easily "git/hg/cvs log project.org" to see the history. And the format is not tied to the VCS software, so, if I switch to sth. else, it's still perfectly usable.

An basic example of an org file for tracking issues:

  #+title: Project issue tracker
  #+description: descr...
  #+todo: OPEN(o!) | CLOSED (c@)
  
  This is the issue tracker for Project.  In order to add a
  new issue, add it to the top of the entries as a plain org
  entry, then hit =C-c C-t o= to mark it as open.  In order
  to close an issue, on it's headline, hit =C-c C-t C=,
  this will prompt for a closing comment, see the buffer that
  pops up for instructions.
  
  Common tags: docs, features, bugs, security, ideas
  
  * CLOSED Write README. :docs:bookkeeping:
  - State "CLOSED"     from "OPEN"       [2016-03-22 Tue 02:16] \\
    Written.
  - State "OPEN"       from              [2016-03-18 Fri 22:33]
  * OPEN Implement new features :features:
  - State "OPEN"       from              [2016-01-27 Çrş 23:35]
Re:GitHub is down by cytzol on Tuesday April 05, 2016 @05:37PM (#11434718)
Ah, I see. In that case, you're right, it's not: if you track issues and docs like like in the same way as you track source files, then functionality-wise they're no different.

The differences that remain are purely in the interface. For example, although they're synced the same way, VCSes tend to display issues differently than source; it's easier to filter out issue changes from the timeline, and harder to accidentally delete other people’s comments. It also makes it possible for people who aren't actual members of your project to raise and comment on the issues, which wouldn't usually be possible (unless your VCS can manage permissions for each file).

One particular use case of yours that Fossil does support is the ability to have a "wiki/" subfolder and have the web interface automatically format and display the pages inside, so you can link to them more easily if you're using the HTTP server for hosting. I think I use this feature more than the built-in wiki because it’s possible to version the docs along with the source, ensuring they never go out of sync.

Re:GitHub is down by asdfadr1344kk on Tuesday April 05, 2016 @06:17AM (#11429241)
<3 Fossil. I wish it were more popular so I could use it on non-personal projects and still have a hope of attracting collaborators...
Re:GitHub is down by CMay on Tuesday April 05, 2016 @06:36AM (#11429312)
Yeah, fossil is all I use. It's so clean, tiny and self contained with no install or bloat. I've always been in love with software written that way. It makes me look at things like git as just a product of engineers that can get the job done, but don't know what it means to write good software or use imagination.

Being fair, fossil performance on giant scale projects might not compare quite as well against git or proprietary solutions like Perforce, but for the large majority of projects I expect it is more than adequate.

Re:GitHub is down by popmystack on Tuesday April 05, 2016 @10:06AM (#11430451)
> but don't know what it means to write good software or use imagination.

You can't do patches. You can't rebase. You can't rename files.

Tell me all about this good software and imagination you speak of?

Re:GitHub is down by CMay on Tuesday April 05, 2016 @01:50PM (#11432666)
Rename: https://www.fossil-scm.org/xfer/help/rename - Merge only merges content, but the content does get updated between renamed files. Also note that while rename and mv work similarly, only mv can be used with --hard to also rename the actual file on the drive. If you know of an issue with renaming, you should report it on the bug tracker.

Patches: You can select any 2 commits and create a patch between them ( http://fossil-scm.org/xfer/vpatch?from=cbda43e71bda52f0&to=e... ). If you want to apply the patch, you can just use patch. Whether patch itself should be integrated directly into fossil is I guess something people can argue over. I don't use patches often, but haven't had issues with them.

Rebase: This is what Hipp has to say - http://permalink.gmane.org/gmane.comp.version-control.fossil...

These things may not be exactly how you prefer them, but you're misinterpreting my point about good software and imagination. Almost no software in existence is perfect for everyone in every scenario, but that doesn't also mean that no software is good.

Re:GitHub is down by popmystack on Wednesday April 06, 2016 @01:47PM (#11440379)
Fossil leaves me with no reason to use it. What it can do, Git and Mercurial can do better. Saying that no software fits the use case for everyone, everywhere is completely irrelevant. Other software not fitting into every mold completely, while fossil doesn't really bring anything to the table to cover what other solutions don't, doesn't really justify its existence as a solution in any way.
Re:GitHub is down by CMay on Wednesday April 06, 2016 @04:51PM (#11441996)
If you need something that works in exactly the way you're used to and that's how you evaluated fossil, then I guess fossil isn't what you need, because fossil is different. I'm not sure why you're being toxic and venting frustration, though. Use whatever you like, these aren't football teams. :P
Re:GitHub is down by popmystack on Thursday April 07, 2016 @09:36AM (#11447102)
>I'm not sure why you're being toxic and venting frustration

Please do not devolve the conversation by making outlandish statements that have no bearing on the conversation.

>If you need something that works in exactly the way you're used to and that's how you evaluated fossil

That's the exact opposite point I made though. Fossil constrains me in how I work and how I accomplish certain tasks -- with no benefit. Neither Git or Mercurial do that. What Fossil can do, both Git and Mercurial can do better. So why would I choose Fossil?

Re:GitHub is down by CMay on Thursday April 07, 2016 @01:42PM (#11449097)
They're not outlandish statements, you are frustrated.

If you don't get any benefit out of a tool, then don't use that tool. I get value out of it and am not meaningfully impacted by the issues you have with it in practice.

I'm not a salesman and it's free software, so do what makes sense to you.

Re:GitHub is down by popmystack on Thursday April 14, 2016 @11:39AM (#11497555)
>They're not outlandish statements, you are frustrated.

As an expert on myself, I must disagree.

>If you don't get any benefit out of a tool, then don't use that tool.

I don't use it. But I think you need to remember what I replied to, as that's an ill-placed sentiment in this thread.

Re:GitHub is down by richieadler on Tuesday April 05, 2016 @10:21AM (#11430555)
> You can't do patches.

You can create bundles and submit them for approval. Very similar.

> You can't rebase.

You have alternatives. The work philosophy is different, though.

> You can't rename files.

False.

Re:GitHub is down by popmystack on Tuesday April 05, 2016 @10:37AM (#11430676)
>You can create bundles and submit them for approval. Very similar.

Bundles do not have anywhere near the same flexibility and nuanced capacity that patches do.

>The work philosophy is different, though.

That's an apology if I've ever seen one. Again, not the same.

>False.

Rename a file. Then try to merge. Tell me what happens.

Re:GitHub is down by penguinonrocket on Friday April 08, 2016 @09:51AM (#11454619)
>Bundles do not have anywhere near the same flexibility and nuanced capacity that patches do.

Interesting. That's basically what the people who suggested bundles (a Hg feature) said about patches.

I've used both as appropriate. Handy that Fossil has both.

Re:GitHub is down by not_kurt_godel on Tuesday April 05, 2016 @07:58AM (#11429660)
> http://fossil-scm.org/

Off-topic, but I'd reccomend that you install HTTPS Everywhere: https://www.eff.org/https-everywhere - the fact that you are linking the HTTP version means you don't have this very basic extension that really improves your security.

Re:GitHub is down by kevinmgranger on Tuesday April 05, 2016 @02:25PM (#11433009)
For those wanting to stick with Git, the concept extends to Fedora's Pagure: https://fedoramagazine.org/pagure-diy-git-project-hosting/

Granted, the documentation needs work. But all issues and docs are exposed as git repos.

Re:GitHub is down by joshschreuder on Tuesday April 05, 2016 @07:36AM (#11429566)
Is it easy to fix merge conflicts on something like an issue?
Re:GitHub is down by cytzol on Tuesday April 05, 2016 @05:32PM (#11434688)
Argh, I don’t actually know, and I probably should. I’ll ask on the mailing list and reply with what I find out.
Re:GitHub is down by simula67 on Tuesday April 05, 2016 @05:40AM (#11429118)
Most developers will not be able to write code without being able to look up stuff on the Internet.
Re:GitHub is down by petetnt on Tuesday April 05, 2016 @04:46AM (#11428833)
We do. It's called Git.
Re:GitHub is down by alkonaut on Tuesday April 05, 2016 @04:57AM (#11428898)
Now if only we had a convenient way of using a distributed VCS without a central hub.
Re:GitHub is down by masklinn on Tuesday April 05, 2016 @05:08AM (#11428965)
That sounds like a joke, but that's exactly the problem: the VCS has been distributed, but not all the services enmeshed around it: all the discussions (issues, pull requests, design debates, …).

Github makes it easy to host git repositories, but so do a bunch of other services and it's not that hard to host your own either way or to set up trees of repository or multiple mirrors or what have you. The reason people use a central hub is all the meta-information and exchange about the code and the contributor communities.

The repository on its own has very little value.

And lest you think it's different for the kernel or whatever, a mailing list or an IRC channel are still centralised SPOF[0], when the ML provider goes down so does the project.

[0] though possibly more resilient and easier to switch out of ones

Re:GitHub is down by TeMPOraL on Tuesday April 05, 2016 @05:37AM (#11429104)
> The repository on its own has very little value.

Depends for who. When I'm a user of a project, I don't care at all about anything other than the repository. The source code is the only thing that matters.

Anyway, you can't really avoid centralization in most of the projects. Barring some extreme social experiments, a project always has identity, a "canonical version". That's your SPOF right there. Of course we have tons of experience with mitigating potential issues - from caching and mirroring to not doing stupid shit like telling your CI server to download dependencies from GitHub every time it builds your project. Temporary GitHub outages seem to be a problem mostly for people doing the latter kind of stupid shit.

What would be interesting to see though is some kind of torrent network for Git repos. The kind of where I ask for a particular commit of a particular project, and I get a way to download it from some random computer that has it (with all the magic crypto code signing for confirming the code was not maliciously changed, etc.). Node.js developers have local mirrors of third of GitHub anyway, so that would pretty much solve "GitHub is down" issues.

Though it would not solve the problem of people too lazy to have a local cache of their dependencies...

Re:GitHub is down by masklinn on Tuesday April 05, 2016 @09:18AM (#11430089)
> Depends for who. When I'm a user of a project, I don't care at all about anything other than the repository. The source code is the only thing that matters.

The repository doesn't have any more value for that use case, tarballs would be just as good if not better.

Re:GitHub is down by morsch on Tuesday April 05, 2016 @05:26AM (#11429063)
Has anybody tried to store a project's metadata (issues and PRs) within the project's git repository itself? Seems like a logical step.

If you don't want special git semantics around it, you'd have to be clever about how you store it so you don't have conflicts within the metadata. I.e. a naive design just adding a markdown file per issue or for all issues will require manual merging all the time. Still, it seems doable.

Re:GitHub is down by masklinn on Tuesday April 05, 2016 @05:30AM (#11429077)
> Has anybody tried to store a project's metadata (issues and PRs) within the project's git repository itself? Seems like a logical step.

There were a number of tentative distributed bug trackers a few years ago, they sucked and fizzled out. IIRC Fossil is an attempt at an entire distributed project management system, I don't know how it fares.

> I.e. a naive design just adding a markdown file per issue or for all issues will require manual merging all the time. Still, it seems doable.

That only works for your own personal project where you're the only user and contributor. Bug reporting by editing a markdown file (or even something actually usable like an org-mode file or an sqlite or BDB file) isn't going to scale very high and is way more effort than most bug reporters (even technical ones) will be willing to put in.

And even if your users were willing to subject themselves to that, they still need a way to send back those contributions somehow.

Re:GitHub is down by procrastitron on Tuesday April 05, 2016 @10:08AM (#11430470)
git-appraise (https://github.com/google/git-appraise) does this for reviews and there is a tool (https://github.com/google/git-pull-request-mirror) for importing pull requests into the git-appraise format.
Re:GitHub is down by JohnDoe365 on Tuesday April 05, 2016 @05:16AM (#11429011)
What about BitTorrent DHTs?

Or dat http://dat-data.com/

Or Camlistore? https://camlistore.org/

Re:GitHub is down by masklinn on Tuesday April 05, 2016 @05:27AM (#11429067)
The problem of content-addressing — aside from the opaqueness to "shallow" contributions (nobody is going to install a content-addressed distributed filesystem just to report a bug to your software, don't kid yourself) — is what content-addressing means for resource updates. How do I get the most recent comment on the most recent bug report on one of my projects? In fact how do I even discover their existence from knowledge of the project's existence?
Re:GitHub is down by panic on Tuesday April 05, 2016 @06:06AM (#11429213)
You could have separate centralized servers for each project, though, instead of one big point of failure for all the projects.
Re:GitHub is down by icebraining on Tuesday April 05, 2016 @06:12AM (#11429228)
That would make the downtime less correlated, but if it was higher in aggregate, would it be a net benefit?
Re:GitHub is down by panic on Tuesday April 05, 2016 @07:26AM (#11429530)
I'm talking about a traditional sort of model, where each project hosts its own issue tracker, code review, etc. Unless you're working across multiple projects, you'd only care about downtime for your own server, not other people's (except perhaps for dependencies, which should be cached locally anyway).
Re:GitHub is down by systoll on Tuesday April 05, 2016 @10:02AM (#11430412)
So where's the 'big point of failure'?

Unless you're working across multiple projects, it doesn't matter to you that a GitHub outage takes out everyone else's projects at the same time.

Can you beat GitHub's uptime with a self-hosted solution? Sure. But you'll waste more time setting it up & managing it than you'd lose from GitHub downtimes.

Re:GitHub is down by alemhnan on Tuesday April 05, 2016 @05:14AM (#11428993)
Could Ethereum (or a similar concept) be the solution of this kind of problems?
Re:GitHub is down by 7373737373 on Tuesday April 05, 2016 @06:24AM (#11429272)
Together with systems such as ipfs.io, possibly yes. Have a look at https://github.com/whyrusleeping/gx

But there still are many open problems: - incentivised file storage - fair name spaces - search and indexing and more.

Re:GitHub is down by maze-le on Tuesday April 05, 2016 @05:20AM (#11429030)
Did someone say GitTorrent...?

https://github.com/cjb/GitTorrent

Re:GitHub is down by TeMPOraL on Tuesday April 05, 2016 @05:42AM (#11429122)
Looks exactly like what's needed. Is it safe enough though? I.e. can I rely on getting a non-maliciously-modified repo when I ask for particular SHA1?

Also:

sudo npm install --global gittorrent

Cool! It automatically installs a local copy of half of GitHub! ;).

Re:GitHub is down by cjbprime on Tuesday April 05, 2016 @05:35PM (#11434707)
> I.e. can I rely on getting a non-maliciously-modified repo when I ask for particular SHA1?

Someone could serve you a maliciously-modified repo, but Git itself would then reject those objects, since they won't lead to the SHA1 that Git knows that it's looking for -- you would keep trying other peers until someone gave you bits that match the correct SHA1.

Re:GitHub is down by maze-le on Tuesday April 05, 2016 @06:07AM (#11429215)
> Is it safe enough though?

I'm not so sure about that. I've only used it once, an only to test its functionality, I didn't do any in-depth testing. Well I wouln't use it in production, but in a non-critical, small-scale project it could be worth a try...

Re:GitHub is down by avip on Tuesday April 05, 2016 @05:14AM (#11428996)
We do. It's called git instaweb && ngrok 1234
Re:GitHub is down by bsandert on Tuesday April 05, 2016 @04:46AM (#11428836)
whoosh
Re:GitHub is down by Retr0spectrum on Tuesday April 05, 2016 @04:54AM (#11428877)
Re:GitHub is down by tragic on Tuesday April 05, 2016 @04:57AM (#11428900)
I'm assuming it's the sound a joke makes when it goes over one's head.
Re:GitHub is down by oneeyedpigeon on Tuesday April 05, 2016 @05:22AM (#11429043)
There needs to be an xkcd about editing a comment such that old replies to it no longer make sense. I couldn't find one, though.
Re:GitHub is down by slaman on Tuesday April 05, 2016 @11:44AM (#11431305)
he had one but he edited it.
Re:GitHub is down by hiby007 on Tuesday April 05, 2016 @06:11AM (#11429225)
I think he was joking, he was referring to stackoverflow.com :D
Re:GitHub is down by ryan-allen on Tuesday April 05, 2016 @05:45AM (#11429130)
That's the joke!
Re:GitHub is down by InclinedPlane on Tuesday April 05, 2016 @04:55AM (#11428884)
thatsthejoke.jpg
Re:GitHub is down by amelius on Tuesday April 05, 2016 @05:41AM (#11429119)
Re:GitHub is down by kefka on Tuesday April 05, 2016 @06:43AM (#11429341)
Oh, I agree. But I still think Git, even over IPFS, has significant failings. Mainly, how do I share the issues and other problems that Github has did their own GUI for?

Fossil SCM seems to fit that bill. As another user said, they can address issues in a local, non-connected manner, and then merge the issues back to main.

The last piece would be to use IPNS so you can have the same key for a changing package. I just hope versioning support gets added in soon (it's in the spec, just not done yet with go-ipfs).

Re:GitHub is down by amelius on Tuesday April 05, 2016 @06:58AM (#11429394)
> Mainly, how do I share the issues and other problems that Github has did their own GUI for?

I think this should not be done in the same system as where people store their source repos. Mixing the two is convenient, but can stifle innovation. Better to have flexible and well documented abstractions and good separation of concerns.

Re:GitHub is down by dalai on Tuesday April 05, 2016 @07:56AM (#11429645)
> Mixing the two is convenient, but can stifle innovation.

Could you elaborate?

I think I've heard the argument before, but I don't really see how. These outages show up again and again, partly because people cannot access the project issues.

Re:GitHub is down by amelius on Tuesday April 05, 2016 @08:20AM (#11429762)
Well, the argument holds for any big system. It is better to keep things modular and simple, so anybody can work on each of the components (in parallel), and improve each of the components, and replace them at will.

Also keep in mind that protocols are much more important than the actual code implementing them (see git for a good example!)

Re:GitHub is down by kefka on Tuesday April 05, 2016 @09:51AM (#11430327)
I guess I'm still not following.

If I sync a git repo from random location, I have the files to make that package. However none of the documents that aren't explicitly in the git repo are provided. With Git[hub/lab/...], this is metadata outside of the repo. Ideally, I want and need that as well. If there's an issue, I can research it quickly and see if it applies to me... Or if I'm a maintainer, I can make a solution offline and then merge it when online.

I understand that it may not be the perfect tool to include everything... but it does seem to fit the bill. Fossil does seem to do this correctly. I'll have to look into it.

Re:GitHub is down by sureshn on Tuesday April 05, 2016 @05:53AM (#11429171)
its better to use fossil locally and have a mirror sync to github to run in the background. Its sad that git being distributed and github being a central place , sort of undermines the very purpose git was built for