News for hackers. Stuff that matters.
Re:Updating the Git protocol for SHA-256 by chmaynard on Friday June 19, 2020 @03:22PM (#23577987)
This article by John Coggeshall is an example of great technical writing. I look forward to reading more of his work.

The more I learn about Git, the more it blows my mind. Torvalds must have designed Git in his head during the time he was using BitKeeper. When he decided to implement Git, he went to work and in a few weeks he had it working well enough to use for Linux kernel source control. Torvalds is either a genius or merely a superstar computer scientist and software engineer. Choose any two.

Re:Updating the Git protocol for SHA-256 by beagle3 on Saturday June 20, 2020 @04:38AM (#23582654)
Everyone is forgetting “monotone”, a DVCS developed by Graydon Hoare (who later went to create Rust) of which the Git model is essentially a simplification (and much much less related to BitKeeper)

There was a lot of experimentation with VCSes at the time: arch -> tla -> baz ; bzr ; monotone ; cdv ; mercurial ; git ; even sun was finally getting merge tracking.

Monotone had the best structure but a slow and clunky implementation. It was adopted and simplified (in different ways) by git and hg; eventually git won by virtue of being way faster and demonstrably effective for a project the size of the Linux kernel (and Linus’ celebrity status didn’t hurt either)

But graydon hoare deserves a lot more credit than he received - Linus did credit him at the time, but no one seems to remember.

Re:Updating the Git protocol for SHA-256 by emmelaich on Saturday June 20, 2020 @11:28AM (#23584465)
Definitely monotone; Linus acknowledges it. But it was way too slow.

Surely Git is influenced by Venti and Fossil from Plan9. Though I'm not sure it's ever mentioned.

https://en.wikipedia.org/wiki/Venti

https://en.wikipedia.org/wiki/Fossil_(file_system)

Re:Updating the Git protocol for SHA-256 by nix23 on Saturday June 20, 2020 @05:31AM (#23582854)
>Everyone is forgetting “monotone”

I miss monotone! What a beautiful single-file (sqlite) VCS if it would be still maintained i would use it for small projects, but nowadays i use fossil and bitkeeper...and yeah git if i have to ;)

Re:Updating the Git protocol for SHA-256 by SQLite on Saturday June 20, 2020 @07:14AM (#23583275)
Author of SQLite and Fossil here - I have not forgotten monotone! Indeed, Fossil itself is inspired by monotone documentation (though not the implementation). This is credited at https://fossil-scm.org/fossil/doc/trunk/www/history.md
Re:Updating the Git protocol for SHA-256 by dschulz on Saturday June 20, 2020 @09:42AM (#23583887)
Dr. Richard Hipp? Thanks for all your work. The world is a significantly better place thanks to you.
Re:Updating the Git protocol for SHA-256 by nix23 on Saturday June 20, 2020 @08:40AM (#23583625)
Thank you very much for that great piece's of Software!! Both Fossil and SQLite.
Re:Updating the Git protocol for SHA-256 by the_pwner224 on Saturday June 20, 2020 @12:48PM (#23584922)
> but nowadays i use fossil and bitkeeper

Do you know of any http-accessible BitKeeper host (commercial or self hostable)? I tried out BK some months ago but wasn't able to find any way to put my code up on the internet, aside from BkBits.net, which appears to be abandoned and gave a HTTP 5xx error when I tried to sign up.

Re:Updating the Git protocol for SHA-256 by nix23 on Saturday June 20, 2020 @02:14PM (#23585554)
It works again...but for production...nah probably not, they just need more peoples who work on bk itself and on a hosting platform like BkBits....its a bit a sad state for such a great product.

But yes you can host bkbits for yourself, but i have no clue in witch repos it is, maybe ask here:

https://users.bitkeeper.org/

Sorry for being not a big help

Re:Updating the Git protocol for SHA-256 by cpach on Saturday June 20, 2020 @03:13PM (#23586161)
I just want to chip in to say that I think darcs also deserves a honorable mention :)
Re:Updating the Git protocol for SHA-256 by beagle3 on Sunday June 21, 2020 @04:35AM (#23590704)
Oh, most definitely - forgot to put darcs in that list - it was definitely influential in the huge “diffs vs snapshots” debate.
Re:Updating the Git protocol for SHA-256 by magnio on Saturday June 20, 2020 @01:09AM (#23581866)
Reading the first Git version, i.e. its initial commit, makes learning git easier for me. Albeit very simple and barebone, its ideas are pretty fundamental to Git and differentiate it from many other VCSs.
Re:Updating the Git protocol for SHA-256 by alblue on Saturday June 20, 2020 @07:02AM (#23583224)
I wrote a series of blog posts covering how the intervals of git works; I posted a summary here for reference:

https://alblue.bandlem.com/2011/12/git-tip-of-week-finale.ht...

If you’re interested in how commits, trees and objects are represented then it could be interesting for you.

Re:Updating the Git protocol for SHA-256 by chmaynard on Saturday June 20, 2020 @09:49AM (#23583926)
“The thing that differentiates scientists is purely an artistic ability to discern what is a good idea, what is a beautiful idea, what is worth spending time on, and most importantly, what is a problem that is sufficiently interesting, yet sufficiently difficult, that it hasn't yet been solved, but the time for solving it has come now.”

-- Savas Dimopoulos

Re:Updating the Git protocol for SHA-256 by nujabe on Saturday June 20, 2020 @12:15AM (#23581602)
I'm almost certain if it weren't Torvalds, it would be someone else who creates something like Git. He just had the need and skills to create it. Like Bill Gates he was just a competent person, at the right place and time.
Re:Updating the Git protocol for SHA-256 by nordsieck on Saturday June 20, 2020 @01:41AM (#23581993)
> I'm almost certain if it weren't Torvalds, it would be someone else who creates something like Git. He just had the need and skills to create it. Like Bill Gates he was just a competent person, at the right place and time.

I think it's fair to point out that Torvalds didn't come up with Git on his own - he was influenced by a good amount of prior art, not the least of which was Bitkeeper.

However, I think calling him a "competent person, at the right place and time" undersells him to a substantial degree.

1. He's a world class software developer.

2. He's a world class tech lead (There are certainly criticisms about his communication style, which I don't think are unfair. Here, I am judging him by the artifacts created under his leadership).

3. He was the write lock for an extremely large distributed team for more than a decade.

It is not surprising to me that the 2nd most famous distributed source control tool - Mercurial - was also initially created by a Linux kernel developer.

Re:Updating the Git protocol for SHA-256 by bch on Saturday June 20, 2020 @02:49AM (#23582286)
> It is not surprising to me that the 2nd most famous distributed source control tool - Mercurial - was also initially created by a Linux kernel developer.

Because Linux was in a crisis and hot off an excellent experience w bitkeeper? Or something more profound?

Re:Updating the Git protocol for SHA-256 by nordsieck on Saturday June 20, 2020 @03:10AM (#23582351)
> Because Linux was in a crisis and hot off an excellent experience w bitkeeper? Or something more profound?

I'm sure the crisis was part of it.

But also, the way Linux development is organized is very weird compared to how code is developed in most places. "Distributed" is not quite right, but it's the best word I've got. A source control tool like Perforce just wouldn't fit linux development very well, whereas large companies at the time were perfectly happy with it.

Re:Updating the Git protocol for SHA-256 by quicklime on Saturday June 20, 2020 @04:15AM (#23582580)
“Decentralized”?

I agree with you that Linux development is weird compared to most places. Most places have a designated central repo that acts as the source of truth, whereas the Linux developers don’t really have this.

This is possibly an unpopular opinion, but I think that when there is an official main repo, git is far more complicated than it needs to be. It’s confusing to a lot of developers because of all this unnecessary complexity. Most teams could probably be served better by a simpler system.

Re:Updating the Git protocol for SHA-256 by Koromix on Saturday June 20, 2020 @05:16AM (#23582797)
I share this opinion as well. For centralized-repo style, which is what most teams need, the Git model has three problems:

- It is hard to use. There's a reason most teams have a single or two Git "experts" to help everyone else resolve repository / merge / pull / whatever problems that happen regularly. The onboarding experience for developers unfamilir with Git is very bad, and many of them end up never able to use it. If you have non-developers (e.g. artists), it is even worse.

- Binary files. Yes, there is Git LFS, but there are many small integration problems when you try to use it, and the simple fact that Git needs something special to manage binary files is a problem. And no, storing binary files outside the repository is NOT a good solution. In games for example, the binary files and the engine usually evole together and if you want to checkout an old version, the code and the assets need to stay in sync. You want to version the game, not just the engine.

- Partial (subtree) clones and permissions. There's a reason monorepos are popular: they're much simpler to manage. Unfortunaly, because Git barely does partial clones and cannot manage permissions (inside a repository) at all, monorepos are much more limited than in SVN or P4. That's why many projects end up divided in multiple repos, but this brings all sorts of problems and a large administrative overhead for all developers.

Re:Updating the Git protocol for SHA-256 by mpawelski on Saturday June 20, 2020 @10:12AM (#23584035)
The point of being hard to use is valid. But I would focus more on being hard to learn instead. Once you know it you forgot about it 99% of times, for other 1% it's good to have this "git expert" on a team ;)

For other points there seems to be ongoing process [0][1] and I think in one year or more having huge monorepos with binary files should not be such a big problem or require additional tools. It should be build in core git.

Permissions seems to be partially "solved" by git hosting sites like Github. But I agree it's a pity we don't have anything build in core git for this :(

[0] https://github.blog/2020-01-17-bring-your-monorepo-down-to-s... [1] https://git-scm.com/docs/partial-clone

Re:Updating the Git protocol for SHA-256 by nix23 on Saturday June 20, 2020 @05:39AM (#23582884)
Give bitkeeper a try, it's now FOSS

-Simple clean interface

-You can work the linux way or with a central-repo-style

-Binary Asset Manager build in

-Nested (submodules done right)

Re:Updating the Git protocol for SHA-256 by Koromix on Saturday June 20, 2020 @05:56AM (#23582960)
Interesting, thanks for the tip! I'm gonna give it a go during the weekend.
Re:Updating the Git protocol for SHA-256 by bch on Saturday June 20, 2020 @01:11PM (#23585049)
Thanks for the thoughtful reply and kicking off a great discussion about gits strong points and pain points. I see too many discussions that are just “fans” who seem to think Linus/Linux can do no wrong, without acknowledging what Linux development is, and how probably 99% of us will never be there, but still live w the pain points. Like suffering through supercar gas mileage and repair costs for a commuter/grocery-getter, but “McLaren can’t be wrong, can they?”
Re:Updating the Git protocol for SHA-256 by edoceo on Saturday June 20, 2020 @03:09AM (#23582349)
Maybe their extensive experience with both big-system code and distributed team problems?
Re:Updating the Git protocol for SHA-256 by Dylan16807 on Saturday June 20, 2020 @02:18AM (#23582151)
If? Is Mercurial not like Git?
Re:Updating the Git protocol for SHA-256 by addicted on Saturday June 20, 2020 @03:50AM (#23582504)
Yes, and according to Wikipedia their initial releases were only 2 weeks apart.

Further, you also had Bazaar whose initial release was a month earlier and was itself based on another tool that was released a year before.

For whatever reason, creating distributed alternatives to SVN was a very popular thing to do at the time.

Re:Updating the Git protocol for SHA-256 by Volt on Sunday June 21, 2020 @03:52PM (#23594832)
They were really meant to be FLOSS alternatives to BitKeeper, not SVN.
Re:Updating the Git protocol for SHA-256 by sradman on Saturday June 20, 2020 @05:41AM (#23582890)
> ... he was just a competent person, at the right place and time.

Right skill set, right place, right time. The decentralized team workflow of Open Source projects demanded a decentralized version control system (DVCS). A number of DVCS systems emerged with varying trade-offs.

It is interesting, but non obvious, which set of trade-offs gain greater adoption. Git versus Mercurial is a case study of this process.

Re:Updating the Git protocol for SHA-256 by riquito on Saturday June 20, 2020 @01:53AM (#23582040)
> "He just had the need and skills to create it"

Yeah, lucky Linus

/sarcasm

A bit undeserving, don't you think?

Re:Updating the Git protocol for SHA-256 by kohtatsu on Saturday June 20, 2020 @01:43AM (#23582006)
I'd love to see an in-depth comparison of the contributions to technology from Jobs, Gates, and Torvalds.
Re:Updating the Git protocol for SHA-256 by nix23 on Saturday June 20, 2020 @06:17AM (#23583035)
I dont think there is much:

-Jobs was management

-Gates made basic and management

-Torvald made a VCS a Kernel a Divecomputer-programm and a new way to develop software

Re:Updating the Git protocol for SHA-256 by rumanator on Saturday June 20, 2020 @03:35AM (#23582449)
> he was just a competent person, at the right place and time.

If you honestly have that pov then it must be very hard to explain how no one else in the whole history of the world has ever managed to pull anything similar to Git.

It's one thing to point out we all stand on the shoulders of giants, but it's an entirely different thing to claim any random person with average skills pulls this off. I mean where's your Git?

Re:Updating the Git protocol for SHA-256 by langitbiru on Saturday June 20, 2020 @03:30AM (#23582433)
10x engineer? :)