News for hackers. Stuff that matters.
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by didntcheck on Thursday June 15, 2023 @11:37AM (#36342057)
I'm a big fan of neat statistical analyses, but when I look at the archive site https://www.gharchive.org/ , the overwhelming feeling I have is "creeped out". Taking periodic snapshots of repositories and their issues and wikis sounds good, but do we really need a log of every time someone watches an issue, and every commit message being irrevocably set on public record? That level of details on individual activity seems to have little value outside of cyberstalking

I did have a look at the bottom of the page where prominent uses are listed, but nothing stands out as actually useful tbqh

Re:Getting 10TB of GitHub Logs and Extracting Details of All... by zx8080 on Thursday June 15, 2023 @12:01PM (#36342472)
> That level of details on individual activity seems to have little value outside of cyberstalking

A selling point for business-level is that they can do whatever OKR they want on top of that details. To make any employee dance whatever business can imagine. Any amount of Tb seems OK until it helps selling "Business" tier github.

Re:Getting 10TB of GitHub Logs and Extracting Details of All... by ziml77 on Thursday June 15, 2023 @12:47PM (#36343242)
I have a GitHub account under my real name, but recently I've started using GitHub under a couple of other names instead. There's so much stuff you do in public on GitHub that I want to avoid people doing exactly this kind of analysis on.

I wish using multiple identities was at least some level of foolproof though. I have to be careful to configure my local copies of repos to use the correct username, masked email, and PGP signing key. It would be super handy if git had a global config of multiple identities and if I could have it prompt me to select one either when I clone a repo or the first time I push to it.

Re:Getting 10TB of GitHub Logs and Extracting Details of All... by jxramos on Thursday June 15, 2023 @12:55PM (#36343384)
Private repos are still off limits for this sort of analysis correct?
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by _a_a_a_ on Thursday June 15, 2023 @01:12PM (#36343647)
Microsoft owns github so draw your own conclusions on whether that's true and how long it will last if it is.
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by ahauxuueei on Thursday June 15, 2023 @01:31PM (#36343916)
What a blast from the past. Trust no one, am I right?

What's up Mulder! This is deep throat speaking

Re:Getting 10TB of GitHub Logs and Extracting Details of All... by _a_a_a_ on Thursday June 15, 2023 @01:41PM (#36344030)
You are wrong. Don't be cynical, but equally don't be naive. MS hasn't changed at core.
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by iudqnolq on Thursday June 15, 2023 @07:25PM (#36348379)
Yes but the specific ways that large companies like Microsoft violate user privacy tends not to include posting sensitive user data on the open internet. Especially not for business customers.
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by ziml77 on Thursday June 15, 2023 @01:56PM (#36344227)
They should be, but those aren't a solution for anything where you want to share, collaborate, or even just ask questions on.
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by 0x0 on Thursday June 15, 2023 @02:38PM (#36344787)
You can have includeIf sections in your .gitconfig that applies only to things within a certain directory. So you if you create top level directories in your $HOME for your various identities, all you need to do is to make sure you are cloning into and working within the appropriate directory hierarchy.
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by mplewis9z on Thursday June 15, 2023 @03:49PM (#36345559)
I do this to separate personal and company repositories on the same machine, and it works flawlessly. An example config looks like:

~/.gitconfig:

```

[includeIf "gitdir:~/Personal/"]

        path = ~/personal.gitconfig
```

~/personal.gitconfig:

```

[user]

        email = {personal email address}
```

And you can have arbitrary numbers of "profiles" like this, as long as each is in their own directory.

Re:Getting 10TB of GitHub Logs and Extracting Details of All... by ziml77 on Thursday June 15, 2023 @10:11PM (#36350130)
Oh that's really cool! I'm absolutely going to use this technique. Thanks both of you!
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by zhfliz on Thursday June 15, 2023 @02:45PM (#36344877)
note that this is technically against their TOS if not using paid accounts:

> One person or legal entity may maintain no more than one free Account (if you choose to control a machine account as well, that's fine, but it can only be used for running a machine)

https://docs.github.com/en/site-policy/github-terms/github-t...

Re:Getting 10TB of GitHub Logs and Extracting Details of All... by kfrzcode on Thursday June 15, 2023 @03:05PM (#36345076)
internet would be better with total anonymity.
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by awesome_dude on Thursday June 15, 2023 @03:21PM (#36345250)
There's an almost constant debate on anonymity on the internet, the argument has existed for at least the last 30 or so years, and will likely continue for the lifetime of the internet.

In the "use your real name" corner - people argue that using an anonymous handle means that there is no credibility, the lack of consequence means that people can be /more/ disingenuous and provide bad faith comments.

In the "be anonymous" corner - people argue that what you say or do on the net now shouldn't affect you in 25 years time (there are multiple examples of politicians, or public figures who have said unwise things on the internet, only to have their careers ripped apart decades later)

For me (obviously) I have chosen the anonymous handle - because in the past I have had employers contacted because I hold different political views to some nasty people, I've had my house marked by them, my life was threatened, and some veiled threats about my children. (libertarians are very anti free speech when the speech is anti their house of cards)

Re:Getting 10TB of GitHub Logs and Extracting Details of All... by Firmwarrior on Thursday June 15, 2023 @03:55PM (#36345639)
Well, to be fair, some of the most vile hateful stuff I've ever seen in my life was posted on Facebook-powered comment sections under news articles, next to real names and pictures of smiling grandparents holding their grandchildren
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by kfrzcode on Friday June 16, 2023 @08:53AM (#36355763)
Your experience is very different than mine.
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by WalterBright on Thursday June 15, 2023 @05:30PM (#36346775)
> only to have their careers ripped apart decades later)

A stock car driver had his career ruined for things is father said long ago.

> libertarians are very anti free speech when the speech is anti their house of cards

It's sad that that occurred. A major part of libertarianism is free speech. But I'm sure you know that left-wing governments prefer to send any dissenters to the gulag.

Re:Getting 10TB of GitHub Logs and Extracting Details of All... by awesome_dude on Thursday June 15, 2023 @06:38PM (#36347709)
> It's sad that that occurred. A major part of libertarianism is free speech. But I'm sure you know that left-wing governments prefer to send any dissenters to the gulag.

Whataboutism?

Honestly if all you really have is "but those other bad people are bad too" you have nothing at all.

Re:Getting 10TB of GitHub Logs and Extracting Details of All... by WalterBright on Thursday June 15, 2023 @10:45PM (#36350424)
Your post generalized libertarians as bad people.

I generalized left wing government as bad, sure, and I can cite many examples of it. The USSR, Pol Pot, etc.

Re:Getting 10TB of GitHub Logs and Extracting Details of All... by ziml77 on Thursday June 15, 2023 @10:33PM (#36350328)
It's a really tough situation. I want both at the exact same time. But since that's not possible, I lean towards anonymity. Stuff that's published on the internet is out there forever. Because of automated tools that exist now and that will only get better in the future, it will be easy to surface.

And it's hard because there's so many ways someone could make connections that aren't immediately obvious. For example, I used to have my home's IP address set as a subdomain of the same one I use for email (for VPNing in). But later I thought about it and realized that anyone could easily look at the DNS records for my domain and know more than I really want them to.

Re:Getting 10TB of GitHub Logs and Extracting Details of All... by xur17 on Thursday June 15, 2023 @05:27PM (#36346724)
That's one of my favorite parts of reddit. Accounts are just pseudonyms, and you can generate as many as you want. I personally generate a new one every few months, which helps keep too much identifying data from building up over time.
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by kfrzcode on Thursday June 15, 2023 @06:38PM (#36347714)
and they're all identifiably attached to your metadata package(s)
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by drdaeman on Thursday June 15, 2023 @06:59PM (#36347965)
Which, at the very least, isn't public to everyone. So, not perfect, but better than single public account.
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by xur17 on Thursday June 15, 2023 @10:16PM (#36350175)
Not sure I follow.
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by eek2121 on Thursday June 15, 2023 @11:04PM (#36350607)
no. going to disagree. If you were alive in the 70s-90s you'd understand why. Anonymity = Animosity. I used to have your stance until MAGA tried to destroy the US. Meanwhile, countries that don't support anonymity, like the EU, are doing fine for the most part.
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by kfrzcode on Thursday June 15, 2023 @11:43PM (#36350890)
I'll refrain from trying to convince you that the "MAGA" demographic certainly were not destroying nor trying to destroy the US. You're clearly under-informed if you're assigning the country label to the EU. Is the EU a country?

I've been on the web since before GNU/Linux, I'm not unfamiliar with the olden days.

Re:Getting 10TB of GitHub Logs and Extracting Details of All... by DropInIn on Friday June 16, 2023 @09:37PM (#36366310)
If you really were on the web since before gnu/Linux you would never have expressed it that way...

You'd say you were around when you dialed into BBSes.... Like those who actually were on the "web" before gnu/Linux.... Do you actually understand what you claimed with that?

Quick edit: just in case it's not clear enough

"First released on September 17, 1991, by Linus Torvalds"

"By Christmas 1990, Berners-Lee had built all the tools necessary for a working Web"..."In 1991 the Commercial Internet eXchange was founded"

Unless you were friends with Tim it's literally impossible....

Re:Getting 10TB of GitHub Logs and Extracting Details of All... by bigbillheck on Thursday June 15, 2023 @04:33PM (#36346132)
They'll have to catch me first.
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by ziml77 on Thursday June 15, 2023 @10:06PM (#36350082)
That's a term of service that I'm not too worried about. I'm not going to cry if they terminate those two accounts (main account is paid, so that's not in violation). And I'm not doing anything unusual or abusive with the accounts so I'm not worried they'll take action anyway.
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by mxmlnkn on Thursday June 15, 2023 @12:56PM (#36343400)
This kind of information has become even more easily accessible for everyone with the introduction of the Activity tab. I really wish that force-pushed commits and deleted branches would be permanently lost instead of being permanently stored like on a blockchain.

https://github.blog/changelog/2023-05-31-view-repository-pus...

Re:Getting 10TB of GitHub Logs and Extracting Details of All... by ResearchCode on Thursday June 15, 2023 @02:51PM (#36344949)
Since people can't behave and come up with "business models" like this, sites will have to become subscription-only.
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by lesquivemeau on Thursday June 15, 2023 @02:51PM (#36344953)
Is this even GDPR compliant ?
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by kiririn on Thursday June 15, 2023 @03:13PM (#36345161)
GitHub is already a GDPR joke. They won’t delete anything less than an entire account
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by janosdebugs on Thursday June 15, 2023 @11:55PM (#36351005)
How so? I deleted my previous accound and they replaced all interactions with "ghost". Deleting all interactions would be going a step too far IMHO since it would destroy documentation of issues, etc, just like public forums usually argue against deleting all posted content when you delete your account.
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by pcdevils on Thursday June 15, 2023 @04:02PM (#36345731)
Based on Serbia but operating the servers in Frankfurt. With the cavalier attitude to scraping and linking people's identifiable data without any sort of opt-in I had assumed it would be a US company.
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by kfrzcode on Thursday June 15, 2023 @03:06PM (#36345085)
Lol let me introduce you to a little organization called the National Security Agency, with their "creepy" periodic snapshots of much more intriguing datasets.

"Stellar Wind" is a good place to start.

Including, but of course not limited to, every communication made by any person within the United States (or outgoing) for the better part of two decades. Internet traffic, communications, all of it.

https://oig.justice.gov/reports/2015/PSP-09-18-15-vol-III.pd...

Re:Getting 10TB of GitHub Logs and Extracting Details of All... by WalterBright on Thursday June 15, 2023 @05:34PM (#36346824)
Looks like I'm destined to the gulag for sure.
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by killingtime74 on Thursday June 15, 2023 @04:50PM (#36346352)
Don't blame the archiver who is only doing what is allowed of them by Github. If you don't want to be public don't be public. Other archivers aren't making themselves publicly known but have the data all the same.
Re:Getting 10TB of GitHub Logs and Extracting Details of All... by onlypositive on Thursday June 15, 2023 @08:20PM (#36349085)
Just because you can perve on people at a nudest beach doesn't mean you should.

Society frequently has norms and unwritten rules that we usually follow. Not every rule needs to be written down as law.

Re:Getting 10TB of GitHub Logs and Extracting Details of All... by JakobH on Friday June 16, 2023 @02:38AM (#36352373)
Those beaches have rules. You are not allowed to take pictures.

While on github there is no rule like that.

Re:Getting 10TB of GitHub Logs and Extracting Details of All... by onlypositive on Friday June 16, 2023 @02:40AM (#36352392)
Nobody is claiming there was any rules being broken.

Doesn't make it any less creepy.

Re:Getting 10TB of GitHub Logs and Extracting Details of All... by TheBrokenRail on Thursday June 15, 2023 @05:56PM (#36347181)
If you put information online publicly, you should be always working under the assumption that it will be immediately archived by someone. Whether that is the Internet Archive for websites, a Discord bot archiving edits and deletions, Pushshift (formerly) for Reddit, or just some private group operating a web scraper.

At least in this situation the archived data is public.