News for hackers. Stuff that matters.
Re:Everything I built with Claude Artifacts this week by kridsdale3 on Wednesday October 23, 2024 @06:48PM (#41930006)
Can those kinds of things work in monorepos with 50 million files?
Re:Everything I built with Claude Artifacts this week by adamtaylor_13 on Wednesday October 23, 2024 @07:35PM (#41930333)
No and neither can you. Like you, it works best with small, focused context.

These tools aren’t magic. But they do certain tasks remarkably well.

Re:Everything I built with Claude Artifacts this week by dartos on Wednesday October 23, 2024 @08:54PM (#41930821)
> No and neither can you.

People do work on monorepos with 50 million+ files, though…

Re:Everything I built with Claude Artifacts this week by syntaxing on Wednesday October 23, 2024 @07:05PM (#41930130)
They use this thing called repo map[1]. I only used it for personal projects and it’s been great. You need to add the files you care about yourself, it’ll do its best and add additional files from the repo map if needed.

Since it’s git based, it makes it very easy to keep track of the LLMs output. The agents is really well done too. I like to skip auto commit so I can “git reset —hard HEAD^1” if needed but aider has built in “undo” command too.

[1] https://aider.chat/docs/repomap.html

Re:Everything I built with Claude Artifacts this week by cdchn on Wednesday October 23, 2024 @08:41PM (#41930751)
Thats a cool idea, kind of reminds me of ctags.
Re:Everything I built with Claude Artifacts this week by imjonse on Thursday October 24, 2024 @01:25AM (#41932203)
Aider had actually used ctags to implement that feature before they switched to tree-sitter.
Re:Everything I built with Claude Artifacts this week by salviati on Wednesday October 23, 2024 @06:49PM (#41930022)
I believe they can as long as you're able to identify a contained task that touches no more than a handful of files. Still very useful to automate some tedious work or refactoring if you ask me.
Re:Everything I built with Claude Artifacts this week by jprete on Wednesday October 23, 2024 @06:55PM (#41930065)
That's effectively an answer of "no".
Re:Everything I built with Claude Artifacts this week by sthatipamala on Wednesday October 23, 2024 @06:57PM (#41930083)
I used to work in a monorepo of that size.

All of the PRs I ever submitted touched a handful of files in my project’s subdirectory.

Re:Everything I built with Claude Artifacts this week by raincole on Wednesday October 23, 2024 @07:04PM (#41930125)
That's effectively an answer of "yes".

Or what "yes" looks like to you? It can do all the work itself, for a 50m-file monorepo, without a human guiding it which files to look at?

If it were true then human programmers would have been considered obsoleted today. There would be exactly zero human programmers who make any money in 2025.

Re:Everything I built with Claude Artifacts this week by ctoth on Wednesday October 23, 2024 @07:04PM (#41930122)
Can you work in a repo with fifty million files? Can Git? I just checked on my Windows machine using Everything and there are 15,960,619 files total including every executable, image, datafile, &c.

Out of curiosity what does your IDE do when you do a global symbol rename in a repository with fifty million files?

I'm absolutely a real human, and I think this just might be too much context for me! Perhaps I am not general enough.

Re:Everything I built with Claude Artifacts this week by dexwiz on Wednesday October 23, 2024 @09:12PM (#41930926)
Having worked on a codebase like that, you need to use some extra plugins to get git to work. And even then, it’s very slow. Like 15-30 seconds for a git status to run even with caching. Global renames with an IDE are impossible but tools like sed and grep still work well. Usually there is a module system that maps to the org structure and you don’t venture outside of your modules or dependency modules very often.
Re:Everything I built with Claude Artifacts this week by achierius on Wednesday October 23, 2024 @09:17PM (#41930951)
I thought this was common knowledge but I guess not: Google's monopoly famously has over a billion files. No, Git cannot handle it. Their whole software stack is developed around this from the ground up. But they are one of the largest software employers in the world, so quite a few engineers evidently do make do with 200x more than 50 million files.
Re:Everything I built with Claude Artifacts this week by nasmorn on Thursday October 24, 2024 @01:05AM (#41932096)
Monopoly <> Monorepo This is the funniest typo possible in the context of google
Re:Everything I built with Claude Artifacts this week by rorytbyrne on Wednesday October 23, 2024 @07:16PM (#41930212)
It doesn't take the whole repo as context, it tries to guess which files to look at. So if you prompt with that in mind, it works well. Haven't tried it on a very large codebase though. You can also explicitly add files, if you know where work should be done.
Re:Everything I built with Claude Artifacts this week by paradite on Wednesday October 23, 2024 @10:07PM (#41931205)
I made a tool that allows you to use LLMs on large codebases. You can select which files are relevant and embed them into the prompt: https://prompt.16x.engineer/

Based on my personal experience it works well as long as each file is not too long.

Re:Everything I built with Claude Artifacts this week by ziggyzecat on Thursday October 24, 2024 @04:32AM (#41933389)
you can make it work. just think of the many approaches and you'll see that there are actually quite many viable ways to work around pseudo-infinite context.