News for hackers. Stuff that matters.
Re:Imagine a drive where every file exists as all file types... by grandslammer on Friday May 16, 2025 @09:25AM (#44005237)
I work with AI tools often and I find myself constantly swapping between file types to navigate different sites and use cases. I built anydoc — I imagined a universal document format drive layer that would allow me to essentially have a file that is many different file types at once. CSV for organizing, markdown for feeding into LLMs, HTML for fast sharing... so here it is and I am working on making it better all of the time. Just shipped an update that makes the most relevant format types available faster on a document upload @boshjerns on X
Re:Imagine a drive where every file exists as all file types... by unsnap_biceps on Tuesday May 20, 2025 @07:19AM (#44040219)
Have you considered writing this as a FUSE system rather than a web service?
Re:Imagine a drive where every file exists as all file types... by RileyJames on Tuesday May 20, 2025 @07:24AM (#44040253)
It’s an interesting idea.

I’ve definitely felt the pain of file formats in some unexpected ways recently.

Like airdropping a photo from iPhone only to discover a .HEIC file, which nothing will accept.

I’ve previously used “what ever turns up first on google”, but I now won’t for anything of significance (privacy)

I’ve recently discovered Automator (on Mac) and the quick actions menu. Which can achieve a lot of image and pdf related conversions, but takes some setup (not a mass market solution)

I like the idea of this product. But I think the challenge will be: - reaching the user at the moment they have this problem

- making your solution frictionless to solve their immediate problem, while also bootstrapping to solve it next time around (without them forgetting it exists)

If you can nail that experience for a single use case, I think this will be a winner.

Re:Imagine a drive where every file exists as all file types... by DontchaKnowit on Tuesday May 20, 2025 @09:34AM (#44041457)
I think the real problem is getting it to actually work....
Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @08:33AM (#44050797)
i think i hit credit limits because so many people were using the app all of a sudden and i'm just like using my own funds for api costs and had a cap on my openai account
Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @05:06AM (#44049617)
Hey, I’m just catching up here and I really appreciate the feedback and I’m gonna work to integrate all this feedback into the application and repost about it again I really appreciate you
Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @05:06AM (#44049618)
Let me actually work on this HEIC issue right now. I think that I know a fix for this.
Re:Imagine a drive where every file exists as all file types... by gus_massa on Saturday May 17, 2025 @12:10AM (#44011986)
I think calling it a "drive" will confuse a lot of people. I expected a device driver, and not technical people have no idea of drives, they just have documents and photos.

I tried with a text file

  X Y
  1 2
  3 4
and for some reason the convert version has 1 2 3 4 in the same row.
Re:Imagine a drive where every file exists as all file types... by gus_massa on Sunday May 18, 2025 @07:12AM (#44020470)
Too late to edit: Google drive is call "drive", so I guess it's more usual than I noticed.
Re:Imagine a drive where every file exists as all file types... by alentred on Tuesday May 20, 2025 @07:47AM (#44040450)
Hm, I don't know, I am OK with "drive". Google Drive, Microsoft OneDrive, iCloud Drive.
Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @05:20AM (#44049679)
It really does just make sense too. We have hard drive so I wouldn’t we have digital drives.
Re:Imagine a drive where every file exists as all file types... by nkrisc on Tuesday May 20, 2025 @07:23AM (#44040242)
So it turns one file into many? Or is it actually one file that is simultaneously a valid HTML document and PNG?
Re:Imagine a drive where every file exists as all file types... by IAmBroom on Tuesday May 20, 2025 @07:59AM (#44040549)
According to what I read, the latter.
Re:Imagine a drive where every file exists as all file types... by c0wb0yc0d3r on Tuesday May 20, 2025 @08:38AM (#44040888)
And you’d be mislead. The video shows the original file is converted to different formats, depending on the user’s selection. The video shows jpeg to html (using AI to perform OCR?).

Pandoc but extra AI steps.

Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @04:12PM (#44055811)
That argument really skips over what most people actually need. Nobody outside of a tech bubble wants to learn half a dozen Pandoc flags, stitch together shell commands and temp files, or write Lua filters just to reshape a document. With our drive layer you literally rename a file or type “make this header bold and export as PDF” and the work just happens, no scripts required.

This isn’t about replacing power-user workflows, it’s about giving anyone on your team the ability to reshape data and documents without ever opening a terminal. You getflexibility with the simple UX of renaming a file. Calling it “Pandoc plus AI” misses the fact that 90 percent of users neither know nor care about Pandoc’s internals. They just want “I have a file, make it look like this, or formatted with these sections to share with X person who works in X field...” and that’s exactly what our natural-language, filesystem-driven approach delivers.

Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @05:22AM (#44049692)
It’s basically an access layer that gives you quick access to all the different conversions of the files in one place, but it also allows you to redesign them with natural language so that you can configure them for your needs on the fly
Re:Imagine a drive where every file exists as all file types... by globular-toast on Tuesday May 20, 2025 @07:52AM (#44040494)
I like the idea if it was deterministic. So if there are standard ways to convert to/from document types, like Pandoc, being able to write to any one of them and have it update the rest would be interesting.

I hate it if it's built with "AI". Can't imagine a use case for this apart from just shit you don't care about. Why would I be hoarding data I don't care about?

Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @05:23AM (#44049700)
It’s not about hoarding data rather it’s about the malleability of the data itself so for me, I’m constantly working with data but need to format the way that it is displayed whether it’s the file type or the way that the data is given in the specific file if it’s a CSV for example so an application like this allows me to quickly reformat the files with natural language to maybe make them an HTML where I could share a certain form of document HTML file or take that information and reverted into a CSV format. I need to configure it with a management system or something like that.
Re:Imagine a drive where every file exists as all file types... by SPBS on Tuesday May 20, 2025 @08:07AM (#44040611)
the page is really laggy on Edge, kills any interest in wanting to explore more (strangely, it's much snappier on Chrome)
Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @05:02AM (#44049592)
I will work to fix this asap I just caught up here
Re:Imagine a drive where every file exists as all file types... by ramoz on Tuesday May 20, 2025 @08:12AM (#44040646)
AI as a use case doesn’t make sense to me.

You’re using AI to create a transpilation of whatever modality. It’s a wasted step if the purpose is to feed back into AI.

Re:Imagine a drive where every file exists as all file types... by cyanydeez on Tuesday May 20, 2025 @05:00PM (#44045870)
keep in mind, almost all the uses of the current AI are to generate some unstable product that whimsically can change given a butterfly's wings in Japan.
Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @05:04AM (#44049607)
I literally find myself using this tool every day because I need to use natural language to reformat files and the data that are in the files like CSV‘s or markdown so maybe this isn’t useful for you but it definitely is useful to have the LM be able to interpret your natural language to redesign the file the way that you want it to give the information
Re:Imagine a drive where every file exists as all file types... by ramoz on Wednesday May 21, 2025 @03:27PM (#44055257)
You're talking about a commodity interaction at this point your tool offers nothing different from a chatbot other than your confusing semantics and abstraction.

What Im saying: If the point is to "convert this csv to markdown so i can feed the markdown to a LLM to ask questions about it" etc... it is a completely unnecessary step.

Your service is nothing more than:

1. augmented metadata for files; btw if that requires a whole new drive-oriented solution then you're doing too much.

2. llm api wrapper for a commoditized capability (custom format/or transpilation)

Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @04:06PM (#44055724)
The friction isn’t “can I call an LLM,” it’s every time I want to do anything with this file I have to:

open it in a tool that understands the format,

export / paste the part I care about,

phrase an LLM prompt,

paste the result back,

do this all again if i want the data formatted differently for different use cases.

adding the ability to format your data and view/download that natively, fast is like giving python scripting capabilities to normal users. You're thinking like a dev not like a business owner who may want to take a picture of a timesheet and have that immediately become a CSV then have it reformatted for a management system they use, all on the fly through natural language... there's so many ways that normal people navigate files and formats and I want to give these people some superpowers that they won't seek out themselves.

the gpt-wrapper argument is so played out. just like you’d say “my app is a GPT-wrapper” (it wraps the OpenAI API in a file-centric UX), you could say “Google Drive is a distributed-storage-wrapper” or “a cloud-storage-and-sync wrapper.” It’s the polished frontend and glue that makes the raw backend useful to end users.

Re:Imagine a drive where every file exists as all file types... by voidUpdate on Tuesday May 20, 2025 @08:16AM (#44040695)
So I can have my exe convert into a shapefile and an mp3?
Re:Imagine a drive where every file exists as all file types... by voidUpdate on Tuesday May 20, 2025 @08:21AM (#44040746)
Well I tried to convert an exe into a pptx and it outputted a file that looked like an attempt at html, saying that the conversion wasn't feasible due to its nature and size
Re:Imagine a drive where every file exists as all file types... by lloeki on Tuesday May 20, 2025 @09:44AM (#44041595)
You have it the wrong way around? Usually you are handed a pptx by customers and your job is to turn that into an exe.
Re:Imagine a drive where every file exists as all file types... by voidUpdate on Tuesday May 20, 2025 @09:59AM (#44041805)
I mean the website cays it can convert anything to anything ("every file exists as all file types all of the time") so it should be able to do exe to pptx
Re:Imagine a drive where every file exists as all file types... by thebeardisred on Tuesday May 20, 2025 @10:06AM (#44041861)
You missed the joke
Re:Imagine a drive where every file exists as all file types... by jeroenhd on Tuesday May 20, 2025 @10:30AM (#44042087)
Based on important research like https://www.youtube.com/watch?v=uNjxe8ShM-8, it should definitely be possible to generate a .pptx that will run Windows inside of an emulator inside PowerPoint slides. That HTML file is lying to you!
Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @08:34AM (#44050811)
i need to work on the pptx conversions and some of the other file types specifically- now i'm on this
Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @05:05AM (#44049613)
I’m actually working on some really interesting conversions right now
Re:Imagine a drive where every file exists as all file types... by dgan on Tuesday May 20, 2025 @08:27AM (#44040795)
i ve read the title 5 times, and can't make sense of it. Is this even valid English ?
Re:Imagine a drive where every file exists as all file types... by Akronymus on Tuesday May 20, 2025 @09:44AM (#44041594)
>Imagine a drive[,] where every file exists[,] as all file types[,] all of the time

Basically treating one file type as if it were any arbitrary other file type

Re:Imagine a drive where every file exists as all file types... by quesera on Tuesday May 20, 2025 @10:49AM (#44042272)
Punctuated like that, I can't help reading it in the movie trailer guy[0] voice.

[0] https://en.wikipedia.org/wiki/Don_LaFontaine .. wow, dead for 17 years!

Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @05:21AM (#44049686)
Hahahahaha thank you??
Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @05:21AM (#44049688)
I may need to work on the short pitch
Re:Imagine a drive where every file exists as all file types... by sigmaisaletter on Tuesday May 20, 2025 @09:00AM (#44041084)
It's a fancy file format conversion utility.

Am I missing something?

Re:Imagine a drive where every file exists as all file types... by dsr_ on Tuesday May 20, 2025 @10:18AM (#44041962)
Yes: it's a fancy file format conversion service that adds errors so your QA people have more work.
Re:Imagine a drive where every file exists as all file types... by emadda on Tuesday May 20, 2025 @09:04AM (#44041132)
Could have called it quantumdoc
Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @05:02AM (#44049593)
It’s not too late
Re:Imagine a drive where every file exists as all file types... by jy14898 on Tuesday May 20, 2025 @09:24AM (#44041351)
Now make it an HTTP API where content negotiation always succeeds
Re:Imagine a drive where every file exists as all file types... by ramses0 on Tuesday May 20, 2025 @09:49AM (#44041671)
Back in the day there were a bunch of `x2y` programs[1], like html2pdf, xls2csv, rst2odt, jpg2png, png2jpg, etc...

You could imagine something like `any2zip`, or `any2tgz` or `iso2mp4` or something.

It seems like there could/should be some sort of virtual filesystem where you could say "cat inventory.xls.csv", or "wine.exe excel.exe inventory.csv.xls" (please bear with me on these examples). Effectively "$BLOB.format.format", where "." becomes a sort of "convert to this $TYPE".

Imagine being able to say:

    `echo "# Hello\n\n * World" > README.md ; cat README.md.html"`
    (effectively invoking `md2html`)
    
    `printer README.md.html.pdf`
    (eg: `cat README.md | md2html | html2pdf | printer`)
...if you requested `README.md.pdf`, maybe it could intuit the intermediate `md2html2pdf` (HTML) portion?

I really wish local linux filesystems (for end-users) would at least match Apple's capabilities. eg: `$RECENT`, spotlight, auto-OCR. We've really regressed since the era of `locate`, but I'd _LOVE_ some sort of modern equivalent.

Imagine: `inotify`, `auditd`, just anything that can avoid full-disk scans during "normal end user" daily operation... wired up to `llm-summary $FILE >> sqlite.db ; `llava-describe $IMAGE >> sqlite.db ; etc...`

For bonus points, catch anything missed with some sort of full daily/weekly backup operation. We're on the cusp of a much more intimate "partnership" with the compute boxes underneath our desks, but so much is getting sucked into the void of "the network is the computer".

[1]: compgen -c | grep 2 | grep -v '2$' | grep -v '\.2' | grep -v '2\.'

[2]: https://en.wikipedia.org/wiki/Locate_(Unix)

Re:Imagine a drive where every file exists as all file types... by RetroTechie on Tuesday May 20, 2025 @01:51PM (#44044081)
> Back in the day there were a bunch of `x2y` programs[1], like html2pdf, xls2csv, rst2odt, jpg2png, png2jpg, etc...

They're still around. A problem is loss of information on each conversion. For example, wav->mp3 loses info. Converting back (mp3->wav) won't get you the exact .wav you started with. Similar thing with file types supporting different resolution graphics, vector vs. bitmap, metadata being stripped, features in format A not supported in format B, etc.

Another problem is the explosion of M:N file format combinations. A possible fix would be a universal (?) in-between format, functioning as a container for [portions of a file] + whatever metadata was extracted from original. That way you can at least do conversions along the lines of video container formats, where container type is changed but video inside does not get decompressed/re-encoded. Or simular operations like extracting/shuffling pages in a pdf document.

All in all this is not an easy problem & therefore unlikely to be solved anytime soon.

Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @08:41AM (#44050866)
really appreciate you adding to the discourse here - I'm not sure if you got a chance to test out the site but I refilled my credits after the surge of attention and would love if you checked it out! also @boshjerns on X if you want to reach out to chat
Re:Imagine a drive where every file exists as all file types... by TomMasz on Tuesday May 20, 2025 @09:52AM (#44041712)
I got "No video with supported format and MIME type found." in the How It Works section.
Re:Imagine a drive where every file exists as all file types... by troyvit on Tuesday May 20, 2025 @10:19AM (#44041971)
I think you can get past that if you download the video, then upload it back up to anydoc and ask it to translate it to Markdown.

edit: /s

Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @05:33PM (#44056505)
hahahaahhaha nice one
Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @05:05AM (#44049615)
Video files are not supported right now is probably the issue. Working on this because I’m going to have to pass the video into frames and then feed the frames into a model and I just need to work this out a little bit more
Re:Imagine a drive where every file exists as all file types... by Y_Y on Tuesday May 20, 2025 @09:53AM (#44041721)
I thought this was something like a FUSE driver that would on-the-fly generate any file you tried to read, with some consistency. Like if you open stories/zombie-party.txt it will have some generative network make it, and cache it. If you later ask for stories/zombie-party.odt it can just do a conversion.

I vibe-coded a demo of such a thing, with the idea of making game assets like textures/outdoor/wall.jpg etc. You can do it easily enough, but you need to be patient, and not particularly discerning.

Re:Imagine a drive where every file exists as all file types... by raphman on Tuesday May 20, 2025 @10:50AM (#44042278)
FWIW, I wrote a small paper on this general topic a few years ago, collecting earlier work and own ideas.

"Files as Directories: Some Thoughts on Accessing Structured Data within Files"

https://dl.acm.org/doi/pdf/10.1145/3191697.3214323

Re:Imagine a drive where every file exists as all file types... by RetroTechie on Tuesday May 20, 2025 @12:20PM (#44043309)
Says "get access" with a "locked" icon.

Is this paper freely available somewhere?

Re:Imagine a drive where every file exists as all file types... by kurtoid on Tuesday May 20, 2025 @12:35PM (#44043445)
Re:Imagine a drive where every file exists as all file types... by raphman on Tuesday May 20, 2025 @02:50PM (#44044640)
Thanks! Sorry - I didn't realize that the paper in the ACM DL is not open-access.
Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @06:43AM (#44050075)
i think we have some similar thoughts - i am working on a file format that accomplishes something like this
Re:Imagine a drive where every file exists as all file types... by quesera on Tuesday May 20, 2025 @10:52AM (#44042302)
I played with this idea for media servers.

I want iTunes and Audiobookshelf and beets and Jellyfin, etc to all work on the same filesystem and media archive.

There are challenges.

Re:Imagine a drive where every file exists as all file types... by lawlessone on Tuesday May 20, 2025 @10:21AM (#44041985)
Wouldn't this make every file a lot bigger?
Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @05:03AM (#44049596)
It’s not really saving everything into one file type rather than allowing a layer. That access is all the file types easily and fast.
Re:Imagine a drive where every file exists as all file types... by jeroenhd on Tuesday May 20, 2025 @10:37AM (#44042139)
You might not want to use https://anydocai.com/result/<incremental number> for URLs like that. Anyone can enumerate the ~300 files from the home page and look at what others have uploaded.

That said, the website doesn't seem to work anymore. It just errors out.

Re:Imagine a drive where every file exists as all file types... by pavel_lishin on Tuesday May 20, 2025 @11:21AM (#44042621)
I wonder if they ran out of credits.
Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @05:17AM (#44049669)
Yeah, this is exactly what happened. I did not expect this or catch up until just now, but I just fixed it.
Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @05:17AM (#44049667)
I didn’t expect this to go semi viral on here so I just refilled the credits. It actually ran out of credits for open AI.
Re:Imagine a drive where every file exists as all file types... by woleium on Thursday May 22, 2025 @11:43AM (#44063189)
gemini is cheaper, probably
Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @05:25AM (#44049708)
Also, as far as the enumeration users are only authorized to access the files that they’ve created in our system, but I should definitely obscure the file count
Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @05:25AM (#44049709)
I’m like a mid-level developer though so if I messed up the authorization access and you worked around it in someway if you let me know that would be sick @boshjerns on X
Re:Imagine a drive where every file exists as all file types... by _wire_ on Tuesday May 20, 2025 @10:59AM (#44042394)
Imagine no file types

♪ It's easy if you try No hell below us Above us only sky Imagine all the people Visualize whirled peas Ah ah ah oooo!

You may say I'm a dreamer...

Re:Imagine a drive where every file exists as all file types... by grandslammer on Wednesday May 21, 2025 @05:02AM (#44049594)
real one