News for hackers. Stuff that matters.
Re:Ask HN: What underrated open source project deserves more... by xnx on Thursday March 07, 2024 @06:13PM (#39635795)
"OpenRefine is a powerful free, open source tool for working with messy data: cleaning it; transforming it from one format into another; and extending it with web services and external data." https://openrefine.org/
Re:Ask HN: What underrated open source project deserves more... by mickael-kerjean on Thursday March 07, 2024 @05:56PM (#39635653)
Filestash [1] was born after the infamous FTP top answer on the Dropbox launch [2]. Trying to understand why we couldn't have nice things made on top of FTP, I came out with this interface:

  type IBackend interface {
    Ls(path string) ([]os.FileInfo, error)
    Cat(path string) (io.ReadCloser, error)
    Mkdir(path string) error
    Rm(path string) error
    Mv(from string, to string) error
    Save(path string, file io.Reader) error
    Touch(path string) error
  }
and once I had the UI working nice for FTP, I made it work for every possible file transfer protocol: S3, SFTP, NFS, SMB, WebDAV, Dropbox, Google Drive, .....

[1] https://github.com/mickael-kerjean/filestash

[2] https://news.ycombinator.com/item?id=8863

Re:Ask HN: What underrated open source project deserves more... by yablak on Thursday March 07, 2024 @06:25PM (#39635895)
https://github.com/NightscoutFoundation/xDrip

xDrip+ is an unofficial and independent Android app which works as data hub and processor between many different devices.

It supports wireless connections to G4, G5, G6, G7, Medtrum A6, Libre via NFC and Bluetooth, 630G, 640G, 670G pumps, CareSens Air and Eversense CGM via companion apps. Bluetooth Glucose Meters such as the Contour Next One, AccuChek Guide, Verio Flex & Diamond Mini as well as devices like the Pendiq 2.0 Insulin Pen.

Heart-rate and step counter data is processed from Android Wear, Garmin, Fitbit and Pebble smart-watches and watch-faces for those that show glucose values and graphs.

On some Android Wear watches, it is possible for the G5 or G6 to talk directly to the watch so it can display values even when out of range of the phone.

The app contains sophisticated charting, customization and data entry features as well as a predictive simulation model.

Re:Ask HN: What underrated open source project deserves more... by _benj on Thursday March 07, 2024 @06:51PM (#39636068)
ImHex

“A Hex Editor for Reverse Engineers, Programmers and people who value their retinas when working at 3 AM.”

I actually used it not too long ago to inspect why a mp4 file wasn’t valid. The pattern language that they have is quite nice and having sections of the hex highlighted and being able to see what structures they represent and what data was on those structures was very useful!

https://github.com/WerWolv/ImHex

Re:Ask HN: What underrated open source project deserves more... by cookiengineer on Friday March 08, 2024 @01:41AM (#39638447)
Can confirm. ImHex is an amazing tool for a cyber analyst because it also supports yara rulesets, so you can quickly iterate and try out whether the malware was or will be detected. And it even supports capstone to disassemble the binary, while you debug the code and edit the yara rule!

Combined with ghidra, these are pretty much the most valueable tools in my day job.

(with golang, vim, arch etc of course)

Re:Ask HN: What underrated open source project deserves more... by brycelarkin on Thursday March 07, 2024 @05:54PM (#39635634)
Postgraphile. Postgres + graphql. It really solves all the negative aspects of graphql. Also, incredibly performant. Their v5 release is also a pretty interesting piece of tech.

https://postgraphile.org/

Re:Ask HN: What underrated open source project deserves more... by mdaniel on Thursday March 07, 2024 @07:52PM (#39636492)
I didn't see a v5 tag in order to know, and I have no idea what "utils/graphile" does for the project, but one will want to ensure they are aware of its licensing scheme https://github.com/graphile/crystal/blob/db8894c74eb0ec3fe96...
Re:Ask HN: What underrated open source project deserves more... by BenjieGillam on Friday March 08, 2024 @01:09AM (#39638262)
Its an optional command line utility that you may use with PostGraphile which does things like printing out your configuration in a pretty format and using TypeScript to figure out what options are available to you based on the plugins you are using. It is 100% non-essential because all the options are documented in each of the plugins (and also you can use TypeScript auto-complete in your editor), and you can just console.dir() your configuration. You can read about it here: https://postgraphile.org/postgraphile/next/config#viewing-th...
Re:Ask HN: What underrated open source project deserves more... by nagstler on Thursday March 07, 2024 @05:59PM (#39635687)
Interesting, This project looks very versatile, Can experiment with quick a backend API on Postgres.
Re:Ask HN: What underrated open source project deserves more... by brycelarkin on Thursday March 07, 2024 @06:10PM (#39635778)
It’s one of the few big projects that still feels “open source” as opposed to corporate run open source.

I think Netflix is a big user / sponsor of the project.

Re:Ask HN: What underrated open source project deserves more... by igor47 on Friday March 08, 2024 @02:13AM (#39638621)
Graphile worker is also awesome. Wish celery was as good -- I've been thinking of implementing a compatible worker in Python
Re:Ask HN: What underrated open source project deserves more... by grardb on Friday March 08, 2024 @02:29AM (#39638708)
I played with this a bit years ago when it was still called PostgraphQL. My biggest issue with it was that there didn't seem to be a recommended (or even suggested) version control method for things like functions. Using a standard migration tool to update functions seems like hell, so I gave up on using it.

Looking through the docs, I still see no mention of version control or even migrations at all. Is this something that has been solved?

Re:Ask HN: What underrated open source project deserves more... by brycelarkin on Friday March 08, 2024 @03:39PM (#39646154)
It’d be like any other database schema change. We commit all schema migrations to git and have cicd run them.
Re:Ask HN: What underrated open source project deserves more... by aitchnyu on Friday March 08, 2024 @04:45AM (#39639521)
Is there any alternative that works with Python?
Re:Ask HN: What underrated open source project deserves more... by xeonmc on Thursday March 07, 2024 @06:08PM (#39635754)
Small AutoIt utility scripts, such as WhyNotWin11 and other applets by similar users using AutoIt to make VB6-era -esq programs. These are always neither motivated by lofty architectural goals to “do things correctly” of many collaborative open source projects that forgot about laymen-ergonomics entirely, nor user-acquisition driven dark-pattern minefields of sluggish eye candy entirely focused on exploiting the aforementioned laymen-approachability, instead just being small-scope, pragmatic UX solutions to solve minuscule pain-/friction-points in interacting with Windows that are too fragmented to be part of some overarching software utility. They replace the typical SEO shovelware web app/adware that you get when searching on Google for “how do you do X on windows” that sends you to some factory-stamped installshield executable which does nothing more than passing command line arguments to some existing open-source CLI software that neglected laymen-usability.
Re:Ask HN: What underrated open source project deserves more... by mdaniel on Thursday March 07, 2024 @08:00PM (#39636547)
https://www.autoitscript.com/site/autoit/ says "AutoIt v3 is a freeware BASIC-like scripting language" and https://www.autoitscript.com/site/code/ just has " Here are some C++ source code samples from various projects of mine. Most are free to use but check any license files that accompany the downloads for details."

However, while trying to dig up the repo I did find https://github.com/J2TEAM/awesome-AutoIt#awesome-autoit that may interest the same audience

Re:Ask HN: What underrated open source project deserves more... by threeseed on Thursday March 07, 2024 @06:00PM (#39635696)
Re:Ask HN: What underrated open source project deserves more... by mdaniel on Thursday March 07, 2024 @07:55PM (#39636510)
Re:Ask HN: What underrated open source project deserves more... by jasonpeacock on Thursday March 07, 2024 @06:16PM (#39635815)
Everyone hand-rolls their own dotfile management system, but YADM already does everything you need:

https://yadm.io/

Re:Ask HN: What underrated open source project deserves more... by saghm on Friday March 08, 2024 @02:15AM (#39638633)
I've never doubted that there are existing solutions for dot files that do everything I need, but I've yet to find one that doesn't take more work for me to swap to than continuing to just clone a git repo an symlink maybe half a dozen things the once or twice a year that I happen to set up a new machine.
Re:Ask HN: What underrated open source project deserves more... by blemasle on Friday March 08, 2024 @02:35AM (#39638734)
You might want to have a look in stow. https://www.gnu.org/software/stow/

I just stumble across dotstow which adds a git layer on top of it https://github.com/clayrisser/dotstow

Re:Ask HN: What underrated open source project deserves more... by uneekname on Friday March 08, 2024 @10:37AM (#39642025)
stow has worked really nicely for managing my dotfiles. Here are two blog posts that helped me get my workflow down:

https://alexpearce.me/2016/02/managing-dotfiles-with-stow/

https://bastian.rieck.me/blog/2019/dotfiles_stow/

Re:Ask HN: What underrated open source project deserves more... by saghm on Friday March 08, 2024 @12:04PM (#39643092)
I've looked at it before. Looking at the system I'm writing this comment on, my dotfiles from my repo are ~/.config/alacritty/alacritty.toml, ~/.config/nushell/{config.nu,env.nu}, ~/.tmux.conf, and ~/.gitconfig. I'm not sure if I just use far fewer dotfiles than average, and I know this is a matter of personal taste, but it's just not obvious to me why I'd want to add a tool to symlink five things once. Moreover, most of the jobs I've had give me a Macbook to work on rather than Linux, so that also would require me to either manually install `stow` or move getting homebrew set up to _before _setting_ up my dotfiles, which seems a bit backwards to me given that my my shell config is where I store any configuration for stuff like that.

I'm starting to wonder if I just have a very vanilla dotfile workflow compared to what some other people use. This would surprise me a bit, given how I tend to go overboard in custom configuration for most things, but it definitely feels like my experience isn't enough for me to understand why specialized tooling for dotfiles is needed.

Re:Ask HN: What underrated open source project deserves more... by jasonpeacock on Friday March 08, 2024 @03:18PM (#39645860)
I have a work mac, work linux, and home mac. I want the same terminal-based development environment on all of them, but each requires just a little bit of customization.

For example, the .gitconfig for work is different from home (e.g. my username/email). Ditto for my .ssh/config and my shell aliases.

I also use Nix to manage all my tools, and the home-manager configuration is slightly different between mac & linux due to platform support.

I've gone through a few iterations of home-built solutions, including extending homeshick[1], before discovering YADM which implemented everything I had done but better.

[1] https://github.com/andsens/homeshick

Re:Ask HN: What underrated open source project deserves more... by jasonpeacock on Saturday March 09, 2024 @01:54PM (#39653886)
> the once or twice a year that I happen to set up a new machine

This was me for a long time - but then I started using ephemeral (EC2) hosts for remote development, and while I wasn't setting up a new machine frequently, knowing that I could do it with <5min of effort (and 15min of building Nix packages) eliminated a lot of anxiety.

Re:Ask HN: What underrated open source project deserves more... by manx on Monday March 11, 2024 @02:03AM (#39665274)
You can just use git directly, no symlinking required. The home folder doesn't become a git repo itself, the dotfiles are just a checkout from a bare repo: https://www.atlassian.com/git/tutorials/dotfiles
Re:Ask HN: What underrated open source project deserves more... by recursivedoubts on Thursday March 07, 2024 @06:02PM (#39635710)
Re:Ask HN: What underrated open source project deserves more... by meto on Thursday March 07, 2024 @10:07PM (#39637391)
https://pagefind.app/ static site search
Re:Ask HN: What underrated open source project deserves more... by rdtsc on Friday March 08, 2024 @01:13AM (#39638284)
I like https://github.com/pyinfra-dev/pyinfra. "pyinfra automates infrastructure using Python"

Only played with it for a little but it seems well designed an simpler alternative to ansible, chef and other such things.

Re:Ask HN: What underrated open source project deserves more... by Fizzadar on Friday March 08, 2024 @04:23AM (#39639397)
Thank you for posting this! Happy to answer any questions anyone has :)
Re:Ask HN: What underrated open source project deserves more... by rdtsc on Friday March 08, 2024 @10:25AM (#39641882)
Thank you for building it and sharing it!
Re:Ask HN: What underrated open source project deserves more... by ramesh1994 on Friday March 08, 2024 @12:28PM (#39643388)
I just found about this project from this comment, absolutely excited to try this out.

As someone who's never used any of the infrastructure tools, I'm thinking of pyinfra as a way to run shell commands + install dependencies on hosts (declaratively?) on a bunch of hosts via ssh.

Inventory is to sort of take a self-defined inventory on a bunch of hosts?

One final question on usage, would it be possible to sync or reference files from the machine running pyinfra on the remote hosts? Or would that have to be done indirectly via running shell commands to sync?

Re:Ask HN: What underrated open source project deserves more... by Fizzadar on Saturday March 16, 2024 @05:47PM (#39729778)
Missed this comment apologies!

- ops are (mostly) declarative, but some (server.shell) will always execute the command given

- inventory is just that, basically a list of hosts to target plus associated data, docs page: https://docs.pyinfra.com/en/2.x/inventory-data.html

- absolutely for syncing files, check out the files.put and files.template operations (and the files ops in general): https://docs.pyinfra.com/en/2.x/operations/files.html

Re:Ask HN: What underrated open source project deserves more... by theedwood on Friday March 15, 2024 @09:01AM (#39715015)
I’ve used several different IaC tools; Puppet, Ansible, Terraform and Polumi to name a few.

What would you say are key differentiators of PyInfra from these existing projects?

Re:Ask HN: What underrated open source project deserves more... by Fizzadar on Saturday March 16, 2024 @05:53PM (#39729817)
Both Terraform and Pulumi differ slightly I think provisioning cloud resources - pyinfra can be used alongside to setup instances/etc, I’ve used the pyinfra/Terraform combo with great success.

For ansible/chef, etc the main reasons/benefits boil down to:

- instant feedback esp on errors, get the stdout/stderr of whatever command pyinfra was executing, there’s no agent or abstraction to hide it

- configure in python rather than yaml+jinja2 mess

- integrate with the whole python package ecosystem

- speed and small overhead as inventories scale

Re:Ask HN: What underrated open source project deserves more... by rexfuzzle on Friday March 08, 2024 @05:57AM (#39639909)
+1 on this! It's scales amazingly well too!
Re:Ask HN: What underrated open source project deserves more... by AdilZtn on Friday March 08, 2024 @01:25AM (#39638352)
River, online machine learning in python: https://github.com/online-ml/river
Re:Ask HN: What underrated open source project deserves more... by gricardo99 on Friday March 08, 2024 @01:37AM (#39638423)
QCAD[1]

I Used it to create home improvement drawings. bit of a learning curve but very flexible and powerful

1 - https://www.qcad.org/

Re:Ask HN: What underrated open source project deserves more... by igor47 on Friday March 08, 2024 @02:11AM (#39638608)
What I love about qcad is how keyboard-driven it is. Are there other cad programs that I can operate mostly by typing instead of clicking?
Re:Ask HN: What underrated open source project deserves more... by yonatan8070 on Friday March 08, 2024 @03:51AM (#39639219)
There's OpenSCAD, but I don't think it's exactly what you mean

https://openscad.org/

Re:Ask HN: What underrated open source project deserves more... by v64 on Friday March 08, 2024 @01:40AM (#39638439)
https://github.com/BespokeSynth/BespokeSynth

BespokeSynth takes the concept of a modular synthesizer and expands it so that the application is less just a synth and more a complete modular DAW. I've used it to create MIDI/audio workflows that I couldn't get exactly the way I wanted in Ableton or FL Studio. It also has a module for doing livecoded audio processing in Python that I'm just starting to scratch the surface of.

Video from the creator covering I Feel Love in BespokeSynth: https://www.youtube.com/watch?v=kzYUgPMMpts

Re:Ask HN: What underrated open source project deserves more... by RustyRussell on Friday March 08, 2024 @01:46AM (#39638472)
https://tdb.samba.org/

Trivial key/data database with great performance and robustness. Embedded in surprising places (e2fsck!) and my go-to unless I need Sqlite3.

Re:Ask HN: What underrated open source project deserves more... by zubairq on Friday March 08, 2024 @01:47AM (#39638475)
Shameless plug. My own one of course :)

https://github.com/yazz/yazz

Re:Ask HN: What underrated open source project deserves more... by itsgrimetime on Friday March 08, 2024 @01:52AM (#39638503)
https://github.com/decompme/decomp.me

I’ve posted this before but I love it so much I gotta do it again.

You plug in a piece of ASM from a video game ROM, and it gives you a first pass decompilation. On the left hand side you can edit this decompilation, and on the right there’s a side-by-side diff of the target ASM and what your source currently compiles to. It’s slightly gamified, looks great, is super easy to fork/share, and can be pretty addicting once you get into it. Super cool community.

Re:Ask HN: What underrated open source project deserves more... by FloatArtifact on Friday March 08, 2024 @01:53AM (#39638512)
Dragonfly allows for OS interaction with a various recognition engine. A backbone for free and open source accessibility projects. Using it you can create scripts, commands, macros in Python.

https://github.com/dictation-toolbox/dragonfly

Re:Ask HN: What underrated open source project deserves more... by grzaks on Friday March 08, 2024 @02:02AM (#39638553)
Saleor Core: the high performance, composable, headless commerce API

https://github.com/saleor/saleor

Re:Ask HN: What underrated open source project deserves more... by nairboon on Friday March 08, 2024 @02:12AM (#39638615)
Orange Data Mining: https://orangedatamining.com/ A visual programming tool for machine learning and data visualization. It has great potential for teaching these concepts in the classroom.
Re:Ask HN: What underrated open source project deserves more... by mdaniel on Sunday March 10, 2024 @05:27PM (#39662662)
Re:Ask HN: What underrated open source project deserves more... by ssernikk on Friday March 08, 2024 @02:15AM (#39638636)
Photon: https://phtn.app

(Repository: https://github.com/Xyphyn/Photon)

It's the best Lemmy client in my opinion, but not well known in the community.

Re:Ask HN: What underrated open source project deserves more... by Fire-Dragon-DoL on Friday March 08, 2024 @02:37AM (#39638747)
I discovered these 3 amazing projects recently:

Cryptpad, essentially google docs/sheets/forms e2e encrypted. It does include collaboration. https://github.com/cryptpad/cryptpad

Immich, google photos self hostable, with share options https://github.com/immich-app/immich

Nginxproxymanager manages certificates and proxies to self hosted stuff through nginx https://github.com/NginxProxyManager/nginx-proxy-manager

Great self hosting stuff!

Re:Ask HN: What underrated open source project deserves more... by yonatan8070 on Friday March 08, 2024 @03:48AM (#39639190)
I've been using both Immich and Nginx Proxy Manager for a while now, it's the first time that I see Cryptpad, it looks like an awesome tool.

I recently tried the Collabora Online integration in Nextcloud, but was quite disappointed with it, the right-to-left button was greyed out for no apparent reason, and creating shapes and moving then around felt sluggish (clicking the rectangle tool directly added a rectangle in the middle of the slide, which I could then drag around and resize, but the transformation tools seemed buggy and didn't really work well).

I'll certainly try out Cryptpad

Re:Ask HN: What underrated open source project deserves more... by ei23 on Friday March 08, 2024 @01:11PM (#39643968)
I have a bash script for self hosting (mostly docker services). https://github.com/ei23com/diy-smart-home

I can recommend traefik as proxy too

Re:Ask HN: What underrated open source project deserves more... by SulphurCrested on Friday March 08, 2024 @02:40AM (#39638766)
Phil Harvey’s exiftool [0]. Despite being a command-line tool, it is widely known and used by professional and advanced amateur photographers to extract or repair metadata in images. It does handle more than just still images.

It’s written in perl and the perl API for handling the metadata is documented, but I’ve never seen anyone use that directly.

[0] exiftool.org

Re:Ask HN: What underrated open source project deserves more... by TimK65 on Friday March 08, 2024 @03:53AM (#39639231)
I created an account here to say this: Exiftool doesn't only work with image files, either. I use it to extract metadata from audio files as part of a toolchain that creates playlists automatically from my music metadata.
Re:Ask HN: What underrated open source project deserves more... by v3ss0n on Friday March 08, 2024 @02:46AM (#39638810)
Litestar haystack

They are masterpieces

Re:Ask HN: What underrated open source project deserves more... by shp0ngle on Friday March 08, 2024 @02:47AM (#39638826)
Bruno https://www.usebruno.com/

https://github.com/usebruno/bruno

Alternative to postman, that's fully local and syncs to git easily. Unlike hoppskotch and insomnia that are free, but offer paid sync, Bruno just works in git. Unlike others, it doesn't dump JSON that's hard to diff, but has its own easily diffable format. You can share your collections in your existing git, with your existing accounts and PRs.

Also has integrated CLI testing.

He plans to sell GRPC later for money. HTTP and GraphQL API works now. https://www.usebruno.com/pricing

Re:Ask HN: What underrated open source project deserves more... by voxal on Friday March 08, 2024 @04:21AM (#39639387)
> All open-source contributors of Bruno will receive a free license for the Golden Edition. I'm a fan of this idea. I hope we see more attempts to make open source sustainable while still keeping the product accessible like this project.
Re:Ask HN: What underrated open source project deserves more... by Scarlxd on Friday March 08, 2024 @04:11AM (#39639332)
We recently stumbled upon Bruno and it's been great so far. Our team has been exploring alternatives to Postman, and Bruno's recent updates on Oauth2 made it an obvious choice. I hope that more people start using Bruno and contribute to its development.
Re:Ask HN: What underrated open source project deserves more... by boffbowsh on Friday March 08, 2024 @03:05AM (#39638940)
This does deserve more recognition but unfortunately we don’t talk about Bruno
Re:Ask HN: What underrated open source project deserves more... by kalyantm on Friday March 08, 2024 @05:15AM (#39639674)
Haha sick reference.
Re:Ask HN: What underrated open source project deserves more... by jdoss on Friday March 08, 2024 @03:02AM (#39638917)
Thanks for posting this! I did a lot of API work in Python last fall and I was just using curl because, as far as I could tell, none of the other clients (Postman, hoppskotch, insomnia etc) were fully offline.

Bruno looks fantastic and it is only $9 USD for a preorder license right now. That is a pretty good deal to support this work.

Re:Ask HN: What underrated open source project deserves more... by KomoD on Friday March 08, 2024 @07:27PM (#39648166)
All these clients miss something I really want, Protobuf support for regular HTTP/S requests, they all pretty much have Protobuf stuff already from implementing GRPC support
Re:Ask HN: What underrated open source project deserves more... by sanjai0pi on Friday March 08, 2024 @10:55PM (#39649262)
What do you mean? Can you please explain more or raise a GH issue?
Re:Ask HN: What underrated open source project deserves more... by KomoD on Saturday March 09, 2024 @11:56AM (#39652949)
A regular HTTP request with protobuf as the body, load a .proto file, select a message and enter the values
Re:Ask HN: What underrated open source project deserves more... by shp0ngle on Saturday March 09, 2024 @05:25PM (#39655188)
isn't that just grpc?
Re:Ask HN: What underrated open source project deserves more... by shp0ngle on Saturday March 09, 2024 @03:18AM (#39650288)
Bruno doesn't have grpc.
Re:Ask HN: What underrated open source project deserves more... by KomoD on Saturday March 09, 2024 @11:53AM (#39652912)
I never said that it did?

But clearly they're planning to add it.

Re:Ask HN: What underrated open source project deserves more... by Scarlxd on Friday March 08, 2024 @02:50AM (#39638844)
Have you heard of the Bruno project? It's an open-source alternative to subscription-based API testing applications like Postman and Insomnia. It's gaining popularity and deserves more attention. Plus, since it's open-source, users can enjoy full privacy. Check it out at https://github.com/usebruno/bruno.
Re:Ask HN: What underrated open source project deserves more... by buildfocus on Friday March 08, 2024 @02:55AM (#39638873)
https://httptoolkit.com - HTTP debugging proxy with really easy one-click launch to intercept android devices/browsers/docker containers/etc.
Re:Ask HN: What underrated open source project deserves more... by mdaniel on Sunday March 10, 2024 @05:37PM (#39662718)
> docker containers

heh, that's neat: https://github.com/httptoolkit/docker-registry-facade (Apache 2) although the rest of their stuff seems to be AGPLv3 https://github.com/httptoolkit/httptoolkit-android/blob/v1.3...

Re:Ask HN: What underrated open source project deserves more... by pimterry on Monday March 11, 2024 @07:05AM (#39666589)
I'm the maintainer of HTTP Toolkit.

In general the source for core components that can't really be used for anything else is AGPL, but all the generally reusable libraries are Apache 2 or similar. The goal is to share as much as possible, and let everybody access the source for everything, and fork for their own use or submit modifications or whatever, but without the risk that a proprietary product runs off with the core product in a different direction. Seems to be working reasonably so far!

Regarding Docker, you might also be interested in https://github.com/httptoolkit/docker-socks-tunnel (1MB Docker container that runs a socks proxy, for tunnelling traffic between networks) and this detailed breakdown of how the whole Docker interception setup works under the hood: https://httptoolkit.com/docs/guides/docker/#the-technical-de...

Re:Ask HN: What underrated open source project deserves more... by orph on Friday March 08, 2024 @02:58AM (#39638886)
Lilac for dataset cleaning and polishing https://www.lilacml.com/
Re:Ask HN: What underrated open source project deserves more... by dhaavi on Friday March 08, 2024 @03:01AM (#39638909)
Earthly

https://earthly.dev/

Fast, consistent builds with an instantly familiar syntax – like Dockerfile and Makefile had a baby.

Re:Ask HN: What underrated open source project deserves more... by siddheshgunjal on Friday March 08, 2024 @03:02AM (#39638918)
slackker for monitoring your ML model training status in real-time on Slack & Telegram.

https://github.com/siddheshgunjal/slackker

I have also been planning to add discord support soon.

Re:Ask HN: What underrated open source project deserves more... by akavel on Friday March 08, 2024 @03:04AM (#39638927)
Symphytum https://github.com/giowck/symphytum

A small cross-platform personal GUI database app for desktop, with support for images. A modern riff on the idea of MS Access (for those old enough to remember). I think I saw someone claim it's a clone of some Mac app, but I'm not a Mac person so I have no idea if that's true. It's my go-to app when I want to do some shopping research/comparison and collect my results, and I'm not yet sure what fields I will need in the DB. I like it more for that purpose than a spreadsheet.

The repo is archived (unfortunately), but the binary releases work for me for now.

Re:Ask HN: What underrated open source project deserves more... by leejoramo on Friday March 08, 2024 @08:29AM (#39640836)
Judging by the screen shots Symphytum is patterned after Apple/Claris FileMaker https://en.m.wikipedia.org/wiki/FileMaker Which is one of Apple’s oldest products. (Maybe only the Macintosh itself has had a longer run, although the history is a little complicated)
Re:Ask HN: What underrated open source project deserves more... by lardissone on Tuesday March 19, 2024 @10:05AM (#39755852)
For macOS/iOS there's a nice database app I use for different things called Collections https://collectionsdb.com

It's really good, I use it with Shortcuts and saves me a bunch of time on small things that I don't want to create an app for this.

Re:Ask HN: What underrated open source project deserves more... by natmaka on Friday March 08, 2024 @03:04AM (#39638933)
"PostgreSQL utility for creating a small, sample database from a larger one"

https://github.com/mla/pg_sample

Re:Ask HN: What underrated open source project deserves more... by loa_in_ on Friday March 08, 2024 @03:05AM (#39638937)
Concise Encoding https://github.com/kstenerud/concise-encoding/

It's a specification for a family of data exchange formats with most complete feature list but little to no recognition

Re:Ask HN: What underrated open source project deserves more... by Modified3019 on Friday March 08, 2024 @03:08AM (#39638953)
Two projects I greatly appreciate, allowing me to easily archive my bandcamp and GOG purchases (after the initial setup anyways):

https://github.com/easlice/bandcamp-downloader

https://github.com/Kalanyr/gogrepoc

And I recently learned about archivebox, which I think is going to be a fast favorite and finally let me clear out my mess of tabs/bookmarks: https://github.com/ArchiveBox/ArchiveBox

Re:Ask HN: What underrated open source project deserves more... by jdoss on Friday March 08, 2024 @03:10AM (#39638966)
This has been posted a few times already, but I cannot tell you how life changing Paperless NGX is for organizing PDFs. As someone who wrangles all of the insurance and bills for my house, this open source software is so damn good.

https://docs.paperless-ngx.com/

I maintain Bash script to quickly set it up locally on Linux with Podman. Give it a spin if you want to kick the tires.

https://github.com/jdoss/ppngx

Re:Ask HN: What underrated open source project deserves more... by ei23 on Friday March 08, 2024 @01:07PM (#39643916)
my script also has paperless-ngx included https://github.com/ei23com/diy-smart-home
Re:Ask HN: What underrated open source project deserves more... by sandreas on Tuesday March 12, 2024 @03:41AM (#39677075)
pretty neat stack... I chose other projects in some cases (e.g. ntfy vs gotify) but all in all it's pretty complete. Thanks.

Did you consider watchtower to keep the dockers up to date?

Re:Ask HN: What underrated open source project deserves more... by ei23 on Tuesday March 12, 2024 @04:19AM (#39677259)
thanks for the tip! Not tried watchtower yet since i just have to click an update button and a background task in "screen" will be start a docker pull of the full stack and also clean up. Also have that for the host. I don't now what watchtower is doing better, but since some project come with breaking changes i need to decide when to update... Anyway update notifications are nice to have.
Re:Ask HN: What underrated open source project deserves more... by arwalk on Friday March 08, 2024 @03:15AM (#39638989)
Cosmopolitan https://github.com/jart/cosmopolitan and https://justine.lol/cosmopolitan/index.html

Some genius realized that you can actually embed valid win32 programs inside valid posix shell scripts, and found a way to make a C cross-platform solution out of it, meaning that you can write C programs that compile to a single executable that will run on (quoting the site) Linux + Mac + Windows + FreeBSD + OpenBSD + NetBSD + BIOS

It all started from this post.

Re:Ask HN: What underrated open source project deserves more... by arwalk on Friday March 08, 2024 @03:16AM (#39638997)
Missing post in previous comment, sorry. https://justine.lol/ape.html
Re:Ask HN: What underrated open source project deserves more... by t-rflcf on Friday March 08, 2024 @05:36AM (#39639804)
A truly excellent project
Re:Ask HN: What underrated open source project deserves more... by xet7 on Friday March 08, 2024 @05:09PM (#39647120)
Agreed. I'm trying to use it at https://github.com/wekan/wekanstudio . Contributions very welcome.
Re:Ask HN: What underrated open source project deserves more... by landgenoot on Friday March 08, 2024 @03:15AM (#39638990)
Open streetmap

I'm so amazed by the amount of problems that can be solved by using this data.

Need to find out the nearest drinking water tap. They got you covered.

Need to know how you can enter a particular subway station as a blind person? The data should be there. Including traffic lights with audible feedback.

Want to charge your ebike at your destination? Find type of bicycle rack and the availability of power outlets.

Need to mail a letter? The collection time of the nearest post box is there.

Planning a trip? The access fee of an attraction is documented.

Need to find a gate at any airport. ...

Re:Ask HN: What underrated open source project deserves more... by McDyver on Friday March 08, 2024 @03:44AM (#39639165)
I would also mention Street Complete, as the companion app to contribute all that data.

https://github.com/streetcomplete/StreetComplete

Re:Ask HN: What underrated open source project deserves more... by uneekname on Friday March 08, 2024 @10:34AM (#39641980)
StreetComplete is fabulous, and another surveying app worth mentioning is Every Door [0] which is specifically focused on updating business and other POI details.

[0] https://every-door.app/

Re:Ask HN: What underrated open source project deserves more... by uneekname on Friday March 08, 2024 @10:32AM (#39641954)
Quick plug for the OpenStreetMap community, too. Online or in-person, there are so many active mapping groups. I started one in my city last year and it's been an awesome way to meet with like-minded folks and feel like we're making an impact on others' lives. Check out the OSM Community Index [0], or the (multilingual) Discourse [1], or feel free to reach out to me if you want to learn more about engaging with OSM!

[0] https://openstreetmap.community/

[1] https://community.openstreetmap.org/

Re:Ask HN: What underrated open source project deserves more... by parthjainpj1994 on Saturday March 16, 2024 @07:45PM (#39730472)
So i am hearing about Open street map for the first time. Can someone explain a bit more about it and how can i use it in day today life.
Re:Ask HN: What underrated open source project deserves more... by yonatan8070 on Friday March 08, 2024 @04:21AM (#39639389)
JTX Board, it's an Android app for tasks, notes, and journals, it uses iCalendar to store all the data, and integrates with DAVx⁵ to sync your data to any CalDAV server, such as Nextcloud, so you can see your tasks in the Nextcloud web app, and automaticlly sync them to your PC.

I use the Nextcloud app on my KDE Plasma laptop, and it works perfectly, I only realized this works when reminders started magically showing up on my laptop without me needing to set anything up

https://jtx.techbee.at/ https://www.davx5.com/ https://nextcloud.com/

Re:Ask HN: What underrated open source project deserves more... by steph-123 on Friday March 08, 2024 @04:23AM (#39639401)
x-cmd is a great CLI that I've been using lately. It's very lightweight (not exceeding 1.1MB), yet packed with numerous features. It provides a range of interactive CLI tools, currently boasting over 100 modules and close to 500 packages.
Re:Ask HN: What underrated open source project deserves more... by nyaruko on Friday March 08, 2024 @07:12AM (#39640346)
It's quite a pleasant surprise to see other x-cmd users here. Indeed, x-cmd has proven its worth. I've successfully replaced my previous setup, including the oh-my-zsh theme and various version managers like pyenv and nvm, with x-cmd on my machine. It's streamlined my workflow considerably.
Re:Ask HN: What underrated open source project deserves more... by jerry8hero on Friday March 08, 2024 @04:51AM (#39639554)
nice recommendation ~
Re:Ask HN: What underrated open source project deserves more... by steph-123 on Friday March 08, 2024 @10:32AM (#39641962)
Re:Ask HN: What underrated open source project deserves more... by qbbsh on Friday March 08, 2024 @12:19PM (#39643279)
A awesome project !!!
Re:Ask HN: What underrated open source project deserves more... by lijunhao on Friday March 08, 2024 @12:38PM (#39643509)
55 stars only in Github. I am wondering what's wrong with it.
Re:Ask HN: What underrated open source project deserves more... by em-bee on Friday March 08, 2024 @04:26AM (#39639411)
20 years ago i discovered a project by a university in germany that implemented a well thought through object storage with connections to all sorts of messaging protocols.

it was used as a platform to research collaboration models.

fortunately, at the time some german academic institution offered grants to universities for publishing their projects as Free Software or Open Source, and so this platform was released under the GPL.

what is interesting about the platform is that it not only stores objects like say mongodb, but it also implements user and group management, a hierarchical access control system down to the object level, and messaging. further messaging implements pretty much all communication protocols out there: IRC, XMPP, SMTP, IMAP, and of course HTTP, FTP and more. and no, to get these it does not require a bridge to independent implementations of those protocols, but they are implemented natively into the server, and SMTP or IMAP or the webinterface will all directly access the same stored object.

what's more, the platform allows you to upload your own modules to extend it, which are stored in its object object storage, and can be updated at runtime. it has been used by the university to host various courses for more than 10000 users all handing in assignments at the same time.

i have been using this platform for my own websites pretty much ever since.

the university stopped development on the project more than a decade ago, but i forked it, and eventually added a REST API and implemented multi domain hosting on it so that i could serve multiple websites from the same service.

the code is old, and needs updating. TLS support is outdated, which is something that needs to be fixed before the project can be recommended to anyone else. the built in web templating system is using XSLT, which should be replaced with easier to use alternatives (or simply ignored, as as i do, by building all websites as SPA using the REST API instead. the REST API too, should be updated or replaced by GraphQL.

but aside from these problems the platform is usable like Backend As A Service. ever since adding the REST API, i have not done any custom backend coding, as the platform already provides any features i have ever needed.

the challenge throughout all this time has been to get other developers interested in using such a platform, instead of building yet another CRUD backend from scratch.

i don't currently have time to do any work on it (even its website is down), as i need to focus on paid engagements, but i have not given up hope to be able to revive it and make it popular some day.

Re:Ask HN: What underrated open source project deserves more... by mharig on Friday March 08, 2024 @05:59AM (#39639923)
Pushing the code to github might be a good starting point?
Re:Ask HN: What underrated open source project deserves more... by em-bee on Friday March 08, 2024 @07:17AM (#39640376)
it's there (and on gitlab, where i prefer to work), but there are so many projects on there, that doesn't really help discovery.
Re:Ask HN: What underrated open source project deserves more... by tetris11 on Friday March 08, 2024 @07:51AM (#39640599)
link please
Re:Ask HN: What underrated open source project deserves more... by em-bee on Friday March 08, 2024 @10:57AM (#39642240)
please email me. see profile.
Re:Ask HN: What underrated open source project deserves more... by redder23 on Saturday March 09, 2024 @01:53AM (#39649969)
So you think this does not get enough attention, but you keep it secret? Makes zero sense.
Re:Ask HN: What underrated open source project deserves more... by em-bee on Saturday March 09, 2024 @03:33AM (#39650350)
if you are interested, you can contact me. otherwise i'd like to avoid de-anonymizing my hackernews account.
Re:Ask HN: What underrated open source project deserves more... by mdaniel on Sunday March 10, 2024 @06:23PM (#39662994)
I hear you, but for your consideration people create throwaway HN accounts all the time for commenting on sensitive topics, and thus one created to submit a link to GitLab for sure wouldn't stand out as belonging to you
Re:Ask HN: What underrated open source project deserves more... by em-bee on Monday March 11, 2024 @12:48AM (#39664997)
yes, i could have done that. but to late now.
Re:Ask HN: What underrated open source project deserves more... by novoreorx on Friday March 08, 2024 @07:29PM (#39648174)
I may be able to contribute, what language is it written in?
Re:Ask HN: What underrated open source project deserves more... by ensocode on Friday March 08, 2024 @04:42AM (#39639502)
Looks fantastic. Always wanted to switch to an alternative to postman. But as my clients all work with postman collections I never really had the chance to switch.
Re:Ask HN: What underrated open source project deserves more... by moooo99 on Friday March 08, 2024 @05:04AM (#39639615)
The entire KDE project, which not only includes the Plasma Shell but also Projects like Krita [0] and Kdenlive [1] and some other great applications that work cross platform.

[0] https://krita.org/en/

[1] https://kdenlive.org/de/

Re:Ask HN: What underrated open source project deserves more... by ludovicianul on Friday March 08, 2024 @05:29AM (#39639752)
Rest API fuzzing with minimal configuration: https://github.com/Endava/cats
Re:Ask HN: What underrated open source project deserves more... by throwaway38375 on Friday March 08, 2024 @05:29AM (#39639753)
Re:Ask HN: What underrated open source project deserves more... by mdaniel on Sunday March 10, 2024 @05:57PM (#39662828)
Heh, what a name for a DB explorer ("Adminer - Database management in a single PHP file"; Apache 2 or GPLv2 https://github.com/vrana/adminer/blob/v4.8.1/readme.txt#L7 )
Re:Ask HN: What underrated open source project deserves more... by aarvi on Friday March 08, 2024 @06:00AM (#39639924)
glibc. Stop this and the world will come to a halt real quick.
Re:Ask HN: What underrated open source project deserves more... by mmsimanga on Friday March 08, 2024 @06:13AM (#39639993)
https://art.sourceforge.net/

Business intelligence tool. Not the prettiest but it is like one of those all in one types of tools. Can connect to any data source that has JSBC driver and most databases have a JDBC driver. Reports can be simple SQL scripts, groovy code, JasperReport or created used Excel, Word or PowerPoint. You can schedule extracts and FTP files ... It is a developers BI tool.

Re:Ask HN: What underrated open source project deserves more... by farhadhf on Friday March 08, 2024 @07:09AM (#39640328)
I've been using KumoMTA for the past 3 months and it's one of the most well thought-out, stable and fast softwares I've ever used.

https://kumomta.com/ https://github.com/KumoCorp/kumomta

Re:Ask HN: What underrated open source project deserves more... by tetris11 on Friday March 08, 2024 @07:54AM (#39640623)
xmllint, for parsing any XML/HTML file using XPaths all from the commandline
Re:Ask HN: What underrated open source project deserves more... by mdaniel on Sunday March 10, 2024 @05:55PM (#39662814)
Also, don't overlook xmlstarlet (MIT https://sourceforge.net/p/xmlstar/code/ci/1.6.1/tree/Copyrig...) which I love bunches because one can execute super complicated XSLT things, then tack the -C on the front of the invocation and it'll cheerfully emit the XSLT syntax for what you just did <https://xmlstar.sourceforge.net/doc/UG/ch04.html#idm47989546...> It has a ton of other fun tricks, too: https://xmlstar.sourceforge.net/overview.php
Re:Ask HN: What underrated open source project deserves more... by JeremyNT on Friday March 08, 2024 @08:57AM (#39641086)
Nebula, originally from Slack [0].

Wireguard rightly gets a lot of attention, but Nebula is a really simple and easy to deploy overlay network that is often overlooked.

It does lack a management GUI and that stuff is very much DIY.

[0] https://github.com/slackhq/nebula

Re:Ask HN: What underrated open source project deserves more... by arwalk on Sunday March 10, 2024 @07:28PM (#39663358)
I've been looking for a long time for a VPN solution that i can use without having to rely on third-party services for my home lab, and this is absolutely excellent. Sure it has no GUI but if you're already self-hosting stuff this is among the easiest thing i ever had to configure. Thanks!
Re:Ask HN: What underrated open source project deserves more... by alok-g on Friday March 08, 2024 @09:17AM (#39641234)
FreeFileSync

https://freefilesync.org/

I have been a happy user for years and have made a donation too.

Re:Ask HN: What underrated open source project deserves more... by mdaniel on Sunday March 10, 2024 @05:50PM (#39662792)
It imposes limitations on how one can use it https://freefilesync.org/faq.php#commercial which I don't believe squares up with its GPLv3 license. Between that, and there being no obvious response to any of the submitted patches or bug reports in the forum, I'd guess this is "fork-only open source" ala sqlite

  $ curl -fsSLO https://freefilesync.org/download/FreeFileSync_13.4_Source.zip
  $ unzip -qc FreeFileSync_13.4_Source.zip License.txt | head
  A.                  GNU GENERAL PUBLIC LICENSE
                         Version 3, 29 June 2007
Re:Ask HN: What underrated open source project deserves more... by jasomill on Friday March 08, 2024 @09:55AM (#39641572)
qpdf[1], and, in particular, libqpdf, is possibly the most useful PDF tool I've ever used, because it was the first library I found that works at the proper level of abstraction for dealing with the PDF file format on its own terms.

In other words, the library directly exposes the essential PDF object structure (pages, dictionaries, strings, numbers, streams, etc.) for easy editing, while abstracting away as much of the incidental PDF file structure as possible (encryption, compression, object references, the page tree structure, etc.).

Among many other applications, I've used it to

• Automatically repair minor PDF file format problems (of the sort that would be fixed by Open + Save in Acrobat).

• Concatenate multiple PDFs into a single PDF, adding a bookmark to the first page of each, with the bookmark title derived from information not contained within the PDFs or their file names.

• Losslessly reduce the size of PDFs in not-entirely-trivial ways. For example, I was given a ~1 TB set of PDFs that stored 1-bit monochrome scanned images as losslessly-compressed (RLE, LZW, or flate) 24-bit color images with every pixel either 0x000000 or 0xFFFFFF, but also stored color and grayscale images in the same way, and included important non-image data. libqpdf made it easy to loop through each PDF file, extract and analyze the pixel data for each image, and replace relevant images with JBIG2-compressed "true" 1-bit equivalents without otherwise modifying the PDF.

• Lossily recompress large images embedded in PDFs, but only if they matched certain criteria. Specifically, I had a large number of PDFs that contained lots of lossless high-DPI 4K screenshots of a specific application, where even relatively high JPEG compression maintained legibility, interspersed with images where such recompression was undesirable (photos, document scans, 1080p screenshots).

• Create PDFs by overlaying plain text on PDF forms — "paper" forms defined by PDFs, not PDF forms — without duplicating form content for each page.

[In the above examples, JPEG and JBIG2 compression was performed with other libraries, as these are out-of-scope for libqpdf itself.]

[1] https://qpdf.sourceforge.io

Re:Ask HN: What underrated open source project deserves more... by fuzztester on Saturday March 09, 2024 @02:39PM (#39654167)
Interesting.

I must check out qPDF.

Have you tried out muPDF?

I have not, yet, but it looks interesting too.

mupdf.com

https://artifex.com/company

Re:Ask HN: What underrated open source project deserves more... by devinprater on Friday March 08, 2024 @10:12AM (#39641735)
I'd say Orca, the Linux GUI screen reader:

https://gitlab.gnome.org/GNOME/orca

This is, besides the underlying ATSPI and other API's and toolkits, how blind people access Linux. I think it could always use more eyes or hands.

Re:Ask HN: What underrated open source project deserves more... by ei23 on Friday March 08, 2024 @12:56PM (#39643738)
I have a full list: https://ei23.com/opensource

So many great projects!

Re:Ask HN: What underrated open source project deserves more... by em-bee on Friday March 08, 2024 @03:07PM (#39645728)
which of these are underrated and deserve more recognition?
Re:Ask HN: What underrated open source project deserves more... by ei23 on Monday March 11, 2024 @07:35PM (#39674427)
I think only some are underrated, such as PiperTTS, Immich, HeidiSQL, and ShotCut. Also small tools like rsync are widely used, but their maintainers often don't receive much appreciation, as these tools are as common as hammers and screwdrivers. They need some love, thats why i have this list.
Re:Ask HN: What underrated open source project deserves more... by novoreorx on Friday March 08, 2024 @01:25PM (#39644177)
Django Ninja [1], it forever changed how I write Django project, in a way so elegant and productive.

[1]: https://django-ninja.dev/

Re:Ask HN: What underrated open source project deserves more... by c0mbonat0r on Friday March 08, 2024 @01:56PM (#39644652)
theres a github repo somewhere of open source equivalents to paid software - anyone know what im talking about? i havent been able to find it since i saw it
Re:Ask HN: What underrated open source project deserves more... by mdaniel on Sunday March 10, 2024 @06:02PM (#39662864)
I see that you said github repo, but my life experience has been that those "awesome" style repos are committed to once and then ignore all pull requests or issues going forward. Thus, I think the audience would be better served by AlternativeTo or one of its ilk, which offers a licensing filter on their lists (e.g. https://alternativeto.net/software/github/?license=opensourc... )

But, a quick search for alternative coughed up a few results, which exhibit the behavior I described https://github.com/RunaCapital/awesome-oss-alternatives#awes... https://github.com/btw-so/open-source-alternatives?tab=readm...

One may also find more via topic exploration, e.g. https://github.com/topics/alternatives

Re:Ask HN: What underrated open source project deserves more... by mtooth on Friday March 08, 2024 @05:29PM (#39647284)
pdu: https://github.com/KSXGitHub/parallel-disk-usage

Great compliment to ncdu for a single-view disk report and blazing fast.

Re:Ask HN: What underrated open source project deserves more... by sandreas on Friday March 08, 2024 @05:38PM (#39647363)
There are so many...

atldotnet - Extremely versatile audio tagging library for C#

LocalSend - UI Tool to share files everywhere

Thorsten-Voice - A FOSS Voice Dataset for german language (e.g. coqui-tts)

LVGL - Light versatile embedded graphics library

zincsearch - ElasticSearch compatible Fulltext engine

Obtainium - Open Source Android App Updater

OCRmyPDF - OCR Layer for PDFs

FunKey-S - Open Hardware / Software Gaming Handheld (incl. PCB and Buildroot OS)

logseq - Personal Information Manager (like Obsidian)

fq - jq for binary formats

OperationResult - Rust style error handling for C#

BoofCV - Java Computer Vision library

Re:Ask HN: What underrated open source project deserves more... by t0bia_s on Sunday March 10, 2024 @01:37AM (#39657183)
https://iode.tech/

IodéOS is custom ROM build on LineageOS with hardened privacy.

Re:Ask HN: What underrated open source project deserves more... by Cloudef on Sunday March 10, 2024 @04:28AM (#39657609)
Re:Ask HN: What underrated open source project deserves more... by tomcam on Monday March 11, 2024 @02:05AM (#39665281)
Incredible batteries-included Python web framework

https://py4web.com

Re:Ask HN: What underrated open source project deserves more... by amai on Monday March 11, 2024 @05:09PM (#39673257)
A LaTeX successor: https://typst.app/
Re:Ask HN: What underrated open source project deserves more... by jnsnco on Monday March 18, 2024 @07:34PM (#39751351)
Fireproof

https://use-fireproof.com/

Pure JS embedded Document DB, no setup or config. e2e encryption, CRDT support. Build, prototype, iterate without a backend, plug into any cloud when you’re ready

[disclaimer: I’m part of the team working on this]

Re:Ask HN: What underrated open source project deserves more... by ikanny on Tuesday March 19, 2024 @12:07AM (#39752856)
webview-bridge https://github.com/gronxb/webview-bridge It's necessary when you build react native app with webview.
Re:Ask HN: What underrated open source project deserves more... by whereas445 on Tuesday March 19, 2024 @12:16AM (#39752901)
+1 for this. currently using this for my project and it works like a charm!