SdtEE
Later I find the technique I developed to instantly load arbitrary large CSV files can be generalized to work with any format, with an incremental parser combinator. This means the tool can read from not only files, but any stream-oriented sources like a pipe.
I did used AI in development but it didn't speed up the process very much, as I found a lot of time was spent on the deign of an intuitive and consistent UX. The project is still not very production ready, but in case anyone is interested: https://github.com/Verticalysis/Hitomi
https://github.com/Verticalysis/Hitomi
The secret: I engineered an incremental combinatorial parser capable of processing customized format from a steam. Any inputs, including file or the stdout from a command, are first chunked and then fed to the pipeline. The UI is ready when the first small chunk is processed.
Other highlights: 2-mode filter, one with a convenient UI and the other is based on an extensible DSL for complex cases;
Timeline mode scrollbar, a secret weapon for log or time series analysis;
Column widths fit to content automatically;
Native code, no web bloat;
Cross-platform (currently Windows and Linux, MacOS WIP).
If you are tired of all the quirks Excel have when working with CSV files, you'll gonna love it!