News for hackers. Stuff that matters.

jpiech

Show HN: GS-Base – A multifunctional database tool with Python integration

https://citadel5.com/gs-base.htm

A wide range of possible use: from simple contact/inventory lists, photo albums to editing CSV/text files and processing (transforming, splitting, merging, normalizing) large, multi-GB data tables in various file formats.Text, Numeric, Long Text / Memo fields, Image / File fields; Code fields for code snippets with syntax highlighting for 16 programming languages.You can analyze, query and...

( Read More... | no comments | 2 points | on HN )

Show HN: GS-Base – A multifunctional database tool with Python integration

https://citadel5.com/gs-base.htm

A wide range of possible use: from simple contact/inventory lists, photo albums to editing CSV/text files and processing (transforming, splitting, merging, normalizing) large, multi-GB data tables in various file formats.Text, Numeric, Long Text / Memo fields, Image / File fields; Code fields for code snippets with syntax highlighting for 16 programming languages.You can analyze, query and...

( Read More... | no comments | 2 points | on HN )
Re: on Tuesday April 29, 2025 @05:43AM (#43830434)
Thank you. The current integration is described in the online HTML GS-Calc help. Any suggestions would be highly appreciated.
Re: on Sunday April 27, 2025 @06:52AM (#43810963)
Yep, the website is being kept simple, in fact too simple and will have to be eventually redesigned. It seems the classic (and actually up to date) WinAPI GUI shouldn't imply the software is being "slow". One could have it both ways and say it's usually on the contrary where commonly cloned packages weighing hundreds of MB and performing relatively simple tasks get a free ride on users' ten(s) of times faster hardware. Then there is the Wirth's law, May's law etc.
Re: on Saturday April 26, 2025 @07:03PM (#43808040)
This is a potentially interesting feature - it probably could be relatively easily extended to the shared environment in GS-Calc as there are already separate passwords to protect files, the sheet/view structures and cell ranges and optional sha256 checksums for all the data categories, but there no plans as such. At the moment you can just use two script commands to release the opened file, periodically check whether it's modified, report it and automatically reload the file.
Re: on Saturday April 26, 2025 @03:58AM (#43801745)
Thanks. Yes, that was put off a bit too long, but there are plans to come up with the multiplatform version this year.
Re: on Friday April 25, 2025 @07:06PM (#43799319)
Thanks. This is just a set of features that offer better (sometimes significantly better) performance and make it possible to work with large data sets in some predictable way, that is, knowing what the performance is with 100K formulas, you should be able to estimate how it'll work with 10 millions no matter how much formatting is applied, added hyperlinks, links to external closed workbooks, lists etc. That is probably correct, in the upcoming years there might be no way to compete directly with (the standalone) Excel. Hopefully it just helps to perform or verify various things way faster than in Excel with add-ins (or often at all).
Re: on Friday April 25, 2025 @04:34PM (#43798248)
Fully adaptable to every database need, ranging from a household list to the personnel or inventory records of a large corporation. You can analyze, query, perform calculations, merges and joins with up to 256 million rows, 16K columns and 4GB+ files efficiently using even old PC's.

If you are new to database technology, don't worry - GS Base lets you start small and, without any extra cost, increase functionality as you need it.

You can perform both simple and complex record filtering, searching for duplicates, for unique values and frequencies, full-text searches, find-as-you-type, fuzzy searches, searching quartiles, random searches, one-click statistical breakdown analysis and link GS-Base UDF function in calculated fields with your Python libraries. You can use unlimited in-cell charts to spot trends and analyze largest data sets using pivot tables with up to 256 million rows and a broad selection of pivot data functions.

GS-Calc can be helpful, for example, to:

* process large (e.g. 4GB+) data sets in a spreadsheet;

* load GB/32 million-row files in seconds and use them without any crashes;

* load/edit in-place/split/merge/clean CSV/text files with up to 32 million rows and 1 million columns;

* use your Python functions as UDF formulas that can return to GS-Calc images and entire CSV files;

* use a set of statistical pivot data functions;

* create and display all popular chart types with millions of data points instantly.

Suggestions for improvements are welcome (and often implemented quite quickly).

Show HN: A spreadsheet-like program to handle any data and files of any size

https://citadel5.com/gs-base.htm

New features added recently:[+] The "Text File Input Filters" have been added to enable processing of CSV / text files of any size with any number of rows regardless of the amount of RAM in a computer. Filters can use RegEx patters, the popular relations, ranges and fuzzy filters.https://citadel5.com/help/gsbase/open_text_file.pngFor example, in GS-Base you can load this (publicly available)...

( Read More... | no comments | on HN )

Show HN: A Database and an ETL Tool

https://citadel5.com/gs-base.htm

GS-Base is a database designed to keep things as simple as possible and the same time to make the most of the (even old) hardware. With the generic set of UI commands and functions you can perform virtually any data operations/transformations without programming (though scripting is available as well to automate most of the tasks).The "native" file format is just a zipped collection of CSV...

( Read More... | no comments | on HN )

Show HN: GS-Calc – a spreadsheet with 12 million rows

https://citadel5.com/gs-calc.htm

A spreadsheet with 12 million rows, fast binary lookup functions with automatic internal background sorting of searched ranges, built-in Monte Carlo simulations, regex filtering and data transformations and with workbook (zip64) files of any size (4GB+).Previously: https://news.ycombinator.com/item?id=36044691Now, among others, with 16K columns, MySQL .sql and SQLite3 .db file support. For...

( Read More... | no comments | on HN )
With GS-Base you can perform virtually any data (especially text/CSV files) transformations, making the most of your hardware.

[+] Up to 256 million records in one table.

[+] Text, Numeric, Long Text / Memo fields, Image/Files fields, Code fields for code snippets with syntax highlighting for many programming languages.

[+] The underlying zip64/zip32 file format enables you to browse and edit GS-Base databases without the program.

[+] Versatile record filtering methods, searching for duplicates and for unique values, search-as- you-type, full-text searches, fuzzy searches, random searches, quartile searches and one-click statistical breakdown analysis.

[+] Around 300 built-in calculation function used for calculated fields, data conversion and validation.

[+] Pivot tables with up to 256 million records and over 2,000 columns.

[+] Definable number (1 to 100) of processor cores used for field and pivot table calculations.

[+] Many options for splitting/merging text/xlsx/xls files.

[+] Support for the text, dBase/Clipper/FoxPro, MySQL (*.sql), HTML formats.

[+] GS-Base can be installed on any portable storage device and used without performing any registry modifications.

Re:Show HN: GS-Calc – a spreadsheet with 12M rows on Wednesday May 24, 2023 @11:18AM (#36059334)
BTW, data tables exceeding 12 million rows can be handled by a companion database program GS-Base ( https://citadel5.com/gs-base.htm ). It's a database with spreadsheet functions. Uses up to 256 million records/rows including data types same as in GS-Calc and binary fields: Long Text, Images/Files, Code (for code snippets with syntax highlighting for 16 languages). It uses the same type of calculations within one and more tables but in this case, they record/row based.
Re:Show HN: GS-Calc – a spreadsheet with 12M rows on Tuesday May 23, 2023 @03:31PM (#36049631)
Thanks. Actually, it's easy to overlook this at first but splitting views also maximizes the working area, e.g.: (1) click the table toolbar and chose to hide it, (2) right click a given split view and hide row and/or column headings, (3) right click that view and hide the vertical and/or horizontal scrollbars. In the "View" menu you can also minimize the width of the splitter line. What's left in the view are only cells. You can have up to 99 individually resized and individually synch. views of various regions of the same worksheet or any other worksheet in the same workbook (View > Choose Worksheet) per window.

Re: the "Open with" menu for other file types, it should be done automatically once you set the file association (Windows might require the installation folder not to be account-restricted).

Re:Show HN: GS-Calc – a spreadsheet with 12M rows on Tuesday May 23, 2023 @12:21PM (#36046524)
As a matter of fact, if someone owns the system, competing on equal terms (or at all) is impossible. Re: the Linux, it's tempting for a couple of reasons, but potential user base seems to be a problem (at the moment).
Re:Show HN: GS-Calc – a spreadsheet with 12M rows on Tuesday May 23, 2023 @11:48AM (#36046072)
Unfortunately, even for fast NVMe SSDs random access to cells (which determines the performance) can't compare to RAM. In the example above these 0.5 billion cells can still be fully loaded to 16GB RAM, but adding further such worksheets will cause spooling and noticeable slow down.
Re:Show HN: GS-Calc – a spreadsheet with 12M rows on Tuesday May 23, 2023 @11:40AM (#36045916)
For various internal indexing purposes, it's more convenient to use powers of 2 or their multiplicities. While "no limits" is doable it would have some impact on the performance and would require a bit more complex UI for the column-oriented editing actions (which might not necessarily be worth it).
Re:Show HN: GS-Calc – a spreadsheet with 12M rows on Tuesday May 23, 2023 @11:33AM (#36045802)
Thanks. It's C++, mostly with custom template classes instead of the STL.

Show HN: GS-Calc – a spreadsheet with 12M rows

https://citadel5.com/gs-calc.htm

Loading a 4GB+ workbook with over 500 million cells with random floating-point numbers and text strings - 8 worksheets, ~12 million rows each should take less than 30s on a computer with 16GB RAM.Updating 12 million vlookups searching 12 million rows takes seconds.Effective use of up to 64 processor cores for calculations applying any functions, including any number of user-created functions...

( Read More... | 11 comments | 3 points | on HN )