Re:A lot of complex “scalable” systems can be done with a si...
by hnews_account_1 on Monday December 30, 2019 @05:58PM
(#21917459)
I'm open to using any db that I can query over some engine with a python implementation. So any SQL db should be fine. However, I don't know how to convert a csv to an SQL directly. Is the command you mentioned part of some SQL server package? Sounds like it's exactly what I need.
[ Parent
| on HN ]
Re:A lot of complex “scalable” systems can be done with a si...
by nwallin on Monday December 30, 2019 @10:15PM
(#21918681)
pandas can read from a CSV file and then write to SQL. Even if you don't go the SQL route, you'd probably gain significant benefits by working with HDF instead of CSV.
https://pandas.pydata.org/pandas-docs/version/0.22/generated...
https://pandas.pydata.org/pandas-docs/version/0.22/io.html#w...