Re:Ask HN: Those with success using GPT-4 for programming – ...
by bredren on Monday May 22, 2023 @07:36PM
(#36038061)
What kind of memory efficiency gains did you see as a result of the effort?
[ Parent
| on HN ]
Re:Ask HN: Those with success using GPT-4 for programming – ...
by vitorbaptistaa on Wednesday May 24, 2023 @06:51AM
(#36056236)
I didn't keep track of the benchmarks very well. However, it went from taking 3+ days and 180GB of memory to process 80M rows [1] to processing 1.3B rows in ~6 hours using ~90GB of memory.
[1] I stopped the process early, as it was taking too long