News for hackers. Stuff that matters.
Re:Launch HN: Lume (YC W23) – Generate custom data integrati... by nmachado on Monday March 20, 2023 @12:30PM (#35234105)
Yes, we are using an LLM for some parts of the code generation, specifically GPT-4. In the medium-term, we plan to go lower in the stack and have our own AI model. We broke down the process into modular steps to only leverage LLMs where it's most needed, and use rule-based methods in other parts of the process (e.g. in fixing compilation errors). This maximizes the accuracy of the transformations.
Re:Launch HN: Lume (YC W23) – Generate custom data integrati... by Avicebron on Monday March 20, 2023 @12:35PM (#35234199)
Do you have some sort of automatic test suite for what's generated by the LLM prior to release? Just to ensure what it returns won't break downstream?
Re:Launch HN: Lume (YC W23) – Generate custom data integrati... by robert-te-ross on Monday March 20, 2023 @01:19PM (#35235028)
Yes, internally, we have separate models that produce tests the final data has to pass before being presented to the user. In addition, you can define your own tests on the platform, and we will ensure transformations produced will pass those tests before deployment. We also have helpful versioning and backtesting features.
Re:Launch HN: Lume (YC W23) – Generate custom data integrati... by btbuildem on Monday March 20, 2023 @11:43PM (#35242315)
Modular use of an LLM over a problem-specific workflow skeleton is the winning ticket. Nicely conceptualized!