News for hackers. Stuff that matters.

wpride

Re:Understanding LangChain Basic Concepts on Tuesday July 11, 2023 @06:35PM (#36688172)
We do, but mostly as a fairly nice and fairly well-documented interface for plugging together tools like vector DBs and memory with LLMs.

My feeling is that with the agentic/AutoGPT hype fading and OpenAI adding the functions API there's a lot less value in LangChain's abstractions, at least for production use cases. They're still cool for hacking/toys.

Re:Generating SQL with LLMs for fun and profit on Thursday June 22, 2023 @09:09PM (#36441477)
Maybe "complaint" was the wrong word but I disagree with the conclusion that LLMs are "not for trustworthy production systems" for the reasons I stated.

Full disclosure, I wrote a blog post called "Text to SQL in Production." Maybe I should add a follow-up covering our guardrails. I agree that they are necessary.

https://canvasapp.com/blog/text-to-sql-in-production

Re:Generating SQL with LLMs for fun and profit on Thursday June 22, 2023 @08:46PM (#36441280)
What is the complaint here exactly? That LLMs aren't enforcing database access best practices for you? That's not their job, that's your job. LLMs generate text. You do the rest. Give the LLM a user with the correct access control rules. Add a reasonable timeout to your warehouse/database. Enforce rate limiting like you would with any other endpoint.
Re:CodeCompose: Meta’s AI Coding Assistant on Saturday June 03, 2023 @12:26PM (#36177982)
Everyone in this space seems to be building on the LSP and classic auto-complete in particular as their UI. But I've found this to be non ideal.

- As mentioned in this paper I definitely do not want the AI suggestion crowding out a suggestion generated directly from the type bindings

- I often do want the AI to write an entirely new block of boilerplate. To do this you have to write a comment string targeted at the AI, then delete this afterwards

- Sometimes I'd just like the AI to explain to me what some code does without writing anything

- This isn't something I always want on; I find myself turning the plugin on and off depending on the context

Overall I think we need a novel UX to really unlock the AI's helpfulness

Also, accumulating powerful backers and friends to signal "this is a successful company" instead of building an actual company.
Re:GitHub Is Down on Friday September 02, 2022 @05:54PM (#32696158)
Phew, was worried when all my CI jobs failed simultaneously
Re:Node.js 16 Available Now on Tuesday April 20, 2021 @03:15PM (#26879893)
Not OC but we generate the client types with Apollo codegen (https://www.apollographql.com/blog/typescript-graphql-code-g...) using the schema file generated by our NestJS backend
What news they choose to make News is an opinion.
We use Contracts too and are in the process of transitioning to Sorbet. In addition to the same runtime type checking as Contracts, Sorbet offers static type checking (and will re-use your runtime signatures in its static analysis).