pombo
Show HN: LLMcomp – compare cost and results of different LLMs on the same prompt
Hey HN,I often want a quick comparison of different LLMs to see the result+price+performance across different tasks or prompts.So I put together LLMcomp—a straightforward site to compare (some) popular LLMs on cost, latency, and other details in one place. It’s still a work in progress, so any suggestions or ideas are welcome. I can add more LLMs if there is interest. It currently has Claude...
Show HN: Llms.txt directory with automated submission and rough draft generator
I have been noticing AI websites adding support for llms.txt standard, which inspired me to read more about it. llms.txt is similar to robots.txt but for LLMs so they can better understand a website with less tokens. I have seen a few directories, but submission is typically through a pull request to a Github repo so I went ahead and created one with automated submission and a rough draft...
Show HN: ChatGPT-like Flutter app demo with source code (no backend and ~1k LOC)
https://github.com/backmesh/flutter-chatgpt
Source Code: https://github.com/backmesh/flutter-chatgptLive Demo: https://flutter-chatgpt.pages.dev
Show HN: Backmesh, Firebase for AI Apps
Hello HN! Fernando from Backmesh. I got tired of having to spin up a backend to use the OpenAI or Anthropic API and figure out authentication, usage and error analytics per user in my web or mobile apps so I created Backmesh, the Firebase for AI Apps. It lets you safely call any LLM API from your app without a backend with usage analytics and rate limits per user.
Show HN: Anthropic React Native Client
https://github.com/backmesh/anthropic-react-native
I recently published a new package on npm that brings the Anthropic APIs to React Native without polyfills.The library supports chat streaming and normal chat completions. The goal of the library is to follow the Node SDK wherever possible while taking advantage of React Native SSE for streaming where the Anthropic Node SDK does not work. Lmk what you think or if this will be useful to you!
Show HN: OpenAI React Native Client
https://github.com/backmesh/openai-react-native
I recently published a new package on npm that brings the OpenAI APIs to React Native Expo without polyfills.Today the library supports chat streaming, normal chat completions and file upload with more endpoints coming soon. The goal of the library is to follow the OpenAI Node SDK wherever possible while taking advantage of React Native SSE and Expo FileSystem with streaming and file upload...
Re:npm i openai-react-native
on Tuesday September 03, 2024 @02:28PM (#41437658)
I recently published a new package on npm that brings the OpenAI APIs to React Native Expo without polyfills.
Today the library supports chat streaming, normal chat completions and file upload with more endpoints coming soon. The goal of the library is to follow the OpenAI Node SDK wherever possible while taking advantage of React Native SSE and Expo FileSystem with streaming and file upload support where the OpenAI Node SDK does not work. Lmk what you think or what you would like to see!
npm i openai-react-native
The Firebase for AI Apps (Early Access)
Re:The Firebase for AI Apps (Early Access)
on Thursday August 22, 2024 @06:03PM (#41324712)
Use any Gen AI API from your app without a backend with analytics and rate limits per user
No more needless backends for Flutter apps
Cloud infrastructure that proposes verifiable bugfixes
Verifying LLM-Generated Code
Show HN: DebugSage, get answers to coding questions from LLMs and developers
A little side project I put together as I realized I was increasingly using going to different LLMS to help me debug.
LLMs as Compilers
Re:Show HN: Marsha – An LLM-Based Programming Language
on Tuesday July 25, 2023 @04:03PM (#36868506)
I'm not sure I agree with the fact that an abstraction is always the answer, but your last sentence outlines precisely one of our motivations behind Marsha. You can specify an imperative set of steps in the description of a function/program, or you can (in the future) write a Python function that you use from Marsha
Re:Show HN: Marsha – An LLM-Based Programming Language
on Tuesday July 25, 2023 @04:01PM (#36868479)
I would say that it depends. Python and JS, two of the most used programming languages, abstract away memory management and threading details that most of the time you don't need, but you can "drop down" to write code that does pay attention to that within the language (building an object pool and reusing it, or memoization, etc) and if that's not enough, go to the "deeper" language like C/Rust to handle those cases with first-class primitives.
Re:Show HN: Marsha – An LLM-Based Programming Language
on Tuesday July 25, 2023 @01:27PM (#36865992)
one of the contributors here. we have a statistical test script we can run on our branches to test the compile time, cost and reliability. we want to try tree of thought and also something like https://www.reddit.com/r/ChatGPT/comments/14d7pfz/become_god.... that said, we found that when we asked GPT to first explain why a test case is failing and then to correct that failure instead of just asking it to correct the failure, unexpectedly costs went up and reliability went down
Re:With plugins, GPT-4 posts GitHub issue without instructions to
on Wednesday July 05, 2023 @04:19PM (#36606504)
Why SQL is right for Infrastructure Management
Show HN: Deploy Stable Diffusion in EC2 Using a SQL Query
Infrastructure as Code Is Not the Answer
Re:Ask HN: What books helped you in your entrepreneurship journey?
on Wednesday March 15, 2023 @11:06AM (#35169451)
Traction by Weinberg. Understanding the distribution of your product, how to think about it and how much resources to devote to it was a missing piece for me as a technical founder. I easily fall into the fallacy of "build it and they will come" even when I don't think I do.
Save $ on public S3 buckets using VPC endpoints via SQL
Re:Show HN: Super minimalistic cross-platform cloud to-do list
on Wednesday March 08, 2023 @01:23PM (#35072733)
I'm fully on the Apple ecosystem nowadays so don't feel this pain anymore, but I would have used this before. Not sure if I would have paid for it though
Show HN: IaSQL – Open-source tool to manage cloud infra as data in PostgreSQL
https://github.com/iasql/iasql
Hi all,IaSQL maintains a two-way connection between an unmodified PostgreSQL database and an AWS account. IaSQL at it's core is a diffing system between the cloud infrastructure state and the desired state that is used to execute AWS SDK calls to update your infrastructure.But we also use the same mechanism to take changes in your infrastructure, perhaps made via the AWS console or an IaC tool...