News for hackers. Stuff that matters.

gavi

mcp-pyexec - Core MCP server for secure Python execution https://github.com/gavi/mcp-pyexec

oauth-idp-server - OAuth 2.0 Identity Provider with third-party support https://github.com/gavi/oauth-idp-server

mcp-pyexec-client - Testing client for end-to-end validation https://github.com/gavi/mcp-pyexec-client

Re: on Tuesday February 04, 2025 @06:07PM (#42940497)
I think people misunderstand LLMs, you should think of them like humans with limited recall capabilities. Seems like the author asked to retrieve a lot of data which it is bound to make mistakes as the training data might contain this but only a lossy representation of it, the better way to think is can it generate some SQL given this dataset and provide answers you were looking for just like how humans would approach this type of problem.

I have been experimenting with USDA food database and sending just the metadata of the table structure to the LLM as a prompt so it can write SQL

My prompt is below

----

You are a SQL Generator for USDA Food Database which is stored in sqlite. When generating SQL make sure to use :parameter_name for queries requiring parameters. Here is the schema:

{% for row in data %} Table: {{ row.table_name }} Columns: {{ row.columns }} {% endfor %}

You can generate python code to analyze the data only if user requests it, each python code block should be able to run in Jupyter cell fully self contained. Libraries such as matplotlib, numpy, seaborn are installed. You will get the previously executed sql queries by the user in <context> </context>tags

You can access this executed data from cache

```python import cache data = cache.get_data('query_hash') ``` the data in the above example is already a pandas data frame

Wait for the user to ask for questions before generating any queries.

----

you can try it out here https://catalyst.voov.ai

Re:RLHF Book on Sunday February 02, 2025 @04:19AM (#42907395)
I love Claude 3.5 sonnet and their UI is top notch especially for coding, recently though they have been facing capacity issues especially during weekdays correlating with working hours. Have tried Qwen2.5 coder 32B and it's very good and close to Claude 3.5 in my coding cases.
I have aging parents in India, and I can tell you firsthand—healthcare there is far from cheap. In fact, prices have surged, and many people are now accustomed to the higher costs, thanks to rampant price gouging during the COVID pandemic.
The GPU requirements for realtime video generation are very minimal in the grand scheme of things. Assault on reality itself.
Re:Every Dunder Method in Python on Wednesday April 03, 2024 @10:03AM (#39917655)
This is used to build micrograd and essentially extensively used in PyTorch.

https://www.youtube.com/watch?v=VMj-3S1tku0

Excellent intro video btw

This is great. Please check obsidian which I think is excellent also.
Re:Extracting Training Data from ChatGPT on Wednesday November 29, 2023 @02:09PM (#38463753)
I tried the same in CodeLLAMA and it did not leak anything. Wondering what could trigger this

Older »