bbischof

This is great; it's honestly so f'in annoying working with documents with multiple users AND LLMs

Data visualizations and live dashboards of people tweeting that '_ is dead'

Label studio is fine if it covers your need, but in many cases the core opportunity in an eval interface is fitting in with the SME’s workflow or current tech stack.

If label studio looks like what they can use, it’s fine. If not, a day of vibecoding is worth the effort to make your partners with special knowledge comfortable.

10x speed up; what more do you want

Hello, it’s Bryan, an author on this piece.

I’d you’re interested in using one of the LLM-applications I have in prod, check out https://hex.tech/product/magic-ai/ It has a free limit every month to give it a try and see how you like it. If you have feedback after using it, we’re always very interested to hear from users.

As far as fine-tuning in particular, our consensus is that there are easier options first. I personally have fine-tuned gpt models since 2022; here’s a silly post I wrote about it on gpt 2: https://wandb.ai/wandb/fc-bot/reports/Accelerating-ML-Conten...

Hello, it’s Bryan, an author on this piece.

I’d you’re interested in using one of the LLM-applications I have in prod, check out https://hex.tech/product/magic-ai/ It has a free limit every month to give it a try and see how you like it. If you have feedback after using it, we’re always very interested to hear from users.

We allude to 2 when talking about using explanations first, but I totally agree. One minor comment is explanations after can sometimes be useful for understanding how the model came to a particular generation during post-hoc evals.

Point 1 is also a good callout. I added something on this for llm judge but it’s relevant more broadly.

Bryan here, one of the authors.

Sure. Ultimately, you want to use KG to increase your ability to do great retrieval.

Why do graphs help with retrieval? Well, don’t overlook the classic pageant example: graphs provide signal about the interconnectivity of the docs.

Also, sometimes the graph itself are a kind of object you want to retrieve over.

Super interesting. I haven’t seen much chain support tech for ts folk which is a hard requirement for more production applications.

System 1 & 2 as it applies to AGI

`AI generated content` probably

SEO is dead, or it's so back, I have no idea.

(not OC)

Probably this is the article you saw https://link.medium.com/bf81IpGM8yb

Hehe, I had the same question: https://news.ycombinator.com/item?id=33812666

Interesting! I do contribute to OSM due to my exploration but I didn’t know about this. Thanks for the reference.

I’m really into this gps game: https://wandrer.earth (I’m not the creator, just a fan)

It encourages you to walk/run/bike all the roads in a town/city/county and it tracks the percentage.

It’s a fun and creative way to go see parts of your area you wouldn’t otherwise. I’ve used it to walk 97% of the miles in Berkeley and seen so many funky little areas. I also really enjoy how much it has increased my walking over the last few years.