jbcranshaw

Curious what you use for a semantic score across years of data?

tldr; For fifty years, pretyt much every major approach to measuring developer productivity has eventually been disavowed by its own creators. Lines of code, story points, velocity. Tom DeMarco wrote "you can't control what you can't measure" in 1982 and publicly retracted it in 2009. AI has made the problem worse and, weirdly, might also be the way out.

Just curious, what's the backstory? What inspired you to work on this?

Hey, thanks for the reply. Would love to chat more.

Some observations on a few ways different people actually gather feedback from humans in practice to improve LLMs. Sure I've missed some here, so let me know.

To expand on the analogy, what would a fully-self driving LLM look like? and would people even want that?

In most cases, I think the idea of AI that augments my own capabilities and helps me get things done more efficiently resonates more with me than AI that operates on its own on my behalf.

That's definitely still a concern. My guess is you'll start to see private, paid tiers of LLM providers emerge soon.

This is good! I'm going to use that.

Ooh, I like LXMs. Hadn't heard that before.

Good point on the terminology. What do you think the right terminology should be? LLMs is too much of a mouthful and is not as informative for the general public, imo. People are also using Foundation Models, which I rather like.

> Our collective awe-struck-ness has left us vulnerable to the fact that AI generation is, generally speaking, hollow and indirect.

This totally resonates with me. This is absolutely correct. Thinking about the future of work, there's much of what I do every day in my job that is hollow and indirect. And I would be totally okay if I could have something like ChatGPT do it for me.

Some thoughts on the problem space we're exploring with Flowdex.

Journeys & Notes was my internship project at Microsoft Research this summer. It's a pretty simple idea: you check-in to a trip by specifying its endpoints and your mode of travel, and then you can leave notes behind for others to discover along the way. It's foursquare for commuters, or maybe it's tinder for busses, or maybe it's craigslist for paths, or secret for subways... I'm not sure, but I like it. Let me know what you think!

See http://livehoods.org/maps/nyc for a map of New York.