vermorel

Full text at: https://www.lokad.com/document/book-introduction-to-supply-c...

It's safe to assume that anything publicly available on the web is being scraped.

Is-it though? Hyperbolic praise of a vendor on the web is quite transparent, hence, a casual reader is hardly going to be fooled. LLM distortion would be just as severe BUT much harder to spot.

The other comment stating "Yann LeCun is the Paul Krugman of AI" does resonate with me. There is a lot to be criticized about his takes on AI in general, and the need for a "worldview" in particular.

The longer version at: https://www.lokad.com/blog/2024/3/18/ai-interview-with-yann-...

Lokad.com | Full stack, Backend, Frontend, Compiler | REMOTE or ONSITE | Paris, France | Full-time | https://www.lokad.com Lokad is a bootstrapped profitable software company - 60 employees and growing fast - that specializes on predictive supply chain optimization. We are based in France, but the majority of our clients are outside France.

Supply chains remain wasteful and poorly resilient to tail risks (as demonstrated by present day situation). We’re talking about roughly 15% of the worldwide economy: supply chains are vast, and double-digit improvements remain possible. We want to put supply chains on AI autopilot, and deliver above-human performance while doing so.

Technologies used: C#, F#, Typescript, .NET Core, Linux

Find out more: https://www.lokad.com/software-engineering

Our basic low-dimensional parametric model landed No1 at the SKU level at the M5, see my lecture https://www.lokad.com/tv/2022/1/5/no1-at-the-sku-level-in-th... (more references at the bottom)

While there is some obvious US-centric left wing bias in most major LLMs, I am not sure this is what is at play here. I routinely end-up with similar behaviors on all sort of subjects.

As a CEO, this is one of the many reasons why I do not do money transfers myself.

Ps: your insights are spot on. Been plagued by this issue for years. Deep fake is merely a refinement of a pre-existing fraud pattern.

With 1M tokens, if snapshotting the LLM state is cheap, it would beat out-of-the-box nearly all RAG setups, except the ones dealing with large datasets. 1M tokens is a lot of docs.

Agreed, some problem here.

The "cost" is storing the state of the LLM after processing the input. My back-of-the-envelop guesstimate gives me 1GB to capture the 8bit state of 70B parameters model (I might be wrong though, insights are welcome), which is quite manageable with NVMe storage for fast reload. The operator would charge per pay per "saved" prompt, plus maybe a fix per call fee to re-load the state.

Does any of those LLM-as-a-service companies provide a mechanism to "save" a given input? Paying only for the state storage and the extra input when continuing the completion from the snapshot?

Indeed, at 1M token and $15/M tokens, we are talking of $10+ API calls (per call) when maxing out the LLM capacity.

I see plenty of use cases for such a big context, but re-paying, at every API call, to re-submit the exact same knowledge base seems very inefficient.

Right now, only ChatGPT (the webapp) seems to be using such those snapshots.

Am I missing something?

Thanks! The interesting thing is that my casual observations indicate that GPT itself might already be good enough to self-arbiter itself. Just like a human writer can improve its own writing by iterating over it. In a sense, having humans in the loop were what it took (past) to gain the possibility to reach self-arbitration capacity.

Original paper (2018) https://www.nature.com/articles/s41586-018-0411-9

Lokad.com | Full stack, Backend, Frontend, Compiler | REMOTE or ONSITE | Paris, France | Full-time | https://www.lokad.com

Lokad is a bootstrapped profitable software company - 50 employees and growing fast - that specializes on predictive supply chain optimization. We are based in France, but the majority of our clients are outside France.

Supply chains remain wasteful and poorly resilient to tail risks (as demonstrated by present day situation). We’re talking about roughly 15% of the worldwide economy: supply chains are vast, and double-digit improvements remain possible. We want to put supply chains on AI autopilot, and deliver above-human performance while doing so.

Technologies used: C#, F#, Typescript, .NET Core, Linux

Find out more: https://www.lokad.com/software-engineering

Agreed. As a software employer, solid public code contributions weight a lot more than degrees.

Lokad.com | Full stack, Backend, Frontend, Compiler | REMOTE or ONSITE | Paris, France | Full-time | https://www.lokad.com Lokad is a bootstrapped profitable software company - 50 employees and growing fast - that specializes on predictive supply chain optimization. We are based in France, but the majority of our clients are outside France.

Supply chains remain wasteful and poorly resilient to tail risks (as demonstrated by present day situation). We’re talking about roughly 15% of the worldwide economy: supply chains are vast, and double-digit improvements remain possible. We want to put supply chains on AI autopilot, and deliver above-human performance while doing so.

Technologies used: C#, F#, Typescript, .NET Core, Linux

Find out more: https://www.lokad.com/software-engineering

Lokad.com | Full stack, Backend, Frontend, Compiler | REMOTE or ONSITE | Paris, France | Full-time | https://www.lokad.com

Lokad is a bootstrapped profitable software company - 50 employees and growing fast - that specializes on predictive supply chain optimization. We are based in France, but the majority of our clients are outside France.

Supply chains remain wasteful and poorly resilient to tail risks (as demonstrated by present day situation). We’re talking about roughly 15% of the worldwide economy: supply chains are vast, and double-digit improvements remain possible. We want to put supply chains on AI autopilot, and deliver above-human performance while doing so.

Technologies used: C#, F#, Typescript, .NET Core, Linux

Find out more: https://www.lokad.com/software-engineering

Lokad.com | Full stack, Backend, Frontend, Compiler | REMOTE or ONSITE | Paris, France | Full-time | https://www.lokad.com

Lokad is a bootstrapped profitable software company - 50 employees and growing fast - that specializes on predictive supply chain optimization. We are based in France, but the majority of our clients are outside France.

Supply chains remain wasteful and poorly resilient to tail risks (as demonstrated by present day situation). We’re talking about roughly 15% of the worldwide economy: supply chains are vast, and double-digit improvements remain possible. We want to put supply chains on AI autopilot, and deliver above-human performance while doing so.

Technologies used: C#, F#, Typescript, .NET Core, Linux

Find out more: https://www.lokad.com/software-engineering

Lokad.com | Full stack, Backend, Frontend, Compiler | REMOTE or ONSITE | Paris, France | Full-time | https://www.lokad.com

Lokad is a bootstrapped profitable software company - 50 employees and growing fast - that specializes on predictive supply chain optimization. We are based in France, but the majority of our clients are outside France.

Supply chains remain wasteful and poorly resilient to tail risks (as demonstrated by present day situation). We’re talking about roughly 15% of the worldwide economy: supply chains are vast, and double-digit improvements remain possible. We want to put supply chains on AI autopilot, and deliver above-human performance while doing so.

Technologies used: C#, F#, Typescript, .NET Core, Linux

Find out more: https://www.lokad.com/software-engineering

It might be too late, but for others, PeerTube, open source replacement of YouTube, is the solution. Longer discussion https://blog.vermorel.com/journal/2021/4/30/peertube-to-repl...