karterk

Where is this, if I may ask?

> The moat of the frontier folks is just compute.

This is not really true. Google has all the compute but in many dimensions they lag behind GPT-5 class (catching up, but it has not been a given).

Amazon itself did try to train a model (so did Meta) and had limited success.

Satya saved Microsoft by doubling down on Azure and Cloud. Something that Balmer failed to do with Mobile.

There are many different classes of problems that are affected by tokenization. Some of them can be tackled by code.

Solving the strawberry problem will probably require a model that just works with bytes of text. There have been a few attempts at building this [1] but it just does not work as well as models that consume pre-tokenized strings.

[1]: https://arxiv.org/abs/2106.12672

It's interesting how all focus is now primarily on decoder-only next-token-prediction models. Encoders (BERT, encoder of T5) are still useful for generating embedding for tasks like retrieval or classification. While there is a lot of work on fine-tuning BERT and T5 for such tasks, it would be nice to see more research on better pre-training architectures for embedding use cases.

> Cows are treated very well in all the ranches I've been on.

Unfortunately the entire premise of your argument is based on a personal anecdote that's a gross generalization of vast number of cattle farms.

For JIT-ing you need to know the sizes upfront. There was an experimental branch for introducing jagged tensors, but as far as I know, it has been abandoned.

Can you give some examples of problematic C idioms in C++?

Every billion dollar idea is a million dollar idea.

Every million dollar idea is a 100K dollar idea.

There are always smaller segments within large segments that you can go after.

Yes, you can get a waiver if you apply for something called the "Letter of Undertaking" which allows you to not pay anything for exports. This was not available at the start.

No, they usually are very brazen about that, but this time they are generally clueless.

Back when GST was introduced, they asked all exporters of software services to pay the 18% GST and then claim a refund because exports are exempted. This was before they introduced a process to apply for a "NOC" (which must be renewed periodically I think). So, I duly paid GST for the first couple of months.

5 years later, I'm yet to receive the refunds. First, they said that they were authorized to only sanction refunds for exporters of physical goods and then they said that this is handled by the State government, who said that it was handled by the Central. Finally Central accepted that they are in-charge of the refund, but by then COVID happened and I could not follow up for 2 years. In May, when I tried to claim the refund again, they said that this refund pertains to 2016 and it's difficult to "reopen" the accounts for that year and that's handled by yet another department. So, they have written to them to ask for the process. No replies after two emails. Story continues...

Here's the 2022 edition: https://twitter.com/mrohanshah/status/1579829414916784128

What are some ways in which they are bad/broken?

Yes, we plan to do that, but we will start off with first supporting raw vector data type and search on that.

To offer a counter view: paper ballots were a huge source of fraud in India's elections until electronic voting machines were introduced. I don't wish to ever go back.

Have you looked at TinySeed? But they don't operate at a Series A scale in terms of cash deployed per investment. I suspect that the power law of returns in VC model requires really large outsized returns that cannot be achieved Without an all or nothing model.

Diversify initially to protect the downside but double down on your winner(s) to scale the upside!

There are many large arid, desert-like land available in almost every part of the world which can be put to use for Solar. I don't think cost of land is a huge issue.

Sure. At earlier jobs, I often got paged because of some bot running wild in crawling our web pages. Some pages are heavy and we don't expect them to be hit often, but once you crawl these pages indiscriminately (even if accidentally) that can bring a site down. There are also some pages whose underlying resources are billed in a pay-as-you-use model. Once again, heavy bot traffic ran up our bills.

Robots.txt allows the site owners to restrict such pages from being crawled by bots. Services that allow people to circumvent the restrictions are being rude to say the least. Many crawling services also use a farm of proxies that spoof their real identity with fake user agents to circumvent rate limiting etc. All of these "strategies" go far beyond basic automation and is quite shady in reality.

Do you follow robots.txt or do you allow your customers to bypass restrictions placed by the website? How do you feel about bypassing that? I know it's not illegal but it's certainly not ethical either.

> My app is officially dead.

Most markets are large enough to accommodate several businesses. There's really no reason to stop working on something just because you find that there is already someone solving that same problem. Who knows, they will shut it down at some point, or might head upmarket or pivot to a tangential area.