Please use your own LLM api instead!

The free testing LLM is Qwen hosted by Aliyun. Qwen and DeepSeek are the only ones I can afford to offer for free. It's just there to lower the try-out barrier; please DO NOT rely on it.

The library itself does NOT include any backend service. Your data only goes to the LLM api you configured.

I tested it on local Ollama models it works fine.

Or why not stay fully local with WebLLM... https://webllm.mlc.ai

That looks great! I also thought about calling the Gemini nano model embedded into Chrome (only extensions can do that). But after some testing on smaller models I found that anything smaller than 9b can’t really handle the complex tool call schema I use.

Qwen3.5 4b is quite good but still gives messy json quite often. But it’s very promising!

Maybe after one more model iteration or some fine-toning we can go fully embedded?

I'm looking into a European testing endpoint. The legal and compliance requirements are quite hassle, and persuading my company to pay for that infrastructure is gonna be a tough sell.

Ask the project to offer an EU-hosted endpoint or a self-hosted Docker image, and to publish a clear dataflow diagram showing which inputs, inference steps, logs and backups are stored or processed in Mainland China.

Practically that can be done by provisioning EU clusters with Terraform on AWS eu-west-1 or a European host like Hetzner, using geolocation DNS or Cloudflare load balancing to steer users and pin accounts to a region, while accepting higher costs, more complex CI/CD and subtle GDPR issues around backups and telemetry.

Details of the testing LLM are listed here. https://github.com/alibaba/page-agent/blob/main/docs/terms-a...

The library does NOT include backend services. This is an open source project. I’m not selling any service here…