News for hackers. Stuff that matters.

A comment on Ghostwriter – use the reMarkable2 as an interface to vision-LLMs. Parent comment

Re:Ghostwriter – use the reMarkable2 as an interface to visi... by owulveryck on Saturday February 08, 2025 @01:15AM (#42980826)
At some point I wanted to turn goMarkableStream into a MCP server (model context protocol). I could get the screen, but without “hack” I couldn’t write the response back.
[ Parent | on HN ]
Re:Ghostwriter – use the reMarkable2 as an interface to visi... by awwaiid on Saturday February 08, 2025 @10:52AM (#42983748)
The trick here is to inject events as if they came from the user. The virtual-keyboard works really reliably, you can see it over at https://github.com/awwaiid/ghostwriter/blob/main/src/keyboar... . It is the equivalent of plugging in the reMarkable type-folio.

Main limitation is that the reMarkable drawing app is very very minimal, it doesn't let you place text in arbitrary screen locations and is instead sort of a weird overlay text area spanning the entire screen.

[ Parent | on HN ]