Yes, this will work of course :-)

I was thinking of something more "graphical", similar to pgAdmin or SequelPro, when you need to navigate in a dataset.

I use https://sqlitebrowser.org/ if I need to but primarily Jupyter w/ Pandas to explore and understand the data and prototype new queries.

Regarding SQLiteBrowser, I guess you have to download a copy of the database on your local workstation?

Correct. I use it rarely.

Just ran it using X remotely, so that's an option too.

There's https://sqlitebrowser.org,

But I suppose you'll have to string up something if you want it to access a remote db.

There is also https://www.phpliteadmin.org, but I'm not a fan of the user interface.

Whatever exists specifically for sqlite, sshfs is your friend too.