DuckDuckGo browser seemingly sends domains a user visits to DDG servers

Re:DuckDuckGo browser seemingly sends domains a user visits ... by oefrha on Thursday July 02, 2020 @02:02AM (#23710457)

Chrome, according to my understanding, hardcodes a few favicon URLs for builtin search engines, and caches everything else on site visit. There's SQLite3 database named Favicons in your profile directory (e.g. on macOS it's ~/Library/Application Support/Google/Chrome/<Profile>/Favicons). Here's the schema:

  CREATE TABLE meta(key LONGVARCHAR NOT NULL UNIQUE PRIMARY KEY, value LONGVARCHAR);
  CREATE TABLE icon_mapping(id INTEGER PRIMARY KEY,page_url LONGVARCHAR NOT NULL,icon_id INTEGER);
  CREATE TABLE favicons(id INTEGER PRIMARY KEY,url LONGVARCHAR NOT NULL,icon_type INTEGER DEFAULT 1);
  CREATE TABLE favicon_bitmaps(id INTEGER PRIMARY KEY,icon_id INTEGER NOT NULL,last_updated INTEGER DEFAULT 0,image_data BLOB,width INTEGER DEFAULT 0,height INTEGER DEFAULT 0,last_requested INTEGER DEFAULT 0);
  CREATE INDEX icon_mapping_page_url_idx ON icon_mapping(page_url);
  CREATE INDEX icon_mapping_icon_id_idx ON icon_mapping(icon_id);
  CREATE INDEX favicons_url ON favicons(url);
  CREATE INDEX favicon_bitmaps_icon_id ON favicon_bitmaps(icon_id);

I haven't looked at Firefox and Safari but I assume they do something similar.

[ Parent | on HN ]

Re:DuckDuckGo browser seemingly sends domains a user visits ... by zzo38computer on Thursday July 02, 2020 @04:51AM (#23711266)

I would hope that it can also be made to cache 404 and 410 responses to favicon requests too (or at least 410 even if not 404), so that it won't keep trying to access it.

Also, in SQLite, note that LONGVARCHAR is the same as TEXT, and that you don't need to specify both UNIQUE and PRIMARY KEY (it is redundant), and that if it is not a INTEGER PRIMARY KEY and not WITHOUT ROWID, then it isn't the real primary key but just an index (same as UNIQUE); add WITHOUT ROWID if you want to make it a real primary key, but note that the way the data is stored differs then, and WITHOUT ROWID is inefficient with tables storing large blobs.

[ Parent | on HN ]