There does seem to be some overloading of the term 'semantic web' though. Sometimes the term is used to refer to semantic markup, such as using the <em> HTML tag instead of using the <i> HTML tag...
https://en.m.wikipedia.org/wiki/Semantic_HTML
Other times, the term semantic web is used to refer to structured meaning transmitted through specialised metadata...
https://en.m.wikipedia.org/wiki/Semantic_Web
Fathom seems to sit across the two, though I'd suggest it's closer to the first, unless it's used as a tool to analyse the design of existing web pages for the benefit of new website designs (combined with site usage data, e.g. bounce rates, etc...).
That is the reason why we currently work on http://link.fish which is a smart bookmark manager and allows people to work with the information behind the urls. We are currently in a closed beta but am happy about anybody who gives honest feedback.
Here is a short 2 min (low quality) demo video which shows how it works: https://youtu.be/Chfy3le5gY0
I'd note that Google's Knowledge Vault paper[1] found that "semantic web"-type technologies (very widely interpreted as anything that used metadata) was pretty useless as a source of data: only 0.25M out of 140M total "facts" extracted using those annotations were classified as high confidence (ie 0.2%).
This is in contrast to a DOM-rules based approach (which seems similar to Fathom) which extracted 94M out of 1200M total (ie 8%).
The Semantic Web is dead, and the KV paper buried it.
TCP/IP: "It's not the wires, it's the computers!"
HTTP/HTML: "It's not the computers, it's the documents!"
Semantic Web (/Fathom): "It's not the documents, it's the things that they are about!"
https://www.w3.org/DesignIssues/Abstractions.html
I look forward to the day when the idea of discrete, atomic documents is finally abstracted away in the same manner that we abstracted away the physical machines that host them.