News for hackers. Stuff that matters.

A comment on Sci-Bay: Google Scholar plus Sci-Hub. Parent comment

Re:Sci-Bay: Google Scholar plus Sci-Hub by matheusmoreira on Wednesday March 21, 2018 @02:01AM (#16635852)
The page's HTML is the API. It's pretty easy to download a web page, parse the HTML and then extract specific bits of information from it. The browser does the same thing on the user's behalf, which is why it is called the user agent.
[ Parent | on HN ]
Re:Sci-Bay: Google Scholar plus Sci-Hub by hrasyid on Wednesday March 21, 2018 @02:45AM (#16636040)
An API is a contract. HTML can be tweaked and become incompatible with your parser at the developer's whim.
[ Parent | on HN ]
Re:Sci-Bay: Google Scholar plus Sci-Hub by gkya on Wednesday March 21, 2018 @05:07AM (#16636523)
Oh luckily major APIs never change. /s
[ Parent | on HN ]
Re:Sci-Bay: Google Scholar plus Sci-Hub by hrasyid on Friday March 23, 2018 @08:28PM (#16663881)
Not as easily as an HTML page
[ Parent | on HN ]
Re:Sci-Bay: Google Scholar plus Sci-Hub by matheusmoreira on Wednesday March 21, 2018 @06:55AM (#16636939)
That just means your code must be maintained. You can verify that the HTML has a given structure and log a failure if it doesn't.
[ Parent | on HN ]
Re:Sci-Bay: Google Scholar plus Sci-Hub by amelius on Wednesday March 21, 2018 @08:51AM (#16637558)
Use Deep Learning to circumvent that.
[ Parent | on HN ]