Re:Lecture 8: How to Start a Startup
by graycat on Thursday October 16, 2014 @10:32PM
(#8469143)
Here's an analogy: Have some URLs of some Web
pages and want to extract the links from those
pages? Okay, first do it by hand! So, have
a Web browser save the HTML and CSS, JS, files.
Then use a good editor to look at the HTML and
see how to parse the thing and extract the links.
Write some code to do this and try on some more
of the URLs. When see are not parsing the files
just right, tweak the code.
Finally, get some okay code and get and parse all
the HTML files from all the URLs with the code --
scalable!
So, start by hand and see how to automate the work
and then have a scalable solution.
I just did that for a collection of about 5000 URLs!
Then use a good editor to look at the HTML and see how to parse the thing and extract the links.
Write some code to do this and try on some more of the URLs. When see are not parsing the files just right, tweak the code.
Finally, get some okay code and get and parse all the HTML files from all the URLs with the code -- scalable!
So, start by hand and see how to automate the work and then have a scalable solution.
I just did that for a collection of about 5000 URLs!