How could i grab a website and execute js on this site to get the complete dom?

Posted by addisaden on Wednesday May 30, 2012 @06:26PM
from the self-post dept.

Hi everybody,

is there a way to grab the website and execute the javascripts? Some Websites inject Content via Javascript and Ajax and it would be great to get these.

I am porgramming in Ruby. Maybe there is a way to do this with NodeJS?

Thank you for your help

( 3 comments | 3 points | on HN )

Re:How could i grab a website and execute js on this site to... by mmccomb on Thursday May 31, 2012 @07:27AM (#4047457)

Selenium is capable of doing this and has a Ruby driver (library from which it can be controller).

http://selenium-client.rubyforge.org/

[ Parent | on HN ]

Re:How could i grab a website and execute js on this site to... by wmf on Wednesday May 30, 2012 @06:33PM (#4045243)

You can do this with Node+jsdom or PhantomJS.

[ Parent | on HN ]

Re:How could i grab a website and execute js on this site to... by addisaden on Thursday May 31, 2012 @03:20AM (#4046811)

Thank you. PhantomJS looks great.

[ Parent | on HN ]