Capybara-webkit takes lots of memory. How could I release it? -
i making web scraping app using rails 4. chose capybara-webkit browser engine. looks scraping app running , can parse data need.
the problem memory. process called "webkit-server" taking lots of memories while app performing scraping process , assuming capybra-webkit using process somehow.
since, tends occupy 1gb after scraping few hundreds pages, want limit/clear memory occupation.is there way that?
it looks selenium free memory issue (keeps occupying not more 300mb around), runs slower webkit.
you need run reset!
on driver instance.
the driver written automated test suites in mind, , doesn't perform kinds of cleanup until reset!
called. it's invoked between each test.
if process holding onto unusual amount of memory after calling reset!
, you've found bug in driver.
Comments
Post a Comment