How to use the crawler.run function in crawler

To help you get started, we’ve selected a few crawler examples, based on popular ways it is used in public projects.

Secure your code as it's written. Use Snyk Code to scan source code in minutes - no build needed - and fix issues immediately.

github adblockplus / abpcrawler / lib / main.js View on Github external
applicationReady.then(function()
  {
    let window = Services.wm.getMostRecentWindow("navigator:browser");
    run(window, urls, timeout, maxtabs, baseURL + "save", function()
    {
      Services.startup.quit(Services.startup.eAttemptQuit);
    });
  }, function(exception)
  {

crawler

Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously

MIT
Latest version published 5 months ago

Package Health Score

65 / 100
Full package analysis