Version 3.0.0

Breaking Changes:

• Node 18+

Other updates:

• Puppeteer 22.0.0
• Security override for legacy phantomjs package

Version 2.0.0

Drops support for node 14 and update dependencies.

v1.0.0 Puppeteer

Added puppeteer as the default browser.
Added browser option to allow selection of "phantomjs".
Added debug option to run puppeteer headed with devtools.

0.19.0

Updates

• Dependency: Dropped usage of request in favor of the got library.
• robots input types now search for Sitemap directives and favor those over any other information in the robots.txt file. If Sitemap directives are found, those alone are used to drive crawling of the site. If no Sitemap directives are found, it will fallback to Allow directives as in previous versions.
• Sitemaps can accidentally be SitemapIndexes. If a sitemap index is parsed and is actually a sitemapIndex file, it is just processed as a sitemapIndex file, no questions asked. This allows robots.txt to contain a mixture of sitemap and sitemapIndex files.

Supports Node 14+ (dropped 10 & 12)
Select dependency update, copyright 2022.

Release v0.17.0

Breaking Changes

Node 10 Minimum

This release supports Node 10 and greater only.

Other Changes

• Dependency updates - All, but most notably mocha (dev) and mkdirp (sitemap sources only).
• Copyright 2020

Dropped support for Node 6.

Change List:

• Dropped support for Node 6. Updated test grid for Node 8, 10.
• Updated internal async dependency used for worker process management to 3.0.1.

Dropped support for Node 4.x

0.14.0

This is a release with major and breaking changes.
The readme has the scoop, but here's the TL;DR:

Change Summary

• Added sitemap-index input generator (also supports gzipped)
• Added verbose output option for debugging
• Dropped support for <= NodeJS 0.12
• Library run method now returns a Promise
• Improved Error handling, multiple errors reported

Internal Changes

• Promise usage at library and input generator levels
• Added multi-timer lock to protect Notifier data in timer callbacks
• Switched to Async Node I/O calls throughout Notifier
• Added runtime dependencies
  • Async-Lock
  • Combine-Errors
  • mkdirp

Breaking Changes

The library run method

• Returns a Promise that resolves (or rejects) at the end of the entire run (instead of a boolean indicating start success/failure).
• The second argument (callback) is now optional. If you supply one it will be called on completion, but the run Promise will also resolve. The callback argument is deprecated and may be removed at some future date.
• The arguments given to a phantomjs process have changed slightly to accommodate the new verbose option.

Dropped Node 0.12 support

• Library now only supports Node 4.x +

Promise Failure Handler Error

A Promise failure handler will receive an Error instance that contains all of the errors that have occurred. Also, the Error instance contains additional properties that contain useful information:

• completed - An array of the file output paths that actually completed and were written to storage.
• notCompleted - An array of the file output paths that did not complete and were not written to storage.