Package Health Score

79 / 100

security
Security issues found
popularity
Influential project
maintenance
Healthy
community
Active

Explore Similar Packages

Popularity

Influential project

GitHub Stars: 50.85K
Forks: 10.32K
Contributors: 380

Direct Usage Popularity

Based on project statistics from the GitHub repository for the PyPI package Scrapy, we found that it has been starred 50,853 times.

Security

Security issues found

Security and license risk for latest version

Release Date: Feb 14, 2024
Direct Vulnerabilities: 0
C
0
H
1
M
0
L
Indirect Vulnerabilities: 0
C
0
H
0
M
0
L
License Risk: 0
H
0
M
0
L

All security vulnerabilities belong to production dependencies of direct and indirect packages.

License

BSD-3-Clause

Security Policy

Yes

Snyk detected that the latest version of Scrapy has a security vulnerability.

We highly advise you to review these security issues.

You can connect your project's repository to Snyk to stay up to date on security alerts and receive automatic fix pull requests.

Fix it in your project with Snyk!

Maintenance

Healthy

Commit Frequency

Open Issues: 432
Open PR: 218
Last Release: 2 months ago
Last Commit: 6 days ago

Further analysis of the maintenance status of Scrapy based on released PyPI versions cadence, the repository activity, and other data points determined that its maintenance is Healthy.

We found that Scrapy demonstrates a positive version release cadence with at least one new version released in the past 3 months.

As a healthy sign for on-going project maintenance, we found that the GitHub repository had at least 1 pull request or issue interacted with by the community.

Community

Active

Readme: Yes
Contributing.md: Yes
Code of Conduct: Yes
Contributors: 380
Funding: No

A good and healthy external contribution signal for Scrapy project, which invites more than one hundred open source maintainers to collaborate on the repository.

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Ensure all the packages you're using are healthy and well-maintained

Snyk Vulnerability Scanner

Get health score & security insights directly in your IDE

Package

Python Versions Compatibility: >=3.8

Age: 14 years
Latest Release: 2 months ago
Dependencies: 18 Direct
Versions: 98
Maintainers: 4
Wheels: OS Independent

Not sure how to use Scrapy?

To help you get started, we've collected the most common ways that Scrapy is being used within popular public projects.

aiqm / torchani / tools / generate-unit-test-expect / nist-dataset / nist.py View on Github

def start_requests(self):
        start_url = urltemplate.format(min_weight, max_weight)
        yield scrapy.Request(
            url=start_url,
            callback=lambda x: self.parse_range(x, min_weight, max_weight))

View more ways to use Scrapy

Scrapy

Overview

Scrapy is a BSD-licensed fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.

Scrapy is maintained by Zyte (formerly Scrapinghub) and many other contributors.

Check the Scrapy homepage at for more information, including a list of features.

Requirements

Python 3.8+
Works on Linux, Windows, macOS, BSD

Install

The quick way:

pip install scrapy

See the install section in the documentation at for more details.

Documentation

Documentation is available online at and in the docs directory.

Releases

You can check for the release notes.

Community (blog, twitter, mail list, IRC)

See for details.

Contributing

See for details.

Code of Conduct

Please note that this project is released with a Contributor Code of Conduct.

By participating in this project you agree to abide by its terms. Please report unacceptable behavior to .

Companies using Scrapy

See for a list.

Commercial Support

See for details.

Scrapy dependencies

cryptography cssselect itemadapter itemloaders lxml packaging parsel protego pydispatcher pyopenssl pypydispatcher queuelib service-identity setuptools tldextract twisted w3lib zope-interface

FAQs

What is Scrapy?

A high-level Web Crawling and Web Scraping framework. Visit Snyk Advisor to see a full health score report for Scrapy, including popularity, security, maintenance & community analysis.

Is Scrapy popular?

The python package Scrapy receives a total of 452,102 weekly downloads. As such, Scrapy popularity was classified as an influential project. Visit the popularity section on Snyk Advisor to see the full health analysis.

Is Scrapy well maintained?

We found that Scrapy demonstrated a healthy version release cadence and project activity. It has a community of 380 open source contributors collaborating on the project. See the full package health analysis to learn more about the package maintenance status.

Is Scrapy safe to use?

Security issues were found while scanning the latest version of Scrapy, and a total of 0 vulnerabilities were detected. It is highly advised to conduct a security review before using this package. View the full security scan results.

Last updated on 24 April-2024, at 22:43 (UTC).

Build a secure application checklist

Select a recommended open source package

Minimize your risk by selecting secure & well maintained open source packages

DONE

Scan your app for vulnerabilities

Scan your application to find vulnerabilities in your: source code, open source dependencies, containers and configuration files

SCAN NOW

Fix identified vulnerabilities

Easily fix your code by leveraging automatically generated PRs

AUTO FIX

Monitor for new issues

New vulnerabilities are discovered every day. Get notified if your application is affected

MONITOR APP

Scrapy

A high-level Web Crawling and Web Scraping framework For more information about how to use this package see README

Ensure you're using the healthiest python packages

Package Health Score

Explore Similar Packages

Popularity

Direct Usage Popularity

Security

Security and license risk for latest version

Maintenance

Commit Frequency

Community

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Snyk Vulnerability Scanner

Package

Not sure how to use Scrapy?

Scrapy

Overview

Requirements

Install

Documentation

Releases

Community (blog, twitter, mail list, IRC)

Contributing

Code of Conduct

Companies using Scrapy

Commercial Support

Scrapy dependencies

FAQs

What is Scrapy?

Is Scrapy popular?

Is Scrapy well maintained?

Is Scrapy safe to use?

Build a secure application checklist

Select a recommended open source package

Scan your app for vulnerabilities

Fix identified vulnerabilities

Monitor for new issues

Package Health Score

Explore Similar Packages

Direct Usage Popularity

Security and license risk for latest version

Commit Frequency

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Snyk Vulnerability Scanner

Not sure how to use Scrapy?

Scrapy

Overview

Requirements

Install

Documentation

Releases

Community (blog, twitter, mail list, IRC)

Contributing

Code of Conduct

Companies using Scrapy

Commercial Support

Scrapy dependencies

FAQs

What is Scrapy?

Is Scrapy popular?

Is Scrapy well maintained?

Is Scrapy safe to use?

Build a secure application checklist

Select a recommended open source package

Scan your app for vulnerabilities

Source Code

Open Source

Container

Config

Fix identified vulnerabilities

Monitor for new issues