Package Health Score

82 / 100

security
No known security issues
popularity
Popular
maintenance
Healthy
community
Sustainable

Explore Similar Packages

Popularity

Popular

GitHub Stars: 49
Forks: 25
Contributors: 20

Direct Usage Popularity

Based on project statistics from the GitHub repository for the PyPI package Protego, we found that it has been starred 49 times.

Security

No known security issues

Security and license risk for latest version

Release Date: Apr 5, 2024
Direct Vulnerabilities: 0
C
0
H
0
M
0
L
Indirect Vulnerabilities: 0
C
0
H
0
M
0
L
License Risk: 0
H
0
M
0
L

All security vulnerabilities belong to production dependencies of direct and indirect packages.

License

BSD-3-Clause

Security Policy

We found a way for you to contribute to the project! Looks like Protego is missing a security policy.

You can connect your project's repository to Snyk to stay up to date on security alerts and receive automatic fix pull requests.

Keep your project free of vulnerabilities with Snyk

Maintenance

Healthy

Commit Frequency

Open Issues: 6
Open PR: 1
Last Release: 14 days ago
Last Commit: 14 days ago

Further analysis of the maintenance status of Protego based on released PyPI versions cadence, the repository activity, and other data points determined that its maintenance is Healthy.

We found that Protego demonstrates a positive version release cadence with at least one new version released in the past 3 months.

As a healthy sign for on-going project maintenance, we found that the GitHub repository had at least 1 pull request or issue interacted with by the community.

Community

Sustainable

Readme: Yes
Contributing.md: No
Code of Conduct: No
Contributors: 20
Funding: No

With more than 10 contributors for the Protego repository, this is possibly a sign for a growing and inviting community.

We found a way for you to contribute to the project! Looks like Protego is missing a Code of Conduct.

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Ensure all the packages you're using are healthy and well-maintained

Snyk Vulnerability Scanner

Get health score & security insights directly in your IDE

Package

Python Versions Compatibility: >=3.8

Age: 5 years
Latest Release: 14 days ago
Dependencies: N/A
Versions: 10
Maintainers: 4
Wheels: OS Independent

Readme

Protego

Protego is a pure-Python robots.txt parser with support for modern conventions.

Install

To install Protego, simply use pip:

pip install protego

Usage

>>> from protego import Protego >>> robotstxt = """ ... User-agent: * ... Disallow: / ... Allow: /about ... Allow: /account ... Disallow: /account/contact$ ... Disallow: /account/*/profile ... Crawl-delay: 4 ... Request-rate: 10/1m # 10 requests every 1 minute ... ... Sitemap: ... Host: ... """ >>> rp = Protego.parse(robotstxt) >>> rp.can_fetch("", "mybot") False >>> rp.can_fetch("", "mybot") True >>> rp.can_fetch("", "mybot") True >>> rp.can_fetch("", "mybot") False >>> rp.can_fetch("", "mybot") False >>> rp.crawl_delay("mybot") 4.0 >>> rp.request_rate("mybot") RequestRate(requests=10, seconds=60, start_time=None, end_time=None) >>> list(rp.sitemaps) [''] >>> rp.preferred_host ''

Using Protego with Requests:

>>> from protego import Protego >>> import requests >>> r = requests.get("") >>> rp = Protego.parse(r.text) >>> rp.can_fetch("", "mybot") False >>> rp.can_fetch("", "mybot") True >>> list(rp.sitemaps) ['']

Comparison

The following table compares Protego to the most popular robots.txt parsers implemented in Python or featuring Python bindings:

	Protego	RobotFileParser	Reppy	Robotexclusionrulesparser
Implementation language	Python	Python	C++	Python
Reference specification	Google	`Martijn Koster’s	1996 dra	ft`_
Wildcard support	✓		✓	✓
Length-based precedence	✓		✓
Performance		+40%	+1300%	-25%

API Reference

Class protego.Protego:

Properties

sitemaps {list_iterator} A list of sitemaps specified in robots.txt.
preferred_host {string} Preferred host specified in robots.txt.

Methods

parse(robotstxt_body) Parse robots.txt and return a new instance of protego.Protego.
can_fetch(url, user_agent) Return True if the user agent can fetch the URL, otherwise return False.
crawl_delay(user_agent) Return the crawl delay specified for the user agent as a float. If nothing is specified, return None.
request_rate(user_agent) Return the request rate specified for the user agent as a named tuple RequestRate(requests, seconds, start_time, end_time). If nothing is specified, return None.
visit_time(user_agent) Return the visit time specified for the user agent as a named tuple VisitTime(start_time, end_time). If nothing is specified, return None.

FAQs

What is Protego?

Pure-Python robots.txt parser with support for modern conventions. Visit Snyk Advisor to see a full health score report for Protego, including popularity, security, maintenance & community analysis.

Is Protego popular?

The python package Protego receives a total of 350,665 weekly downloads. As such, Protego popularity was classified as a popular. Visit the popularity section on Snyk Advisor to see the full health analysis.

Is Protego well maintained?

We found that Protego demonstrated a healthy version release cadence and project activity. It has a community of 20 open source contributors collaborating on the project. See the full package health analysis to learn more about the package maintenance status.

Is Protego safe to use?

The python package Protego was scanned for known vulnerabilities and missing license, and no issues were found. Thus the package was deemed as safe to use. See the full health analysis review.

Last updated on 18 April-2024, at 05:00 (UTC).

Build a secure application checklist

Select a recommended open source package

Minimize your risk by selecting secure & well maintained open source packages

DONE

Scan your app for vulnerabilities

Scan your application to find vulnerabilities in your: source code, open source dependencies, containers and configuration files

SCAN NOW

Fix identified vulnerabilities

Easily fix your code by leveraging automatically generated PRs

AUTO FIX

Monitor for new issues

New vulnerabilities are discovered every day. Get notified if your application is affected

MONITOR APP

Protego

Pure-Python robots.txt parser with support for modern conventions For more information about how to use this package see README

Ensure you're using the healthiest python packages

Package Health Score

Explore Similar Packages

Popularity

Direct Usage Popularity

Security

Security and license risk for latest version

Maintenance

Commit Frequency

Community

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Snyk Vulnerability Scanner

Package

Readme

Protego

Install

Usage

Comparison

API Reference

Properties

Methods

FAQs

What is Protego?

Is Protego popular?

Is Protego well maintained?

Is Protego safe to use?

Build a secure application checklist

Select a recommended open source package

Scan your app for vulnerabilities

Fix identified vulnerabilities

Monitor for new issues

Package Health Score

Explore Similar Packages

Direct Usage Popularity

Security and license risk for latest version

Commit Frequency

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Snyk Vulnerability Scanner

Readme

Protego

Install

Usage

Comparison

API Reference

Properties

Methods

FAQs

What is Protego?

Is Protego popular?

Is Protego well maintained?

Is Protego safe to use?

Build a secure application checklist

Select a recommended open source package

Scan your app for vulnerabilities

Source Code

Open Source

Container

Config

Fix identified vulnerabilities

Monitor for new issues