Package Health Score

76 / 100

security
Security review needed
popularity
Influential project
maintenance
Sustainable
community
Sustainable

Popularity

Influential project

GitHub Stars: 2.58K
Forks: 295
Contributors: 30

Direct Usage Popularity

Based on project statistics from the GitHub repository for the PyPI package datasketch, we found that it has been starred 2,583 times.

Security

Security review needed

Security and license risk for latest version

Release Date: Jun 4, 2024
Direct Vulnerabilities: 0
C
0
H
0
M
0
L
Indirect Vulnerabilities: 0
C
0
H
0
M
0
L
License Risk: 0
H
0
M
0
L

All security vulnerabilities belong to production dependencies of direct and indirect packages.

License

MIT

Security Policy

We found a way for you to contribute to the project! Looks like datasketch is missing a security policy.

You can connect your project's repository to Snyk to stay up to date on security alerts and receive automatic fix pull requests.

Keep your project free of vulnerabilities with Snyk

Maintenance

Sustainable

Commit Frequency

Open Issues: 48
Open PR: 5
Last Release: 6 months ago
Last Commit: 8 months ago

Further analysis of the maintenance status of datasketch based on released PyPI versions cadence, the repository activity, and other data points determined that its maintenance is Sustainable.

We found that datasketch demonstrates a positive version release cadence with at least one new version released in the past 12 months.

In the past month we didn't find any pull request activity or change in issues status has been detected for the GitHub repository.

Community

Sustainable

Readme: Yes
Contributing.md: No
Code of Conduct: No
Contributors: 30
Funding: No

With more than 10 contributors for the datasketch repository, this is possibly a sign for a growing and inviting community.

We found a way for you to contribute to the project! Looks like datasketch is missing a Code of Conduct.

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Ensure all the packages you're using are healthy and well-maintained

Snyk Vulnerability Scanner

Get health score & security insights directly in your IDE

Package

Python Versions Compatibility: ==3.10.*, ==3.11.*, ==3.7.*, ==3.8.*, ==3.9.*

Age: 10 years
Latest Release: 6 months ago
Dependencies: 0 Direct
Versions: 83
Maintainers: 1
Wheels: OS Independent

Not sure how to use datasketch?

To help you get started, we've collected the most common ways that datasketch is being used within popular public projects.

ekzhu / datasketch / test / aio / test_lsh_mongo.py View on Github

async def test__H_mongo(self):
        """
        Check _H output consistent bytes length given
        the same concatenated hash value size
        """
        mg = WeightedMinHashGenerator(100, sample_size=128)
        for l in range(2, mg.sample_size + 1, 16):
            m = mg.minhash(np.random.randint(1, 99999999, 100))
            async with AsyncMinHashLSH(storage_config=self._storage_config_mongo,
                                       num_perm=128) as lsh:
                await lsh.insert("m", m)
                fs = (ht.keys() for ht in lsh.hashtables)
                hashtables = await asyncio.gather(*fs)
                sizes = [len(H) for H in hashtables]
                self.assertTrue(all(sizes[0] == s for s in sizes))

View more ways to use datasketch

datasketch: Big Data Looks Small

datasketch gives you probabilistic data structures that can process and search very large amount of data super fast, with little loss of accuracy.

This package contains the following data sketches:

Data Sketch	Usage
MinHash	estimate Jaccard similarity and cardinality
Weighted MinHash	estimate weighted Jaccard similarity
HyperLogLog	estimate cardinality
HyperLogLog++	estimate cardinality

The following indexes for data sketches are provided to support sub-linear query time:

Index	For Data Sketch	Supported Query Type
MinHash LSH	MinHash, Weighted MinHash	Jaccard Threshold
MinHash LSH Forest	MinHash, Weighted MinHash	Jaccard Top-K
MinHash LSH Ensemble	MinHash	Containment Threshold
HNSW	Any	Custom Metric Top-K

datasketch must be used with Python 3.7 or above, NumPy 1.11 or above, and Scipy.

Note that MinHash LSH and MinHash LSH Ensemble also support Redis and Cassandra storage layer (see MinHash LSH at Scale).

Install

To install datasketch using pip:

pip install datasketch

This will also install NumPy as dependency.

To install with Redis dependency:

pip install datasketch[redis]

To install with Cassandra dependency:

pip install datasketch[cassandra]

FAQs

What is datasketch?

Probabilistic data structures for processing and searching very large datasets. Visit Snyk Advisor to see a full health score report for datasketch, including popularity, security, maintenance & community analysis.

Is datasketch popular?

The python package datasketch receives a total of 676,026 weekly downloads. As such, datasketch popularity was classified as an influential project. Visit the popularity section on Snyk Advisor to see the full health analysis.

Is datasketch well maintained?

We found indications that datasketch maintenance is sustainable demonstrating some project activity. We saw a total of 30 open source contributors collaborating on the project. See the full package health analysis to learn more about the package maintenance status.

Is datasketch safe to use?

While scanning the latest version of datasketch, we found that a security review is needed. A total of 0 vulnerabilities or license issues were detected. See the full security scan results.

Last updated on 25 November-2024, at 23:38 (UTC).

Build a secure application checklist

Select a recommended open source package

Minimize your risk by selecting secure & well maintained open source packages

DONE

Scan your app for vulnerabilities

Scan your application to find vulnerabilities in your: source code, open source dependencies, containers and configuration files

SCAN NOW

Fix identified vulnerabilities

Easily fix your code by leveraging automatically generated PRs

AUTO FIX

Monitor for new issues

New vulnerabilities are discovered every day. Get notified if your application is affected

MONITOR APP

datasketch

Probabilistic data structures for processing and searching very large datasets For more information about how to use this package see README

Ensure you're using the healthiest python packages

Package Health Score

Popularity

Direct Usage Popularity

Security

Security and license risk for latest version

Maintenance

Commit Frequency

Community

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Snyk Vulnerability Scanner

Package

Not sure how to use datasketch?

datasketch: Big Data Looks Small

Install

FAQs

What is datasketch?

Is datasketch popular?

Is datasketch well maintained?

Is datasketch safe to use?

Build a secure application checklist

Select a recommended open source package

Scan your app for vulnerabilities

Fix identified vulnerabilities

Monitor for new issues

Package Health Score

Direct Usage Popularity

Security and license risk for latest version

Commit Frequency

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Snyk Vulnerability Scanner

Not sure how to use datasketch?

datasketch: Big Data Looks Small

Install

FAQs

What is datasketch?

Is datasketch popular?

Is datasketch well maintained?

Is datasketch safe to use?

Build a secure application checklist

Select a recommended open source package

Scan your app for vulnerabilities

Source Code

Open Source

Container

Config

Fix identified vulnerabilities

Monitor for new issues