Package Health Score

65 / 100

security
No known security issues
popularity
Limited
maintenance
Inactive
community
Active

Popularity

Limited

GitHub Stars: 69
Forks: 22
Contributors: 20

Direct Usage Popularity

Based on project statistics from the GitHub repository for the PyPI package ragas-once, we found that it has been starred 69 times.

Security

No known security issues

Security and license risk for latest version

Release Date: Jan 19, 2024
Direct Vulnerabilities: 0
C
0
H
0
M
0
L
Indirect Vulnerabilities: 0
C
0
H
0
M
0
L
License Risk: 0
H
0
M
0
L

All security vulnerabilities belong to production dependencies of direct and indirect packages.

License

Apache-2.0

Security Policy

We found a way for you to contribute to the project! Looks like ragas-once is missing a security policy.

You can connect your project's repository to Snyk to stay up to date on security alerts and receive automatic fix pull requests.

Keep your project free of vulnerabilities with Snyk

Maintenance

Inactive

Commit Frequency

Open Issues: 68
Open PR: 0
Last Release: 6 months ago
Last Commit: 3 months ago

Further analysis of the maintenance status of ragas-once based on released PyPI versions cadence, the repository activity, and other data points determined that its maintenance is Inactive.

We found that ragas-once demonstrates a positive version release cadence with at least one new version released in the past 12 months.

In the past month we didn't find any pull request activity or change in issues status has been detected for the GitHub repository.

Community

Active

Readme: Yes
Contributing.md: No
Code of Conduct: Yes
Contributors: 20
Funding: No

With more than 10 contributors for the ragas-once repository, this is possibly a sign for a growing and inviting community.

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Ensure all the packages you're using are healthy and well-maintained

Snyk Vulnerability Scanner

Get health score & security insights directly in your IDE

Package

Python Versions Compatibility: >=3.8

Age: 6 months
Latest Release: 6 months ago
Dependencies: N/A
Versions: 1
Maintainers: 1
Wheels: OS Independent

Readme

Ragas CLI

A one-step Ragas cli tool to evaluate QCAG testsets generated by RAG apps. (Q = Question, C = Contexts, A = Answer, G = Ground_truth)

Install with pip

pip install ragas langchain==0.0.354

then:

pip install ragas_once

Arguments

--model: Specifies the model to use for evaluation.
- Default value is "gpt-3.5-turbo". Langchain compatible.
--api_base: Specifies the base URL for the API.
- Default value is "https://api.openai.com/v1".
--api_key: Specifies the API key to authenticate requests.
- Not required if using psuedo-openai API server, e.g. vLLM, Fastchat, etc.
--embeddings: Specifies the Huggingface embeddings model to use for evaluation.
- Embeddings will run locally.
- Will use OpenAI embeddings if not set.
- Better set if using psuedo-openai API server.
--metrics: Specifies the metrics to use for evaluation.
- Will use Ragas default metrics if not set.
- Default metrics: ["answer_relevancy", "context_precision", "faithfulness", "context_recall", "context_relevancy"]
- Other metrics: "answer_similarity", "answer_correctness"
--dataset: Specifies the path to the dataset for evaluation.
- Dataset format must meet RAGAS requirements.
- Will use fiqa dataset as demo if not set.

Usage

Fiqa dataset demo:

python3 -m ragas_once.cli --api_key "YOUR_OPENAI_API_KEY"

Evaluate with GPT-4 and `BAAI/bge-small-en` embeddings

The huggingface embeddings will run locally, so Make sure your machine works and have sentence-transformers installed:

pip install sentence-transformers

Then run:

python3 -m ragas_once.cli --model "gpt-4" --api_key "YOUR_OPENAI_API_KEY" --embeddings "BAAI/bge-small-en" --dataset "path/to/dataset.csv"

Prepare Dataset

See Ragas documentation

FAQs

What is ragas-once?

A one-step Ragas cli tool to evaluate RAG apps. Visit Snyk Advisor to see a full health score report for ragas-once, including popularity, security, maintenance & community analysis.

Is ragas-once popular?

The python package ragas-once receives a total of 23 weekly downloads. As such, ragas-once popularity was classified as limited. Visit the popularity section on Snyk Advisor to see the full health analysis.

Is ragas-once well maintained?

We found indications that ragas-once is an Inactive project. See the full package health analysis to learn more about the package maintenance status.

Is ragas-once safe to use?

The python package ragas-once was scanned for known vulnerabilities and missing license, and no issues were found. Thus the package was deemed as safe to use. See the full health analysis review.

Last updated on 26 July-2024, at 20:12 (UTC).

Build a secure application checklist

Select a recommended open source package

Minimize your risk by selecting secure & well maintained open source packages

DONE

Scan your app for vulnerabilities

Scan your application to find vulnerabilities in your: source code, open source dependencies, containers and configuration files

SCAN NOW

Fix identified vulnerabilities

Easily fix your code by leveraging automatically generated PRs

AUTO FIX

Monitor for new issues

New vulnerabilities are discovered every day. Get notified if your application is affected

MONITOR APP

ragas-once

A one-step Ragas cli tool to evaluate RAG apps For more information about how to use this package see README

Ensure you're using the healthiest python packages

Package Health Score

Popularity

Direct Usage Popularity

Security

Security and license risk for latest version

Maintenance

Commit Frequency

Community

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Snyk Vulnerability Scanner

Package

Readme

Ragas CLI

Install with pip

Arguments

Usage

Fiqa dataset demo:

Evaluate with GPT-4 and `BAAI/bge-small-en` embeddings

Prepare Dataset

FAQs

What is ragas-once?

Is ragas-once popular?

Is ragas-once well maintained?

Is ragas-once safe to use?

Build a secure application checklist

Select a recommended open source package

Scan your app for vulnerabilities

Fix identified vulnerabilities

Monitor for new issues

Package Health Score

Direct Usage Popularity

Security and license risk for latest version

Commit Frequency

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Snyk Vulnerability Scanner

Readme

Ragas CLI

Install with pip

Arguments

Usage

Fiqa dataset demo:

Evaluate with GPT-4 and BAAI/bge-small-en embeddings

Prepare Dataset

FAQs

What is ragas-once?

Is ragas-once popular?

Is ragas-once well maintained?

Is ragas-once safe to use?

Build a secure application checklist

Select a recommended open source package

Scan your app for vulnerabilities

Source Code

Open Source

Container

Config

Fix identified vulnerabilities

Monitor for new issues

Evaluate with GPT-4 and `BAAI/bge-small-en` embeddings