dag-dq-generator

v1.0.5

DPaaS Airflow DAG (Dynamic Acyclic Graph) and DQ (Data Quality) generator For more information about how to use this package see README

Latest version published 12 months ago

License: Apache-2.0

PyPI

GitHub

Package Health Score

70 / 100

security
Security review needed
popularity
Small
maintenance
Sustainable
community
Active

Popularity

Small

GitHub Stars: 36.68K
Forks: 14.2K
Contributors: 420

Direct Usage Popularity

Based on project statistics from the GitHub repository for the PyPI package dag-dq-generator, we found that it has been starred 36,684 times.

Security

Security review needed

Security and license risk for latest version

Release Date: Dec 6, 2023
Direct Vulnerabilities: 0
C
0
H
0
M
0
L
Indirect Vulnerabilities: 0
C
0
H
0
M
0
L
License Risk: 1
H
15
M
0
L

All security vulnerabilities belong to production dependencies of direct and indirect packages.

License

Apache-2.0

Security Policy

Yes

You can connect your project's repository to Snyk to stay up to date on security alerts and receive automatic fix pull requests.

Keep your project free of vulnerabilities with Snyk

Maintenance

Sustainable

Commit Frequency

Open Issues: 986
Open PR: 199
Last Release: 12 months ago
Last Commit: 1 month ago

Further analysis of the maintenance status of dag-dq-generator based on released PyPI versions cadence, the repository activity, and other data points determined that its maintenance is Sustainable.

We found that dag-dq-generator demonstrates a positive version release cadence with at least one new version released in the past 12 months.

In the past month we didn't find any pull request activity or change in issues status has been detected for the GitHub repository.

Community

Active

Readme: Yes
Contributing.md: Yes
Code of Conduct: Yes
Contributors: 420
Funding: No

A good and healthy external contribution signal for dag-dq-generator project, which invites more than one hundred open source maintainers to collaborate on the repository.

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Ensure all the packages you're using are healthy and well-maintained

Snyk Vulnerability Scanner

Get health score & security insights directly in your IDE

Package

Python Versions Compatibility: ==3.7.*

Age: 2 years
Latest Release: 12 months ago
Dependencies: N/A
Versions: 5
Maintainers: 1
Wheels: No

Readme

dag-dq-generator

DPaaS Airflow DAG (Dynamic Acyclic Graph) and DQ (Data Quality) generator.

dag-dq-generator is a DPaaS Apache Airflow Airflow DAG (Dynamic Acyclic Graph) and DQ (Data Quality) generator from YAML configuration files.

Usage

Setup

dag-dq-generator requires Python 3.6.0+. To set up your environment, you can run sh build.sh which installs the required Python packages and run the generator program. Otherwise, you can run pip install -r requirements.txt to install the required Python packages and run python dag_generator.py with the following parameters:

--config-path defines the path to the configurations folder. Defaults to ./configs/
--dag-storage-path defines the path to the folder where generated DAGs will be stored. Defaults to ./dags/
--dq-storage-path defines the path to the folder where DQ SQL files will be stored. Defaults to ./sql/

YAML Definition

Benefits

Construct DAGs without knowing Python
Construct DAGs without learning Airflow primitives
Avoid duplicative code

Contributing

Contributions are welcome! Just submit a Pull Request or Github Issue. Feel free to join the discussions on the #dag-dq-generator Slack channel.

FAQs

What is dag-dq-generator?

DPaaS Airflow DAG (Dynamic Acyclic Graph) and DQ (Data Quality) generator. Visit Snyk Advisor to see a full health score report for dag-dq-generator, including popularity, security, maintenance & community analysis.

Is dag-dq-generator popular?

The python package dag-dq-generator receives a total of 48 weekly downloads. As such, dag-dq-generator popularity was classified as small. Visit the popularity section on Snyk Advisor to see the full health analysis.

Is dag-dq-generator well maintained?

We found indications that dag-dq-generator maintenance is sustainable demonstrating some project activity. We saw a total of 420 open source contributors collaborating on the project. See the full package health analysis to learn more about the package maintenance status.

Is dag-dq-generator safe to use?

While scanning the latest version of dag-dq-generator, we found that a security review is needed. A total of 0 vulnerabilities or license issues were detected. See the full security scan results.

Last updated on 17 November-2024, at 02:22 (UTC).

Build a secure application checklist

Select a recommended open source package

Minimize your risk by selecting secure & well maintained open source packages

DONE

Scan your app for vulnerabilities

Scan your application to find vulnerabilities in your: source code, open source dependencies, containers and configuration files

SCAN NOW

Fix identified vulnerabilities

Easily fix your code by leveraging automatically generated PRs

AUTO FIX

Monitor for new issues

New vulnerabilities are discovered every day. Get notified if your application is affected

MONITOR APP

Package Health Score

Direct Usage Popularity

Security and license risk for latest version

Commit Frequency

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Snyk Vulnerability Scanner

Readme

dag-dq-generator

Usage

Setup

YAML Definition

Benefits

Contributing

FAQs

What is dag-dq-generator?

Is dag-dq-generator popular?

Is dag-dq-generator well maintained?

Is dag-dq-generator safe to use?

Build a secure application checklist

Select a recommended open source package

Scan your app for vulnerabilities

Source Code

Open Source

Container

Config

Fix identified vulnerabilities

Monitor for new issues