megatron-core

v0.9.0

Megatron Core - a library for efficient and scalable training of transformer based models For more information about how to use this package see README

Latest version published 1 month ago

License: BSD-3-Clause

PyPI

GitHub

Package Health Score

90 / 100

security
No known security issues
popularity
Popular
maintenance
Healthy
community
Active

Explore Similar Packages

Popularity

Popular

GitHub Stars: 10.59K
Forks: 2.37K
Contributors: 120

Direct Usage Popularity

Based on project statistics from the GitHub repository for the PyPI package megatron-core, we found that it has been starred 10,591 times.

Security

No known security issues

Security and license risk for latest version

Release Date: Oct 24, 2024
Direct Vulnerabilities: 0
C
0
H
0
M
0
L
Indirect Vulnerabilities: 0
C
0
H
0
M
0
L
License Risk: 0
H
0
M
0
L

All security vulnerabilities belong to production dependencies of direct and indirect packages.

License

BSD-3-Clause

Security Policy

We found a way for you to contribute to the project! Looks like megatron-core is missing a security policy.

You can connect your project's repository to Snyk to stay up to date on security alerts and receive automatic fix pull requests.

Keep your project free of vulnerabilities with Snyk

Maintenance

Healthy

Commit Frequency

Open Issues: 134
Open PR: 152
Last Release: 1 month ago
Last Commit: 4 days ago

Further analysis of the maintenance status of megatron-core based on released PyPI versions cadence, the repository activity, and other data points determined that its maintenance is Healthy.

We found that megatron-core demonstrates a positive version release cadence with at least one new version released in the past 3 months.

As a healthy sign for on-going project maintenance, we found that the GitHub repository had at least 1 pull request or issue interacted with by the community.

Community

Active

Readme: Yes
Contributing.md: Yes
Code of Conduct: No
Contributors: 120
Funding: No

A good and healthy external contribution signal for megatron-core project, which invites more than one hundred open source maintainers to collaborate on the repository.

We found a way for you to contribute to the project! Looks like megatron-core is missing a Code of Conduct.

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Ensure all the packages you're using are healthy and well-maintained

Snyk Vulnerability Scanner

Get health score & security insights directly in your IDE

Package

Python Versions Compatibility: ==3.8.*, ==3.9.*

Age: 2 years
Latest Release: 1 month ago
Dependencies: N/A
Versions: 9
Maintainers: 3
Wheels: Linux

Readme

Megatron-Core

Megatron-Core is an open-source PyTorch-based library that contains GPU-optimized techniques and cutting-edge system-level optimizations. It abstracts them into composable and modular APIs, allowing full flexibility for developers and model researchers to train custom transformers at-scale on NVIDIA accelerated computing infrastructure. This library is compatible with all NVIDIA Tensor Core GPUs, including FP8 acceleration support for NVIDIA Hopper architectures.

Megatron-Core offers core building blocks such as attention mechanisms, transformer blocks and layers, normalization layers, and embedding techniques. Additional functionality like activation re-computation, distributed checkpointing is also natively built-in to the library. The building blocks and functionality are all GPU optimized, and can be built with advanced parallelization strategies for optimal training speed and stability on NVIDIA Accelerated Computing Infrastructure. Another key component of the Megatron-Core library includes advanced model parallelism techniques (tensor, sequence, pipeline, context, and MoE expert parallelism).

Megatron-Core can be used with NVIDIA NeMo, an enterprise-grade AI platform. Alternatively, you can explore Megatron-Core with the native PyTorch training loop here. Visit Megatron-Core documentation to learn more.

Quick links

FAQs

What is megatron-core?

Megatron Core - a library for efficient and scalable training of transformer based models. Visit Snyk Advisor to see a full health score report for megatron-core, including popularity, security, maintenance & community analysis.

Is megatron-core popular?

The python package megatron-core receives a total of 10,287 weekly downloads. As such, megatron-core popularity was classified as a popular. Visit the popularity section on Snyk Advisor to see the full health analysis.

Is megatron-core well maintained?

We found that megatron-core demonstrated a healthy version release cadence and project activity. It has a community of 120 open source contributors collaborating on the project. See the full package health analysis to learn more about the package maintenance status.

Is megatron-core safe to use?

The python package megatron-core was scanned for known vulnerabilities and missing license, and no issues were found. Thus the package was deemed as safe to use. See the full health analysis review.

Last updated on 22 November-2024, at 15:21 (UTC).

Build a secure application checklist

Select a recommended open source package

Minimize your risk by selecting secure & well maintained open source packages

DONE

Scan your app for vulnerabilities

Scan your application to find vulnerabilities in your: source code, open source dependencies, containers and configuration files

SCAN NOW

Fix identified vulnerabilities

Easily fix your code by leveraging automatically generated PRs

AUTO FIX

Monitor for new issues

New vulnerabilities are discovered every day. Get notified if your application is affected

MONITOR APP