Package Health Score

85 / 100

security
No known security issues
popularity
Recognized
maintenance
Healthy
community
Active

Popularity

Recognized

GitHub Stars: 1.63K
Forks: 249
Contributors: 80

Direct Usage Popularity

Based on project statistics from the GitHub repository for the PyPI package intel-extension-for-pytorch, we found that it has been starred 1,628 times.

Security

No known security issues

Security and license risk for latest version

Release Date: Nov 5, 2024
Direct Vulnerabilities: 0
C
0
H
0
M
0
L
Indirect Vulnerabilities: 0
C
0
H
0
M
0
L
License Risk: 0
H
0
M
0
L

All security vulnerabilities belong to production dependencies of direct and indirect packages.

License

Apache-2.0

Security Policy

Yes

You can connect your project's repository to Snyk to stay up to date on security alerts and receive automatic fix pull requests.

Keep your project free of vulnerabilities with Snyk

Maintenance

Healthy

Commit Frequency

Open Issues: 161
Open PR: 15
Last Release: 20 days ago
Last Commit: 4 days ago

Further analysis of the maintenance status of intel-extension-for-pytorch based on released PyPI versions cadence, the repository activity, and other data points determined that its maintenance is Healthy.

We found that intel-extension-for-pytorch demonstrates a positive version release cadence with at least one new version released in the past 3 months.

As a healthy sign for on-going project maintenance, we found that the GitHub repository had at least 1 pull request or issue interacted with by the community.

Community

Active

Readme: Yes
Contributing.md: Yes
Code of Conduct: Yes
Contributors: 80
Funding: No

With more than 10 contributors for the intel-extension-for-pytorch repository, this is possibly a sign for a growing and inviting community.

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Ensure all the packages you're using are healthy and well-maintained

Snyk Vulnerability Scanner

Get health score & security insights directly in your IDE

Package

Python Versions Compatibility: Unspecified

Age: 3 years
Latest Release: 20 days ago
Dependencies: 3 Direct
Versions: 19
Maintainers: 3
Wheels: Linux

Readme

Intel® Extension for PyTorch*

Intel® Extension for PyTorch* extends PyTorch* with up-to-date features optimizations for an extra performance boost on Intel hardware. Optimizations take advantage of Intel® Advanced Vector Extensions 512 (Intel® AVX-512) Vector Neural Network Instructions (VNNI) and Intel® Advanced Matrix Extensions (Intel® AMX) on Intel CPUs as well as Intel X^e Matrix Extensions (XMX) AI engines on Intel discrete GPUs. Moreover, Intel® Extension for PyTorch* provides easy GPU acceleration for Intel discrete GPUs through the PyTorch* xpu device.

ipex.llm - Large Language Models (LLMs) Optimization

In the current technological landscape, Generative AI (GenAI) workloads and models have gained widespread attention and popularity. Large Language Models (LLMs) have emerged as the dominant models driving these GenAI applications. Starting from 2.1.0, specific optimizations for certain LLM models are introduced in the Intel® Extension for PyTorch*. Check LLM optimizations for details.

Optimized Model List

MODEL FAMILY	MODEL NAME (Huggingface hub)	FP32	BF16	Static quantization INT8	Weight only quantization INT8	Weight only quantization INT4
LLAMA	meta-llama/Llama-2-7b-hf	🟩	🟩	🟩	🟩	🟩
LLAMA	meta-llama/Llama-2-13b-hf	🟩	🟩	🟩	🟩	🟩
LLAMA	meta-llama/Llama-2-70b-hf	🟩	🟩	🟩	🟩	🟩
LLAMA	meta-llama/Meta-Llama-3-8B	🟩	🟩	🟩	🟩	🟩
LLAMA	meta-llama/Meta-Llama-3-70B	🟩	🟩	🟩	🟩	🟩
LLAMA	meta-llama/Meta-Llama-3.1-8B-Instruct	🟩	🟩	🟩	🟩	🟩
LLAMA	meta-llama/Llama-3.2-3B-Instruct	🟩	🟩	🟩	🟩	🟩
LLAMA	meta-llama/Llama-3.2-11B-Vision-Instruct	🟩	🟩		🟩
GPT-J	EleutherAI/gpt-j-6b	🟩	🟩	🟩	🟩	🟩
GPT-NEOX	EleutherAI/gpt-neox-20b	🟩	🟩	🟩	🟩	🟩
DOLLY	databricks/dolly-v2-12b	🟩	🟩	🟩	🟩	🟩
FALCON	tiiuae/falcon-7b	🟩	🟩	🟩	🟩	🟩
FALCON	tiiuae/falcon-11b	🟩	🟩	🟩	🟩	🟩
FALCON	tiiuae/falcon-40b	🟩	🟩	🟩	🟩	🟩
OPT	facebook/opt-30b	🟩	🟩	🟩	🟩	🟩
OPT	facebook/opt-1.3b	🟩	🟩	🟩	🟩	🟩
Bloom	bigscience/bloom-1b7	🟩	🟩	🟩	🟩	🟩
CodeGen	Salesforce/codegen-2B-multi	🟩	🟩	🟩	🟩	🟩
Baichuan	baichuan-inc/Baichuan2-7B-Chat	🟩	🟩	🟩	🟩	🟩
Baichuan	baichuan-inc/Baichuan2-13B-Chat	🟩	🟩	🟩	🟩	🟩
Baichuan	baichuan-inc/Baichuan-13B-Chat	🟩	🟩	🟩	🟩	🟩
ChatGLM	THUDM/chatglm3-6b	🟩	🟩	🟩	🟩	🟩
ChatGLM	THUDM/chatglm2-6b	🟩	🟩	🟩	🟩	🟩
GPTBigCode	bigcode/starcoder	🟩	🟩	🟩	🟩	🟩
T5	google/flan-t5-xl	🟩	🟩	🟩	🟩
MPT	mosaicml/mpt-7b	🟩	🟩	🟩	🟩	🟩
Mistral	mistralai/Mistral-7B-v0.1	🟩	🟩	🟩	🟩	🟩
Mixtral	mistralai/Mixtral-8x7B-v0.1	🟩	🟩		🟩	🟩
Stablelm	stabilityai/stablelm-2-1_6b	🟩	🟩	🟩	🟩	🟩
Qwen	Qwen/Qwen-7B-Chat	🟩	🟩	🟩	🟩	🟩
Qwen	Qwen/Qwen2-7B	🟩	🟩	🟩	🟩	🟩
LLaVA	liuhaotian/llava-v1.5-7b	🟩	🟩		🟩	🟩
GIT	microsoft/git-base	🟩	🟩		🟩
Yuan	IEITYuan/Yuan2-102B-hf	🟩	🟩		🟩
Phi	microsoft/phi-2	🟩	🟩	🟩	🟩	🟩
Phi	microsoft/Phi-3-mini-4k-instruct	🟩	🟩	🟩	🟩	🟩
Phi	microsoft/Phi-3-mini-128k-instruct	🟩	🟩	🟩	🟩	🟩
Phi	microsoft/Phi-3-medium-4k-instruct	🟩	🟩	🟩	🟩	🟩
Phi	microsoft/Phi-3-medium-128k-instruct	🟩	🟩	🟩	🟩	🟩
Whisper	openai/whisper-large-v2	🟩	🟩	🟩	🟩

Note: The above verified models (including other models in the same model family, like "codellama/CodeLlama-7b-hf" from LLAMA family) are well supported with all optimizations like indirect access KV cache, fused ROPE, and customized linear kernels. We are working in progress to better support the models in the tables with various data types. In addition, more models will be optimized in the future.

In addition, Intel® Extension for PyTorch* introduces module level optimization APIs (prototype feature) since release 2.3.0. The feature provides optimized alternatives for several commonly used LLM modules and functionalities for the optimizations of the niche or customized LLMs. Please read LLM module level optimization practice to better understand how to optimize your own LLM and achieve better performance.

Support

The team tracks bugs and enhancement requests using GitHub issues. Before submitting a suggestion or bug report, search the existing GitHub issues to see if your issue has already been reported.

License

Apache License, Version 2.0. As found in LICENSE file.

Security

See Intel's Security Center for information on how to report a potential security issue or vulnerability.

intel-extension-for-pytorch dependencies

numpy packaging psutil

FAQs

What is intel-extension-for-pytorch?

Intel® Extension for PyTorch*. Visit Snyk Advisor to see a full health score report for intel-extension-for-pytorch, including popularity, security, maintenance & community analysis.

Is intel-extension-for-pytorch popular?

The python package intel-extension-for-pytorch receives a total of 8,195 weekly downloads. As such, intel-extension-for-pytorch popularity was classified as a recognized. Visit the popularity section on Snyk Advisor to see the full health analysis.

Is intel-extension-for-pytorch well maintained?

We found that intel-extension-for-pytorch demonstrated a healthy version release cadence and project activity. It has a community of 80 open source contributors collaborating on the project. See the full package health analysis to learn more about the package maintenance status.

Is intel-extension-for-pytorch safe to use?

The python package intel-extension-for-pytorch was scanned for known vulnerabilities and missing license, and no issues were found. Thus the package was deemed as safe to use. See the full health analysis review.

Last updated on 23 November-2024, at 21:44 (UTC).

Build a secure application checklist

Select a recommended open source package

Minimize your risk by selecting secure & well maintained open source packages

DONE

Scan your app for vulnerabilities

Scan your application to find vulnerabilities in your: source code, open source dependencies, containers and configuration files

SCAN NOW

Fix identified vulnerabilities

Easily fix your code by leveraging automatically generated PRs

AUTO FIX

Monitor for new issues

New vulnerabilities are discovered every day. Get notified if your application is affected

MONITOR APP

intel-extension-for-pytorch

Intel® Extension for PyTorch* For more information about how to use this package see README

Ensure you're using the healthiest python packages

Package Health Score

Popularity

Direct Usage Popularity

Security

Security and license risk for latest version

Maintenance

Commit Frequency

Community

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Snyk Vulnerability Scanner

Package

Readme

Intel® Extension for PyTorch*

ipex.llm - Large Language Models (LLMs) Optimization

Optimized Model List

Support

License

Security

intel-extension-for-pytorch dependencies

FAQs

What is intel-extension-for-pytorch?

Is intel-extension-for-pytorch popular?

Is intel-extension-for-pytorch well maintained?

Is intel-extension-for-pytorch safe to use?

Build a secure application checklist

Select a recommended open source package

Scan your app for vulnerabilities

Fix identified vulnerabilities

Monitor for new issues

Package Health Score

Direct Usage Popularity

Security and license risk for latest version

Commit Frequency

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Snyk Vulnerability Scanner

Readme

Intel® Extension for PyTorch*

ipex.llm - Large Language Models (LLMs) Optimization

Optimized Model List

Support

License

Security

intel-extension-for-pytorch dependencies

FAQs

What is intel-extension-for-pytorch?

Is intel-extension-for-pytorch popular?

Is intel-extension-for-pytorch well maintained?

Is intel-extension-for-pytorch safe to use?

Build a secure application checklist

Select a recommended open source package

Scan your app for vulnerabilities

Source Code

Open Source

Container

Config

Fix identified vulnerabilities

Monitor for new issues