View nni-daily on Snyk Open Source Advisor

Package Health Score

51 / 100

security
Security review needed
popularity
Small
maintenance
Inactive
community
Active

Popularity

Small

GitHub Stars: 14.06K
Forks: 1.82K
Contributors: 180

Direct Usage Popularity

Based on project statistics from the GitHub repository for the PyPI package nni-daily, we found that it has been starred 14,058 times.

Security

Security review needed

Security and license risk for latest version

Release Date: May 18, 2020
Direct Vulnerabilities: 0
C
0
H
0
M
0
L
Indirect Vulnerabilities: 0
C
0
H
0
M
0
L
License Risk: 0
H
2
M
0
L

All security vulnerabilities belong to production dependencies of direct and indirect packages.

License

MIT

Security Policy

Yes

You can connect your project's repository to Snyk to stay up to date on security alerts and receive automatic fix pull requests.

Keep your project free of vulnerabilities with Snyk

Maintenance

Inactive

archived

Commit Frequency

No Recent Commits

Open Issues: 399
Open PR: 18
Last Release: 5 years ago
Last Commit: 1 year ago

Further analysis of the maintenance status of nni-daily based on released PyPI versions cadence, the repository activity, and other data points determined that its maintenance is Inactive.

An important project maintenance signal to consider for nni-daily is that it hasn't seen any new versions released to PyPI in the past 12 months, and could be considered as a discontinued project, or that which receives low attention from its maintainers.

In the past month we didn't find any pull request activity or change in issues status has been detected for the GitHub repository.

Community

Active

Readme: Yes
Contributing.md: No
Code of Conduct: Yes
Contributors: 180
Funding: No

A good and healthy external contribution signal for nni-daily project, which invites more than one hundred open source maintainers to collaborate on the repository.

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Ensure all the packages you're using are healthy and well-maintained

Snyk Vulnerability Scanner

Get health score & security insights directly in your IDE

Package

Python Versions Compatibility: >=3.5

Age: 5 years
Latest Release: 5 years ago
Dependencies: 13 Direct / 26 Total
Versions: 58
Maintainers: 1
Wheels: Linux

Readme

简体中文

NNI (Neural Network Intelligence) is a lightweight but powerful toolkit to help users automate Feature Engineering, Neural Architecture Search, Hyperparameter Tuning and Model Compression.

The tool manages automated machine learning (AutoML) experiments, dispatches and runs experiments' trial jobs generated by tuning algorithms to search the best neural architecture and/or hyper-parameters in different training environments like Local Machine, Remote Servers, OpenPAI, Kubeflow, FrameworkController on K8S (AKS etc.), DLWorkspace (aka. DLTS) and other cloud options.

Who should consider using NNI

Those who want to try different AutoML algorithms in their training code/model.
Those who want to run AutoML trial jobs in different environments to speed up search.
Researchers and data scientists who want to easily implement and experiment new AutoML algorithms, may it be: hyperparameter tuning algorithm, neural architect search algorithm or model compression algorithm.
ML Platform owners who want to support AutoML in their platform.

NNI v1.5 has been released!

NNI capabilities in a glance

NNI provides CommandLine Tool as well as an user friendly WebUI to manage training experiments. With the extensible API, you can customize your own AutoML algorithms and training services. To make it easy for new users, NNI also provides a set of build-in stat-of-the-art AutoML algorithms and out of box support for popular training platforms.

Within the following table, we summarized the current NNI capabilities, we are gradually adding new capabilities and we'd love to have your contribution.

<tr valign="top">
<td valign="middle" align="center">
<b>Built-in</b>
  </td>
  <td>
  <ul><li><b>Supported Frameworks</b></li>
    <ul>
      <li>PyTorch</li>
      <li>Keras</li>
      <li>TensorFlow</li>
      <li>MXNet</li>
      <li>Caffe2</li>
      <a href="docs/en_US/SupportedFramework_Library.md">More...</a><br>
    </ul>
    </ul>
  <ul>
    <li><b>Supported Libraries</b></li>
      <ul>
       <li>Scikit-learn</li>
       <li>XGBoost</li>
       <li>LightGBM</li>
       <a href="docs/en_US/SupportedFramework_Library.md">More...</a><br>
      </ul>
  </ul>
    <ul>
    <li><b>Examples</b></li>
     <ul>
       <li><a href="examples/trials/mnist-pytorch">MNIST-pytorch</a></li>
       <li><a href="examples/trials/mnist-tfv1">MNIST-tensorflow</a></li>
       <li><a href="examples/trials/mnist-keras">MNIST-keras</a></li>
       <li><a href="docs/en_US/TrialExample/GbdtExample.md">Auto-gbdt</a></li>
       <li><a href="docs/en_US/TrialExample/Cifar10Examples.md">Cifar10-pytorch</a></li>
       <li><a href="docs/en_US/TrialExample/SklearnExamples.md">Scikit-learn</a></li>
       <li><a href="docs/en_US/TrialExample/EfficientNet.md">EfficientNet</a></li>
          <a href="docs/en_US/SupportedFramework_Library.md">More...</a><br>
      </ul>
    </ul>
  </td>
  <td align="left">
    <a href="docs/en_US/Tuner/BuiltinTuner.md">Hyperparameter Tuning</a>
    <ul>
      <b>Exhaustive search</b>
      <ul>
        <li><a href="docs/en_US/Tuner/BuiltinTuner.md#Random">Random Search</a></li>
        <li><a href="docs/en_US/Tuner/BuiltinTuner.md#GridSearch">Grid Search</a></li>
        <li><a href="docs/en_US/Tuner/BuiltinTuner.md#Batch">Batch</a></li>
        </ul>
      <b>Heuristic search</b>
      <ul>
        <li><a href="docs/en_US/Tuner/BuiltinTuner.md#Evolution">Naïve Evolution</a></li>
        <li><a href="docs/en_US/Tuner/BuiltinTuner.md#Anneal">Anneal</a></li>
        <li><a href="docs/en_US/Tuner/BuiltinTuner.md#Hyperband">Hyperband</a></li>
        <li><a href="docs/en_US/Tuner/BuiltinTuner.md#PBTTuner">PBT</a></li>
      </ul>
      <b>Bayesian optimization</b>
        <ul>
          <li><a href="docs/en_US/Tuner/BuiltinTuner.md#BOHB">BOHB</a></li>
          <li><a href="docs/en_US/Tuner/BuiltinTuner.md#TPE">TPE</a></li>
        <li><a href="docs/en_US/Tuner/BuiltinTuner.md#SMAC">SMAC</a></li>
        <li><a href="docs/en_US/Tuner/BuiltinTuner.md#MetisTuner">Metis Tuner</a></li>
        <li><a href="docs/en_US/Tuner/BuiltinTuner.md#GPTuner">GP Tuner</a></li>
        </ul>
      <b>RL Based</b>
      <ul>
        <li><a href="docs/en_US/Tuner/BuiltinTuner.md#PPOTuner">PPO Tuner</a> </li>
      </ul>
    </ul>
      <a href="docs/en_US/NAS/Overview.md">Neural Architecture Search</a>
      <ul>
        <ul>
          <li><a href="docs/en_US/NAS/ENAS.md">ENAS</a></li>
          <li><a href="docs/en_US/NAS/DARTS.md">DARTS</a></li>
          <li><a href="docs/en_US/NAS/PDARTS.md">P-DARTS</a></li>
          <li><a href="docs/en_US/NAS/CDARTS.md">CDARTS</a></li>
          <li><a href="docs/en_US/NAS/SPOS.md">SPOS</a></li>
          <li><a href="docs/en_US/NAS/Proxylessnas.md">ProxylessNAS</a></li>
          <li><a href="docs/en_US/Tuner/BuiltinTuner.md#NetworkMorphism">Network Morphism</a></li>
          <li><a href="docs/en_US/NAS/TextNAS.md">TextNAS</a></li>
        </ul>
      </ul>
      <a href="docs/en_US/Compressor/Overview.md">Model Compression</a>
      <ul>
        <b>Pruning</b>
        <ul>
          <li><a href="docs/en_US/Compressor/Pruner.md#agp-pruner">AGP Pruner</a></li>
          <li><a href="docs/en_US/Compressor/Pruner.md#slim-pruner">Slim Pruner</a></li>
          <li><a href="docs/en_US/Compressor/Pruner.md#fpgm-pruner">FPGM Pruner</a></li>
        </ul>
        <b>Quantization</b>
        <ul>
          <li><a href="docs/en_US/Compressor/Quantizer.md#qat-quantizer">QAT Quantizer</a></li>
          <li><a href="docs/en_US/Compressor/Quantizer.md#dorefa-quantizer">DoReFa Quantizer</a></li>
        </ul>
      </ul>
      <a href="docs/en_US/FeatureEngineering/Overview.md">Feature Engineering (Beta)</a>
      <ul>
      <li><a href="docs/en_US/FeatureEngineering/GradientFeatureSelector.md">GradientFeatureSelector</a></li>
      <li><a href="docs/en_US/FeatureEngineering/GBDTSelector.md">GBDTSelector</a></li>
      </ul>
      <a href="docs/en_US/Assessor/BuiltinAssessor.md">Early Stop Algorithms</a>
      <ul>
      <li><a href="docs/en_US/Assessor/BuiltinAssessor.md#Medianstop">Median Stop</a></li>
      <li><a href="docs/en_US/Assessor/BuiltinAssessor.md#Curvefitting">Curve Fitting</a></li>
      </ul>
  </td>
  <td>
  <ul>
    <li><a href="docs/en_US/TrainingService/LocalMode.md">Local Machine</a></li>
    <li><a href="docs/en_US/TrainingService/RemoteMachineMode.md">Remote Servers</a></li>
    <li><b>Kubernetes based services</b></li>
        <ul><li><a href="docs/en_US/TrainingService/PaiMode.md">OpenPAI</a></li>
        <li><a href="docs/en_US/TrainingService/KubeflowMode.md">Kubeflow</a></li>
        <li><a href="docs/en_US/TrainingService/FrameworkControllerMode.md">FrameworkController on K8S (AKS etc.)</a></li>
        </ul>
        <ul><li><a href="docs/en_US/TrainingService/DLTSMode.md">DLWorkspace (aka. DLTS)</a></li>        
  </ul>
  </ul></td>
</tr>
  <tr valign="bottom" align="center">
  
  </tr>
  <tr valign="top">
   <td valign="middle">
<b>References</b>
  </td>
 <td style="border-top:#FF0000 solid 0px;">
  <ul>
    <li><a href="https://nni.readthedocs.io/en/latest/autotune_ref.html#trial">Python API</a></li>
    <li><a href="docs/en_US/Tutorial/AnnotationSpec.md">NNI Annotation</a></li>
     <li><a href="https://nni.readthedocs.io/en/latest/installation.html">Supported OS</a></li>
  </ul>
  </td>
   <td style="border-top:#FF0000 solid 0px;">
  <ul>
    <li><a href="docs/en_US/Tuner/CustomizeTuner.md">CustomizeTuner</a></li>
    <li><a href="docs/en_US/Assessor/CustomizeAssessor.md">CustomizeAssessor</a></li>
  </ul>
  </td>
    <td style="border-top:#FF0000 solid 0px;">
  <ul>
    <li><a href="docs/en_US/TrainingService/SupportTrainingService.md">Support TrainingService</a></li><a href="docs/en_US/TrainingService/SupportTrainingService.md">
    </a><li><a href="docs/en_US/TrainingService/SupportTrainingService.md"></a><a href="docs/en_US/TrainingService/HowToImplementTrainingService.md">Implement TrainingService</a></li>
  </ul>
  </td>
</tr>

Frameworks & Libraries

Algorithms

Training Services

Installation

Install

NNI supports and is tested on Ubuntu >= 16.04, macOS >= 10.14.1, and Windows 10 >= 1809. Simply run the following pip install in an environment that has python 64-bit >= 3.5.

Linux or macOS

python3 -m pip install --upgrade nni

Windows

python -m pip install --upgrade nni

If you want to try latest code, please install NNI from source code.

For detail system requirements of NNI, please refer to here for Linux & macOS, and here for Windows.

Note:

If there is any privilege issue, add --user to install NNI in the user directory.
Currently NNI on Windows supports local, remote and pai mode. Anaconda or Miniconda is highly recommended to install NNI on Windows.
If there is any error like Segmentation fault, please refer to FAQ. For FAQ on Windows, please refer to NNI on Windows.

Verify installation

The following example is built on TensorFlow 1.x. Make sure TensorFlow 1.x is used when running it.

Download the examples via clone the source code.

git clone -b v1.5 https://github.com/Microsoft/nni.git

Run the MNIST example.

Linux or macOS

nnictl create --config nni/examples/trials/mnist-tfv1/config.yml

Windows

nnictl create --config nni\examples\trials\mnist-tfv1\config_windows.yml

Wait for the message INFO: Successfully started experiment! in the command line. This message indicates that your experiment has been successfully started. You can explore the experiment using the Web UI url.

INFO: Starting restful server...
INFO: Successfully started Restful server!
INFO: Setting local config...
INFO: Successfully set local config!
INFO: Starting experiment...
INFO: Successfully started experiment!
-----------------------------------------------------------------------
The experiment id is egchD4qy
The Web UI urls are: http://223.255.255.1:8080   http://127.0.0.1:8080
-----------------------------------------------------------------------

You can use these commands to get more information about the experiment
-----------------------------------------------------------------------
         commands                       description
1. nnictl experiment show        show the information of experiments
2. nnictl trial ls               list all of trial jobs
3. nnictl top                    monitor the status of running experiments
4. nnictl log stderr             show stderr log content
5. nnictl log stdout             show stdout log content
6. nnictl stop                   stop an experiment
7. nnictl trial kill             kill a trial job by id
8. nnictl --help                 get help information about nnictl
-----------------------------------------------------------------------

Open the Web UI url in your browser, you can view detail information of the experiment and all the submitted trial jobs as shown below. Here are more Web UI pages.

Documentation

To learn about what's NNI, read the NNI Overview.
To get yourself familiar with how to use NNI, read the documentation.
To get started and install NNI on your system, please refer to Install NNI.

Contributing

This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.microsoft.com.

When you submit a pull request, a CLA-bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., label, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.

After getting familiar with contribution agreements, you are ready to create your first PR =), follow the NNI developer tutorials to get start:

We recommend new contributors to start with simple issues: 'good first issue' or 'help-wanted'.
NNI developer environment installation tutorial
How to debug
If you have any questions on usage, review FAQ first, if there are no relevant issues and answers to your question, try contact NNI dev team and users in Gitter or File an issue on GitHub.
Customize your own Tuner
Implement customized TrainingService
Implement a new NAS trainer on NNI
Customize your own Advisor

External Repositories and References

With authors' permission, we listed a set of NNI usage examples and relevant articles.

External Repositories
- Run ENAS with NNI
- Run Neural Network Architecture Search with NNI
- Automatic Feature Engineering with NNI
- Hyperparameter Tuning for Matrix Factorization with NNI
- scikit-nni Hyper-parameter search for scikit-learn pipelines using NNI
Relevant Articles
- Hyper Parameter Optimization Comparison
- Neural Architecture Search Comparison
- Parallelizing a Sequential Algorithm TPE
- Automatically tuning SVD with NNI
- Automatically tuning SPTAG with NNI
- Find thy hyper-parameters for scikit-learn pipelines using Microsoft NNI
- Blog (in Chinese) - AutoML tools (Advisor, NNI and Google Vizier) comparison by @gaocegege - 总结与分析 section of design and implementation of kubeflow/katib
- Blog (in Chinese) - A summary of NNI new capabilities in 2019 by @squirrelsc

Feedback

File an issue on GitHub.
Ask a question with NNI tags on Stack Overflow.
Discuss on the NNI Gitter in NNI.

Join IM discussion groups:

Gitter		WeChat
	OR

Related Projects

Targeting at openness and advancing state-of-art technology, Microsoft Research (MSR) had also released few other open source projects.

OpenPAI : an open source platform that provides complete AI model training and resource management capabilities, it is easy to extend and supports on-premise, cloud and hybrid environments in various scale.
FrameworkController : an open source general-purpose Kubernetes Pod Controller that orchestrate all kinds of applications on Kubernetes by a single controller.
MMdnn : A comprehensive, cross-framework solution to convert, visualize and diagnose deep neural network models. The "MM" in MMdnn stands for model management and "dnn" is an acronym for deep neural network.
SPTAG : Space Partition Tree And Graph (SPTAG) is an open source library for large scale vector approximate nearest neighbor search scenario.

We encourage researchers and students leverage these projects to accelerate the AI development and research.

License

The entire codebase is under MIT license

nni-daily dependencies

astor colorama coverage hyperopt json-tricks numpy psutil pythonwebhdfs requests ruamel-yaml schema scikit-learn scipy

FAQs

What is nni-daily?

Neural Network Intelligence package. Visit Snyk Advisor to see a full health score report for nni-daily, including popularity, security, maintenance & community analysis.

Is nni-daily popular?

The python package nni-daily receives a total of 424 weekly downloads. As such, nni-daily popularity was classified as small. Visit the popularity section on Snyk Advisor to see the full health analysis.

Is nni-daily well maintained?

We found indications that nni-daily is an Inactive project. See the full package health analysis to learn more about the package maintenance status.

Is nni-daily safe to use?

While scanning the latest version of nni-daily, we found that a security review is needed. A total of 0 vulnerabilities or license issues were detected. See the full security scan results.

Last updated on 24 November-2024, at 09:07 (UTC).

Build a secure application checklist

Select a recommended open source package

Minimize your risk by selecting secure & well maintained open source packages

DONE

Scan your app for vulnerabilities

Scan your application to find vulnerabilities in your: source code, open source dependencies, containers and configuration files

SCAN NOW

Fix identified vulnerabilities

Easily fix your code by leveraging automatically generated PRs

AUTO FIX

Monitor for new issues

New vulnerabilities are discovered every day. Get notified if your application is affected

MONITOR APP

Package Health Score

Direct Usage Popularity

Security and license risk for latest version

Commit Frequency

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Snyk Vulnerability Scanner

Readme

Who should consider using NNI

NNI v1.5 has been released!

NNI capabilities in a glance

Installation

Install

Verify installation

Documentation

Contributing

External Repositories and References

External Repositories

Relevant Articles

Feedback

Related Projects

License

nni-daily dependencies

FAQs

What is nni-daily?

Is nni-daily popular?

Is nni-daily well maintained?

Is nni-daily safe to use?

Build a secure application checklist

Select a recommended open source package

Scan your app for vulnerabilities

Source Code

Open Source

Container

Config

Fix identified vulnerabilities

Monitor for new issues