stable-baselines3

v2.4.0

Pytorch version of Stable Baselines, implementations of reinforcement learning algorithms. For more information about how to use this package see README

Latest version published 1 month ago

License: MIT

PyPI

GitHub

Package Health Score

93 / 100

security
No known security issues
popularity
Popular
maintenance
Healthy
community
Active

Explore Similar Packages

Popularity

Popular

GitHub Stars: 9.4K
Forks: 1.73K
Contributors: 150

Direct Usage Popularity

Based on project statistics from the GitHub repository for the PyPI package stable-baselines3, we found that it has been starred 9,400 times.

Security

No known security issues

Security and license risk for latest version

Release Date: Nov 18, 2024
Direct Vulnerabilities: 0
C
0
H
0
M
0
L
Indirect Vulnerabilities: 0
C
0
H
0
M
0
L
License Risk: 0
H
0
M
0
L

All security vulnerabilities belong to production dependencies of direct and indirect packages.

License

MIT

Security Policy

We found a way for you to contribute to the project! Looks like stable-baselines3 is missing a security policy.

You can connect your project's repository to Snyk to stay up to date on security alerts and receive automatic fix pull requests.

Keep your project free of vulnerabilities with Snyk

Maintenance

Healthy

Commit Frequency

Open Issues: 64
Open PR: 19
Last Release: 1 month ago
Last Commit: 7 days ago

Further analysis of the maintenance status of stable-baselines3 based on released PyPI versions cadence, the repository activity, and other data points determined that its maintenance is Healthy.

We found that stable-baselines3 demonstrates a positive version release cadence with at least one new version released in the past 3 months.

As a healthy sign for on-going project maintenance, we found that the GitHub repository had at least 1 pull request or issue interacted with by the community.

Community

Active

Readme: Yes
Contributing.md: Yes
Code of Conduct: Yes
Contributors: 150
Funding: No

A good and healthy external contribution signal for stable-baselines3 project, which invites more than one hundred open source maintainers to collaborate on the repository.

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Ensure all the packages you're using are healthy and well-maintained

Snyk Vulnerability Scanner

Get health score & security insights directly in your IDE

Package

Python Versions Compatibility: >=3.8

Age: 5 years
Latest Release: 1 month ago
Dependencies: 3 Direct
Versions: 95
Maintainers: 5
Wheels: OS Independent

Readme

Stable Baselines3

Stable Baselines3 is a set of reliable implementations of reinforcement learning algorithms in PyTorch. It is the next major version of Stable Baselines.

These algorithms will make it easier for the research community and industry to replicate, refine, and identify new ideas, and will create good baselines to build projects on top of. We expect these tools will be used as a base around which new ideas can be added, and as a tool for comparing a new approach against existing ones. We also hope that the simplicity of these tools will allow beginners to experiment with a more advanced toolset, without being buried in implementation details.

Links

Repository: https://github.com/DLR-RM/stable-baselines3

Blog post: https://araffin.github.io/post/sb3/

Documentation: https://stable-baselines3.readthedocs.io/en/master/

RL Baselines3 Zoo: https://github.com/DLR-RM/rl-baselines3-zoo

SB3 Contrib: https://github.com/Stable-Baselines-Team/stable-baselines3-contrib

Quick example

Most of the library tries to follow a sklearn-like syntax for the Reinforcement Learning algorithms using Gym.

Here is a quick example of how to train and run PPO on a cartpole environment:

import gymnasium

from stable_baselines3 import PPO

env = gymnasium.make("CartPole-v1", render_mode="human")

model = PPO("MlpPolicy", env, verbose=1)
model.learn(total_timesteps=10_000)

vec_env = model.get_env()
obs = vec_env.reset()
for i in range(1000):
    action, _states = model.predict(obs, deterministic=True)
    obs, reward, done, info = vec_env.step(action)
    vec_env.render()
    # VecEnv resets automatically
    # if done:
    #   obs = vec_env.reset()

Or just train a model with a one liner if the environment is registered in Gymnasium and if the policy is registered:

from stable_baselines3 import PPO

model = PPO("MlpPolicy", "CartPole-v1").learn(10_000)

stable-baselines3 dependencies

cloudpickle matplotlib pandas

FAQs

What is stable-baselines3?

Pytorch version of Stable Baselines, implementations of reinforcement learning algorithms. Visit Snyk Advisor to see a full health score report for stable-baselines3, including popularity, security, maintenance & community analysis.

Is stable-baselines3 popular?

The python package stable-baselines3 receives a total of 41,866 weekly downloads. As such, stable-baselines3 popularity was classified as a popular. Visit the popularity section on Snyk Advisor to see the full health analysis.

Is stable-baselines3 well maintained?

We found that stable-baselines3 demonstrated a healthy version release cadence and project activity. It has a community of 150 open source contributors collaborating on the project. See the full package health analysis to learn more about the package maintenance status.

Is stable-baselines3 safe to use?

The python package stable-baselines3 was scanned for known vulnerabilities and missing license, and no issues were found. Thus the package was deemed as safe to use. See the full health analysis review.

Last updated on 28 December-2024, at 02:17 (UTC).

Build a secure application checklist

Select a recommended open source package

Minimize your risk by selecting secure & well maintained open source packages

DONE

Scan your app for vulnerabilities

Scan your application to find vulnerabilities in your: source code, open source dependencies, containers and configuration files

SCAN NOW

Fix identified vulnerabilities

Easily fix your code by leveraging automatically generated PRs

AUTO FIX

Monitor for new issues

New vulnerabilities are discovered every day. Get notified if your application is affected

MONITOR APP