splitlog

v4.0.1

Utility to split aggregated logs from Apache Hadoop Yarn applications into a folder hierarchy For more information about how to use this package see README

Latest version published 10 days ago

License: MIT

PyPI

GitHub

Package Health Score

63 / 100

security
No known security issues
popularity
Limited
maintenance
Healthy
community
Limited

Explore Similar Packages

glog
52

Popularity

Limited

GitHub Stars: 0
Forks: 0
Contributors: 2

Direct Usage Popularity

Based on project statistics from the GitHub repository for the PyPI package splitlog, we found that it has been starred ? times.

Security

No known security issues

Security and license risk for latest version

Release Date: Oct 26, 2024
Direct Vulnerabilities: 0
C
0
H
0
M
0
L
Indirect Vulnerabilities: 0
C
0
H
0
M
0
L
License Risk: 0
H
0
M
0
L

All security vulnerabilities belong to production dependencies of direct and indirect packages.

License

MIT

Security Policy

We found a way for you to contribute to the project! Looks like splitlog is missing a security policy.

You can connect your project's repository to Snyk to stay up to date on security alerts and receive automatic fix pull requests.

Keep your project free of vulnerabilities with Snyk

Maintenance

Healthy

Commit Frequency

Open Issues: 0
Open PR: 0
Last Release: 10 days ago
Last Commit: 10 days ago

Further analysis of the maintenance status of splitlog based on released PyPI versions cadence, the repository activity, and other data points determined that its maintenance is Healthy.

We found that splitlog demonstrates a positive version release cadence with at least one new version released in the past 3 months.

As a healthy sign for on-going project maintenance, we found that the GitHub repository had at least 1 pull request or issue interacted with by the community.

Community

Limited

Readme: Yes
Contributing.md: No
Code of Conduct: No
Contributors: 2
Funding: No

This project has seen only 10 or less contributors.

We found a way for you to contribute to the project! Looks like splitlog is missing a Code of Conduct.

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Ensure all the packages you're using are healthy and well-maintained

Snyk Vulnerability Scanner

Get health score & security insights directly in your IDE

Package

Python Versions Compatibility: <4.0.0,>=3.9.0

Age: 2 years
Latest Release: 10 days ago
Dependencies: 0 Direct
Versions: 14
Maintainers: 1
Wheels: OS Independent

Readme

splitlog

Hadoop Yarn application logs aggregate all container logs of a Yarn application into a single file. This makes it very difficult to use Unix command line tools to analyze these logs: Grep will search over all containers and context provided for hits often does not include Yarn container name or host name. splitlog splits a combined logfile for all containers of an application into a file system hierarchy suitable for further analysis:

out
└── hadoopnode
    ├── container_1671326373437_0001_01_000001
    │   ├── directory.info
    │   ├── launch_container.sh
    │   ├── prelaunch.err
    │   ├── prelaunch.out
    │   ├── stderr
    │   ├── stdout
    │   └── syslog
    ├── container_1671326373437_0001_01_000002
    │   ├── directory.info
    │   ├── launch_container.sh
    │   ├── prelaunch.err
    │   ├── prelaunch.out
    │   ├── stderr
    │   ├── stdout
    │   └── syslog
    └── container_1671326373437_0001_01_000003
        ├── directory.info
        ├── launch_container.sh
        ├── prelaunch.err
        ├── prelaunch.out
        ├── stderr
        ├── stdout
        └── syslog

4 directories, 21 files

Installation

Python 3.9+ must be available. Installation via pipx:

pipx install splitlog

How to use

Read logs from standard input:

yarn logs -applicationId application_1582815261257_232080 | splitlog

Read logs from file application_1582815261257_232080.log:

splitlog -i application_1582815261257_232080.log

FAQs

What is splitlog?

Utility to split aggregated logs from Apache Hadoop Yarn applications into a folder hierarchy. Visit Snyk Advisor to see a full health score report for splitlog, including popularity, security, maintenance & community analysis.

Is splitlog popular?

The python package splitlog receives a total of 88 weekly downloads. As such, splitlog popularity was classified as limited. Visit the popularity section on Snyk Advisor to see the full health analysis.

Is splitlog well maintained?

We found that splitlog demonstrated a healthy version release cadence and project activity. It has a community of 2 open source contributors collaborating on the project. See the full package health analysis to learn more about the package maintenance status.

Is splitlog safe to use?

The python package splitlog was scanned for known vulnerabilities and missing license, and no issues were found. Thus the package was deemed as safe to use. See the full health analysis review.

Last updated on 4 November-2024, at 21:18 (UTC).

Build a secure application checklist

Select a recommended open source package

Minimize your risk by selecting secure & well maintained open source packages

DONE

Scan your app for vulnerabilities

Scan your application to find vulnerabilities in your: source code, open source dependencies, containers and configuration files

SCAN NOW

Fix identified vulnerabilities

Easily fix your code by leveraging automatically generated PRs

AUTO FIX

Monitor for new issues

New vulnerabilities are discovered every day. Get notified if your application is affected

MONITOR APP

Package Health Score

Explore Similar Packages

Direct Usage Popularity

Security and license risk for latest version

Commit Frequency

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Snyk Vulnerability Scanner

Readme

splitlog

Installation

How to use

FAQs

What is splitlog?

Is splitlog popular?

Is splitlog well maintained?

Is splitlog safe to use?

Build a secure application checklist

Select a recommended open source package

Scan your app for vulnerabilities

Source Code

Open Source

Container

Config

Fix identified vulnerabilities

Monitor for new issues