How to use the bigflow.util.log.logger.debug function in bigflow

To help you get started, we’ve selected a few bigflow examples, based on popular ways it is used in public projects.

Secure your code as it's written. Use Snyk Code to scan source code in minutes - no build needed - and fix issues immediately.

github baidu / bigflow / bigflow_python / python / bigflow / pipeline / pipeline_base.py View on Github external
def _add_dynamic_library_in_path(self, lib_dir):
        for f in os.listdir(lib_dir):
            file_path = os.path.join(lib_dir, f)
            if os.path.isfile(file_path):
                logger.debug("LIB: %s" % file_path)
                self._resource.add_dynamic_library(file_path)
github baidu / bigflow / bigflow_python / python / bigflow / pipeline / pipeline_base.py View on Github external
def _force_delete_file(self, path):
        toft_path = self._toft_path(path)
        if toft_path.startswith('/hdfs/'):
            self._hadoop_client().fs_rmr(path, self._hadoop_config)
            return True
        else:
            try:
                logger.debug('rmtree %s' % path)
                shutil.rmtree(path)
            except Exception as e:
                logger.warning('%s' % e)
            return not os.path.exists(path)