How to use the polyaxon.polyaxon.config_settings.celery_settings.SchedulerCeleryTasks function in polyaxon

To help you get started, we’ve selected a few polyaxon examples, based on popular ways it is used in public projects.

Secure your code as it's written. Use Snyk Code to scan source code in minutes - no build needed - and fix issues immediately.

github polyaxon / polyaxon / polyaxon / polyaxon / config_settings / celery_settings.py View on Github external
# Scheduler stores
    SchedulerCeleryTasks.STORES_SCHEDULE_DATA_DELETION:
        {'queue': CeleryQueues.SCHEDULER_STORES},
    SchedulerCeleryTasks.STORES_SCHEDULE_OUTPUTS_DELETION:
        {'queue': CeleryQueues.SCHEDULER_STORES},
    SchedulerCeleryTasks.STORES_SCHEDULE_LOGS_DELETION:
        {'queue': CeleryQueues.SCHEDULER_STORES},

    # Scheduler deletion
    SchedulerCeleryTasks.DELETE_ARCHIVED_PROJECT:
        {'queue': CeleryQueues.SCHEDULER_CLEAN},
    SchedulerCeleryTasks.DELETE_ARCHIVED_EXPERIMENT_GROUP:
        {'queue': CeleryQueues.SCHEDULER_CLEAN},
    SchedulerCeleryTasks.DELETE_ARCHIVED_EXPERIMENT:
        {'queue': CeleryQueues.SCHEDULER_CLEAN},
    SchedulerCeleryTasks.DELETE_ARCHIVED_JOB:
        {'queue': CeleryQueues.SCHEDULER_CLEAN},
    SchedulerCeleryTasks.DELETE_ARCHIVED_BUILD_JOB:
        {'queue': CeleryQueues.SCHEDULER_CLEAN},
    SchedulerCeleryTasks.DELETE_ARCHIVED_NOTEBOOK_JOB:
        {'queue': CeleryQueues.SCHEDULER_CLEAN},
    SchedulerCeleryTasks.DELETE_ARCHIVED_TENSORBOARD_JOB:
        {'queue': CeleryQueues.SCHEDULER_CLEAN},


    # Crons health
    CronsCeleryTasks.CRONS_HEALTH:
        {'queue': CeleryQueues.CRONS_HEALTH},

    # Crons
    CronsCeleryTasks.EXPERIMENTS_SYNC_JOBS_STATUSES:
        {'queue': CeleryQueues.CRONS_EXPERIMENTS},
github polyaxon / polyaxon / polyaxon / polyaxon / config_settings / celery_settings.py View on Github external
{'queue': CeleryQueues.SCHEDULER_PROJECTS},
    SchedulerCeleryTasks.PROJECTS_NOTEBOOK_START:
        {'queue': CeleryQueues.SCHEDULER_PROJECTS},
    SchedulerCeleryTasks.PROJECTS_NOTEBOOK_STOP:
        {'queue': CeleryQueues.SCHEDULER_PROJECTS},
    SchedulerCeleryTasks.PROJECTS_NOTEBOOK_SCHEDULE_DELETION:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENT_GROUPS},

    # Scheduler builds
    SchedulerCeleryTasks.BUILD_JOBS_START:
        {'queue': CeleryQueues.SCHEDULER_BUILD_JOBS},
    SchedulerCeleryTasks.BUILD_JOBS_STOP:
        {'queue': CeleryQueues.SCHEDULER_BUILD_JOBS},
    SchedulerCeleryTasks.BUILD_JOBS_NOTIFY_DONE:
        {'queue': CeleryQueues.SCHEDULER_BUILD_JOBS},
    SchedulerCeleryTasks.BUILD_JOBS_SET_DOCKERFILE:
        {'queue': CeleryQueues.SCHEDULER_BUILD_JOBS},
    SchedulerCeleryTasks.BUILD_JOBS_CHECK_HEARTBEAT:
        {'queue': CeleryQueues.SCHEDULER_BUILD_JOBS},
    SchedulerCeleryTasks.BUILD_JOBS_SCHEDULE_DELETION:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENT_GROUPS},

    # Scheduler jobs
    SchedulerCeleryTasks.JOBS_BUILD:
        {'queue': CeleryQueues.SCHEDULER_JOBS},
    SchedulerCeleryTasks.JOBS_START:
        {'queue': CeleryQueues.SCHEDULER_JOBS},
    SchedulerCeleryTasks.JOBS_STOP:
        {'queue': CeleryQueues.SCHEDULER_JOBS},
    SchedulerCeleryTasks.JOBS_NOTIFY_DONE:
        {'queue': CeleryQueues.SCHEDULER_JOBS},
    SchedulerCeleryTasks.JOBS_CHECK_HEARTBEAT:
github polyaxon / polyaxon / polyaxon / polyaxon / config_settings / celery_settings.py View on Github external
{'queue': CeleryQueues.SCHEDULER_JOBS},
    SchedulerCeleryTasks.JOBS_CHECK_HEARTBEAT:
        {'queue': CeleryQueues.SCHEDULER_JOBS},
    SchedulerCeleryTasks.JOBS_SCHEDULE_DELETION:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENT_GROUPS},

    # Scheduler projects
    SchedulerCeleryTasks.PROJECTS_SCHEDULE_DELETION:
        {'queue': CeleryQueues.SCHEDULER_PROJECTS},

    # Scheduler stores
    SchedulerCeleryTasks.STORES_SCHEDULE_DATA_DELETION:
        {'queue': CeleryQueues.SCHEDULER_STORES},
    SchedulerCeleryTasks.STORES_SCHEDULE_OUTPUTS_DELETION:
        {'queue': CeleryQueues.SCHEDULER_STORES},
    SchedulerCeleryTasks.STORES_SCHEDULE_LOGS_DELETION:
        {'queue': CeleryQueues.SCHEDULER_STORES},

    # Scheduler deletion
    SchedulerCeleryTasks.DELETE_ARCHIVED_PROJECT:
        {'queue': CeleryQueues.SCHEDULER_CLEAN},
    SchedulerCeleryTasks.DELETE_ARCHIVED_EXPERIMENT_GROUP:
        {'queue': CeleryQueues.SCHEDULER_CLEAN},
    SchedulerCeleryTasks.DELETE_ARCHIVED_EXPERIMENT:
        {'queue': CeleryQueues.SCHEDULER_CLEAN},
    SchedulerCeleryTasks.DELETE_ARCHIVED_JOB:
        {'queue': CeleryQueues.SCHEDULER_CLEAN},
    SchedulerCeleryTasks.DELETE_ARCHIVED_BUILD_JOB:
        {'queue': CeleryQueues.SCHEDULER_CLEAN},
    SchedulerCeleryTasks.DELETE_ARCHIVED_NOTEBOOK_JOB:
        {'queue': CeleryQueues.SCHEDULER_CLEAN},
    SchedulerCeleryTasks.DELETE_ARCHIVED_TENSORBOARD_JOB:
github polyaxon / polyaxon / polyaxon / polyaxon / config_settings / celery_settings.py View on Github external
# Scheduler health
    SchedulerCeleryTasks.SCHEDULER_HEALTH:
        {'queue': CeleryQueues.SCHEDULER_HEALTH},

    # Scheduler experiments
    SchedulerCeleryTasks.EXPERIMENTS_START:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENTS},
    SchedulerCeleryTasks.EXPERIMENTS_STOP:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENTS},
    SchedulerCeleryTasks.EXPERIMENTS_BUILD:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENTS},
    SchedulerCeleryTasks.EXPERIMENTS_CHECK_STATUS:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENTS},
    SchedulerCeleryTasks.EXPERIMENTS_CHECK_HEARTBEAT:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENTS},
    SchedulerCeleryTasks.EXPERIMENTS_SET_METRICS:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENTS},
    SchedulerCeleryTasks.EXPERIMENTS_SCHEDULE_DELETION:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENTS},

    # Scheduler groups
    SchedulerCeleryTasks.EXPERIMENTS_GROUP_CREATE:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENT_GROUPS},
    SchedulerCeleryTasks.EXPERIMENTS_GROUP_STOP:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENT_GROUPS},
    SchedulerCeleryTasks.EXPERIMENTS_GROUP_STOP_EXPERIMENTS:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENT_GROUPS},
    SchedulerCeleryTasks.EXPERIMENTS_GROUP_CHECK_DONE:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENT_GROUPS},
    SchedulerCeleryTasks.EXPERIMENTS_GROUP_SCHEDULE_DELETION:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENT_GROUPS},
github polyaxon / polyaxon / polyaxon / polyaxon / config_settings / celery_settings.py View on Github external
{'queue': CeleryQueues.SCHEDULER_PROJECTS},
    SchedulerCeleryTasks.TENSORBOARDS_SCHEDULE_DELETION:
        {'queue': CeleryQueues.SCHEDULER_PROJECTS},
    SchedulerCeleryTasks.PROJECTS_NOTEBOOK_BUILD:
        {'queue': CeleryQueues.SCHEDULER_PROJECTS},
    SchedulerCeleryTasks.PROJECTS_NOTEBOOK_START:
        {'queue': CeleryQueues.SCHEDULER_PROJECTS},
    SchedulerCeleryTasks.PROJECTS_NOTEBOOK_STOP:
        {'queue': CeleryQueues.SCHEDULER_PROJECTS},
    SchedulerCeleryTasks.PROJECTS_NOTEBOOK_SCHEDULE_DELETION:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENT_GROUPS},

    # Scheduler builds
    SchedulerCeleryTasks.BUILD_JOBS_START:
        {'queue': CeleryQueues.SCHEDULER_BUILD_JOBS},
    SchedulerCeleryTasks.BUILD_JOBS_STOP:
        {'queue': CeleryQueues.SCHEDULER_BUILD_JOBS},
    SchedulerCeleryTasks.BUILD_JOBS_NOTIFY_DONE:
        {'queue': CeleryQueues.SCHEDULER_BUILD_JOBS},
    SchedulerCeleryTasks.BUILD_JOBS_SET_DOCKERFILE:
        {'queue': CeleryQueues.SCHEDULER_BUILD_JOBS},
    SchedulerCeleryTasks.BUILD_JOBS_CHECK_HEARTBEAT:
        {'queue': CeleryQueues.SCHEDULER_BUILD_JOBS},
    SchedulerCeleryTasks.BUILD_JOBS_SCHEDULE_DELETION:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENT_GROUPS},

    # Scheduler jobs
    SchedulerCeleryTasks.JOBS_BUILD:
        {'queue': CeleryQueues.SCHEDULER_JOBS},
    SchedulerCeleryTasks.JOBS_START:
        {'queue': CeleryQueues.SCHEDULER_JOBS},
    SchedulerCeleryTasks.JOBS_STOP:
github polyaxon / polyaxon / polyaxon / polyaxon / config_settings / celery_settings.py View on Github external
'exchange_type': 'topic'},
    CeleryPublishTask.PUBLISH_LOGS_SIDECAR_BUILDS:
        {'exchange': INTERNAL_EXCHANGE,
         'routing_key': RoutingKeys.STREAM_LOGS_SIDECARS_BUILDS,
         'exchange_type': 'topic'},

    # Scheduler health
    SchedulerCeleryTasks.SCHEDULER_HEALTH:
        {'queue': CeleryQueues.SCHEDULER_HEALTH},

    # Scheduler experiments
    SchedulerCeleryTasks.EXPERIMENTS_START:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENTS},
    SchedulerCeleryTasks.EXPERIMENTS_STOP:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENTS},
    SchedulerCeleryTasks.EXPERIMENTS_BUILD:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENTS},
    SchedulerCeleryTasks.EXPERIMENTS_CHECK_STATUS:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENTS},
    SchedulerCeleryTasks.EXPERIMENTS_CHECK_HEARTBEAT:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENTS},
    SchedulerCeleryTasks.EXPERIMENTS_SET_METRICS:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENTS},

    # Scheduler groups
    SchedulerCeleryTasks.EXPERIMENTS_GROUP_CREATE:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENT_GROUPS},
    SchedulerCeleryTasks.EXPERIMENTS_GROUP_STOP_EXPERIMENTS:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENT_GROUPS},
    SchedulerCeleryTasks.EXPERIMENTS_GROUP_CHECK_FINISHED:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENT_GROUPS},
github polyaxon / polyaxon / polyaxon / polyaxon / config_settings / celery_settings.py View on Github external
{'queue': CeleryQueues.SCHEDULER_BUILD_JOBS},
    SchedulerCeleryTasks.BUILD_JOBS_SET_DOCKERFILE:
        {'queue': CeleryQueues.SCHEDULER_BUILD_JOBS},
    SchedulerCeleryTasks.BUILD_JOBS_CHECK_HEARTBEAT:
        {'queue': CeleryQueues.SCHEDULER_BUILD_JOBS},
    SchedulerCeleryTasks.BUILD_JOBS_SCHEDULE_DELETION:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENT_GROUPS},

    # Scheduler jobs
    SchedulerCeleryTasks.JOBS_BUILD:
        {'queue': CeleryQueues.SCHEDULER_JOBS},
    SchedulerCeleryTasks.JOBS_START:
        {'queue': CeleryQueues.SCHEDULER_JOBS},
    SchedulerCeleryTasks.JOBS_STOP:
        {'queue': CeleryQueues.SCHEDULER_JOBS},
    SchedulerCeleryTasks.JOBS_NOTIFY_DONE:
        {'queue': CeleryQueues.SCHEDULER_JOBS},
    SchedulerCeleryTasks.JOBS_CHECK_HEARTBEAT:
        {'queue': CeleryQueues.SCHEDULER_JOBS},
    SchedulerCeleryTasks.JOBS_SCHEDULE_DELETION:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENT_GROUPS},

    # Scheduler projects
    SchedulerCeleryTasks.PROJECTS_SCHEDULE_DELETION:
        {'queue': CeleryQueues.SCHEDULER_PROJECTS},

    # Scheduler stores
    SchedulerCeleryTasks.STORES_SCHEDULE_DATA_DELETION:
        {'queue': CeleryQueues.SCHEDULER_STORES},
    SchedulerCeleryTasks.STORES_SCHEDULE_OUTPUTS_DELETION:
        {'queue': CeleryQueues.SCHEDULER_STORES},
    SchedulerCeleryTasks.STORES_SCHEDULE_LOGS_DELETION:
github polyaxon / polyaxon / polyaxon / polyaxon / config_settings / celery_settings.py View on Github external
{'queue': CeleryQueues.SCHEDULER_BUILD_JOBS},
    SchedulerCeleryTasks.BUILD_JOBS_SCHEDULE_DELETION:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENT_GROUPS},

    # Scheduler jobs
    SchedulerCeleryTasks.JOBS_BUILD:
        {'queue': CeleryQueues.SCHEDULER_JOBS},
    SchedulerCeleryTasks.JOBS_START:
        {'queue': CeleryQueues.SCHEDULER_JOBS},
    SchedulerCeleryTasks.JOBS_STOP:
        {'queue': CeleryQueues.SCHEDULER_JOBS},
    SchedulerCeleryTasks.JOBS_NOTIFY_DONE:
        {'queue': CeleryQueues.SCHEDULER_JOBS},
    SchedulerCeleryTasks.JOBS_CHECK_HEARTBEAT:
        {'queue': CeleryQueues.SCHEDULER_JOBS},
    SchedulerCeleryTasks.JOBS_SCHEDULE_DELETION:
        {'queue': CeleryQueues.SCHEDULER_EXPERIMENT_GROUPS},

    # Scheduler projects
    SchedulerCeleryTasks.PROJECTS_SCHEDULE_DELETION:
        {'queue': CeleryQueues.SCHEDULER_PROJECTS},

    # Scheduler stores
    SchedulerCeleryTasks.STORES_SCHEDULE_DATA_DELETION:
        {'queue': CeleryQueues.SCHEDULER_STORES},
    SchedulerCeleryTasks.STORES_SCHEDULE_OUTPUTS_DELETION:
        {'queue': CeleryQueues.SCHEDULER_STORES},
    SchedulerCeleryTasks.STORES_SCHEDULE_LOGS_DELETION:
        {'queue': CeleryQueues.SCHEDULER_STORES},

    # Scheduler deletion
    SchedulerCeleryTasks.DELETE_ARCHIVED_PROJECT:
github polyaxon / polyaxon / polyaxon / polyaxon / config_settings / celery_settings.py View on Github external
# Scheduler builds
    SchedulerCeleryTasks.BUILD_JOBS_START:
        {'queue': CeleryQueues.SCHEDULER_BUILD_JOBS},
    SchedulerCeleryTasks.BUILD_JOBS_STOP:
        {'queue': CeleryQueues.SCHEDULER_BUILD_JOBS},
    SchedulerCeleryTasks.BUILD_JOBS_NOTIFY_DONE:
        {'queue': CeleryQueues.SCHEDULER_BUILD_JOBS},
    SchedulerCeleryTasks.BUILD_JOBS_SET_DOCKERFILE:
        {'queue': CeleryQueues.SCHEDULER_BUILD_JOBS},
    SchedulerCeleryTasks.BUILD_JOBS_CHECK_HEARTBEAT:
        {'queue': CeleryQueues.SCHEDULER_BUILD_JOBS},

    # Scheduler jobs
    SchedulerCeleryTasks.JOBS_BUILD:
        {'queue': CeleryQueues.SCHEDULER_JOBS},
    SchedulerCeleryTasks.JOBS_START:
        {'queue': CeleryQueues.SCHEDULER_JOBS},
    SchedulerCeleryTasks.JOBS_STOP:
        {'queue': CeleryQueues.SCHEDULER_JOBS},
    SchedulerCeleryTasks.JOBS_NOTIFY_DONE:
        {'queue': CeleryQueues.SCHEDULER_JOBS},
    SchedulerCeleryTasks.JOBS_CHECK_HEARTBEAT:
        {'queue': CeleryQueues.SCHEDULER_JOBS},

    # Crons health
    CronsCeleryTasks.CRONS_HEALTH:
        {'queue': CeleryQueues.CRONS_HEALTH},

    # Crons
    CronsCeleryTasks.EXPERIMENTS_SYNC_JOBS_STATUSES:
        {'queue': CeleryQueues.CRONS_EXPERIMENTS},
    CronsCeleryTasks.HEARTBEAT_EXPERIMENTS:
github polyaxon / polyaxon / polyaxon / polyaxon / config_settings / celery_settings.py View on Github external
{'queue': CeleryQueues.SCHEDULER_STORES},
    SchedulerCeleryTasks.STORES_SCHEDULE_LOGS_DELETION:
        {'queue': CeleryQueues.SCHEDULER_STORES},

    # Scheduler deletion
    SchedulerCeleryTasks.DELETE_ARCHIVED_PROJECT:
        {'queue': CeleryQueues.SCHEDULER_CLEAN},
    SchedulerCeleryTasks.DELETE_ARCHIVED_EXPERIMENT_GROUP:
        {'queue': CeleryQueues.SCHEDULER_CLEAN},
    SchedulerCeleryTasks.DELETE_ARCHIVED_EXPERIMENT:
        {'queue': CeleryQueues.SCHEDULER_CLEAN},
    SchedulerCeleryTasks.DELETE_ARCHIVED_JOB:
        {'queue': CeleryQueues.SCHEDULER_CLEAN},
    SchedulerCeleryTasks.DELETE_ARCHIVED_BUILD_JOB:
        {'queue': CeleryQueues.SCHEDULER_CLEAN},
    SchedulerCeleryTasks.DELETE_ARCHIVED_NOTEBOOK_JOB:
        {'queue': CeleryQueues.SCHEDULER_CLEAN},
    SchedulerCeleryTasks.DELETE_ARCHIVED_TENSORBOARD_JOB:
        {'queue': CeleryQueues.SCHEDULER_CLEAN},


    # Crons health
    CronsCeleryTasks.CRONS_HEALTH:
        {'queue': CeleryQueues.CRONS_HEALTH},

    # Crons
    CronsCeleryTasks.EXPERIMENTS_SYNC_JOBS_STATUSES:
        {'queue': CeleryQueues.CRONS_EXPERIMENTS},

    CronsCeleryTasks.HEARTBEAT_EXPERIMENTS:
        {'queue': CeleryQueues.CRONS_HEARTBEAT},
    CronsCeleryTasks.HEARTBEAT_JOBS: