lloydmeta / tasques Goto Github PK

View Code? Open in Web Editor NEW

9.0 3.0 3.0 1 MB

Background Tasks system backed by Elasticsearch with support for language agnostic Workers.

License: Apache License 2.0

Go 65.17% Scala 0.12% Shell 0.65% Java 28.05% Rust 5.44% Makefile 0.30% Dockerfile 0.26%

background-tasks background-jobs language-agnostic job-queue job-scheduler elasticsearch kibana apm docker swagger

tasques's Issues

Improve config

Support env variable substitutions for config (this will improve the k8s experience):
- Note supported out of the box by Viper spf13/viper#761
Improve documentation

Queue name validations

There needs to be a few more validations on queue names, and allowable chars for creates and updates should be different for claiming.

Also, the queue should be persisted with each task.

Improve Swagger docs

Improve descriptions for
- API models and their fields
- API endpoints

Improve documentation

Improve the README
- Explain motivation
- Add comprehensive features list
- Explain some inner workings
- Mention how to spin up the K8s stuff in docker/k8s

[Feature] Support skip-if-uncompleted-tasks-exist for Recurring Tasks

It would be nice to support not scheduling a Recurring Task if there are any outstanding Tasks that belong to it (not DEAD or DONE).

This could be added as an optional (default false) field on RecurringTask.

One simple way to do this for Recurring Tasks that have this option set to true would be to do a search for the existence of outstanding tasks any before scheduling the Task in the Scheduler

tasques/internal/infra/cron/task/recurring/scheduler.go

Lines 60 to 77 in 83b0cc4

 if log.Debug().Enabled() { 

 log.Debug(). 

 Str("id", string(task.ID)). 

 Str("expression", string(task.ScheduleExpression)). 

 Msg("Enqueuing Task") 

 } 

 tx := i.tracer.BackgroundTx("recurring-task-enqueue") 

 ctx := tx.Context() 

 _, err := i.tasksService.Create(ctx, i.taskDefToNewTask(task.ID, &task.TaskDefinition)) 

 if err != nil { 

 log.Error(). 

 Err(err). 

 Str("id", string(task.ID)). 

 Str("expression", string(task.ScheduleExpression)). 

 Msg("Failed to insert new Task at interval") 

 } 

 tx.End()

lloydmeta / tasques Goto Github PK

tasques's Issues

Improve config

Queue name validations

Improve Swagger docs

Improve documentation

[Feature] Support skip-if-uncompleted-tasks-exist for Recurring Tasks

Recommend Projects

React

Vue.js

Typescript

TensorFlow

Django

Laravel

D3

Recommend Topics

javascript

web

server

Machine learning

Visualization

Game

Recommend Org

Facebook

Microsoft

Google

Alibaba

D3

Tencent

	if log.Debug().Enabled() {
	log.Debug().
	Str("id", string(task.ID)).
	Str("expression", string(task.ScheduleExpression)).
	Msg("Enqueuing Task")
	}

	tx := i.tracer.BackgroundTx("recurring-task-enqueue")
	ctx := tx.Context()
	_, err := i.tasksService.Create(ctx, i.taskDefToNewTask(task.ID, &task.TaskDefinition))
	if err != nil {
	log.Error().
	Err(err).
	Str("id", string(task.ID)).
	Str("expression", string(task.ScheduleExpression)).
	Msg("Failed to insert new Task at interval")
	}
	tx.End()