Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

QUADs daemon - Deprecate heavy use of cron #88

Open
jtaleric opened this issue May 15, 2017 · 4 comments
Open

QUADs daemon - Deprecate heavy use of cron #88

jtaleric opened this issue May 15, 2017 · 4 comments
Assignees

Comments

@jtaleric
Copy link
Contributor

Using the QUADs daemon we could spawn a worker thread on an interval (60 minute?), this thread could check the current schedule.

This worker could check if there are hosts to :

  • Move
  • Validate
  • Post-Deploy
  • ETC
@sadsfae
Copy link
Member

sadsfae commented Nov 3, 2017

Related RFE here in Milestones 1.1 and 2.0 (address same features)

#140
#156

@sadsfae
Copy link
Member

sadsfae commented Apr 19, 2018

We'll need a proper messagebus / worker architecture here. I've re-purposed #140 and #156 to tackle the more immediate enhancements we need to get there first.

Something like Celery / RabbitMQ may be what we're after long-term to become event-driven and not need to have cron in the mix.

@sadsfae
Copy link
Member

sadsfae commented Mar 4, 2019

We're looking into celery and in some cases asyncio for this since we're on Python3 now with 1.1. Keeping this open and targeted for 2.0 milestone.

@grafuls
Copy link
Contributor

grafuls commented Aug 22, 2023

Been doing some research on this and I think celery might be a bit of an overkill as we would require a broker and a backend (Redis for both) for it to run and the scope of celery is more for long running async tasks on a queue which we might not take full advantage of with the Quads workflow.
There are several other tools we can use instead like python3-APScheduler which is available via rpm or the less available schedule or the python standard library sched.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants