The Waylay collector framework is a generic job queue that can execute jobs ad-hoc or periodically. It consists of multiple smaller components that work together to create the collector framework.
this component handles scheduling the jobs through a RESTful interface, and can schedule recursive jobs.
Queue & Workers
Listens for jobs that are pushed onto the Redis queue, spawns one worker per CPU.
The amount of workers is configurable, this part of the collector service can be scaled individually from the other components.
The scheduler will push jobs onto the job queue using the API using a specified
Webhook receivers for various providers, part of the RESTful API.