在芹菜任务队列上记录时间



我可以使用信号来记录任务执行时间,但我也想记录队列上的时间。信号可以吗?我应该使用哪些信号?

任务事件可用于根据任务的事件监视和触发操作。任务已发送、任务已接收、任务已启动、任务成功、任务失败、任务被拒绝、任务已撤销、任务重试是任务事件支持芹菜。有关更多详细信息,请参阅此链接。若要记录任务在队列中等待的时间,请使用相应的任务事件处理程序获取任务创建(或添加到作业队列)时间和任务开始时间。它们的差异将给出队列中作业的等待时间。下面是有关如何实现它的 python 代码示例。

    from celery import Celery
    redis = Redis(host='workerdb', port=6379, db=0)
    taskId_startTime = {}
    taskId_createTime = {}
    def my_monitor():
        app = Celery('vwadaptor', broker='redis://workerdb:6379/0',backend='redis://workerdb:6379/0')
        state = app.events.State()
        def announce_task_received(event):
            state.event(event)
            task = state.tasks.get(event['uuid'])
            taskId_createTime[task.uuid] = task.timestamp 
        def announce_task_started(event):
            state.event(event)
            task = state.tasks.get(event['uuid'])
            taskId_startTime[task.uuid] = task.timestamp 
        def announce_task_succeeded(event):
            state.event(event)
            task = state.tasks.get(event['uuid'])
            print "wait time in queue", taskId_startTime[task.uuid] - taskId_createTime[task.uuid] 
        with app.connection() as connection:
            recv = app.events.Receiver(connection, handlers={
                    'task-received': announce_task_received, 
                    'task-started': announce_task_started, 
                    'task-succeeded': announce_task_succeeded, 
            })
            recv.capture(limit=None, timeout=None, wakeup=True)

    my_monitor()

最新更新