Testing complex Celery pipelines

Starting out — a basic chain

Since we’re trying to simulate a real environment, we added a sleep() command to the second task.
A gets an empty list, adds 1, passes [1] to B, which adds 2 and returns [1,2] as the final result

Complex graphs and supplying IDs

Both chains operate completely independently
The result of A is sent to all instances of B in the group as input

Errors and in-flight control

The group’s first child returns an AttributeError, and the second returns successfully
Only the first child has finished, the second is still pending — hence only the result of the first is available

Conclusion

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store