- Update to 5.5.3
* Make the tests run on python 3.13 for gcs backend (#9677)
* Added DeepWiki to README (#9683)
* Limit redis to <=v5.2.1 to match Kombu (#9693)
* Use EX_OK instead of literal zero (#9684)
* Make wheel metadata reproducible (#9687)
* Let celery install from kombu dependencies for better align (#9696)
* Fix stamping documentation to clarify stamped_headers key is optional
in visitor methods (#9697)
* Support apply_async without queue argument on quorum queues (#9686)
* Updated rabbitmq doc about using quorum queues with task routes (#9707)
* Add: Dumper Unit Test (#9711)
* Add unit test for event.group_from (#9709)
* Refactor: add beat_cron_starting_deadline documentation warning (#9712)
* Fix: Resolve issue #9569 by supporting distinct broker transport
options for workers (#9695)
* Fixes issue with retry callback arguments in DelayedDelivery (#9708)
* get_exchange-unit-test (#9710)
* ISSUE-9704: Update documentation of result_expires, filesystem backend
is supported (#9716)
* Update to blacksmith ubuntu 24.04 (#9717)
* Added unit tests for celery.utils.iso8601 (#9725)
* Update introduction.rst docs (#9728)
* Prepare for release: v5.5.3 (#9732)
OBS-URL: https://build.opensuse.org/request/show/1284472
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=164
* Fixed "AttributeError: list object has no attribute strip" with
quorum queues and failover brokers by @Nusnus in #9657
* Prepare for release: v5.5.1 by @Nusnus in #9660
- Update to 5.5.0
* Redis Broker Stability Improvements
* pycurl replaced with urllib3
* RabbitMQ Quorum Queues Support
* Soft Shutdown Mechanism
* Pydantic Support
* Google Pub/Sub Transport
* Python 3.13 Support
* REMAP_SIGTERM Support
* Database Backend Improvements
* see full changelog: https://github.com/celery/celery/releases/tag/v5.5.0
- Add new test dependencies
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=160
- Update to 5.4.0
* Add a Task class specialised for Django
* Add Google Cloud Storage (GCS) backend
* Added documentation to the smoke tests infra
* Bugfix: Missing id on chain
* Bugfix: Worker not consuming tasks after Redis broker restart
* Catch UnicodeDecodeError when opening corrupt beat-schedule.db
* chore(ci): Enhance CI with workflow_dispatch for targeted debugging
* Enable efficient chord when using dynamicdb as backend store
* feat(daemon): allows daemonization options to be fetched from app
settings
* Fix DeprecationWarning: datetime.datetime.utcnow()
* Fix recursive result parents on group in middle of chain
* Hotfix: Smoke tests didn’t allow customizing the worker’s command
arguments, now it does
* Make custom remote control commands available in CLI
* Print safe_say() to stdout for non-error flows
* Support moto 5.0
- Drop support-moto-5.patch
OBS-URL: https://build.opensuse.org/request/show/1185136
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=158
- Update to 5.3.6:
* Update task.py get_custom_headers missing 'compression' key
* Basic ElasticSearch / ElasticClient 8.x Support
* Fix eager tasks does not populate name field
* Fix: serialization error when gossip working
* Stamping bugfix with group/chord header errback linking
* Fixed issue: Flags broker_connection_retry_on_startup &
broker_connection_retry aren’t reliable
* Use string value for CELERY_SKIP_CHECKS envvar
* Added initial support for python 3.11
* Fixed a small float value of retry_backoff
* Update CELERY_TASK_EAGER setting in user guide
* Fixed bug where retrying a task loses its stamps
* Warn when an unnamed periodic task override another one.
* Fix Task.handle_ignore not wrapping exceptions properly
* Align revoke and revoke_by_stamped_headers return values (terminate=True)
* Added signal triggered before fork
* Deprecate pytz and use zoneinfo
* recreate_module: set spec to the new module
* Do not recommend using easy_install anymore
* importlib_metadata remove deprecated entry point interfaces
* New control command revoke_by_stamped_headers
* Remove reference to old Python version
* Stamping a task left the task properties dirty
* Bugfix for nested group stamping on task replace
* Add broker_channel_error_retry option
* async chords should pass it's kwargs to the group/body.
* Fix honor Django's TIME_ZONE setting.
* Remove Python 3.4 compatibility code.
* Use importlib instead of deprecated pkg_resources.
OBS-URL: https://build.opensuse.org/request/show/1145321
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-celery?expand=0&rev=44
* Update task.py get_custom_headers missing 'compression' key
* Basic ElasticSearch / ElasticClient 8.x Support
* Fix eager tasks does not populate name field
* Fix: serialization error when gossip working
* Stamping bugfix with group/chord header errback linking
* Fixed issue: Flags broker_connection_retry_on_startup &
broker_connection_retry aren’t reliable
* Use string value for CELERY_SKIP_CHECKS envvar
* Added initial support for python 3.11
* Fixed a small float value of retry_backoff
* Update CELERY_TASK_EAGER setting in user guide
* Fixed bug where retrying a task loses its stamps
* Warn when an unnamed periodic task override another one.
* Fix Task.handle_ignore not wrapping exceptions properly
* Align revoke and revoke_by_stamped_headers return values (terminate=True)
* Added signal triggered before fork
* Deprecate pytz and use zoneinfo
* recreate_module: set spec to the new module
* Do not recommend using easy_install anymore
* importlib_metadata remove deprecated entry point interfaces
* New control command revoke_by_stamped_headers
* Remove reference to old Python version
* Stamping a task left the task properties dirty
* Bugfix for nested group stamping on task replace
* Add broker_channel_error_retry option
* async chords should pass it's kwargs to the group/body.
* Fix honor Django's TIME_ZONE setting.
* Remove Python 3.4 compatibility code.
* Use importlib instead of deprecated pkg_resources.
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=156
- Update to version 5.2.7
* Depend on the maintained python-consul2 library. (#6544).
* Use result_chord_join_timeout instead of hardcoded default value.
* Upgrade AzureBlockBlob storage backend to use Azure blob storage
library v12 (#6580).
* Exit celery with non zero exit value if failing (#6602).
* Raise BackendStoreError when set value is too large for Redis.
* Trace task optimizations are now set via Celery app instance.
* Add store_eager_result setting so eager tasks can store result on
the result backend (#6614).
* Allow heartbeats to be sent in tests (#6632).
* Simulate more exhaustive delivery info in apply().
* Start chord header tasks as soon as possible (#6576).
* --quiet flag now actually makes celery avoid producing logs
(#6599).
* Update platforms.py "superuser privileges" check (#6600).
* fnmatch.translate() already translates globs for us. (#6668).
* Upgrade some syntax to Python 3.6+.
* Fix checking expiration of X.509 certificates (#6678).
* Fix JSON decoding errors when using MongoDB as backend (#6675).
* Allow configuration of RedisBackend's health_check_interval
(#6666).
* Tasks can now have required kwargs at any order (#6699).
* Initial support of python 3.9 added.
* Add Python 3.10 support (#6807).
* Fix docstring for Signal.send to match code (#6835).
* Chords get body_type independently to handle cases where body.type
does not exist (#6847).
* Fix multithreaded backend usage (#6851).
* Fix Open Collective donate button (#6848).
OBS-URL: https://build.opensuse.org/request/show/989213
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=147
- Update to 5.02:
* Fix _autodiscover_tasks_from_fixups (#6424).
* Flush worker prints, notably the banner (#6432).
* Breaking Change: Remove ha_policy from queue definition. (#6440)
* This argument has no effect since RabbitMQ 3.0. Therefore, We feel
comfortable dropping it in a patch release.
* Python 3.9 support (#6418).
* Regression: When using the prefork pool, pick the fair scheduling strategy
by default (#6447).
* Preserve callbacks when replacing a task with a chain (#6189).
* Fix max_retries override on self.retry() (#6436).
* Raise proper error when replacing with an empty chain (#6452)
* Specify UTF-8 as the encoding for log files (#6357).
* Custom headers now propagate when using the protocol 1 hybrid messages
(#6374).
* Retry creating the database schema for the database results backend in case of a race condition (#6298).
* When using the Redis results backend, awaiting for a chord no longer hangs
when setting :setting:`result_expires` to 0 (#6373).
* When a user tries to specify the app as an option for the subcommand, a
custom error message is displayed (#6363).
* Fix the --without-gossip, --without-mingle, and --without-heartbeat options
which now work as expected. (#6365)
* Provide a clearer error message when the application cannot be loaded.
* Avoid printing deprecation warnings for settings when they are loaded from
Django settings (#6385).
* Allow lowercase log levels for the --loglevel option (#6388).
* Detaching now works as expected (#6401).
* Restore broadcasting messages from celery control (#6400).
* Pass back real result for single task chains (#6411).
* Ensure group tasks a deeply serialized (#6342).
* Fix chord element counting (#6354).
* Restore the celery shell command (#6421).
* Breaking Change Remove AMQP result backend (#6360).
* Warn when deprecated settings are used (#6353).
* Expose retry_policy for Redis result backend (#6330).
* Prepare Celery to support the yet to be released Python 3.9 (#6328).
* More cleanups of leftover Python 2 support (#6338).
* Bump minimum required eventlet version to 0.26.1.
* Update Couchbase Result backend to use SDK V3.
* Restore monkeypatching when gevent or eventlet are used.
* Allow to opt out of ordered group results when using the Redis result
backend (#6290).
* Breaking Change Remove the deprecated celery.utils.encoding module.
* Breaking Change Drop support for the Riak result backend (#5686).
* Breaking Change pytest plugin is no longer enabled by default (#6288).
Install pytest-celery to enable it.
* Breaking Change Brand new CLI based on Click (#5718).
* Bump Kombu version to 5.0 (#5686).
* Removed most of the compatibility code that supports Python 2 (#5686).
* Modernized code to work on Python 3.6 and above (#5686).
- Update BuildRequires/Requires.
- Add patch move-pytest-configuration-to-conftest.patch to fix testsuite.
OBS-URL: https://build.opensuse.org/request/show/848996
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-celery?expand=0&rev=35
* Fix _autodiscover_tasks_from_fixups (#6424).
* Flush worker prints, notably the banner (#6432).
* Breaking Change: Remove ha_policy from queue definition. (#6440)
* This argument has no effect since RabbitMQ 3.0. Therefore, We feel
comfortable dropping it in a patch release.
* Python 3.9 support (#6418).
* Regression: When using the prefork pool, pick the fair scheduling strategy
by default (#6447).
* Preserve callbacks when replacing a task with a chain (#6189).
* Fix max_retries override on self.retry() (#6436).
* Raise proper error when replacing with an empty chain (#6452)
* Specify UTF-8 as the encoding for log files (#6357).
* Custom headers now propagate when using the protocol 1 hybrid messages
(#6374).
* Retry creating the database schema for the database results backend in case of a race condition (#6298).
* When using the Redis results backend, awaiting for a chord no longer hangs
when setting :setting:`result_expires` to 0 (#6373).
* When a user tries to specify the app as an option for the subcommand, a
custom error message is displayed (#6363).
* Fix the --without-gossip, --without-mingle, and --without-heartbeat options
which now work as expected. (#6365)
* Provide a clearer error message when the application cannot be loaded.
* Avoid printing deprecation warnings for settings when they are loaded from
Django settings (#6385).
* Allow lowercase log levels for the --loglevel option (#6388).
* Detaching now works as expected (#6401).
* Restore broadcasting messages from celery control (#6400).
* Pass back real result for single task chains (#6411).
* Ensure group tasks a deeply serialized (#6342).
* Fix chord element counting (#6354).
* Restore the celery shell command (#6421).
* Breaking Change Remove AMQP result backend (#6360).
* Warn when deprecated settings are used (#6353).
* Expose retry_policy for Redis result backend (#6330).
* Prepare Celery to support the yet to be released Python 3.9 (#6328).
* More cleanups of leftover Python 2 support (#6338).
* Bump minimum required eventlet version to 0.26.1.
* Update Couchbase Result backend to use SDK V3.
* Restore monkeypatching when gevent or eventlet are used.
* Allow to opt out of ordered group results when using the Redis result
backend (#6290).
* Breaking Change Remove the deprecated celery.utils.encoding module.
* Breaking Change Drop support for the Riak result backend (#5686).
* Breaking Change pytest plugin is no longer enabled by default (#6288).
Install pytest-celery to enable it.
* Breaking Change Brand new CLI based on Click (#5718).
* Bump Kombu version to 5.0 (#5686).
* Removed most of the compatibility code that supports Python 2 (#5686).
* Modernized code to work on Python 3.6 and above (#5686).
- Update BuildRequires/Requires.
- Add patch move-pytest-configuration-to-conftest.patch to fix testsuite.
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=137
- Use really the upstream tarball
- Don't update to 5.0.0 because missing dependencies
- Update to version 4.4.7
+ Add task_received, task_rejected and task_unknown to signals
module.
+ [ES backend] add 401 as safe for retry.
+ treat internal errors as failure.
+ Remove redis fanout caveats.
+ FIX: -A and --args should behave the same. (#6223)
+ Class-based tasks autoretry (#6233)
+ Preserve order of group results with Redis result backend
(#6218)
+ Replace future with celery.five Fixes#6250, and reraise to
include
+ Fix REMAP_SIGTERM=SIGQUIT not working
+ (Fixes#6258) MongoDB: fix for serialization issue (#6259)
+ Make use of ordered sets in Redis opt-in
+ Test, CI, Docker, style and minor doc impovements.
OBS-URL: https://build.opensuse.org/request/show/838700
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-celery?expand=0&rev=34
- Don't update to 5.0.0 because missing dependencies
- Update to version 4.4.7
+ Add task_received, task_rejected and task_unknown to signals
module.
+ [ES backend] add 401 as safe for retry.
+ treat internal errors as failure.
+ Remove redis fanout caveats.
+ FIX: -A and --args should behave the same. (#6223)
+ Class-based tasks autoretry (#6233)
+ Preserve order of group results with Redis result backend
(#6218)
+ Replace future with celery.five Fixes#6250, and reraise to
include
+ Fix REMAP_SIGTERM=SIGQUIT not working
+ (Fixes#6258) MongoDB: fix for serialization issue (#6259)
+ Make use of ordered sets in Redis opt-in
+ Test, CI, Docker, style and minor doc impovements.
OBS-URL: https://build.opensuse.org/request/show/838603
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=134
- Add ringdisabled to avoid pulling the test deps in rings to
keep them from growing too much
- Switch to multibuild in order to not pull moto everywhere
- Update to 4.3.0:
* See the changelog for in-depth details
- Remove merged patches:
* python37-1.patch
* python37-2.patch
* python37-3.patch
* disable-pytest-log-capturing.patch
* celery-no-redis.patch
* relax-billiard-pin.patch
- Rebase patch unpin-pytest.patch
OBS-URL: https://build.opensuse.org/request/show/718188
OBS-URL: https://build.opensuse.org/package/show/openSUSE:Factory/python-celery?expand=0&rev=27
- Update to 3.1.19:
* Requirements: Now depends on Kombu 3.0.29.
* Requirements: Now depends on billiard 3.3.0.21.
* Results: Fixed MongoDB result backend URL parsing problem
(Issue celery/kombu#375).
* Worker: Task request now properly sets priority in
delivery_info.
* Beat: PyPy shelve may raise KeyError when setting keys (Issue
#2862).
* Programs: celery beat --deatched now working on PyPy.
* Results: Redis result backend now ensures all pipelines are
cleaned up.
* Results: Redis result backend now allows for timeout to be set
in the query portion of the result backend URL.
* Results: result.get now properly handles failures where the
exception value is set to None (Issue #2560).
* Prefork pool: Fixed attribute error proc.dead.
* Worker: Fixed worker hanging when gossip/heartbeat disabled
(Issue #1847).
* Results: MongoDB result backend now supports pymongo 3.x (Issue
#2744).
* Results: RPC/amqp backends did not deserialize exceptions
properly (Issue #2691).
* Programs: Fixed problem with celery amqp‘s basic_publish (Issue
#2013).
* Worker: Embedded beat now properly sets app for thread/process
(Issue #2594).
* Documentation: Many improvements and typos fixed.
OBS-URL: https://build.opensuse.org/request/show/353455
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=91
- Now depends on billiard 2.7.3.28
- A Python 3 related fix managed to disable the deadlock fix
announced in 3.0.18.
Tests have been added to make sure this does not happen again.
- Task retry policy: Default max_retries is now 3.
This ensures clients will not be hanging while the broker is down.
You can set a longer retry for the worker by
using the celeryd_after_setup signal:
from celery.signals import celeryd_after_setup
@celeryd_after_setup.connect
def configure_worker(instance, conf, **kwargs):
conf.CELERY_TASK_PUBLISH_RETRY_POLICY = {
'max_retries': 100,
'interval_start': 0,
'interval_max': 1,
'interval_step': 0.2,
}
- Worker: Will now properly display message body in error messages
even if the body is a buffer instance.
- 3.0.18 broke the MongoDB result backend (Issue #1303).
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=79
- Now depends on kombu 2.5.10.
See the kombu changelog.
- Now depends on billiard 2.7.3.27.
- Can now specify a whitelist of accepted serializers using
the new CELERY_ACCEPT_CONTENT setting.
This means that you can force the worker to discard messages
serialized with pickle and other untrusted serializers.
For example to only allow JSON serialized messages use::
CELERY_ACCEPT_CONTENT = ['json']
you can also specify MIME types in the whitelist::
CELERY_ACCEPT_CONTENT = ['application/json']
- Fixed deadlock in multiprocessing's pool caused by the
semaphore not being released when terminated by signal.
- Processes Pool: It's now possible to debug pool processes using GDB.
- celery report now censors possibly secret settings, like passwords
and secret tokens.
You should still check the output before pasting anything
on the internet.
- Connection URLs now ignore multiple '+' tokens.
- Worker/statedb: Now uses pickle protocol 2 (Py2.5+)
- Fixed Python 3 compatibility issues.
- Worker: A warning is now given if a worker is started with the
same node name as an existing worker.
- Worker: Fixed a deadlock that could occur while revoking tasks (Issue #1297).
- Worker: The :sig:`HUP` handler now closes all open file descriptors
before restarting to ensure file descriptors does not leak (Issue #1270).
- Worker: Optimized storing/loading the revoked tasks list (Issue #1289).
After this change the --statedb file will take up more disk space,
but loading from and storing the revoked tasks will be considerably
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=78
- Happy International Women's Day!
We have a long way to go, so this is a chance for you to get
involved in one of the organizations working for making our
communities more diverse.
- PyLadies — http://pyladies.com
- Girls Who Code — http://www.girlswhocode.com
- Women Who Code — http://www.meetup.com/Women-Who-Code-SF/
- Now depends on :mod:`kombu` version 2.5.7
- Now depends on :mod:`billiard` version 2.7.3.22
- AMQP heartbeats are now disabled by default.
Some users experiences issues with heartbeats enabled,
and it's not strictly necessary to use them.
If you're experiencing problems detecting connection failures,
you can re-enable heartbeats by configuring the BROKER_HEARTBEAT
setting.
- Worker: Now propagates connection errors occurring in multiprocessing
callbacks, so that the connection can be reset (Issue #1226).
- Worker: Now propagates connection errors occurring in timer callbacks,
so that the connection can be reset.
- The modules in CELERY_IMPORTS and CELERY_INCLUDE
are now imported in the original order (Issue #1161).
The modules in CELERY_IMPORTS will be imported first,
then continued by CELERY_INCLUDE.
Thanks to Joey Wilhelm.
- New bash completion for celery available in the git repository:
https://github.com/celery/celery/tree/3.0/extra/bash-completion
You can source this file or put it in bash_completion.d to
get auto-completion for the celery command-line utility.
- The node name of a worker can now include unicode characters (Issue #1186).
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=77
- Now depends on Kombu 2.5.6
- Now depends on billiard 2.7.3.20
- execv is now disabled by default.
It was causing too many problems for users, you can still enable
it using the CELERYD_FORCE_EXECV setting.
execv was only enabled when transports other than amqp/redis was used,
and it's there to prevent deadlocks caused by mutexes not being released
before the process forks. Sadly it also changes the environment
introducing many corner case bugs that is hard to fix without adding
horrible hacks. Deadlock issues are reported far less often than the
bugs that execv are causing, so we now disable it by default.
Work is in motion to create non-blocking versions of these transports
so that execv is not necessary (which is the situation with the amqp
and redis broker transports)
- Chord exception behavior defined (Issue #1172).
From Celery 3.1 the chord callback will change state to FAILURE
when a task part of a chord raises an exception.
It was never documented what happens in this case,
and the actual behavior was very unsatisfactory, indeed
it will just forward the exception value to the chord callback.
For backward compatibility reasons we do not change to the new
behavior in a bugfix release, even if the current behavior was
never documented. Instead you can enable the
CELERY_CHORD_PROPAGATES setting to get the new behavior
that will be default from Celery 3.1.
See more at chord-errors.
- worker: Fixes bug with ignored and retried tasks.
The on_chord_part_return and Task.after_return callbacks,
nor the task_postrun signal should be called when the task was
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=75
- Now depends on Kombu 2.5
- py-amqp has replaced amqplib as the default transport,
gaining support for AMQP 0.9, and the RabbitMQ extensions
including Consumer Cancel Notifications and heartbeats.
- support for multiple connection URLs for failover.
- Read more in the Kombu 2.5 changelog.
- Now depends on billiard 2.7.3.19
- Fixed a deadlock issue that could occur when the producer pool
inherited the connection pool instance of the parent process.
- The --loader option now works again (Issue #1066).
- celery umbrella command: All subcommands now supports
the --workdir option (Issue #1063).
- Groups included in chains now give GroupResults (Issue #1057)
Previously it would incorrectly add a regular result instead of a group
result, but now this works:
# [4 + 4, 4 + 8, 16 + 8]
>>> res = (add.s(2, 2) | group(add.s(4), add.s(8), add.s(16)))()
>>> res
<GroupResult: a0acf905-c704-499e-b03a-8d445e6398f7 [
4346501c-cb99-4ad8-8577-12256c7a22b1,
b12ead10-a622-4d44-86e9-3193a778f345,
26c7a420-11f3-4b33-8fac-66cd3b62abfd]>
- Chains can now chain other chains and use partial arguments (Issue #1057).
Example:
>>> c1 = (add.s(2) | add.s(4))
>>> c2 = (add.s(8) | add.s(16))
>>> c3 = (c1 | c2)
# 8 + 2 + 4 + 8 + 16
>>> assert c3(8).get() == 38
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=74
- Now depends on kombu 2.4.8
- [Redis] New and improved fair queue cycle algorithm (Kevin McCarthy).
- [Redis] Now uses a Redis-based mutex when restoring messages.
- [Redis] Number of messages that can be restored in one interval is no
longer limited (but can be set using the
unacked_restore_limit
transport option <BROKER_TRANSPORT_OPTIONS>.)
- Heartbeat value can be specified in broker URLs (Mher Movsisyan).
- Fixed problem with msgpack on Python 3 (Jasper Bryant-Greene).
- Now depends on billiard 2.7.3.18
- Celery can now be used with static analysis tools like PyDev/PyCharm/pylint
etc.
- Development documentation has moved to Read The Docs.
The new URL is: http://docs.celeryproject.org/en/master
- New CELERY_QUEUE_HA_POLICY setting used to set the default
HA policy for queues when using RabbitMQ.
New method Task.subtask_from_request returns a subtask using the current
request.
- Results get_many method did not respect timeout argument.
Fix contributed by Remigiusz Modrzejewski
- generic_init.d scripts now support setting CELERY_CREATE_DIRS to
always create log and pid directories (Issue #1045).
This can be set in your /etc/default/celeryd.
- Fixed strange kombu import problem on Python 3.2 (Issue #1034).
- Worker: ETA scheduler now uses millisecond precision (Issue #1040).
- The --config argument to programs is now supported by all loaders.
- The CASSANDRA_OPTIONS setting has now been documented.
Contributed by Jared Biel.
- Task methods celery.contrib.methods cannot be used with the old
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=73
- generic-init.d scripts changed permissions of /var/log & /var/run
In the daemonization tutorial the recommended directories were as follows:
CELERYD_LOG_FILE="/var/log/celery/%n.log"
CELERYD_PID_FILE="/var/run/celery/%n.pid"
But in the scripts themselves the default files were /var/log/celery%n.log
and /var/run/celery%n.pid, so if the user did not change the location
by configuration, the directories /var/log and /var/run would be
created - and worse have their permissions and owners changed.
This change means that:
- Default pid file is /var/run/celery/%n.pid
- Default log file is /var/log/celery/%n.log
- The directories are only created and have their permissions
changed if *no custom locations are set*.
Users can force paths to be created by calling the create-paths
subcommand:
$ sudo /etc/init.d/celeryd create-paths
Upgrading Celery will not update init scripts
To update the init scripts you have to re-download
the files from source control and update them manually.
You can find the init scripts for version 3.0.x at:
http://github.com/celery/celery/tree/3.0/extra/generic-init.d
- Now depends on billiard 2.7.3.17
- Fixes request stack protection when app is initialized more than
once (Issue #1003).
- ETA tasks now properly works when system timezone is not the same
as the configured timezone (Issue #1004).
- Terminating a task now works if the task has been sent to the
pool but not yet acknowledged by a pool process (Issue #1007).
Fix contributed by Alexey Zatelepin
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=71
- Now depends on kombu 2.4.7
- Now depends on billiard 2.7.3.14
- Fixes crash at startup when using Django and pre-1.4 projects
(setup_environ).
- Hard time limits now sends the KILL signal shortly after TERM,
to terminate processes that have signal handlers blocked by C extensions.
- Billiard now installs even if the C extension cannot be built.
It's still recommended to build the C extension if you are using
a transport other than rabbitmq/redis (or use forced execv for some
other reason).
- Pool now sets a ``current_process().index`` attribute that can be used to create
as many log files as there are processes in the pool.
- Canvas: chord/group/chain no longer modifies the state when called
Previously calling a chord/group/chain would modify the ids of subtasks
so that:
>>> c = chord([add.s(2, 2), add.s(4, 4)], xsum.s())
>>> c()
>>> c() <-- call again
at the second time the ids for the tasks would be the same as in the
previous invocation. This is now fixed, so that calling a subtask
won't mutate any options.
- Canvas: Chaining a chord to another task now works (Issue #965).
- Worker: Fixed a bug where the request stack could be corrupted if
relative imports are used.
Problem usually manifested itself as an exception while trying to
send a failed task result (NoneType does not have id attribute).
Fix contributed by Sam Cooke.
- Tasks can now raise celery.exceptions.Ignore to skip updating states
or events after return.
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=70
- Important note for users of Django and the database scheduler!
Recently a timezone issue has been fixed for periodic tasks,
but erroneous timezones could have already been stored in the
database, so for the fix to work you need to reset
the last_run_at fields.
You can do this by executing the following command:
$ python manage.py shell
>>> from djcelery.models import PeriodicTask
>>> PeriodicTask.objects.update(last_run_at=None)
You also have to do this if you change the timezone or
CELERY_ENABLE_UTC setting.
- Note about the CELERY_ENABLE_UTC setting.
If you previously disabled this just to force periodic tasks to work with
your timezone, then you are now *encouraged to re-enable it*.
- Now depends on Kombu 2.4.5 which fixes PyPy + Jython installation.
- Fixed bug with timezones when :setting:`CELERY_ENABLE_UTC` is disabled
(Issue #952).
- Fixed a typo in the celerybeat upgrade mechanism (Issue #951).
- Make sure the exc_info argument to logging is resolved (Issue #899).
- Fixed problem with Python 3.2 and thread join timeout overflow (Issue #796).
- A test case was occasionally broken for Python 2.5.
- Unit test suite now passes for PyPy 1.9.
- App instances now supports the with statement.
This calls the new :meth:`~celery.Celery.close` method at exit, which
cleans up after the app like closing pool connections.
Note that this is only necessary when dynamically creating apps,
e.g. for "temporary" apps.
- Support for piping a subtask to a chain.
For example:
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=68
- Now depends on Kombu 2.4.4
- Beat: Fixed another timezone bug with interval and crontab schedules
(Issue #943).
- Beat: The schedule file is now automatically cleared if the timezone
is changed.
The schedule is also cleared when you upgrade to 3.0.8 from an earlier
version, this to register the initial timezone info.
- Events: The worker-heartbeat event now include processed and active
count fields.
Contributed by Mher Movsisyan.
- Fixed error with error email and new task classes (Issue #931).
- BaseTask.__call__ is no longer optimized away if it has been monkey
patched.
- Fixed shutdown issue when using gevent (Issue #911 & Issue #936).
Fix contributed by Thomas Meson.
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=67
- Fixes several problems with periodic tasks and timezones (Issue #937).
- Now depends on kombu 2.4.2
- Redis: Fixes a race condition crash
- Fixes an infinite loop that could happen when retrying establishing
the broker connection.
- Daemons now redirect standard file descriptors to /dev/null
Though by default the standard outs are also redirected
to the logger instead, but you can disable this by changing
the CELERY_REDIRECT_STDOUTS setting.
- Fixes possible problems when eventlet/gevent is patched too late.
- LoggingProxy no longer defines fileno() (Issue #928).
- Results are now ignored for the chord unlock task.
Fix contributed by Steeve Morin.
- Cassandra backend now works if result expiry is disabled.
Fix contributed by Steeve Morin.
- The traceback object is now passed to signal handlers instead
of the string representation.
Fix contributed by Adam DePue.
- Celery command: Extensions are now sorted by name.
- A regression caused the task-failed event to be sent
with the exception object instead of its string representation.
- The worker daemon would try to create the pid file before daemonizing
to catch errors, but this file was not immediately released (Issue #923).
- Fixes Jython compatibility.
- billiard.forking_enable was called by all pools not just the
processes pool, which would result in a useless warning if the billiard
C extensions were not installed.
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=66
- Now depends on kombu 2.4.0
- Now depends on billiard 2.7.3.12
- Redis: Celery now tries to restore messages whenever there are no messages
in the queue.
- Crontab schedules now properly respects CELERY_TIMEZONE setting.
It's important to note that crontab schedules uses UTC time by default
unless this setting is set.
Issue #904 and django-celery #150.
- billiard.enable_forking is now only set by the processes pool.
- The transport is now properly shown by celery report
(Issue #913).
- The --app argument now works if the last part is a module name
(Issue #921).
- Fixed problem with unpickleable exceptions (billiard #12).
- Adds task_name attribute to EagerResult which is always
None (Issue #907).
- Old Task class in celery.task no longer accepts magic kwargs by
default (Issue #918).
A regression long ago disabled magic kwargs for these, and since
no one has complained about it we don't have any incentive to fix it now.
- The inspect reserved control command did not work properly.
- Should now play better with static analyzation tools by explicitly
specifying dynamically created attributes in the celery and
celery.task modules.
- Terminating a task now results in
celery.exceptions.RevokedTaskError instead of a WorkerLostError.
- AsyncResult.revoke now accepts terminate and signal arguments.
- The task-revoked event now includes new fields: terminated,
signum, and expired.
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=65
- Now depends on kombu 2.3.1 + billiard 2.7.3.11
- Fixed a bug with the -B option (``cannot pickle thread.lock objects``)
(Issue #894 + Issue #892, + django-celery #154).
- The restart_pool control command now requires the
CELERYD_POOL_RESTARTS setting to be enabled
This change was necessary as the multiprocessing event that the restart
command depends on is responsible for creating many semaphores/file
descriptors, resulting in problems in some environments.
- chain.apply now passes args to the first task (Issue #889).
- Documented previously secret options to the Django-Celery monitor
in the monitoring userguide (Issue #396).
- Old changelog are now organized in separate documents for each series,
history.
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=64
- Now depends on Kombu 2.3
- New experimental standalone Celery monitor: Flower
See monitoring-flower to read more about it!
Contributed by Mher Movsisyan.
- Now supports AMQP heartbeats if using the new pyamqp:// transport.
- The py-amqp transport requires the amqp library to be installed:
$ pip install amqp
- Then you need to set the transport URL prefix to pyamqp://.
- The default heartbeat value is 10 seconds, but this can be changed using
the BROKER_HEARTBEAT setting
BROKER_HEARTBEAT = 5.0
- If the broker heartbeat is set to 10 seconds, the heartbeats will be
monitored every 5 seconds (double the hertbeat rate).
See the Kombu 2.3 changelog for more information.
- Now supports RabbitMQ Consumer Cancel Notifications, using the pyamqp://
transport.
This is essential when running RabbitMQ in a cluster.
See the Kombu 2.3 changelog for more information.
- Delivery info is no longer passed directly through.
It was discovered that the SQS transport adds objects that can't
be pickled to the delivery info mapping, so we had to go back
to using the whitelist again.
Fixing this bug also means that the SQS transport is now working again.
- The semaphore was not properly released when a task was revoked (Issue #877).
This could lead to tasks being swallowed and not released until a worker
restart.
Thanks to Hynek Schlawack for debugging the issue.
- Retrying a task now also forwards any linked tasks.
This means that if a task is part of a chain (or linked in some other
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=63
- Now depends on kombu 2.2.5
- inspect now supports limit argument::
myapp.control.inspect(limit=1).ping()
- Beat: now works with timezone aware datetime's.
- Task classes inheriting from celery import Task
mistakingly enabled accept_magic_kwargs.
- Fixed bug in inspect scheduled (Issue #829).
- Beat: Now resets the schedule to upgrade to UTC.
- The celery worker command now works with eventlet/gevent.
Previously it would not patch the environment early enough.
- The celery command now supports extension commands
using setuptools entry-points.
Libraries can add additional commands to the celery
command by adding an entry-point like::
setup(
entry_points=[
'celery.commands': [
'foo = my.module:Command',
],
],
...)
The command must then support the interface of
celery.bin.base.Command.
- contrib.migrate: New utilities to move tasks from one queue to another.
- celery.contrib.migrate.move_tasks
- celery.contrib.migrate.move_task_by_id
- The task-sent event now contains exchange and routing_key
fields.
- Fixes bug with installing on Python 3.
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=61
- A new and improved API, that is both simpler and more powerful.
- The worker is now thread-less, giving great performance improvements.
- The new “Canvas” makes it easy to define complex workflows.
- All of Celery’s command line programs are now available from a
single celery umbrella command.
- This is the last version to support Python 2.5.
- Support for the new librabbitmq C client.
- Redis support is more reliable with improved ack emulation.
- Celery now always uses UTC
- Over 600 commits, 30k additions/36k deletions.
- Please read documentation for full list of changes:
http://docs.celeryproject.org/en/latest/whatsnew-3.0.html#whatsnew-3-0
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=60
* A bug causes messages to be sent with UTC timestamps even though
CELERY_ENABLE_UTC was not enabled (Issue #636).
* celerybeat: No longer crashes if an entry's args is set to None
(Issue #657).
* Autoreload did not work if a module's __file__ attribute
was set to the modules '.pyc' file. (Issue #647).
* Fixes early 2.5 compatibility where __package__ does not exist
(Issue #638).
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=54
* Eventlet/Gevent: A small typo caused celeryd to hang when eventlet/gevent
was used, this was because the environment was not monkey patched
early enough.
* Eventlet/Gevent: Another small typo caused the mediator to be started
with eventlet/gevent, which would make celeryd sometimes hang at shutdown.
* Mulitprocessing: Fixed an error occurring if the pool was stopped
before it was properly started.
* Proxy objects now redirects __doc__ and __name__ so help(obj) works.
* Internal timer (timer2) now logs exceptions instead of swallowing them
* celeryctl shell: can now be started with --eventlet or
--gevent options to apply their monkey patches.
- Suggest python-eventlet, python-gevent, python-pymongo, python-pytyrant
- Recommend python-curses, python-pyOpenSSL
- Run testsuite
- Changes file cleanup
- Processes pool: Fixed rare deadlock at shutdown
- Webhook tasks issued the wrong HTTP POST headers
Django and virtualenv together
file directories
* Fixes module import typo in celeryctl
couldn't be written
* Fixed deadlock in worker process handling
* Eventlet: Fixed problem with shutdown
more flexible approach
* CELERY_IMPORTS can now be a scalar value
* Fixed a memory leak when using the thread pool
* Adds EMAIL_USE_TLS to enable secure SMTP connections
where task info would be removed while iterating over it
the CELERY_RESULT_SERIALIZER setting
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=48
* Eventlet/Gevent: A small typo caused celeryd to hang when eventlet/gevent
was used, this was because the environment was not monkey patched
early enough.
* Eventlet/Gevent: Another small typo caused the mediator to be started
with eventlet/gevent, which would make celeryd sometimes hang at shutdown.
* Mulitprocessing: Fixed an error occurring if the pool was stopped
before it was properly started.
* Proxy objects now redirects __doc__ and __name__ so help(obj)
works.
* Internal timer (timer2) now logs exceptions instead of swallowing them
(Issue #626).
* celeryctl shell: can now be started with --eventlet or
--gevent options to apply their monkey patches.
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=47
- Periodic task interval schedules were accidentally rounded down,
resulting in some periodic tasks being executed early.
- Logging of humanized times in the celerybeat log is now more detailed.
- New brokers section in the Getting Started part of the Documentation
This replaces the old tut-otherqueues tutorial, and adds
documentation for MongoDB, Beanstalk and CouchDB.
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=44
- [Security: CELERYSA-0001] Daemons would set effective id’s
rather than real id’s when the --uid/--gid arguments to
celeryd-multi, celeryd_detach, celerybeat and celeryev were used.
This means privileges weren’t properly dropped, and that it
would be possible to regain supervisor privileges later.
- Processes pool: Fixed rare deadlock at shutdown (Issue #523).
- Webhook tasks issued the wrong HTTP POST headers (Issue #515).
The Content-Type header has been changed from
application/json ⇒ application/x-www-form-urlencoded, and adds
a proper Content-Length header.
- Daemonization cookbook: Adds a configuration example using
Django and virtualenv together (Issue #505).
- Generic init scripts now automatically creates log and pid
file directories (Issue #545).
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=43
* celeryctl inspect commands was missing output.
* processes pool: Decrease polling interval for less idle CPU usage.
* processes pool: MaybeEncodingError was not wrapped in ExceptionInfo
(Issue #524).
* celeryd: would silence errors occuring after task consumer started.
* logging: Fixed a bug where unicode in stdout redirected log messages
couldn't be written (Issue #522).
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=40
* Now supports Python 3.
* Fixed deadlock in worker process handling (Issue #496).
* AMQP Result backend: Now expires results by default.
* Eventlet: Fixed problem with shutdown (Issue #457).
* Broker transports can be now be specified using URLs
* The deprecated celery.loaders.setup_loader() function has been
removed.
* The CELERY_TASK_ERROR_WHITELIST setting has been replaced by a
more flexible approach (Issue #447).
* There are additional deprecations.
* No longer depends on pyparsing.
* Now depends on Kombu 1.4.3.
* CELERY_IMPORTS can now be a scalar value (Issue #485).
* Fixed a memory leak when using the thread pool (Issue #486).
* The statedb was not saved at exit.
* Adds EMAIL_USE_TLS to enable secure SMTP connections (Issue #418).
* Now handles missing fields in task messages as documented in the
message format documentation.
* Fixed race condition in celery.events.state (celerymon/celeryev)
where task info would be removed while iterating over it (Issue #501).
* The Cache, Cassandra, MongoDB, Redis and Tyrant backends now respects
the CELERY_RESULT_SERIALIZER setting (Issue #435).
* Logging calls no longer manually formats messages, but delegates that
to the logging system, so tools like Sentry can easier work with the
messages (Issue #445).
* celeryd_multi now supports a stop_verify command to wait for
processes to shutdown.
* Cache backend did not work if the cache key was unicode (Issue #504).
* New setting CELERY_RESULT_DB_SHORT_LIVED_SESSIONS added, which if
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=39
* Improved Contributing guide.
* Now depends on Kombu 1.3.1.
* Task.request now contains the current worker host name
(Issue #460).
* It is now easier for app subclasses to extend how they are
pickled.
* purge/discard_all was not working correctly (Issue #455).
* he coloring of log messages didn’t handle non-ASCII data well
(Issue #427).
* [Windows] the multiprocessing pool tried to import os.kill even
though this is not available there (Issue #450).
* Fixes case where the worker could become unresponsive because of
tasks exceeding the hard time limit.
* The task-sent event was missing from the event reference.
* ResultSet.iterate now returns results as they finish (Issue #459).
* Retries will no longer be performed when tasks are called directly
(using __call__).
* Eventlet no longer crashes if autoscale is enabled.
* py24 target removed from tox.ini.
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=36
* New signals: `after_setup_logger` and `after_setup_task_logger`
These signals can be used to augment logging configuration
after Celery has set up logging.
* Redis result backend now works with Redis 2.4.4.
* celeryd_multi: The :option:`--gid` option now works correctly.
* celeryd: Retry wrongfully used the repr of the traceback instead
of the string representation.
* App.config_from_object: Now loads module, not attribute of module.
* Fixed issue where logging of objects would give "<Unrepresentable: ...>"
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=32
* celeryd: 2.2.3 broke error logging, resulting in tracebacks not being logged.
* AMQP result backend: Polling task states did not work properly if there were
more than one result message in the queue.
* TaskSet.apply_async() and TaskSet.apply() now supports an optional
taskset_id keyword argument (Issue #331).
* The current taskset id (if any) is now available in the task context as
request.context (Issue #329).
* SQLAlchemy result backend: `date_done` was no longer part of the results as it had
been accidentally removed. It is now available again (Issue #325).
* SQLAlchemy result backend: Added unique constraint on `Task.task_id` and
`TaskSet.taskset_id`. Tables needs to be recreated for this to take effect.
* Fixed exception raised when iterating on the result of TaskSet.apply().
* Tasks Userguide: Added section on choosing a result backend.
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=27
- Now depends on Kombu 1.0.3
- Task.retry now supports a max_retries argument, used to change
the default value.
- multiprocessing.cpu_count may raise NotImplementedError on
platforms where this is not supported (Issue #320).
- Coloring of log messages broke if the logged object was not a
string.
- Fixed several typos in the init script documentation.
- A regression caused Task.exchange and Task.routing_key to no
longer have any effect. This is now fixed.
- Routing Userguide: Fixes typo, routers in CELERY_ROUTES must be
instances, not classes.
- celeryev did not create pidfile even though the --pidfile
argument was set.
- Task logger format was no longer used. (Issue #317).
The id and name of the task is now part of the log message
again.
- A safe version of repr() is now used in strategic places to
ensure objects with a broken __repr__ does not crash the
worker, or otherwise make errors hard to understand (Issue #298).
- Remote control command active_queues: did not account for
queues added at runtime.
In addition the dictionary replied by this command now has a
different structure: the exchange key is now a dictionary
containing the exchange declaration in full.
- The -Q option to celeryd removed unused queue declarations, so
routing of tasks could fail.
Queues are no longer removed, but rather
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=25
* Celerybeat could not read the schedule properly, so entries in
:setting:`CELERYBEAT_SCHEDULE` would not be scheduled.
* Task error log message now includes `exc_info` again.
* The `eta` argument can now be used with `task.retry`.
Previously it was overwritten by the countdown argument.
* celeryd-multi/celeryd_detach: Now logs errors occuring when
executing the `celeryd` command.
* daemonizing cookbook: Fixed typo ``--time-limit 300`` ->
``--time-limit=300``
* Colors in logging broke non-string objects in log messages.
* ``setup_task_logger`` no longer makes assumptions about
magic task kwargs.
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=24
* Eventlet pool was leaking memory (Issue #308).
* Deprecated function ``celery.execute.delay_task`` was
accidentally removed,
now available again.
* ``BasePool.on_terminate`` stub did not exist
* celeryd detach: Adds readable error messages if user/group
name does not exist.
* Smarter handling of unicode decod errors when logging errors.
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=23
* Celery programs now hijacks the root logger by default (Issue #250).
* Execution options to `apply_async` now takes precedence over options
returned by active routers. This was a regression introduced recently
(Issue #244).
* `celeryev` curses monitor: Long arguments are now truncated so curses
doesn't crash with out of bounds errors. (Issue #235).
* `celeryd`: Channel errors occurring while handling control commands no
longer crash the worker but are instead logged with severity error.
* SQLAlchemy database backend: Fixed a race condition occurring when
the client wrote the pending state. Just like the Django database backend,
it does no longer save the pending state (Issue #261 + Issue #262).
* `task.apply`: `propagate=True` now raises exceptions from the original
frame, keeping the same stacktrace (Issue #256).
* Error email body now uses `repr(exception)` instead of `str(exception)`,
as the latter could result in Unicode decode errors (Issue #245).
* Error e-mail timeout value is now configurable by using the
:setting:`EMAIL_TIMEOUT` setting.
* `celeryev`: Now works on Windows (but the curses monitor won't work without
having curses).
* Unit test output no longer emits non-standard characters.
* `celeryd`: The broadcast consumer is now closed if the connection is reset.
* `celeryd`: Now properly handles errors occurring while trying to acknowledge
the message.
OBS-URL: https://build.opensuse.org/package/show/devel:languages:python/python-celery?expand=0&rev=21
oid sha256:4d6930f354f9d29295425d7a37261245c74a32807c45d764bedc286afd0e724e
size 1666892
Reference in New Issue
Block a user
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
