Commit Graph

60 Commits

Author SHA1 Message Date
sinowood
52c04217e9 Multiple queue, multiple cluster in one site (#71)
* Support for multi-queue, multi-cluster configuration. API changes include:
  * Adding `cluster` to async_task() parameters and Task model
  * Adding argument --name to qcluster command
  * Necessary adjustments to Conf and Broker classes
  * Some admin improvements

* Add settings.Q_CLUSTER['ALT_CLUSTERS']: q_cluster config overrides for alternative clusters;
Add Conf.CLUSTER_NAME: separate usage from Conf.PREFIX;
QueueAdmin/OrmQ detail page enhanced: now displaying args/kwargs/q_options instead of encrypted payload.

* if `cluster` argument is not set (the default), async_task() and schedule() will be handled by the default cluster; Documentation update.

* Text cleanup

* Documentation update.

* Fix TIMEOUT setting in Windows for non-default cluster

---------

Co-authored-by: Stan Triepels <1939656+GDay@users.noreply.github.com>
2023-04-02 16:36:17 +02:00
GDay
86467dcf03 Revert "Merge pull request #15 from django-q2/error-on-timeout"
This reverts commit d97dca5bcb, reversing
changes made to 01cb652071.
2023-03-31 02:22:38 +02:00
Jim Jagielski
f5ecd337ad Merge branch 'master' into error-on-timeout 2023-02-17 12:33:47 -05:00
msabatier
650c3b1524 Fix use of database router for write queries and remove Conf.HAS_REPLICA (#61)
Co-authored-by: Marc Sabatier
2023-01-18 02:12:13 +01:00
Stan Triepels
4d454e4001 Fix: Daylight saving time issue with scheduler (#47) 2022-12-21 01:44:34 +01:00
Stan Triepels
0ddef44400 Bump version and docs fixes (#21) 2022-10-21 00:04:58 +02:00
Noortheen Raja
64d73a77b7 feat: option to fail-on-timeout
fixes #251
2022-10-19 02:27:12 +02:00
Stan Triepels
c59f036158 Remove arrow dependency, update packages, set up testing with compose (#17) 2022-10-19 02:01:16 +02:00
Stan Triepels
9ace854290 Save limit per group/func/name (#12)
* feat: option to save tasks per group/func/name

* test: update tests for save limit

* fix: convert func when save-limit checking

when passed as function it needs to be converted to work

* Add warning if option is not valid

Co-authored-by: Noortheen Raja <jnoortheen@gmail.com>
2022-10-15 01:56:41 +02:00
Stan Triepels
d32d3f5a09 Docs updates (#6)
* Update django docs links to 4.0
* Update Django Q to Django Q2
* Use different theme to make difference more clear between the original and this forked one
* Added info notice about this fork
* Some small layout/typo fixes
2022-10-13 01:38:24 +02:00
LJlkdskdjflsa
4d17cb965d Update configure.rst 2022-09-01 12:08:41 +08:00
njzhan
7be8205781 Fix docs error (#563)
Reference `django_q/conf.py`
2021-05-24 09:32:19 +02:00
Alexandre Xavier
71d4b726ea Feature/improves multiple databases support (#561)
* feat: adds docker local files to ignore

* feat: adds replica key to django q settings

* feat: adds multiple database routers testing utility

* feat: ensures scheduler works with multiple databases and replicas

* feat: adds docker image to support containerized development

* refactor: removes unnecessary import

* style: improves import styling

* docs: adds replica setting to configure documentation
2021-05-23 15:10:31 +02:00
Dimitri
957f807598 Allow tasks to be scheduled on a specific cluster (#555)
* Allows schedule by cluster

* Update docs

* Add example in doc

* Fixes cluster field must be blank

* Adds cluster arg to schedule func

* Adds cluster field in list_display/filter for admin

* Uses Q filter to fetch schedule

* Fixes ref in doc

* Adds tests
2021-05-14 13:42:54 +02:00
amo13
57ae1dc4dc Update documentation for new retry time default (#538)
As suggested in #526
2021-05-01 16:24:17 +02:00
Daniel Trembath
3e8fc91d46 Change Django documentation URLs from v1.8 to v2.2
URLs were linking to a now unsupported version of Django. Django v2.2 is a LTS version, and also matches the documentation intersphinx_mapping in docs/conf.py.
2020-10-07 17:56:23 +11:00
Tim O'Meara
655f0aadb5 rename config var to max_retries, remove attempt_count form admin , add admin ui customization to docs 2020-08-13 11:58:00 -05:00
Tim O'Meara
45b0b2cc27 add attempt_count to config docs, set value to 1 in inital task save 2020-08-11 10:42:28 -05:00
Ilan Steemers
9946a1a8ce Adds max_rss to the docs 2020-07-05 18:21:51 +02:00
Alejandro Sedeño
4429f99095 Update documentation to say tasks are signed, not encrypted
This resolves #300.
2020-04-17 14:25:35 -04:00
valentinogagliardi
458697c099 add missing semicolon 2020-01-12 19:23:19 +01:00
valentinogagliardi
fa1082ff96 ability to use a Redis connection URI - closes #402 2020-01-12 13:13:41 +01:00
Tyler Harper
3882f1c4d4 fix spelling of careful
Fixed spelling of careful
2019-04-24 14:19:48 -04:00
Janne Rönkkö
d55d33ce27 Document the behaviour of retry value properly
This issue has been reported many times in Django-Q's issue tracker:
https://github.com/Koed00/django-q/issues/183
https://github.com/Koed00/django-q/issues/180
https://github.com/Koed00/django-q/issues/307

All these issue have been closed and responses have noted that retry should
be set bigger than timeout or duration of any task.
2019-02-06 16:49:09 +02:00
Ilan Steemers
b5a01a9e93 Removes old rollbar support - relies on the pluggable error reporters now 2018-08-10 13:03:58 +02:00
Ilan Steemers
acebdaa850 Renames async/enqueue to async_task. 2018-08-01 15:20:34 +02:00
Pierre-Elliott Bécue
ae75a84f7f Replaces async occurrences with alternatives
* async is now a reserved word in python3.7
 * Rename async function to enqueue
 * Rename all async_ functions to enqueue_
 * Rename Async class to AsyncTask
 * Updates the docs.
2018-07-07 21:33:43 +02:00
Balletie
03abbc960f Add option for acknowledging failed tasks (globally and per-task)
If a task fails with an exception, it is retried until it
succeeds. This is contrary to what is said in the documentation: under
the "Architecture" section, heading "Broker" it says that even when a
task errors, it's still considered a successful delivery. Failed tasks
never get acknowledged however, thereby being retried after the
timeout period. See also issues #238 and #194.

This patch adds an option to acknowledge failures, thereby closing
issue #238. Issue #194 would require some more work. The default of
this option is set to `False`, thereby maintaining backwards
compatibility.
2018-03-09 22:09:46 +01:00
Sander van de Graaf
17ea1e7a7b Allow SQS to use environment variables 2018-01-09 13:03:51 +01:00
ilan
14589bde0f Fixes some minor mistakes in the new error reporting documentation source 2017-10-10 22:14:42 +02:00
Daniel Welch
4530b05d86 putting back support for backwards compatibility 2017-10-06 13:26:43 -04:00
Daniel Welch
f5e62bb624 documentation for error reporter plugin system 2017-10-03 17:04:37 -04:00
Yann Pomarede
aa667b40d4 daemonize_workers option 2016-12-05 14:55:42 +01:00
Vladimir Rychkov
cadbc9f220 exception raised if guard_cycle configured not in range (0, 60) 2016-07-13 09:44:26 +01:00
Vladimir Rychkov
1a1385dfba Guard loop sleep made configurable 2016-07-12 13:08:17 +01:00
Ilan Steemers
3c6b2e6ad2 docs: formatting 2016-01-27 13:28:23 +01:00
Ilan Steemers
e1c05732f9 docs: fixes broken ref 2016-01-27 12:14:46 +01:00
Ilan Steemers
c17468ef86 docs: Adds Custom broker class documentation
Also changes some of the variable and settings names, to make them less ambiguous.
2016-01-27 12:06:49 +01:00
Ilan Steemers
ddb8f8117f docs: adds poll configuration option 2016-01-26 22:49:29 +01:00
Ilan Steemers
8ae7aa346e Updates docs with rollbar support
also bumps version to 0.7.12
2016-01-08 12:06:56 +01:00
Ilan Steemers
7911419642 docs: updated cache and group operations 2015-10-02 18:31:52 +02:00
Ilan Steemers
477761a17f :docs: replaced some old redis references with brokers 2015-09-30 10:12:16 +02:00
Ilan Steemers
b8bb186471 check for default database on mongo connection 2015-09-26 13:01:15 +02:00
Ilan Steemers
1fd9ca2441 docs: mongodb broker 2015-09-25 20:57:47 +02:00
Ilan Steemers
826178c463 Adds a MongoDB broker
* adds mongo broker tests
* adds mongo brokers docs

* broker info is now cached when it needs to connect to a server, to reduce traffic.
2015-09-25 20:03:39 +02:00
Ilan Steemers
04470c1a87 docs: compatibility 2015-09-22 18:22:08 +02:00
Ilan Steemers
ff5531aa99 Merge branch 'master' into orm
# Conflicts:
#	docs/conf.py
2015-09-14 16:57:28 +02:00
Ilan Steemers
789f934208 docs: Django ORM broker 2015-09-14 15:38:16 +02:00
Ilan Steemers
793c0a0d6a Merge pull request #58 from Koed00/dev
Adds Amazon SQS broker
2015-09-10 14:46:29 +02:00
Ilan Steemers
2efa5bac57 docs: minor adjustments 2015-09-10 14:27:14 +02:00