fork/django-q2
1
0
Fork 0
mirror of https://github.com/django-q2/django-q2.git synced 2026-09-29 00:08:11 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,324 Commits 9 Branches 31 Tags
post-spawn-docs
Commit Graph
33 Commits
Author SHA1 Message Date
sinowoodandStan Triepels 52c04217e9 Multiple queue, multiple cluster in one site (#71) 
* Support for multi-queue, multi-cluster configuration. API changes include:
  * Adding `cluster` to async_task() parameters and Task model
  * Adding argument --name to qcluster command
  * Necessary adjustments to Conf and Broker classes
  * Some admin improvements

* Add settings.Q_CLUSTER['ALT_CLUSTERS']: q_cluster config overrides for alternative clusters;
Add Conf.CLUSTER_NAME: separate usage from Conf.PREFIX;
QueueAdmin/OrmQ detail page enhanced: now displaying args/kwargs/q_options instead of encrypted payload.

* if `cluster` argument is not set (the default), async_task() and schedule() will be handled by the default cluster; Documentation update.

* Text cleanup

* Documentation update.

* Fix TIMEOUT setting in Windows for non-default cluster

---------

Co-authored-by: Stan Triepels <1939656+GDay@users.noreply.github.com>
 2023-04-02 16:36:17 +02:00
Stan Triepels c59f036158 Remove arrow dependency, update packages, set up testing with compose (#17) 2022-10-19 02:01:16 +02:00
Ilan Steemers 15155c7a99 Build improvements (#569) 
* Black linting

* Adding Black to dev dependencies and upping minimal python to 3.6.2 for compatibility

* Updating packages

* Removing pip-tools input and exporting requirements with poetry

* Deleting old setup files and test runner

* Trying 1.3.7

* Looser extras requirements to prevent conflicts

* Sorted imports with isort

* Added iSort to dev dependencies

* Fixes localtime for naive setups
 2021-05-30 17:10:07 +02:00
Ilan Steemers 87390509ef Merge pull request #477 from fallenhitokiri/fix-get-broker-sqs 
empty dictionary as configuration value for SQS
 2020-10-20 14:04:30 +02:00
ihuk 8b3d6b7d2a Initial work on fix for #424 - TypeError: can't pickle _thread.lock objects. 
Made `Broker` and `Queue` classes pickable which fixes the the problem with new default `spawn` proces start method.
 2020-10-14 22:21:40 +02:00
Timo Zimmermann 73ca8edcf5 empty dictionary as configuration value for SQS 
The [documentation](https://django-q.readthedocs.io/en/latest/configure.html#sqs-configuration) lists all keys as optional, but the way `get_broker` is implemented it will evaluate to false and return Redis. One way around this would be checking if the type of `Conf.SQS` is `dict`.
 2020-09-22 15:42:38 +02:00
Ilan Steemers c8eb7ecddb Linting and hints 2020-06-14 18:48:05 +02:00
Bastien Vallet 68d95a2924 [cleanup] Remove python2 artifacts 2020-06-10 11:48:31 +02:00
ilan e1d1f0f099 Fixes relative imports 2018-03-13 18:32:49 +01:00
Ilan Steemers 3a57ab1b1b Fixes typo in custom broker handler 2016-04-06 19:59:02 +02:00
Ilan Steemers c17468ef86 docs: Adds Custom broker class documentation 
Also changes some of the variable and settings names, to make them less ambiguous.
 2016-01-27 12:06:49 +01:00
Ilan Steemers 3ac7f26de5 Moves custom broker class to top 2016-01-27 11:11:29 +01:00
Ilan Steemers fe8015403c Adds custom broker configuration 2016-01-27 10:33:07 +01:00
Ilan Steemers 826178c463 Adds a MongoDB broker 
* adds mongo broker tests
* adds mongo brokers docs

* broker info is now cached when it needs to connect to a server, to reduce traffic.
 2015-09-25 20:03:39 +02:00
Ilan Steemers 93a8f71157 Only show lock count when available and greater than zero 2015-09-19 15:42:35 +02:00
Ilan Steemers a060b3508a Moves bulk iteration to pusher 2015-09-15 14:45:06 +02:00
Ilan Steemers 2bffcf554b Django ORM broker 2015-09-14 13:24:43 +02:00
Ilan Steemers d7ce945f03 Amazon SQS broker 2015-09-09 18:10:03 +02:00
Ilan Steemers 8eb1431413 Resets broker configuration in case a third party broker crashes 2015-09-08 15:50:32 +02:00
Ilan Steemers c946a16b99 changes py 2.7 import for ironmq 2015-09-08 15:38:00 +02:00
Ilan Steemers 0ffae4519b Adds bulk get to ironmq 2015-09-08 13:37:33 +02:00
Ilan Steemers b56cc9da8f IronMQ broker 2015-09-08 11:20:31 +02:00
Ilan Steemers 3f75e7fa05 removed SQS and IronMQ brokers for now 
Both brokers are not atomic and cause all kinds of problems during testing. Needs more time.
Meanwhile I want to release the pluggable broker backend.
 2015-09-04 14:49:17 +02:00
Ilan Steemers 1ccfc66254 adds fail method to broker 2015-09-03 16:34:00 +02:00
Ilan Steemers 01f8d9ce47 adds info method to brokers 2015-09-03 14:29:03 +02:00
Ilan Steemers b1f2143a3d uses disque_nodes convention 2015-09-03 12:55:49 +02:00
Ilan Steemers 8ce441bed5 Adds more brokers 
* added IronMQ
* added Aws SQS
* removed SafeRedis.
 During tests the 'safe' part wasn't consistent enough
 2015-09-02 19:04:03 +02:00
Ilan Steemers 9e04d8c9a8 Fixes import problems in python 2.7 2015-08-30 21:12:47 +02:00
Ilan Steemers d6b9b10e3e Adds tests for brokers 
* test for redis and django-redis
* test for disque

TODO add disque to Travis
 2015-08-30 20:26:30 +02:00
Ilan Steemers 4f39062785 Adds django cache as monitor cache 
Not the best solution yet, but it solves monitoring problems with brokers that don't have a pattern getter for cluster stats.
 2015-08-30 18:28:26 +02:00
Ilan Steemers d3283571a6 First draft of a Disque broker 
TODO monitoring doesn't work yet
 2015-08-30 14:33:35 +02:00
Ilan Steemers 93cbfc37e2 fixes import confusion in python 2.7 2015-08-29 19:08:19 +02:00
Ilan Steemers 0740c90148 adds pluggable brokers 
* added redis broker
 * added django_redis broker
 * added task acknowledgement
 2015-08-29 18:54:07 +02:00