valentinogagliardi
fa1082ff96
ability to use a Redis connection URI - closes #402
2020-01-12 13:13:41 +01:00
ilan
e1d1f0f099
Fixes relative imports
2018-03-13 18:32:49 +01:00
Sander van de Graaf
17ea1e7a7b
Allow SQS to use environment variables
2018-01-09 13:03:51 +01:00
Yann Pomarede
bbd2e82fd4
fix race condition in orm broker
2016-12-05 18:40:04 +01:00
Ilan Steemers
3a57ab1b1b
Fixes typo in custom broker handler
2016-04-06 19:59:02 +02:00
Ilan Steemers
c17468ef86
docs: Adds Custom broker class documentation
...
Also changes some of the variable and settings names, to make them less ambiguous.
2016-01-27 12:06:49 +01:00
Ilan Steemers
3ac7f26de5
Moves custom broker class to top
2016-01-27 11:11:29 +01:00
Ilan Steemers
fe8015403c
Adds custom broker configuration
2016-01-27 10:33:07 +01:00
Ilan Steemers
af3b1da08f
Makes DB polling time configurable via poll setting
2016-01-26 22:29:00 +01:00
kdmukai
e4a87e167b
Fix for issue referenced in
...
https://github.com/Koed00/django-q/issues/124
2015-12-09 11:43:45 -06:00
Ilan Steemers
08104ef777
check for default database on mongo connection
...
correction
2015-09-26 13:13:25 +02:00
Ilan Steemers
b8bb186471
check for default database on mongo connection
2015-09-26 13:01:15 +02:00
Ilan Steemers
826178c463
Adds a MongoDB broker
...
* adds mongo broker tests
* adds mongo brokers docs
* broker info is now cached when it needs to connect to a server, to reduce traffic.
2015-09-25 20:03:39 +02:00
Ilan Steemers
93a8f71157
Only show lock count when available and greater than zero
2015-09-19 15:42:35 +02:00
Ilan Steemers
16c28a88e2
adds (approximate) lock_size to SQS broker
...
docs: added lock_size
2015-09-18 15:40:30 +02:00
Ilan Steemers
1d12107524
Changed locking mechanism
...
* all new tasks start as timeouts. This makes the queries a lot simpler.
* In BULK mode, the bulk update for the lock was causing actual database locks. The lock updates are now iterated.
2015-09-17 18:49:03 +02:00
Ilan Steemers
a060b3508a
Moves bulk iteration to pusher
2015-09-15 14:45:06 +02:00
Ilan Steemers
2bffcf554b
Django ORM broker
2015-09-14 13:24:43 +02:00
Ilan Steemers
8543c5b328
Adds Fastack option to Disque broker
2015-09-11 17:58:16 +02:00
Ilan Steemers
4c413fc659
Prevents crash on duplicate acknowledge
2015-09-10 13:31:37 +02:00
Ilan Steemers
0b9df26218
Converted SQS broker to Boto3
2015-09-10 11:08:33 +02:00
Ilan Steemers
0fe6c4cbde
SQS only supports max 10 messages in bulk mode
...
* capped bulk at 10
* added tests
2015-09-09 19:34:06 +02:00
Ilan Steemers
d7ce945f03
Amazon SQS broker
2015-09-09 18:10:03 +02:00
Ilan Steemers
8eb1431413
Resets broker configuration in case a third party broker crashes
2015-09-08 15:50:32 +02:00
Ilan Steemers
c946a16b99
changes py 2.7 import for ironmq
2015-09-08 15:38:00 +02:00
Ilan Steemers
d849774c86
Adds bulk option to disque broker
...
adds tests
2015-09-08 14:06:38 +02:00
Ilan Steemers
83548dcfbb
Makes bulk a general setting
2015-09-08 13:42:15 +02:00
Ilan Steemers
0ffae4519b
Adds bulk get to ironmq
2015-09-08 13:37:33 +02:00
Ilan Steemers
b56cc9da8f
IronMQ broker
2015-09-08 11:20:31 +02:00
Ilan Steemers
3f75e7fa05
removed SQS and IronMQ brokers for now
...
Both brokers are not atomic and cause all kinds of problems during testing. Needs more time.
Meanwhile I want to release the pluggable broker backend.
2015-09-04 14:49:17 +02:00
Ilan Steemers
1ccfc66254
adds fail method to broker
2015-09-03 16:34:00 +02:00
Ilan Steemers
7be533d9a6
moved auth to redis py
2015-09-03 16:14:20 +02:00
Ilan Steemers
2e4c1c86ed
Adds extra AUTH before PING
2015-09-03 15:50:22 +02:00
Ilan Steemers
453fc3b133
Changes Disque ping to hello
2015-09-03 15:13:44 +02:00
Ilan Steemers
a342aaf009
Changes Disque ping to hello
2015-09-03 15:13:25 +02:00
Ilan Steemers
1f5952044e
Changes Disque ping to hello
2015-09-03 15:08:55 +02:00
Ilan Steemers
c0f7df3f07
Changes Disque ping to hello
2015-09-03 14:59:57 +02:00
Ilan Steemers
653ae80477
Disque: If retry is 0 , explicitly set replicate to 1
2015-09-03 14:41:03 +02:00
Ilan Steemers
01f8d9ce47
adds info method to brokers
2015-09-03 14:29:03 +02:00
Ilan Steemers
b1f2143a3d
uses disque_nodes convention
2015-09-03 12:55:49 +02:00
Ilan Steemers
e22980834c
Fixes connectionerror bug on 2.7
2015-09-02 20:17:44 +02:00
Ilan Steemers
46ae50043c
Fixes class super for python 2.7
2015-09-02 19:50:04 +02:00
Ilan Steemers
8ce441bed5
Adds more brokers
...
* added IronMQ
* added Aws SQS
* removed SafeRedis.
During tests the 'safe' part wasn't consistent enough
2015-09-02 19:04:03 +02:00
Ilan Steemers
9e04d8c9a8
Fixes import problems in python 2.7
2015-08-30 21:12:47 +02:00
Ilan Steemers
d6b9b10e3e
Adds tests for brokers
...
* test for redis and django-redis
* test for disque
TODO add disque to Travis
2015-08-30 20:26:30 +02:00
Ilan Steemers
4f39062785
Adds django cache as monitor cache
...
Not the best solution yet, but it solves monitoring problems with brokers that don't have a pattern getter for cluster stats.
2015-08-30 18:28:26 +02:00
Ilan Steemers
d3283571a6
First draft of a Disque broker
...
TODO monitoring doesn't work yet
2015-08-30 14:33:35 +02:00
Ilan Steemers
93cbfc37e2
fixes import confusion in python 2.7
2015-08-29 19:08:19 +02:00
Ilan Steemers
0740c90148
adds pluggable brokers
...
* added redis broker
* added django_redis broker
* added task acknowledgement
2015-08-29 18:54:07 +02:00