fork/django-q2
1
0
Fork 0
mirror of https://github.com/django-q2/django-q2.git synced 2026-10-06 22:08:12 +08:00
Code Issues Packages Projects Releases Wiki Activity
500 Commits 9 Branches 31 Tags
f87bb5f8a809d3a306e744f02ba329d96dddc476
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ilan Steemers f87bb5f8a8 Updated README 2015-09-10 14:26:55 +02:00
Ilan Steemers 9af70e799d docs: Amazon SQS broker 2015-09-10 14:11:30 +02:00
Ilan Steemers 4c413fc659 Prevents crash on duplicate acknowledge 2015-09-10 13:31:37 +02:00
Ilan Steemers 5195464c31 tests: sqs is not atomic 2015-09-10 11:34:35 +02:00
Ilan Steemers 0b9df26218 Converted SQS broker to Boto3 2015-09-10 11:08:33 +02:00
Ilan Steemers 0fe6c4cbde SQS only supports max 10 messages in bulk mode 
* capped bulk at 10
* added tests
 2015-09-09 19:34:06 +02:00
Ilan Steemers e4a5951f12 Resets SQS conf in case of test failure 2015-09-09 18:59:24 +02:00
Ilan Steemers d7ce945f03 Amazon SQS broker 2015-09-09 18:10:03 +02:00
Ilan Steemers 54d2822f5c updates future to 0.15.1 2015-09-09 15:21:13 +02:00
Ilan Steemers 6d87163e61 Sets testing for Travis 2015-09-09 13:34:32 +02:00
Ilan Steemers cc178df2b1 #56 fakes setting cpu_affinity on unsupported platforms 2015-09-09 13:25:27 +02:00
Ilan Steemers 0e03601572 docs: cache option 2015-09-08 18:20:42 +02:00
Ilan Steemers bb7e91e875 docs: minor changes 2015-09-08 17:30:09 +02:00
Ilan Steemers 5f4334d85a docs: adds IronMQ and bulk config 2015-09-08 17:17:54 +02:00
Ilan Steemers 69df45ea4e queue size is not atomic on ironmq 2015-09-08 16:22:38 +02:00
Ilan Steemers 52f353fb37 random queue names for ironmq test 2015-09-08 16:11:27 +02:00
Ilan Steemers 661987b368 updated delete job test 2015-09-08 15:56:53 +02:00
Ilan Steemers 8eb1431413 Resets broker configuration in case a third party broker crashes 2015-09-08 15:50:32 +02:00
Ilan Steemers c946a16b99 changes py 2.7 import for ironmq 2015-09-08 15:38:00 +02:00
Ilan Steemers 7fb12fce49 fixes iron-mq test 
purging a queue that never had a message in it raises a not found error. So we queue one message to initialize.
 2015-09-08 15:19:40 +02:00
Ilan Steemers d849774c86 Adds bulk option to disque broker 
adds tests
 2015-09-08 14:06:38 +02:00
Ilan Steemers 83548dcfbb Makes bulk a general setting 2015-09-08 13:42:15 +02:00
Ilan Steemers 0ffae4519b Adds bulk get to ironmq 2015-09-08 13:37:33 +02:00
Ilan Steemers b56cc9da8f IronMQ broker 2015-09-08 11:20:31 +02:00
Ilan Steemers 2078080945 determines decode with django version 2015-09-07 20:38:13 +02:00
Ilan Steemers e899b93c3f determines decode with django version 2015-09-07 20:35:51 +02:00
Ilan Steemers f4f8af1382 Fixes backward compatibility problems with django-picklefield 2015-09-07 20:24:21 +02:00
Ilan Steemers eff51cf9d1 v0.6.1 
pinning django-picklefield
 2015-09-07 11:50:00 +02:00
Ilan Steemers d6d4a2b77a Update requirements.txt 
back to picklefield 0.3.1
 2015-09-06 20:55:26 +02:00
Ilan Steemers 80e5a1194c updated django-picklefield 2015-09-06 20:18:13 +02:00
Ilan Steemers 5bd150baac Merge pull request #52 from Koed00/dev 
Adds pluggable brokers
 2015-09-06 20:02:41 +02:00
Ilan Steemers cba7b60fcc fixing term clear 2015-09-06 19:58:04 +02:00
Ilan Steemers 61306143bd adds brokers to manifest 2015-09-06 19:57:53 +02:00
Ilan Steemers ba4a6f104a removed boto and ironmq for now 2015-09-06 17:52:52 +02:00
Ilan Steemers a4bdc809dc getting ready for new release 2015-09-06 17:14:43 +02:00
Ilan Steemers 43065233f6 Updated README 2015-09-06 16:55:46 +02:00
Ilan Steemers 73d15c3608 docs: minor updates 2015-09-06 16:54:20 +02:00
Ilan Steemers 87c3b7c9ce docs: minor changes 2015-09-06 16:22:06 +02:00
Ilan Steemers 815cbeede9 docs: defaults queue_limit to workers squared. 2015-09-06 16:21:58 +02:00
Ilan Steemers b201979eae defaults queue_limit to workers squared. 2015-09-06 15:45:17 +02:00
Ilan Steemers d72dd8b338 adds bottom bar with broker info 2015-09-06 15:19:05 +02:00
Ilan Steemers 5e5bf2cc8d docs: adjusted for multiple brokers 2015-09-06 14:48:33 +02:00
Ilan Steemers 44473ca408 Adds broker and receipts to architecture flowchart 2015-09-06 12:29:21 +02:00
Ilan Steemers d90db10f5e Just use local disque for testing 2015-09-06 12:28:12 +02:00
Ilan Steemers c7039168cf Updated psutil 2015-09-06 12:07:43 +02:00
Ilan Steemers 3be488f918 Adds Tynd envs for Travis 
attempt #3
 2015-09-04 15:48:43 +02:00
Ilan Steemers 8340a2ae57 Adds Tynd envs for Travis 2015-09-04 15:27:10 +02:00
Ilan Steemers 3524ad2dee Adds Tynd envs for Travis 
and fixes timeout tests
 2015-09-04 15:16:30 +02:00
Ilan Steemers e76e65640b removes AUTH for Travis test 2015-09-04 14:53:42 +02:00
Ilan Steemers 3f75e7fa05 removed SQS and IronMQ brokers for now 
Both brokers are not atomic and cause all kinds of problems during testing. Needs more time.
Meanwhile I want to release the pluggable broker backend.
 2015-09-04 14:49:17 +02:00
Ilan Steemers 1ccfc66254 adds fail method to broker 2015-09-03 16:34:00 +02:00
Ilan Steemers 7be533d9a6 moved auth to redis py 2015-09-03 16:14:20 +02:00
Ilan Steemers 2e4c1c86ed Adds extra AUTH before PING 2015-09-03 15:50:22 +02:00
Ilan Steemers 453fc3b133 Changes Disque ping to hello 2015-09-03 15:13:44 +02:00
Ilan Steemers a342aaf009 Changes Disque ping to hello 2015-09-03 15:13:25 +02:00
Ilan Steemers 1f5952044e Changes Disque ping to hello 2015-09-03 15:08:55 +02:00
Ilan Steemers c0f7df3f07 Changes Disque ping to hello 2015-09-03 14:59:57 +02:00
Ilan Steemers 653ae80477 Disque: If retry is 0 , explicitly set replicate to 1 2015-09-03 14:41:03 +02:00
Ilan Steemers c626c3137c Defaults RETRY to 60 2015-09-03 14:40:32 +02:00
Ilan Steemers 01f8d9ce47 adds info method to brokers 2015-09-03 14:29:03 +02:00
Ilan Steemers b1f2143a3d uses disque_nodes convention 2015-09-03 12:55:49 +02:00
Ilan Steemers e22980834c Fixes connectionerror bug on 2.7 2015-09-02 20:17:44 +02:00
Ilan Steemers dfb1b03cd0 Experimenting with disque build on travis 2015-09-02 20:12:00 +02:00
Ilan Steemers b901039a44 Experimenting with disque build on travis 2015-09-02 20:08:20 +02:00
Ilan Steemers 1a61fa2821 Experimenting with disque build on travis 2015-09-02 20:04:48 +02:00
Ilan Steemers 0756fb9896 Experimenting with disque build on travis 2015-09-02 20:00:43 +02:00
Ilan Steemers 46ae50043c Fixes class super for python 2.7 2015-09-02 19:50:04 +02:00
Ilan Steemers 8ce441bed5 Adds more brokers 
* added IronMQ
* added Aws SQS
* removed SafeRedis.
 During tests the 'safe' part wasn't consistent enough
 2015-09-02 19:04:03 +02:00
Ilan Steemers da20ebe734 fixes connection creation on import 2015-08-31 15:15:24 +02:00
Ilan Steemers 9e04d8c9a8 Fixes import problems in python 2.7 2015-08-30 21:12:47 +02:00
Ilan Steemers c4b0a92e74 Fixes typo in travis conf 2015-08-30 21:07:11 +02:00
Ilan Steemers 5171f1a183 Disabled Disque tests for now 2015-08-30 21:04:07 +02:00
Ilan Steemers 452f53f899 New container build on Travis 2015-08-30 20:57:05 +02:00
Ilan Steemers 3a27af0877 Adds disque build to Travis 2015-08-30 20:33:23 +02:00
Ilan Steemers d6b9b10e3e Adds tests for brokers 
* test for redis and django-redis
* test for disque

TODO add disque to Travis
 2015-08-30 20:26:30 +02:00
Ilan Steemers 4f39062785 Adds django cache as monitor cache 
Not the best solution yet, but it solves monitoring problems with brokers that don't have a pattern getter for cluster stats.
 2015-08-30 18:28:26 +02:00
Ilan Steemers d3283571a6 First draft of a Disque broker 
TODO monitoring doesn't work yet
 2015-08-30 14:33:35 +02:00
Ilan Steemers 93cbfc37e2 fixes import confusion in python 2.7 2015-08-29 19:08:19 +02:00
Ilan Steemers 0740c90148 adds pluggable brokers 
* added redis broker
 * added django_redis broker
 * added task acknowledgement
 2015-08-29 18:54:07 +02:00
Ilan Steemers b0925af8cd Merge pull request #51 from Koed00/dev 
#50 adds psutil as alternative os.getppid provider
 2015-08-28 15:53:01 +02:00
Ilan 0de742b417 Updated README 
out of Alpha
 2015-08-28 15:47:26 +02:00
Ilan ababf2c5d0 Updated README 
fixed some links
 2015-08-28 15:47:26 +02:00
Ilan 57d9c40ae8 Updated README 
fixed some links
 2015-08-28 15:47:26 +02:00
Ilan Steemers 439c8a2f77 Moves Status to it's own file 
This way only qmonitor and qinfo need Curses and you can still run the cluster without it.
 2015-08-26 13:11:58 +02:00
Ilan Steemers 3e92fddcdd #50 removes redis connection argument from pusher process 2015-08-24 10:08:43 +02:00
Ilan Steemers b414b637eb #50 adds psutil as alternative os.getppid provider 2015-08-23 21:19:35 +02:00
Ilan e68170ae96 Updated README 
out of Alpha
 2015-08-19 20:26:44 +02:00
Ilan 7358ef9977 Updated README 
fixed some links
 2015-08-19 20:23:25 +02:00
Ilan 7ef45b61e3 Updated README 
fixed some links
 2015-08-19 20:21:56 +02:00
Ilan 9dfb65a7af docs: minor updates 2015-08-19 13:57:46 +02:00
Ilan Steemers 2011efbe0a Merge pull request #49 from Koed00/dev 
v0.5.3
 2015-08-19 04:02:27 -07:00
Ilan 9fbf859472 Updates to Django 1.7.10 and 1.8.4 2015-08-19 12:56:04 +02:00
Ilan 5ccd86a254 v0.5.3 2015-08-19 12:40:29 +02:00
Ilan da5e265333 Updated comment on catch up 2015-08-19 12:39:56 +02:00
Ilan 6610277b93 docs: moved Configuration to its own section 
* added more info on schedule catch up.
 2015-08-19 12:38:15 +02:00
Ilan Steemers 97a3fc9c9f Merge pull request #48 from Koed00/dev 
adds `catch_up` configuration option
 2015-08-18 15:19:35 -07:00
Ilan b99e16f108 adds catch_up configuration option 
When a cluster hasn't run for a while, the default behavior is to keep executing schedules until they are caught up with the present time.
By setting `catch_up` to False, schedules will not play catch up and instead get rescheduled to the future.
 2015-08-18 11:57:15 +02:00
Ilan Steemers 5158d312b5 Merge pull request #47 from Koed00/dev 
consolidates redis ping
 2015-08-17 10:46:25 -07:00
Ilan ac2dc02b4c consolidated redis ping 2015-08-17 14:25:32 +02:00
Ilan 47a92f8e56 added to translations 
fixed _ conflict
 2015-08-17 12:57:59 +02:00