Commit Graph
112 Commits
Author SHA1 Message Date
Ilan Steemers 4c413fc659 Prevents crash on duplicate acknowledge 2015-09-10 13:31:37 +02:00
Ilan Steemers 5195464c31 tests: sqs is not atomic 2015-09-10 11:34:35 +02:00
Ilan Steemers 0fe6c4cbde SQS only supports max 10 messages in bulk mode
* capped bulk at 10
* added tests
2015-09-09 19:34:06 +02:00
Ilan Steemers e4a5951f12 Resets SQS conf in case of test failure 2015-09-09 18:59:24 +02:00
Ilan Steemers d7ce945f03 Amazon SQS broker 2015-09-09 18:10:03 +02:00
Ilan Steemers 6d87163e61 Sets testing for Travis 2015-09-09 13:34:32 +02:00
Ilan Steemers cc178df2b1 #56 fakes setting cpu_affinity on unsupported platforms 2015-09-09 13:25:27 +02:00
Ilan Steemers 69df45ea4e queue size is not atomic on ironmq 2015-09-08 16:22:38 +02:00
Ilan Steemers 52f353fb37 random queue names for ironmq test 2015-09-08 16:11:27 +02:00
Ilan Steemers 661987b368 updated delete job test 2015-09-08 15:56:53 +02:00
Ilan Steemers 8eb1431413 Resets broker configuration in case a third party broker crashes 2015-09-08 15:50:32 +02:00
Ilan Steemers c946a16b99 changes py 2.7 import for ironmq 2015-09-08 15:38:00 +02:00
Ilan Steemers 7fb12fce49 fixes iron-mq test
purging a queue that never had a message in it raises a not found error. So we queue one message to initialize.
2015-09-08 15:19:40 +02:00
Ilan Steemers d849774c86 Adds bulk option to disque broker
adds tests
2015-09-08 14:06:38 +02:00
Ilan Steemers 0ffae4519b Adds bulk get to ironmq 2015-09-08 13:37:33 +02:00
Ilan Steemers b56cc9da8f IronMQ broker 2015-09-08 11:20:31 +02:00
Ilan Steemers f4f8af1382 Fixes backward compatibility problems with django-picklefield 2015-09-07 20:24:21 +02:00
Ilan Steemers d90db10f5e Just use local disque for testing 2015-09-06 12:28:12 +02:00
Ilan Steemers 3be488f918 Adds Tynd envs for Travis
attempt #3
2015-09-04 15:48:43 +02:00
Ilan Steemers 8340a2ae57 Adds Tynd envs for Travis 2015-09-04 15:27:10 +02:00
Ilan Steemers 3524ad2dee Adds Tynd envs for Travis
and fixes timeout tests
2015-09-04 15:16:30 +02:00
Ilan Steemers e76e65640b removes AUTH for Travis test 2015-09-04 14:53:42 +02:00
Ilan Steemers 3f75e7fa05 removed SQS and IronMQ brokers for now
Both brokers are not atomic and cause all kinds of problems during testing. Needs more time.
Meanwhile I want to release the pluggable broker backend.
2015-09-04 14:49:17 +02:00
Ilan Steemers b1f2143a3d uses disque_nodes convention 2015-09-03 12:55:49 +02:00
Ilan Steemers e22980834c Fixes connectionerror bug on 2.7 2015-09-02 20:17:44 +02:00
Ilan Steemers dfb1b03cd0 Experimenting with disque build on travis 2015-09-02 20:12:00 +02:00
Ilan Steemers b901039a44 Experimenting with disque build on travis 2015-09-02 20:08:20 +02:00
Ilan Steemers 1a61fa2821 Experimenting with disque build on travis 2015-09-02 20:04:48 +02:00
Ilan Steemers 0756fb9896 Experimenting with disque build on travis 2015-09-02 20:00:43 +02:00
Ilan Steemers 8ce441bed5 Adds more brokers
* added IronMQ
* added Aws SQS
* removed SafeRedis.
 During tests the 'safe' part wasn't consistent enough
2015-09-02 19:04:03 +02:00
Ilan Steemers 5171f1a183 Disabled Disque tests for now 2015-08-30 21:04:07 +02:00
Ilan Steemers 452f53f899 New container build on Travis 2015-08-30 20:57:05 +02:00
Ilan Steemers d6b9b10e3e Adds tests for brokers
* test for redis and django-redis
* test for disque

TODO add disque to Travis
2015-08-30 20:26:30 +02:00
Ilan Steemers 0740c90148 adds pluggable brokers
* added redis broker
 * added django_redis broker
 * added task acknowledgement
2015-08-29 18:54:07 +02:00
Ilan Steemers 439c8a2f77 Moves Status to it's own file
This way only qmonitor and qinfo need Curses and you can still run the cluster without it.
2015-08-26 13:11:58 +02:00
Ilan Steemers 3e92fddcdd #50 removes redis connection argument from pusher process 2015-08-24 10:08:43 +02:00
Ilan b99e16f108 adds catch_up configuration option
When a cluster hasn't run for a while, the default behavior is to keep executing schedules until they are caught up with the present time.
By setting `catch_up` to False, schedules will not play catch up and instead get rescheduled to the future.
2015-08-18 11:57:15 +02:00
Ilan 3d12c1d36e adds queue_size()
returns the size of the current redis queue
2015-08-13 15:54:57 +02:00
Ilan df7f8bbcaf Adds more stats to the qinfo command
* Average execution time
* Tasks per day/hour/minute/second
* Number of schedules
2015-08-12 12:39:14 +02:00
Ilan e86308b434 adds qinfo management command
It seems more practical to give this its own command instead of `qmonitor --info`
2015-08-10 13:20:17 +02:00
Ilan 63030aa9d1 Tests schedule creation via model 2015-08-10 13:18:50 +02:00
Ilan 79393dee16 adds --info summary to monitor command 2015-08-09 19:29:24 +02:00
Ilan de5d0f2725 Adds a 'minutes' option to the scheduler 2015-08-05 20:30:29 +02:00
Ilan f470fbf975 uses empty() instead of qsize() == 0 2015-08-04 18:30:07 +02:00
Ilan af61270f62 #40 qsize not implemented 2015-08-04 12:26:23 +02:00
Ilan 9899c42740 * fixes save_limit +1
* adds save_limit test
* expands recycle test
2015-07-31 18:39:54 +02:00
Ilan f8c9ef1bfa adds short delay in test
On some platforms the cluster is not always ready in time for test assertion
2015-07-23 14:57:00 +02:00
Ilan c5b8b800f6 Adds save override option for tasks
Also adds `q_options` dict for async and schedule options
2015-07-20 19:43:27 +02:00
Ilan 5fd436021f Expanding coverage 2015-07-20 12:17:12 +02:00
Ilan d7ecaee18d Added tests for failures filtering
fixed a bug
2015-07-19 15:21:06 +02:00