Ilan
f8c9ef1bfa
adds short delay in test
...
On some platforms the cluster is not always ready in time for test assertion
2015-07-23 14:57:00 +02:00
Ilan
c5b8b800f6
Adds save override option for tasks
...
Also adds `q_options` dict for async and schedule options
2015-07-20 19:43:27 +02:00
Ilan
5fd436021f
Expanding coverage
2015-07-20 12:17:12 +02:00
Ilan
d7ecaee18d
Added tests for failures filtering
...
fixed a bug
2015-07-19 15:21:06 +02:00
Ilan
e75fbecda8
fixed typo and added group tests
2015-07-19 13:56:16 +02:00
Ilan
e4737d765a
Schedule name is optional
...
For backwards compatibility the schedule name is an optional keyword in the `schedule` function.
Adjusted docs accordingly
2015-07-18 19:41:21 +02:00
Ilan
c127604f10
Adds task groups
...
* task now takes an optional keyword `group`
* added result_group() and fetch_group()
* added group column to Success admin
* group column in searchable
* added `name` field to Schedules
* Scheduled tasks take schedule name as group
2015-07-18 17:20:50 +02:00
Ilan Steemers
05c8f3bc16
Merge pull request #20 from Koed00/dev
...
Tests now run with logging level debug
2015-07-17 05:28:59 -07:00
Ilan
b876b1e06d
Tests now run with logging level DEBUG
2015-07-17 14:17:40 +02:00
Ilan Steemers
1e7b3f6ce0
Merge pull request #18 from Koed00/dev
...
Adds a `timeout` override per task
2015-07-16 21:57:47 +02:00
Ilan
af735c328e
Adds a timeout override per task
...
* added a `timeout` keyword to tasks.
* timeouts now count down instead of up
* `timeout` in task overrides global timeout setting
* added tests for timeout override
* added a test for recycling
2015-07-16 20:35:29 +02:00
Ilan Steemers
afda141ed1
Merge pull request #17 from Koed00/dev
...
Adds management commands to the tests
2015-07-16 18:22:10 +02:00
Ilan
0dbeccdfda
Optparse needs named arguments in call_command
2015-07-16 16:11:32 +02:00
Ilan
5a3f875baa
Added management commands to tests
...
* added --run-once option to the management commands for testing
2015-07-16 15:17:15 +02:00
Ilan
218b6a9795
removed unused import
2015-07-16 14:36:36 +02:00
Ilan
6826e75a37
docs: Added a report example
...
Also added a test based on the example.
2015-07-16 14:03:07 +02:00
Ilan
a5580c75a1
Workaround for Travis
...
Travis doesn't support cpu affinity in their virtuals so I've added a setting TESTING that will bypass the actual affinity setting, but will still cover most of the code.
Might be useful for future workarounds.
2015-07-15 22:17:13 +02:00
Ilan
1f28bf1c68
Travis doesn't like cpu affinity. I'm guessing
2015-07-15 20:15:46 +02:00
Ilan
2d0820e80b
Adds cpu affinity for the workers. Courtesy of the optional psutil module.
2015-07-15 19:53:13 +02:00
Ilan
e5708a1ab2
Clean up redis after test
2015-07-15 12:45:11 +02:00
Ilan Steemers
6c9dd1a910
Schedules of type ONCE will now self destruct with negative repeats or just deactivated with positive repeats
2015-07-11 11:32:46 +02:00
Ilan Steemers
e62fd1ee70
Fixes #7
...
* added a synchronous cluster simulation
* added a test for the sync function
* moved signing into its own module
* refactored imports to solve circular import problems stemming from the task module pretending to be a cluster
* added documentation for the new sync option
2015-07-09 20:16:21 +02:00
Ilan Steemers
0413a2e65a
refresh_from_db is 1.8 only
2015-07-08 21:06:32 +02:00
Ilan Steemers
0a8196838a
Removed security middleware from test for Django 1.7
2015-07-08 21:02:00 +02:00
Ilan Steemers
f29fdee5ad
Fixes import error
2015-07-08 13:43:46 +02:00
Ilan Steemers
f8708cfd73
Task now uses a UUID4 instead of a LUID
2015-07-08 13:33:03 +02:00
Ilan Steemers
729abaf726
set exit timeout if no timeout is given
2015-07-07 20:37:03 +02:00
Ilan Steemers
4ee47fc38f
upping the coverage
2015-07-07 20:20:28 +02:00
Ilan Steemers
d06aa40a38
Removed Cluster.is_idle
...
It wasn't used and it could be confused with the cluster stat IDLE
2015-07-06 11:13:54 +02:00
Ilan Steemers
b113a52825
Restructured all the modules
...
The core module was becoming too large.
By splitting it in cluster, monitor and tasks it becomes more manageable. It also reflects the documentation structure.
2015-07-03 15:12:11 +02:00
Ilan Steemers
2c88b1aef6
superfluous import removed
2015-07-02 13:53:12 +02:00
Ilan Steemers
5399865f4e
Adds timeout and reincarnation test
...
Also found a bug because of this.
2015-07-02 12:10:18 +02:00
Ilan Steemers
d1930a3de1
Fixes Travis hang up
...
New admin test introduced a task in the queue which was picked up by the cluster on Travis. Switching cluster test to different list key should prevent this.
2015-07-01 12:52:47 +02:00
Ilan Steemers
ba525a9312
Fixes Travis error
...
added failing hook to tests
2015-07-01 12:42:13 +02:00
Ilan Steemers
b3702319c2
Added admin test for failure resubmission
2015-07-01 12:28:04 +02:00
Ilan Steemers
6853b17a7b
Improved admin test
2015-07-01 11:44:20 +02:00
Ilan Steemers
4e38925cea
Adds timeout mechanism for workers
...
Workers now share a ctype with the sentinel to indicate if they are currently executing a task. This timer is incremented each guard loop until the worker resets it after finishing a job or until it reaches the TIMEOUT value and the worker is terminated by the sentinel.
2015-07-01 10:54:36 +02:00
Ilan Steemers
4096b35adf
Added schedule command
...
* improved schedule tests
* updated README
* bumped up to version 0.1.3
2015-06-30 16:38:08 +02:00
Ilan Steemers
b0423a42d3
Fix import error on travis
2015-06-30 11:01:36 +02:00
Ilan Steemers
482569b312
Rework - configuration now in class - better stop handling under heavy load. - scheduler test - better monitoring - better status reporting
2015-06-30 10:58:24 +02:00
Ilan Steemers
d0b950f9d6
Configuration is now through a dict.
2015-06-28 14:26:55 +02:00
Ilan Steemers
7fd381319c
fixed relative import
2015-06-27 20:07:47 +02:00
Ilan Steemers
b0e738d31b
Passing the redis connection around the cluster to reduce connections
2015-06-27 20:03:32 +02:00
Ilan Steemers
d8020f0c0b
Redis server now configurable with Q_REDIS. Moved constants to conf
2015-06-27 12:08:33 +02:00
Ilan Steemers
8c4f0110fb
Added default logger handler and made coloredlogs optional
2015-06-26 18:07:44 +02:00
Ilan Steemers
f08773f37d
Improved cluster test
2015-06-26 17:20:09 +02:00
Ilan Steemers
666bdc97dc
* updated README
...
* both func and hook check for callable.
2015-06-26 14:24:25 +02:00
Ilan Steemers
d5d529f874
added schedule admin to admin test
2015-06-25 19:54:40 +02:00
Ilan Steemers
d06de5769b
added scheduled tasks with admin interface
2015-06-25 19:48:38 +02:00
Ilan Steemers
6314742343
simple test for monitor
2015-06-25 13:29:06 +02:00
Ilan