Commit Graph
102 Commits
Author SHA1 Message Date
Ilan Steemers b05fe76fbc log database errors more quiet 2015-07-07 17:54:24 +02:00
Ilan Steemers b801c480f5 Handle Redis errors better 2015-07-07 17:47:49 +02:00
Ilan Steemers 33b7fe50ed fix reincarnation bug without timeout set 2015-07-07 16:45:05 +02:00
Ilan Steemers 38dc20043c Stabilize the stop procedure after forced termination of the monitor causes an unstable queue.
* added timeout to final stop
* ony terminate on timeouts
* renamed done_queue to result_queue
2015-07-07 15:48:13 +02:00
Ilan Steemers 254d99e63b Fix reincarnation bug 2015-07-06 20:54:24 +02:00
Ilan Steemers 831427bcc0 Upped version to 0.2.1
adds support for django-redis connections
2015-07-06 13:52:03 +02:00
Ilan Steemers d06aa40a38 Removed Cluster.is_idle
It wasn't used and it could be confused with the cluster stat IDLE
2015-07-06 11:13:54 +02:00
Ilan Steemers 70ea211cfa Can spot difference between recycle and death now.
Added recycle flag
Changed pids to names for readability
2015-07-06 10:42:38 +02:00
Ilan Steemers e7d2dd0309 Missed a return on exception 2015-07-05 21:09:05 +02:00
Ilan Steemers 2ec424fce0 Adds func to searchable fields in admin 2015-07-05 14:37:39 +02:00
Ilan Steemers 83b12629ea removed trailing period 2015-07-03 19:57:22 +02:00
Ilan Steemers fb44f4f0bf raises a redis exception 2015-07-03 18:31:04 +02:00
Ilan Steemers 29774b3afe raises a redis exception 2015-07-03 18:30:22 +02:00
Ilan Steemers 891d017c00 Added STOPPING status to monitor 2015-07-03 17:32:46 +02:00
Ilan Steemers e0a92d2b24 Monitor starts with pinging Redis. 2015-07-03 16:57:26 +02:00
Ilan Steemers f7f3626a03 sets version 0.2.0 2015-07-03 15:35:49 +02:00
Ilan Steemers 27cfe5eb86 fixed relative import 2015-07-03 15:13:19 +02:00
Ilan Steemers b113a52825 Restructured all the modules
The core module was becoming too large.
By splitting it in  cluster, monitor and tasks it becomes more manageable. It also reflects the documentation structure.
2015-07-03 15:12:11 +02:00
Ilan Steemers 2c88b1aef6 superfluous import removed 2015-07-02 13:53:12 +02:00
Ilan Steemers 5399865f4e Adds timeout and reincarnation test
Also found a bug because of this.
2015-07-02 12:10:18 +02:00
Ilan Steemers cbd0ed5243 No need to increase timer on dead workers 2015-07-01 15:00:15 +02:00
Ilan Steemers 2397314a99 Cluster now differentiates between sudden death and timeouts of workers. 2015-07-01 14:58:09 +02:00
Ilan Steemers 1d92b13388 Upped version to 0.1.4 2015-07-01 13:39:05 +02:00
Ilan Steemers d1930a3de1 Fixes Travis hang up
New admin test introduced a task in the queue which was picked up by the cluster on Travis. Switching cluster test to different list key should prevent this.
2015-07-01 12:52:47 +02:00
Ilan Steemers ba525a9312 Fixes Travis error
added failing hook to tests
2015-07-01 12:42:13 +02:00
Ilan Steemers 50cc5b821b Removed superfluous return 2015-07-01 12:30:36 +02:00
Ilan Steemers b3702319c2 Added admin test for failure resubmission 2015-07-01 12:28:04 +02:00
Ilan Steemers 6853b17a7b Improved admin test 2015-07-01 11:44:20 +02:00
Ilan Steemers 83c1601546 Fixes bug with resubmitting none args 2015-07-01 11:42:57 +02:00
Ilan Steemers 4e38925cea Adds timeout mechanism for workers
Workers now share a ctype with the sentinel to indicate if they are currently executing a task.  This timer is incremented each guard loop until the worker resets it after finishing a job or until it reaches the TIMEOUT value and the worker is terminated by the sentinel.
2015-07-01 10:54:36 +02:00
Ilan Steemers 8188893ff4 Schedule args and kwargs fields are now unlimited text fields. 2015-06-30 18:34:14 +02:00
Ilan Steemers 4ce44fe576 Reworked kwargs for Python 2.7 compatibility 2015-06-30 16:57:21 +02:00
Ilan Steemers 4096b35adf Added schedule command
* improved schedule tests
 * updated README
  * bumped up to version 0.1.3
2015-06-30 16:38:08 +02:00
Ilan Steemers c4b80c4b65 Removed old version id 2015-06-30 11:41:08 +02:00
Ilan Steemers 6ffd8452cf New release 0.1.2 2015-06-30 11:14:41 +02:00
Ilan Steemers dd56a8cfa4 Add unicode to models 2015-06-30 11:14:00 +02:00
Ilan Steemers b0423a42d3 Fix import error on travis 2015-06-30 11:01:36 +02:00
Ilan Steemers 482569b312 Rework - configuration now in class - better stop handling under heavy load. - scheduler test - better monitoring - better status reporting 2015-06-30 10:58:24 +02:00
Ilan Steemers d94b631e40 Limited hostname width in monitor 2015-06-29 11:36:30 +02:00
Ilan Steemers f9e3df627c Cleaned up some code 2015-06-29 09:29:47 +02:00
Ilan Steemers 9d36299f73 new bugfix release 2015-06-28 19:51:21 +02:00
Ilan Steemers dffb85c991 fixed crash with badly signed packages and added redis ping 2015-06-28 18:56:10 +02:00
Ilan Steemers 218913e626 Default recycle to 500 2015-06-28 17:12:30 +02:00
Ilan Steemers 9593ad9f1d Added Recycling to workers 2015-06-28 14:27:43 +02:00
Ilan Steemers d0b950f9d6 Configuration is now through a dict. 2015-06-28 14:26:55 +02:00
Ilan Steemers c3475c9278 Admin label is now settable 2015-06-28 14:25:42 +02:00
Ilan Steemers 9bd3b1fa40 renamed scheduled task result to 'last run'. Makes more sense 2015-06-27 21:54:09 +02:00
Ilan Steemers 7fd381319c fixed relative import 2015-06-27 20:07:47 +02:00
Ilan Steemers b0e738d31b Passing the redis connection around the cluster to reduce connections 2015-06-27 20:03:32 +02:00
Ilan Steemers 888a2a8062 migration updated for kwargs and args 2015-06-27 16:22:33 +02:00