Commit Graph
66 Commits
Author SHA1 Message Date
Ilan Steemers b0423a42d3 Fix import error on travis 2015-06-30 11:01:36 +02:00
Ilan Steemers 482569b312 Rework - configuration now in class - better stop handling under heavy load. - scheduler test - better monitoring - better status reporting 2015-06-30 10:58:24 +02:00
Ilan Steemers d94b631e40 Limited hostname width in monitor 2015-06-29 11:36:30 +02:00
Ilan Steemers f9e3df627c Cleaned up some code 2015-06-29 09:29:47 +02:00
Ilan Steemers 9d36299f73 new bugfix release 2015-06-28 19:51:21 +02:00
Ilan Steemers dffb85c991 fixed crash with badly signed packages and added redis ping 2015-06-28 18:56:10 +02:00
Ilan Steemers 218913e626 Default recycle to 500 2015-06-28 17:12:30 +02:00
Ilan Steemers 9593ad9f1d Added Recycling to workers 2015-06-28 14:27:43 +02:00
Ilan Steemers d0b950f9d6 Configuration is now through a dict. 2015-06-28 14:26:55 +02:00
Ilan Steemers c3475c9278 Admin label is now settable 2015-06-28 14:25:42 +02:00
Ilan Steemers 9bd3b1fa40 renamed scheduled task result to 'last run'. Makes more sense 2015-06-27 21:54:09 +02:00
Ilan Steemers 7fd381319c fixed relative import 2015-06-27 20:07:47 +02:00
Ilan Steemers b0e738d31b Passing the redis connection around the cluster to reduce connections 2015-06-27 20:03:32 +02:00
Ilan Steemers 888a2a8062 migration updated for kwargs and args 2015-06-27 16:22:33 +02:00
Ilan Steemers 338b96fe63 Added VERSION 2015-06-27 16:20:38 +02:00
Ilan Steemers de03dd10d8 args and kwargs can be null in db 2015-06-27 16:20:14 +02:00
Ilan Steemers f82a3e75d6 Removed coloredlogs 2015-06-27 16:19:44 +02:00
Ilan Steemers d8020f0c0b Redis server now configurable with Q_REDIS. Moved constants to conf 2015-06-27 12:08:33 +02:00
Ilan Steemers 3b7682411c Sentinel now has a start() function. Will still autostart on init, but can be overriden with start=False 2015-06-27 01:43:11 +02:00
Ilan Steemers 8c4f0110fb Added default logger handler and made coloredlogs optional 2015-06-26 18:07:44 +02:00
Ilan Steemers f08773f37d Improved cluster test 2015-06-26 17:20:09 +02:00
Ilan Steemers 666bdc97dc * updated README
* both func and hook check for callable.
2015-06-26 14:24:25 +02:00
Ilan Steemers e2f7f1e5bf added schedule to README 2015-06-25 20:30:13 +02:00
Ilan Steemers d5d529f874 added schedule admin to admin test 2015-06-25 19:54:40 +02:00
Ilan Steemers d06de5769b added scheduled tasks with admin interface 2015-06-25 19:48:38 +02:00
Ilan Steemers 6314742343 simple test for monitor 2015-06-25 13:29:06 +02:00
Ilan Steemers 99a44dda45 simple test for monitor 2015-06-25 13:22:16 +02:00
Ilan Steemers 065f2dc5aa Django's timezone is back since it can't conflict with JsonPickle anymore 2015-06-24 22:57:21 +02:00
Ilan Steemers 06791005c9 allow Null results - added test 2015-06-24 22:23:22 +02:00
Ilan Steemers 47de658be5 allow Null results 2015-06-24 22:13:29 +02:00
Ilan Steemers 5068641de0 replaced JsonPickle with cPickle for signed packages 2015-06-24 21:57:23 +02:00
Ilan Steemers d0880d06ac neater monitor text 2015-06-24 19:56:39 +02:00
Ilan Steemers e0864f037d py.test discourages __init__.py in tests, but pytest-django needs it, 2015-06-24 19:13:56 +02:00
Ilan Steemers 2c9d53e6b2 fixes for Python 2 2015-06-24 17:45:01 +02:00
Ilan Steemers 0798c42354 adding url module for test 2015-06-24 17:04:30 +02:00
Ilan Steemers 21a4950f36 fixed test settings error 2015-06-24 16:56:07 +02:00
Ilan Steemers 7878b4c05c fixing django settings for travis 2015-06-24 16:08:05 +02:00
Ilan Steemers 67180c1984 Initial tests 2015-06-24 15:29:16 +02:00
Ilan Steemers 9d84e8cf49 using PRE_SAVE instead of POST_SAVE signal for hook. 2015-06-24 15:28:47 +02:00
Ilan Steemers 7dea114b18 cleaned imports 2015-06-24 12:39:54 +02:00
Ilan Steemers a7ab7e9d71 cleaned imports 2015-06-24 12:38:37 +02:00
Ilan Steemers c91fd0f022 monitor now has a little color and columns 2015-06-24 11:44:47 +02:00
Ilan Steemers 0ed1da8f05 Refactoring to make testing more stable 2015-06-23 21:12:08 +02:00
Ilan Steemers 97a4b27f68 Added rudimentary terminal monitor 2015-06-23 20:54:23 +02:00
Ilan Steemers 54e518151e Reduced code for stats. Stat now uses Redis pubsub 2015-06-21 16:51:25 +02:00
Ilan Steemers 9f4e4d94e4 Added basic cluster stats
TODO add these to django admin
2015-06-20 15:00:40 +02:00
Ilan Steemers ed9883470d Separated Cluster and Sentinel into two classes. 2015-06-19 22:24:27 +02:00
Ilan Steemers 45e5187126 Updated README 2015-06-18 18:59:31 +02:00
Ilan Steemers e6cfdf6a1f Better exit strategy:
-Pusher is stopped
-Poison pills are put on the task queue
-Wait for workers to clear the queue and exit
-Poison pill is put in the result queue
-Main process exits when monitor has finished processing results
2015-06-18 17:55:52 +02:00
Ilan Steemers bed64c7313 Added re-submit function to Failed Task admin 2015-06-18 17:03:34 +02:00