Commit Graph
100 Commits
Author SHA1 Message Date
Ilan Steemers 482569b312 Rework - configuration now in class - better stop handling under heavy load. - scheduler test - better monitoring - better status reporting 2015-06-30 10:58:24 +02:00
Ilan Steemers e7784f0d18 README simplified example 2015-06-29 13:54:54 +02:00
Ilan Steemers 4dce502c9b README bug in schedule example 2015-06-29 12:35:38 +02:00
Ilan Steemers d94b631e40 Limited hostname width in monitor 2015-06-29 11:36:30 +02:00
Ilan Steemers 6ac91cb051 Merge remote-tracking branch 'origin/master' 2015-06-29 09:30:31 +02:00
Ilan Steemers f9e3df627c Cleaned up some code 2015-06-29 09:29:47 +02:00
Ilan Steemers 69b3b24068 Update README.rst 2015-06-29 00:28:14 +02:00
Ilan Steemers 4a51f69d32 Updated README.
Now only in reST
2015-06-28 21:56:14 +02:00
Ilan Steemers c3f1bffc0a Updated README.
Now only in reST
2015-06-28 21:55:36 +02:00
Ilan Steemers 9d36299f73 new bugfix release 2015-06-28 19:51:21 +02:00
Ilan Steemers dffb85c991 fixed crash with badly signed packages and added redis ping 2015-06-28 18:56:10 +02:00
Ilan Steemers 8dfbddb6be fixed README error 2015-06-28 17:39:32 +02:00
Ilan Steemers 87c41141b0 cleaned up setup.py 2015-06-28 17:37:08 +02:00
Ilan Steemers b469d0a341 Updated README for release 2015-06-28 17:12:48 +02:00
Ilan Steemers 218913e626 Default recycle to 500 2015-06-28 17:12:30 +02:00
Ilan Steemers e4634e1fe4 Upped level to Alpha 2015-06-28 14:27:56 +02:00
Ilan Steemers 9593ad9f1d Added Recycling to workers 2015-06-28 14:27:43 +02:00
Ilan Steemers d0b950f9d6 Configuration is now through a dict. 2015-06-28 14:26:55 +02:00
Ilan Steemers c3475c9278 Admin label is now settable 2015-06-28 14:25:42 +02:00
Ilan Steemers 9bd3b1fa40 renamed scheduled task result to 'last run'. Makes more sense 2015-06-27 21:54:09 +02:00
Ilan Steemers 7fd381319c fixed relative import 2015-06-27 20:07:47 +02:00
Ilan Steemers b0e738d31b Passing the redis connection around the cluster to reduce connections 2015-06-27 20:03:32 +02:00
Ilan Steemers 888a2a8062 migration updated for kwargs and args 2015-06-27 16:22:33 +02:00
Ilan Steemers 338b96fe63 Added VERSION 2015-06-27 16:20:38 +02:00
Ilan Steemers de03dd10d8 args and kwargs can be null in db 2015-06-27 16:20:14 +02:00
Ilan Steemers f82a3e75d6 Removed coloredlogs 2015-06-27 16:19:44 +02:00
Ilan Steemers d8020f0c0b Redis server now configurable with Q_REDIS. Moved constants to conf 2015-06-27 12:08:33 +02:00
Ilan Steemers 3b7682411c Sentinel now has a start() function. Will still autostart on init, but can be overriden with start=False 2015-06-27 01:43:11 +02:00
Ilan Steemers 8dce0c5560 sfinx conf 2015-06-27 01:42:28 +02:00
Ilan Steemers 28fa7da1ed Initial commit for docs 2015-06-26 22:33:10 +02:00
Ilan Steemers 375d861593 Updated README 2015-06-26 22:04:06 +02:00
Ilan Steemers 8c4f0110fb Added default logger handler and made coloredlogs optional 2015-06-26 18:07:44 +02:00
Ilan Steemers f08773f37d Improved cluster test 2015-06-26 17:20:09 +02:00
Ilan Steemers 666bdc97dc * updated README
* both func and hook check for callable.
2015-06-26 14:24:25 +02:00
Ilan Steemers 28d6c26256 Changed admin screenshot 2015-06-25 20:36:15 +02:00
Ilan Steemers e2f7f1e5bf added schedule to README 2015-06-25 20:30:13 +02:00
Ilan Steemers d5d529f874 added schedule admin to admin test 2015-06-25 19:54:40 +02:00
Ilan Steemers d06de5769b added scheduled tasks with admin interface 2015-06-25 19:48:38 +02:00
Ilan Steemers 6314742343 simple test for monitor 2015-06-25 13:29:06 +02:00
Ilan Steemers 99a44dda45 simple test for monitor 2015-06-25 13:22:16 +02:00
Ilan Steemers 67b41d42b0 Update .travis.yml
fixing coveralls
2015-06-24 23:02:17 +02:00
Ilan Steemers 065f2dc5aa Django's timezone is back since it can't conflict with JsonPickle anymore 2015-06-24 22:57:21 +02:00
Ilan Steemers a44ad57b7a fixing README some typos 2015-06-24 22:48:35 +02:00
Ilan Steemers 06791005c9 allow Null results - added test 2015-06-24 22:23:22 +02:00
Ilan Steemers 47de658be5 allow Null results 2015-06-24 22:13:29 +02:00
Ilan Steemers e86daf5e78 Merge remote-tracking branch 'origin/master' 2015-06-24 21:57:39 +02:00
Ilan Steemers 5068641de0 replaced JsonPickle with cPickle for signed packages 2015-06-24 21:57:23 +02:00
Ilan Steemers 38872855d8 Update README.md 2015-06-24 20:30:07 +02:00
Ilan Steemers 5c8d95b27a Update README.md
added travis badge
2015-06-24 20:27:06 +02:00
Ilan Steemers d0880d06ac neater monitor text 2015-06-24 19:56:39 +02:00
Ilan Steemers 4556a8dc69 setting up setup.py and manifest 2015-06-24 19:55:46 +02:00
Ilan Steemers e0864f037d py.test discourages __init__.py in tests, but pytest-django needs it, 2015-06-24 19:13:56 +02:00
Ilan Steemers 109fe78da6 added Python 2 to setup.py 2015-06-24 17:47:03 +02:00
Ilan Steemers 2c9d53e6b2 fixes for Python 2 2015-06-24 17:45:01 +02:00
Ilan Steemers 0798c42354 adding url module for test 2015-06-24 17:04:30 +02:00
Ilan Steemers 21a4950f36 fixed test settings error 2015-06-24 16:56:07 +02:00
Ilan Steemers 2cdb938036 it helps if you have coverage and coveralls 2015-06-24 16:52:18 +02:00
Ilan Steemers 4b79da42eb getting travis to build 2015-06-24 16:49:42 +02:00
Ilan Steemers 9fe2f2f42e trying to fix the settings problem for travis 2015-06-24 16:33:14 +02:00
Ilan Steemers 407c19d201 adding futures and pytz to travis 2015-06-24 16:11:12 +02:00
Ilan Steemers 7878b4c05c fixing django settings for travis 2015-06-24 16:08:05 +02:00
Ilan Steemers bf360a2d95 Initial travis 2015-06-24 15:29:34 +02:00
Ilan Steemers 67180c1984 Initial tests 2015-06-24 15:29:16 +02:00
Ilan Steemers 9d84e8cf49 using PRE_SAVE instead of POST_SAVE signal for hook. 2015-06-24 15:28:47 +02:00
Ilan Steemers 20047a24db Added management command screenshots 2015-06-24 13:14:18 +02:00
Ilan Steemers 2ef5531939 Added management command screenshots 2015-06-24 13:07:50 +02:00
Ilan Steemers a6e91b0bcf fixed typos etc 2015-06-24 12:49:38 +02:00
Ilan Steemers e80e33daa0 Updated README 2015-06-24 12:44:14 +02:00
Ilan Steemers 7dea114b18 cleaned imports 2015-06-24 12:39:54 +02:00
Ilan Steemers a7ab7e9d71 cleaned imports 2015-06-24 12:38:37 +02:00
Ilan Steemers 2237f34e13 Updated README 2015-06-24 12:37:27 +02:00
Ilan Steemers c91fd0f022 monitor now has a little color and columns 2015-06-24 11:44:47 +02:00
Ilan Steemers 0ed1da8f05 Refactoring to make testing more stable 2015-06-23 21:12:08 +02:00
Ilan Steemers 97a4b27f68 Added rudimentary terminal monitor 2015-06-23 20:54:23 +02:00
Ilan Steemers 8bf25299a9 Added py.test to setup.py 2015-06-21 20:58:23 +02:00
Ilan Steemers 54e518151e Reduced code for stats. Stat now uses Redis pubsub 2015-06-21 16:51:25 +02:00
Ilan Steemers 9f4e4d94e4 Added basic cluster stats
TODO add these to django admin
2015-06-20 15:00:40 +02:00
Ilan Steemers ed9883470d Separated Cluster and Sentinel into two classes. 2015-06-19 22:24:27 +02:00
Ilan Steemers 45e5187126 Updated README 2015-06-18 18:59:31 +02:00
Ilan Steemers e6cfdf6a1f Better exit strategy:
-Pusher is stopped
-Poison pills are put on the task queue
-Wait for workers to clear the queue and exit
-Poison pill is put in the result queue
-Main process exits when monitor has finished processing results
2015-06-18 17:55:52 +02:00
Ilan Steemers bed64c7313 Added re-submit function to Failed Task admin 2015-06-18 17:03:34 +02:00
Ilan Steemers 43e40629d0 Updated README 2015-06-18 16:02:38 +02:00
Ilan Steemers 6a233e63e7 Updated schematic 2015-06-18 15:55:42 +02:00
Ilan Steemers 5adf92eb27 hooks now work
refactored task as dict instead of list for readability.
2015-06-18 15:23:21 +02:00
Ilan Steemers 90b5b0d6ab moved static methods to module functions
medic is now sentinel and runs in it's own process
sentinel shutdown procedure more stable
2015-06-18 14:10:48 +02:00
Ilan Steemers 4faba63d54 Added hook to README 2015-06-18 10:44:23 +02:00
Ilan Steemers 2df5df48cb Merge remote-tracking branch 'origin/master' 2015-06-17 23:50:36 +02:00
Ilan Steemers 69837922b1 Task now accepts a hook function, that will be called with the finished task as the argument. 2015-06-17 23:50:17 +02:00
Ilan Steemers 85f971ae40 Added test task countdown 2015-06-17 23:49:14 +02:00
Ilan Steemers 62bfb7bdc1 Delete testq.py 2015-06-17 21:39:47 +02:00
Ilan Steemers 8b804b56f1 Delete views.py 2015-06-17 21:38:05 +02:00
Ilan Steemers 8d903d51e8 Update setup.py 2015-06-17 19:44:50 +02:00
Ilan Steemers e70ddfd6cd Update setup.py 2015-06-17 19:43:47 +02:00
Ilan Steemers 2e81ba2858 Added some config settings
Updated README
2015-06-17 19:14:20 +02:00
Ilan Steemers b28754de93 Added full package signing and compression through Django signing module and JsonPickle 2015-06-17 18:17:48 +02:00
Ilan Steemers 219d05fa8a Updated requirements (for now) 2015-06-17 17:36:14 +02:00
Ilan Steemers 050212e816 Edited README 2015-06-17 17:17:55 +02:00
Ilan Steemers a4de7f7d2c Added schematic to README 2015-06-17 17:15:48 +02:00
Ilan Steemers e473665760 Added admin pages for failures and success.
SAVE_LIMIT can now be set to limit the amount of saved tasks results.
2015-06-17 15:32:54 +02:00
Ilan Steemers 727a4d560d migrations 2015-06-17 13:34:10 +02:00