Ilan Steemers
b0423a42d3
Fix import error on travis
2015-06-30 11:01:36 +02:00
Ilan Steemers
482569b312
Rework - configuration now in class - better stop handling under heavy load. - scheduler test - better monitoring - better status reporting
2015-06-30 10:58:24 +02:00
Ilan Steemers
e7784f0d18
README simplified example
2015-06-29 13:54:54 +02:00
Ilan Steemers
4dce502c9b
README bug in schedule example
2015-06-29 12:35:38 +02:00
Ilan Steemers
d94b631e40
Limited hostname width in monitor
2015-06-29 11:36:30 +02:00
Ilan Steemers
6ac91cb051
Merge remote-tracking branch 'origin/master'
2015-06-29 09:30:31 +02:00
Ilan Steemers
f9e3df627c
Cleaned up some code
2015-06-29 09:29:47 +02:00
Ilan Steemers
69b3b24068
Update README.rst
2015-06-29 00:28:14 +02:00
Ilan Steemers
4a51f69d32
Updated README.
...
Now only in reST
2015-06-28 21:56:14 +02:00
Ilan Steemers
c3f1bffc0a
Updated README.
...
Now only in reST
2015-06-28 21:55:36 +02:00
Ilan Steemers
9d36299f73
new bugfix release
2015-06-28 19:51:21 +02:00
Ilan Steemers
dffb85c991
fixed crash with badly signed packages and added redis ping
2015-06-28 18:56:10 +02:00
Ilan Steemers
8dfbddb6be
fixed README error
2015-06-28 17:39:32 +02:00
Ilan Steemers
87c41141b0
cleaned up setup.py
2015-06-28 17:37:08 +02:00
Ilan Steemers
b469d0a341
Updated README for release
2015-06-28 17:12:48 +02:00
Ilan Steemers
218913e626
Default recycle to 500
2015-06-28 17:12:30 +02:00
Ilan Steemers
e4634e1fe4
Upped level to Alpha
2015-06-28 14:27:56 +02:00
Ilan Steemers
9593ad9f1d
Added Recycling to workers
2015-06-28 14:27:43 +02:00
Ilan Steemers
d0b950f9d6
Configuration is now through a dict.
2015-06-28 14:26:55 +02:00
Ilan Steemers
c3475c9278
Admin label is now settable
2015-06-28 14:25:42 +02:00
Ilan Steemers
9bd3b1fa40
renamed scheduled task result to 'last run'. Makes more sense
2015-06-27 21:54:09 +02:00
Ilan Steemers
7fd381319c
fixed relative import
2015-06-27 20:07:47 +02:00
Ilan Steemers
b0e738d31b
Passing the redis connection around the cluster to reduce connections
2015-06-27 20:03:32 +02:00
Ilan Steemers
888a2a8062
migration updated for kwargs and args
2015-06-27 16:22:33 +02:00
Ilan Steemers
338b96fe63
Added VERSION
2015-06-27 16:20:38 +02:00
Ilan Steemers
de03dd10d8
args and kwargs can be null in db
2015-06-27 16:20:14 +02:00
Ilan Steemers
f82a3e75d6
Removed coloredlogs
2015-06-27 16:19:44 +02:00
Ilan Steemers
d8020f0c0b
Redis server now configurable with Q_REDIS. Moved constants to conf
2015-06-27 12:08:33 +02:00
Ilan Steemers
3b7682411c
Sentinel now has a start() function. Will still autostart on init, but can be overriden with start=False
2015-06-27 01:43:11 +02:00
Ilan Steemers
8dce0c5560
sfinx conf
2015-06-27 01:42:28 +02:00
Ilan Steemers
28fa7da1ed
Initial commit for docs
2015-06-26 22:33:10 +02:00
Ilan Steemers
375d861593
Updated README
2015-06-26 22:04:06 +02:00
Ilan Steemers
8c4f0110fb
Added default logger handler and made coloredlogs optional
2015-06-26 18:07:44 +02:00
Ilan Steemers
f08773f37d
Improved cluster test
2015-06-26 17:20:09 +02:00
Ilan Steemers
666bdc97dc
* updated README
...
* both func and hook check for callable.
2015-06-26 14:24:25 +02:00
Ilan Steemers
28d6c26256
Changed admin screenshot
2015-06-25 20:36:15 +02:00
Ilan Steemers
e2f7f1e5bf
added schedule to README
2015-06-25 20:30:13 +02:00
Ilan Steemers
d5d529f874
added schedule admin to admin test
2015-06-25 19:54:40 +02:00
Ilan Steemers
d06de5769b
added scheduled tasks with admin interface
2015-06-25 19:48:38 +02:00
Ilan Steemers
6314742343
simple test for monitor
2015-06-25 13:29:06 +02:00
Ilan Steemers
99a44dda45
simple test for monitor
2015-06-25 13:22:16 +02:00
Ilan Steemers
67b41d42b0
Update .travis.yml
...
fixing coveralls
2015-06-24 23:02:17 +02:00
Ilan Steemers
065f2dc5aa
Django's timezone is back since it can't conflict with JsonPickle anymore
2015-06-24 22:57:21 +02:00
Ilan Steemers
a44ad57b7a
fixing README some typos
2015-06-24 22:48:35 +02:00
Ilan Steemers
06791005c9
allow Null results - added test
2015-06-24 22:23:22 +02:00
Ilan Steemers
47de658be5
allow Null results
2015-06-24 22:13:29 +02:00
Ilan Steemers
e86daf5e78
Merge remote-tracking branch 'origin/master'
2015-06-24 21:57:39 +02:00
Ilan Steemers
5068641de0
replaced JsonPickle with cPickle for signed packages
2015-06-24 21:57:23 +02:00
Ilan Steemers
38872855d8
Update README.md
2015-06-24 20:30:07 +02:00
Ilan Steemers
5c8d95b27a
Update README.md
...
added travis badge
2015-06-24 20:27:06 +02:00
Ilan Steemers
d0880d06ac
neater monitor text
2015-06-24 19:56:39 +02:00
Ilan Steemers
4556a8dc69
setting up setup.py and manifest
2015-06-24 19:55:46 +02:00
Ilan Steemers
e0864f037d
py.test discourages __init__.py in tests, but pytest-django needs it,
2015-06-24 19:13:56 +02:00
Ilan Steemers
109fe78da6
added Python 2 to setup.py
2015-06-24 17:47:03 +02:00
Ilan Steemers
2c9d53e6b2
fixes for Python 2
2015-06-24 17:45:01 +02:00
Ilan Steemers
0798c42354
adding url module for test
2015-06-24 17:04:30 +02:00
Ilan Steemers
21a4950f36
fixed test settings error
2015-06-24 16:56:07 +02:00
Ilan Steemers
2cdb938036
it helps if you have coverage and coveralls
2015-06-24 16:52:18 +02:00
Ilan Steemers
4b79da42eb
getting travis to build
2015-06-24 16:49:42 +02:00
Ilan Steemers
9fe2f2f42e
trying to fix the settings problem for travis
2015-06-24 16:33:14 +02:00
Ilan Steemers
407c19d201
adding futures and pytz to travis
2015-06-24 16:11:12 +02:00
Ilan Steemers
7878b4c05c
fixing django settings for travis
2015-06-24 16:08:05 +02:00
Ilan Steemers
bf360a2d95
Initial travis
2015-06-24 15:29:34 +02:00
Ilan Steemers
67180c1984
Initial tests
2015-06-24 15:29:16 +02:00
Ilan Steemers
9d84e8cf49
using PRE_SAVE instead of POST_SAVE signal for hook.
2015-06-24 15:28:47 +02:00
Ilan Steemers
20047a24db
Added management command screenshots
2015-06-24 13:14:18 +02:00
Ilan Steemers
2ef5531939
Added management command screenshots
2015-06-24 13:07:50 +02:00
Ilan Steemers
a6e91b0bcf
fixed typos etc
2015-06-24 12:49:38 +02:00
Ilan Steemers
e80e33daa0
Updated README
2015-06-24 12:44:14 +02:00
Ilan Steemers
7dea114b18
cleaned imports
2015-06-24 12:39:54 +02:00
Ilan Steemers
a7ab7e9d71
cleaned imports
2015-06-24 12:38:37 +02:00
Ilan Steemers
2237f34e13
Updated README
2015-06-24 12:37:27 +02:00
Ilan Steemers
c91fd0f022
monitor now has a little color and columns
2015-06-24 11:44:47 +02:00
Ilan Steemers
0ed1da8f05
Refactoring to make testing more stable
2015-06-23 21:12:08 +02:00
Ilan Steemers
97a4b27f68
Added rudimentary terminal monitor
2015-06-23 20:54:23 +02:00
Ilan Steemers
8bf25299a9
Added py.test to setup.py
2015-06-21 20:58:23 +02:00
Ilan Steemers
54e518151e
Reduced code for stats. Stat now uses Redis pubsub
2015-06-21 16:51:25 +02:00
Ilan Steemers
9f4e4d94e4
Added basic cluster stats
...
TODO add these to django admin
2015-06-20 15:00:40 +02:00
Ilan Steemers
ed9883470d
Separated Cluster and Sentinel into two classes.
2015-06-19 22:24:27 +02:00
Ilan Steemers
45e5187126
Updated README
2015-06-18 18:59:31 +02:00
Ilan Steemers
e6cfdf6a1f
Better exit strategy:
...
-Pusher is stopped
-Poison pills are put on the task queue
-Wait for workers to clear the queue and exit
-Poison pill is put in the result queue
-Main process exits when monitor has finished processing results
2015-06-18 17:55:52 +02:00
Ilan Steemers
bed64c7313
Added re-submit function to Failed Task admin
2015-06-18 17:03:34 +02:00
Ilan Steemers
43e40629d0
Updated README
2015-06-18 16:02:38 +02:00
Ilan Steemers
6a233e63e7
Updated schematic
2015-06-18 15:55:42 +02:00
Ilan Steemers
5adf92eb27
hooks now work
...
refactored task as dict instead of list for readability.
2015-06-18 15:23:21 +02:00
Ilan Steemers
90b5b0d6ab
moved static methods to module functions
...
medic is now sentinel and runs in it's own process
sentinel shutdown procedure more stable
2015-06-18 14:10:48 +02:00
Ilan Steemers
4faba63d54
Added hook to README
2015-06-18 10:44:23 +02:00
Ilan Steemers
2df5df48cb
Merge remote-tracking branch 'origin/master'
2015-06-17 23:50:36 +02:00
Ilan Steemers
69837922b1
Task now accepts a hook function, that will be called with the finished task as the argument.
2015-06-17 23:50:17 +02:00
Ilan Steemers
85f971ae40
Added test task countdown
2015-06-17 23:49:14 +02:00
Ilan Steemers
62bfb7bdc1
Delete testq.py
2015-06-17 21:39:47 +02:00
Ilan Steemers
8b804b56f1
Delete views.py
2015-06-17 21:38:05 +02:00
Ilan Steemers
8d903d51e8
Update setup.py
2015-06-17 19:44:50 +02:00
Ilan Steemers
e70ddfd6cd
Update setup.py
2015-06-17 19:43:47 +02:00
Ilan Steemers
2e81ba2858
Added some config settings
...
Updated README
2015-06-17 19:14:20 +02:00
Ilan Steemers
b28754de93
Added full package signing and compression through Django signing module and JsonPickle
2015-06-17 18:17:48 +02:00
Ilan Steemers
219d05fa8a
Updated requirements (for now)
2015-06-17 17:36:14 +02:00
Ilan Steemers
050212e816
Edited README
2015-06-17 17:17:55 +02:00
Ilan Steemers
a4de7f7d2c
Added schematic to README
2015-06-17 17:15:48 +02:00
Ilan Steemers
e473665760
Added admin pages for failures and success.
...
SAVE_LIMIT can now be set to limit the amount of saved tasks results.
2015-06-17 15:32:54 +02:00