Commit Graph
231 Commits
Author SHA1 Message Date
Ilan Steemers 01f8d9ce47 adds info method to brokers 2015-09-03 14:29:03 +02:00
Ilan Steemers b1f2143a3d uses disque_nodes convention 2015-09-03 12:55:49 +02:00
Ilan Steemers e22980834c Fixes connectionerror bug on 2.7 2015-09-02 20:17:44 +02:00
Ilan Steemers dfb1b03cd0 Experimenting with disque build on travis 2015-09-02 20:12:00 +02:00
Ilan Steemers b901039a44 Experimenting with disque build on travis 2015-09-02 20:08:20 +02:00
Ilan Steemers 1a61fa2821 Experimenting with disque build on travis 2015-09-02 20:04:48 +02:00
Ilan Steemers 0756fb9896 Experimenting with disque build on travis 2015-09-02 20:00:43 +02:00
Ilan Steemers 46ae50043c Fixes class super for python 2.7 2015-09-02 19:50:04 +02:00
Ilan Steemers 8ce441bed5 Adds more brokers
* added IronMQ
* added Aws SQS
* removed SafeRedis.
 During tests the 'safe' part wasn't consistent enough
2015-09-02 19:04:03 +02:00
Ilan Steemers da20ebe734 fixes connection creation on import 2015-08-31 15:15:24 +02:00
Ilan Steemers 9e04d8c9a8 Fixes import problems in python 2.7 2015-08-30 21:12:47 +02:00
Ilan Steemers 5171f1a183 Disabled Disque tests for now 2015-08-30 21:04:07 +02:00
Ilan Steemers 452f53f899 New container build on Travis 2015-08-30 20:57:05 +02:00
Ilan Steemers d6b9b10e3e Adds tests for brokers
* test for redis and django-redis
* test for disque

TODO add disque to Travis
2015-08-30 20:26:30 +02:00
Ilan Steemers 4f39062785 Adds django cache as monitor cache
Not the best solution yet, but it solves monitoring problems with brokers that don't have a pattern getter for cluster stats.
2015-08-30 18:28:26 +02:00
Ilan Steemers d3283571a6 First draft of a Disque broker
TODO monitoring doesn't work yet
2015-08-30 14:33:35 +02:00
Ilan Steemers 93cbfc37e2 fixes import confusion in python 2.7 2015-08-29 19:08:19 +02:00
Ilan Steemers 0740c90148 adds pluggable brokers
* added redis broker
 * added django_redis broker
 * added task acknowledgement
2015-08-29 18:54:07 +02:00
Ilan Steemers 439c8a2f77 Moves Status to it's own file
This way only qmonitor and qinfo need Curses and you can still run the cluster without it.
2015-08-26 13:11:58 +02:00
Ilan Steemers 3e92fddcdd #50 removes redis connection argument from pusher process 2015-08-24 10:08:43 +02:00
Ilan Steemers b414b637eb #50 adds psutil as alternative os.getppid provider 2015-08-23 21:19:35 +02:00
Ilan 5ccd86a254 v0.5.3 2015-08-19 12:40:29 +02:00
Ilan da5e265333 Updated comment on catch up 2015-08-19 12:39:56 +02:00
Ilan b99e16f108 adds catch_up configuration option
When a cluster hasn't run for a while, the default behavior is to keep executing schedules until they are caught up with the present time.
By setting `catch_up` to False, schedules will not play catch up and instead get rescheduled to the future.
2015-08-18 11:57:15 +02:00
Ilan ac2dc02b4c consolidated redis ping 2015-08-17 14:25:32 +02:00
Ilan 47a92f8e56 added to translations
fixed _ conflict
2015-08-17 12:57:59 +02:00
Ilan 12e9e2035e Version 0.5.2 2015-08-13 19:49:36 +02:00
Ilan 6c37b09151 adds global sync configuration option
Setting the `sync` configuration option will force all async() calls to be run with `sync=True`. Useful for testing.
2015-08-13 18:02:38 +02:00
Ilan 3d12c1d36e adds queue_size()
returns the size of the current redis queue
2015-08-13 15:54:57 +02:00
Ilan 204377228f v0.5.1 2015-08-12 13:46:25 +02:00
Ilan df7f8bbcaf Adds more stats to the qinfo command
* Average execution time
* Tasks per day/hour/minute/second
* Number of schedules
2015-08-12 12:39:14 +02:00
Ilan e86308b434 adds qinfo management command
It seems more practical to give this its own command instead of `qmonitor --info`
2015-08-10 13:20:17 +02:00
Ilan 63030aa9d1 Tests schedule creation via model 2015-08-10 13:18:50 +02:00
Ilan 79393dee16 adds --info summary to monitor command 2015-08-09 19:29:24 +02:00
Ilan c22b98e202 v0.5.0 2015-08-05 21:49:10 +02:00
Ilan de5d0f2725 Adds a 'minutes' option to the scheduler 2015-08-05 20:30:29 +02:00
Ilan 77395acbbb Preparing v0.4.6 2015-08-04 21:45:51 +02:00
Ilan f470fbf975 uses empty() instead of qsize() == 0 2015-08-04 18:30:07 +02:00
Ilan ae8745ab39 Checks if cpu_count is implemented
On rare occasions, usually on win32, cpu_count will raise a NotImplemented error.  If psutil is installed we will use this to get the correct count, otherwise we default to 4
2015-08-04 16:28:19 +02:00
Ilan 25dcec4572 Merge branch 'master' into dev
# Conflicts:
#	docs/monitor.rst
2015-08-04 15:15:45 +02:00
Ilan 4bae1fc99f #40 typo 2015-08-04 12:59:24 +02:00
Ilan af61270f62 #40 qsize not implemented 2015-08-04 12:26:23 +02:00
Ilan b50e2a9006 ready for 0.4.5 2015-08-01 15:55:21 +02:00
Ilan Steemers 8253fbe44a Merge pull request #39 from Koed00/dev
Sets pickle protocol to highest
2015-08-01 03:37:52 -07:00
Ilan ed019634d2 Sets pickle protocol to highest
* package signing protocol is now set to highest. Tests show this to be about a 35% speed increase and there is increased probability of correctly pickling complex objects.

* also upped the protocol on the result database picklefield.
2015-08-01 11:41:45 +02:00
Ilan Steemers 6683e7ac21 Merge pull request #37 from Koed00/dev
fixes save_limit +1
2015-07-31 10:10:44 -07:00
Ilan 9899c42740 * fixes save_limit +1
* adds save_limit test
* expands recycle test
2015-07-31 18:39:54 +02:00
Ilan Steemers 4d3451183b Merge pull request #36 from Koed00/dev
Moves unpacking task from Worker to Pusher
2015-07-31 05:07:55 -07:00
Ilan Steemers f75593aebb Moves unpacking task from Worker to Pusher.
Makes more sense and gives us more options to work with control queues from the pusher in the future. Does not seem to affect performance.
2015-07-31 12:29:10 +02:00
Ilan c244075195 Bumping to 0.4.4 2015-07-27 18:08:32 +02:00