Ilan Steemers
dfb1b03cd0
Experimenting with disque build on travis
2015-09-02 20:12:00 +02:00
Ilan Steemers
b901039a44
Experimenting with disque build on travis
2015-09-02 20:08:20 +02:00
Ilan Steemers
1a61fa2821
Experimenting with disque build on travis
2015-09-02 20:04:48 +02:00
Ilan Steemers
0756fb9896
Experimenting with disque build on travis
2015-09-02 20:00:43 +02:00
Ilan Steemers
46ae50043c
Fixes class super for python 2.7
2015-09-02 19:50:04 +02:00
Ilan Steemers
8ce441bed5
Adds more brokers
...
* added IronMQ
* added Aws SQS
* removed SafeRedis.
During tests the 'safe' part wasn't consistent enough
2015-09-02 19:04:03 +02:00
Ilan Steemers
da20ebe734
fixes connection creation on import
2015-08-31 15:15:24 +02:00
Ilan Steemers
9e04d8c9a8
Fixes import problems in python 2.7
2015-08-30 21:12:47 +02:00
Ilan Steemers
5171f1a183
Disabled Disque tests for now
2015-08-30 21:04:07 +02:00
Ilan Steemers
452f53f899
New container build on Travis
2015-08-30 20:57:05 +02:00
Ilan Steemers
d6b9b10e3e
Adds tests for brokers
...
* test for redis and django-redis
* test for disque
TODO add disque to Travis
2015-08-30 20:26:30 +02:00
Ilan Steemers
4f39062785
Adds django cache as monitor cache
...
Not the best solution yet, but it solves monitoring problems with brokers that don't have a pattern getter for cluster stats.
2015-08-30 18:28:26 +02:00
Ilan Steemers
d3283571a6
First draft of a Disque broker
...
TODO monitoring doesn't work yet
2015-08-30 14:33:35 +02:00
Ilan Steemers
93cbfc37e2
fixes import confusion in python 2.7
2015-08-29 19:08:19 +02:00
Ilan Steemers
0740c90148
adds pluggable brokers
...
* added redis broker
* added django_redis broker
* added task acknowledgement
2015-08-29 18:54:07 +02:00
Ilan Steemers
439c8a2f77
Moves Status to it's own file
...
This way only qmonitor and qinfo need Curses and you can still run the cluster without it.
2015-08-26 13:11:58 +02:00
Ilan Steemers
3e92fddcdd
#50 removes redis connection argument from pusher process
2015-08-24 10:08:43 +02:00
Ilan Steemers
b414b637eb
#50 adds psutil as alternative os.getppid provider
2015-08-23 21:19:35 +02:00
Ilan
5ccd86a254
v0.5.3
2015-08-19 12:40:29 +02:00
Ilan
da5e265333
Updated comment on catch up
2015-08-19 12:39:56 +02:00
Ilan
b99e16f108
adds catch_up configuration option
...
When a cluster hasn't run for a while, the default behavior is to keep executing schedules until they are caught up with the present time.
By setting `catch_up` to False, schedules will not play catch up and instead get rescheduled to the future.
2015-08-18 11:57:15 +02:00
Ilan
ac2dc02b4c
consolidated redis ping
2015-08-17 14:25:32 +02:00
Ilan
47a92f8e56
added to translations
...
fixed _ conflict
2015-08-17 12:57:59 +02:00
Ilan
12e9e2035e
Version 0.5.2
2015-08-13 19:49:36 +02:00
Ilan
6c37b09151
adds global sync configuration option
...
Setting the `sync` configuration option will force all async() calls to be run with `sync=True`. Useful for testing.
2015-08-13 18:02:38 +02:00
Ilan
3d12c1d36e
adds queue_size()
...
returns the size of the current redis queue
2015-08-13 15:54:57 +02:00
Ilan
204377228f
v0.5.1
2015-08-12 13:46:25 +02:00
Ilan
df7f8bbcaf
Adds more stats to the qinfo command
...
* Average execution time
* Tasks per day/hour/minute/second
* Number of schedules
2015-08-12 12:39:14 +02:00
Ilan
e86308b434
adds qinfo management command
...
It seems more practical to give this its own command instead of `qmonitor --info`
2015-08-10 13:20:17 +02:00
Ilan
63030aa9d1
Tests schedule creation via model
2015-08-10 13:18:50 +02:00
Ilan
79393dee16
adds --info summary to monitor command
2015-08-09 19:29:24 +02:00
Ilan
c22b98e202
v0.5.0
2015-08-05 21:49:10 +02:00
Ilan
de5d0f2725
Adds a 'minutes' option to the scheduler
2015-08-05 20:30:29 +02:00
Ilan
77395acbbb
Preparing v0.4.6
2015-08-04 21:45:51 +02:00
Ilan
f470fbf975
uses empty() instead of qsize() == 0
2015-08-04 18:30:07 +02:00
Ilan
ae8745ab39
Checks if cpu_count is implemented
...
On rare occasions, usually on win32, cpu_count will raise a NotImplemented error. If psutil is installed we will use this to get the correct count, otherwise we default to 4
2015-08-04 16:28:19 +02:00
Ilan
25dcec4572
Merge branch 'master' into dev
...
# Conflicts:
# docs/monitor.rst
2015-08-04 15:15:45 +02:00
Ilan
4bae1fc99f
#40 typo
2015-08-04 12:59:24 +02:00
Ilan
af61270f62
#40 qsize not implemented
2015-08-04 12:26:23 +02:00
Ilan
b50e2a9006
ready for 0.4.5
2015-08-01 15:55:21 +02:00
Ilan Steemers
8253fbe44a
Merge pull request #39 from Koed00/dev
...
Sets pickle protocol to highest
2015-08-01 03:37:52 -07:00
Ilan
ed019634d2
Sets pickle protocol to highest
...
* package signing protocol is now set to highest. Tests show this to be about a 35% speed increase and there is increased probability of correctly pickling complex objects.
* also upped the protocol on the result database picklefield.
2015-08-01 11:41:45 +02:00
Ilan Steemers
6683e7ac21
Merge pull request #37 from Koed00/dev
...
fixes save_limit +1
2015-07-31 10:10:44 -07:00
Ilan
9899c42740
* fixes save_limit +1
...
* adds save_limit test
* expands recycle test
2015-07-31 18:39:54 +02:00
Ilan Steemers
4d3451183b
Merge pull request #36 from Koed00/dev
...
Moves unpacking task from Worker to Pusher
2015-07-31 05:07:55 -07:00
Ilan Steemers
f75593aebb
Moves unpacking task from Worker to Pusher.
...
Makes more sense and gives us more options to work with control queues from the pusher in the future. Does not seem to affect performance.
2015-07-31 12:29:10 +02:00
Ilan
c244075195
Bumping to 0.4.4
2015-07-27 18:08:32 +02:00
Ilan
ba58b4face
closes db connection on worker and monitor spawn
...
This should prevent some problems with Postgresql where the workers would use stale db connections and cause errors.
2015-07-27 12:31:38 +02:00
Ilan
82bd93d67f
docstring linting
2015-07-27 10:45:43 +02:00
Ilan
38829f25c2
adds group filter to admin
2015-07-27 10:45:43 +02:00
