Ilan Steemers
edb0ffbed3
Retry test is broken
2016-01-07 14:37:55 +01:00
Ilan Steemers
5791089497
Temporarily disabling annoying ironmq bug
2016-01-07 14:09:01 +01:00
Ilan Steemers
0879e4d128
Iron mq is being pendantic
2016-01-07 12:38:13 +01:00
Ilan Steemers
ae74521021
v0.7.11
2015-10-28 12:15:01 +01:00
Ilan Steemers
e9969a29c3
Merge pull request #103 from Koed00/dev
...
adds `Async` class
2015-10-27 11:20:44 +01:00
Ilan Steemers
e736d79a57
Adds global override test to Async
2015-10-27 11:10:46 +01:00
Ilan Steemers
3cc4021aad
Optimizes option iteration for async
...
Simplified option iteration to only use a single loop. This makes the async command about twice as fast in optimal conditions.
2015-10-27 10:29:35 +01:00
Ilan Steemers
9dd79f6522
Adds test for new Async class
2015-10-26 19:35:38 +01:00
Ilan Steemers
02bd14c169
Fixes bug where task with a group only has a group result.
2015-10-26 19:35:07 +01:00
Ilan Steemers
12bfd47917
Splits options from keywords through iteration
...
Popping options from async kwargs will make any reference to them void. Which can lead to unwanted situations. Unfortunately deepcopy clashes with the multiprocessing so we resort to simple re-iteration.
2015-10-26 15:33:42 +01:00
Ilan Steemers
728ba45ef0
Adds Async class wrapper for the async function
2015-10-26 13:48:23 +01:00
Ilan Steemers
62337a9d06
Adds infinite wait to task result functions
...
* the `wait` keyword now can take the value `-1` which will make the functions wait indefinitely for a result.
2015-10-25 16:40:49 +01:00
Ilan Steemers
2bd241bb71
Merge pull request #98 from Koed00/dev
...
Adds timeout to group key cache object
2015-10-20 21:53:52 +02:00
Ilan Steemers
69551793c0
adds timeout to group_key cache object
2015-10-19 15:42:05 +02:00
Ilan Steemers
adc9580b9a
version 0.7.10
2015-10-19 11:43:24 +02:00
Ilan Steemers
7eefb8cb64
returns the size of the chain or iter on append
2015-10-18 15:57:23 +02:00
Ilan Steemers
eb72eb33d9
Adds an Iter class
...
The Iter class serves as a convenience rwrapper around the `async_iter` function
2015-10-18 13:53:32 +02:00
Ilan Steemers
083715f9bd
Replaces list.copy with a slice for python 2.7
2015-10-17 18:59:17 +02:00
Ilan Steemers
2df29b908c
Adds tests for task chains
...
adds several small improvements based on the problems that surfaced during writing the tests
2015-10-17 18:49:45 +02:00
Ilan Steemers
6dcead7310
Adds task chains
2015-10-17 12:13:29 +02:00
Ilan Steemers
1abe23d229
V0.7.9
2015-10-08 12:53:47 +02:00
Ilan Steemers
44fce5ff03
linted
2015-10-07 17:08:05 +02:00
Ilan Steemers
680aac8405
adds version and hides None values for qinfo config
2015-10-07 17:06:50 +02:00
Ilan Steemers
d4aa010428
adds version and broker info to qinfo command
2015-10-07 14:07:39 +02:00
Ilan Steemers
2ba88f2d17
adds cached option to async_iter
2015-10-06 19:37:02 +02:00
Ilan Steemers
913edcb3da
moves hook signal in separate module
...
By moving signals in their own module, we can now follow Django guidelines and register signals on app.ready.
2015-10-05 13:46:47 +02:00
Ilan Steemers
a6ef7e00e0
v 0.7.8
2015-10-04 15:36:41 +02:00
Ilan Steemers
edf188e7bc
adds async iter tests
2015-10-04 11:52:43 +02:00
Ilan Steemers
0c2da87e27
adds async iter tests
2015-10-04 11:49:07 +02:00
Ilan Steemers
f73ae66c0f
Adds async_iter command
...
With async iter you can quickly run the same function on an iterable set of arguments. The results are held in the cache until all are done and collated into a database result.
2015-10-03 18:07:57 +02:00
Ilan Steemers
9243731a9c
Updates test for new wait and count options
2015-10-02 20:03:38 +02:00
Ilan Steemers
81d5abbd00
adds count and wait option to group result and fetch
...
result_group and fetch_group can now be told to block for a certain number of results or a number of miliseconds or a combination of both.
2015-10-02 18:29:03 +02:00
Ilan Steemers
9cfc41f1cb
fixed global cached for fetch group
...
And added docstrings
2015-10-02 16:40:31 +02:00
Ilan Steemers
f6d14bc7b3
adds delete_cached
2015-10-01 19:25:43 +02:00
Ilan Steemers
6127b551ae
fixes tests for cache with better coverage
2015-10-01 17:21:26 +02:00
Ilan Steemers
7107e9ea35
fetch group should default to non cached
2015-10-01 15:06:43 +02:00
Ilan Steemers
33282cb2e5
cached result backend
...
first version of a result backend using django's cache framework
2015-10-01 14:58:28 +02:00
Ilan Steemers
07a7851b54
v0.7.7
2015-09-29 22:59:40 +02:00
Ilan Steemers
76aab3d52a
v0.7.6
2015-09-29 18:31:56 +02:00
Ilan Steemers
00236990af
Merge pull request #80 from Koed00/dev
...
#79 close django db connection before fork
2015-09-29 11:20:59 +02:00
Ilan Steemers
1aed7c2d00
#79 close django db connection before fork
...
The sentinel saves a statistic to the cache provider just before forking the workers. If this cache provider is a database backend, the connection stays open and gets forked and it crashes. Solution is to close any db connection before forking.
2015-09-29 10:47:22 +02:00
Ilan Steemers
ca79228b95
v0.7.5
2015-09-28 18:23:02 +02:00
Ilan Steemers
765c84301f
#76 checks for stale connections always
...
It turns out that checking stale connections on a timer takes between 1-2 times as long as just checking them always. This also has the benefit of catching timeouts that happen between timer loops.
2015-09-28 12:48:11 +02:00
Ilan Steemers
7075a91d37
#76 adds connection checked with timeout
...
Adds a check for old connections in both the workers and the monitor , every DB_TIMEOUT seconds
2015-09-28 11:42:48 +02:00
Ilan Steemers
4ceee42be9
#76 resets stale db connection on every scheduler ping
2015-09-28 10:42:08 +02:00
Ilan Steemers
08104ef777
check for default database on mongo connection
...
correction
2015-09-26 13:13:25 +02:00
Ilan Steemers
b8bb186471
check for default database on mongo connection
2015-09-26 13:01:15 +02:00
Ilan Steemers
8bdbcdaf55
revert to info method
2015-09-25 21:27:33 +02:00
Ilan Steemers
826178c463
Adds a MongoDB broker
...
* adds mongo broker tests
* adds mongo brokers docs
* broker info is now cached when it needs to connect to a server, to reduce traffic.
2015-09-25 20:03:39 +02:00
Ilan Steemers
ef6a60478a
Merge pull request #74 from Koed00/dev
...
Removes root imports for Django 1.9
2015-09-25 12:35:10 +02:00
Ilan Steemers