Commit Graph

627 Commits

Author SHA1 Message Date
Ilan Steemers
c39a8a06cd Merge pull request #88 from Koed00/dev
Updates botocore, requests and six for testing
2015-10-07 10:17:20 +02:00
Ilan Steemers
76cd10d5f8 Updates botocore, requests and six for testing 2015-10-07 10:04:01 +02:00
Ilan Steemers
89eb65f986 Merge pull request #87 from Koed00/dev
adds `cached` option to `async_iter`
2015-10-06 19:46:03 +02:00
Ilan Steemers
2ba88f2d17 adds cached option to async_iter 2015-10-06 19:37:02 +02:00
Ilan Steemers
c9f3e64bf1 Merge pull request #86 from Koed00/dev
moves hook signal in separate module
2015-10-05 17:24:10 +02:00
Ilan Steemers
913edcb3da moves hook signal in separate module
By moving signals in their own module, we can now follow Django guidelines and register signals on app.ready.
2015-10-05 13:46:47 +02:00
Ilan Steemers
6486ee9d7e Merge pull request #85 from Koed00/dev
Updates psutil to 3.2.2
2015-10-05 10:38:28 +02:00
Ilan Steemers
693e182d90 Updated psutil 2015-10-05 10:14:03 +02:00
Ilan Steemers
efed61f786 docs: some tweaks on the new functions 2015-10-04 16:47:42 +02:00
Ilan Steemers
a6ef7e00e0 v 0.7.8 2015-10-04 15:36:41 +02:00
Ilan Steemers
ee87333c43 Merge pull request #84 from Koed00/dev
Adds cached result backend
2015-10-04 14:43:20 +02:00
Ilan Steemers
5d6efbb3bb docs: updated group example 2015-10-04 14:36:42 +02:00
Ilan Steemers
486a0021c7 docs: adds async_iter 2015-10-04 12:44:59 +02:00
Ilan Steemers
edf188e7bc adds async iter tests 2015-10-04 11:52:43 +02:00
Ilan Steemers
0c2da87e27 adds async iter tests 2015-10-04 11:49:07 +02:00
Ilan Steemers
bc0724c967 Merge branch 'updates'
# Conflicts:
#	requirements.txt
2015-10-04 09:57:07 +02:00
Ilan Steemers
e724b9bac1 Update tests for Django 1.8.5
Also updated botocore and blessed
2015-10-04 09:49:28 +02:00
Ilan Steemers
f73ae66c0f Adds async_iter command
With async iter you can quickly run the same function on an iterable set of arguments. The results are held in the cache until all are done and collated into a database result.
2015-10-03 18:07:57 +02:00
Ilan Steemers
9243731a9c Updates test for new wait and count options 2015-10-02 20:03:38 +02:00
Ilan Steemers
7911419642 docs: updated cache and group operations 2015-10-02 18:31:52 +02:00
Ilan Steemers
81d5abbd00 adds count and wait option to group result and fetch
result_group and fetch_group can now be told to block for a certain number of results or a number of miliseconds or a combination of both.
2015-10-02 18:29:03 +02:00
Ilan Steemers
9cfc41f1cb fixed global cached for fetch group
And added docstrings
2015-10-02 16:40:31 +02:00
Ilan Steemers
bcdb62404b updated botocore and dependency 2015-10-02 13:16:13 +02:00
Ilan Steemers
f6d14bc7b3 adds delete_cached 2015-10-01 19:25:43 +02:00
Ilan Steemers
6127b551ae fixes tests for cache with better coverage 2015-10-01 17:21:26 +02:00
Ilan Steemers
7107e9ea35 fetch group should default to non cached 2015-10-01 15:06:43 +02:00
Ilan Steemers
33282cb2e5 cached result backend
first version of a result backend using django's cache framework
2015-10-01 14:58:28 +02:00
Ilan Steemers
36139eaa7b Merge pull request #81 from Koed00/dev
updates botocore to 1.2.6 for testing
2015-09-30 16:09:50 +02:00
Ilan Steemers
109a5fefa2 update botocore to 1.2.6 for testing 2015-09-30 16:03:56 +02:00
Ilan Steemers
477761a17f :docs: replaced some old redis references with brokers 2015-09-30 10:12:16 +02:00
Ilan Steemers
07a7851b54 v0.7.7 2015-09-29 22:59:40 +02:00
Ilan Steemers
d478911160 v0.7.6 2015-09-29 18:33:18 +02:00
Ilan Steemers
76aab3d52a v0.7.6 2015-09-29 18:31:56 +02:00
Ilan Steemers
00236990af Merge pull request #80 from Koed00/dev
#79  close django db connection before fork
2015-09-29 11:20:59 +02:00
Ilan Steemers
1aed7c2d00 #79 close django db connection before fork
The sentinel saves a statistic to the cache provider just before forking the workers. If this cache provider is a database backend, the connection stays open and gets forked and it crashes. Solution is to close any db connection before forking.
2015-09-29 10:47:22 +02:00
Ilan Steemers
ca79228b95 v0.7.5 2015-09-28 18:23:02 +02:00
Ilan Steemers
a07cfbb2e1 Merge pull request #78 from Koed00/dev
docs: mention Django 1.9a1 support
2015-09-28 16:06:50 +02:00
Ilan Steemers
bcad7614b3 docs: mention Django 1.9a1 support 2015-09-28 15:14:22 +02:00
Ilan Steemers
f8fe7ca2c1 Merge pull request #77 from Koed00/dev
Adds stale db connection check before every transaction
2015-09-28 13:49:10 +02:00
Ilan Steemers
765c84301f #76 checks for stale connections always
It turns out that checking stale connections on a timer takes between 1-2 times as long as just checking them always. This also has the benefit of catching timeouts that happen between timer loops.
2015-09-28 12:48:11 +02:00
Ilan Steemers
7075a91d37 #76 adds connection checked with timeout
Adds a check for old connections in both the workers and the monitor , every DB_TIMEOUT seconds
2015-09-28 11:42:48 +02:00
Ilan Steemers
4ceee42be9 #76 resets stale db connection on every scheduler ping 2015-09-28 10:42:08 +02:00
Ilan Steemers
96543e4b75 Merge pull request #75 from Koed00/dev
Adds MongoDB broker
2015-09-26 18:12:57 +02:00
Ilan Steemers
08104ef777 check for default database on mongo connection
correction
2015-09-26 13:13:25 +02:00
Ilan Steemers
b8bb186471 check for default database on mongo connection 2015-09-26 13:01:15 +02:00
Ilan Steemers
6c81840047 docs: updated management command example 2015-09-26 10:52:19 +02:00
Ilan Steemers
7847e3b560 docs: adds shell command example 2015-09-26 10:51:03 +02:00
Ilan Steemers
8bdbcdaf55 revert to info method 2015-09-25 21:27:33 +02:00
Ilan Steemers
1fd9ca2441 docs: mongodb broker 2015-09-25 20:57:47 +02:00
Ilan Steemers
b5842827dd adds pymongo to requirements for testing 2015-09-25 20:10:30 +02:00