Commit Graph
610 Commits
Author SHA1 Message Date
Ilan Steemers 0c2da87e27 adds async iter tests 2015-10-04 11:49:07 +02:00
Ilan Steemers f73ae66c0f Adds async_iter command
With async iter you can quickly run the same function on an iterable set of arguments. The results are held in the cache until all are done and collated into a database result.
2015-10-03 18:07:57 +02:00
Ilan Steemers 9243731a9c Updates test for new wait and count options 2015-10-02 20:03:38 +02:00
Ilan Steemers 7911419642 docs: updated cache and group operations 2015-10-02 18:31:52 +02:00
Ilan Steemers 81d5abbd00 adds count and wait option to group result and fetch
result_group and fetch_group can now be told to block for a certain number of results or a number of miliseconds or a combination of both.
2015-10-02 18:29:03 +02:00
Ilan Steemers 9cfc41f1cb fixed global cached for fetch group
And added docstrings
2015-10-02 16:40:31 +02:00
Ilan Steemers bcdb62404b updated botocore and dependency 2015-10-02 13:16:13 +02:00
Ilan Steemers f6d14bc7b3 adds delete_cached 2015-10-01 19:25:43 +02:00
Ilan Steemers 6127b551ae fixes tests for cache with better coverage 2015-10-01 17:21:26 +02:00
Ilan Steemers 7107e9ea35 fetch group should default to non cached 2015-10-01 15:06:43 +02:00
Ilan Steemers 33282cb2e5 cached result backend
first version of a result backend using django's cache framework
2015-10-01 14:58:28 +02:00
Ilan Steemers 109a5fefa2 update botocore to 1.2.6 for testing 2015-09-30 16:03:56 +02:00
Ilan Steemers 477761a17f :docs: replaced some old redis references with brokers 2015-09-30 10:12:16 +02:00
Ilan Steemers 07a7851b54 v0.7.7 2015-09-29 22:59:40 +02:00
Ilan Steemers d478911160 v0.7.6 2015-09-29 18:33:18 +02:00
Ilan Steemers 76aab3d52a v0.7.6 2015-09-29 18:31:56 +02:00
Ilan Steemers 00236990af Merge pull request #80 from Koed00/dev
#79  close django db connection before fork
2015-09-29 11:20:59 +02:00
Ilan Steemers 1aed7c2d00 #79 close django db connection before fork
The sentinel saves a statistic to the cache provider just before forking the workers. If this cache provider is a database backend, the connection stays open and gets forked and it crashes. Solution is to close any db connection before forking.
2015-09-29 10:47:22 +02:00
Ilan Steemers ca79228b95 v0.7.5 2015-09-28 18:23:02 +02:00
Ilan Steemers a07cfbb2e1 Merge pull request #78 from Koed00/dev
docs: mention Django 1.9a1 support
2015-09-28 16:06:50 +02:00
Ilan Steemers bcad7614b3 docs: mention Django 1.9a1 support 2015-09-28 15:14:22 +02:00
Ilan Steemers f8fe7ca2c1 Merge pull request #77 from Koed00/dev
Adds stale db connection check before every transaction
2015-09-28 13:49:10 +02:00
Ilan Steemers 765c84301f #76 checks for stale connections always
It turns out that checking stale connections on a timer takes between 1-2 times as long as just checking them always. This also has the benefit of catching timeouts that happen between timer loops.
2015-09-28 12:48:11 +02:00
Ilan Steemers 7075a91d37 #76 adds connection checked with timeout
Adds a check for old connections in both the workers and the monitor , every DB_TIMEOUT seconds
2015-09-28 11:42:48 +02:00
Ilan Steemers 4ceee42be9 #76 resets stale db connection on every scheduler ping 2015-09-28 10:42:08 +02:00
Ilan Steemers 96543e4b75 Merge pull request #75 from Koed00/dev
Adds MongoDB broker
2015-09-26 18:12:57 +02:00
Ilan Steemers 08104ef777 check for default database on mongo connection
correction
2015-09-26 13:13:25 +02:00
Ilan Steemers b8bb186471 check for default database on mongo connection 2015-09-26 13:01:15 +02:00
Ilan Steemers 6c81840047 docs: updated management command example 2015-09-26 10:52:19 +02:00
Ilan Steemers 7847e3b560 docs: adds shell command example 2015-09-26 10:51:03 +02:00
Ilan Steemers 8bdbcdaf55 revert to info method 2015-09-25 21:27:33 +02:00
Ilan Steemers 1fd9ca2441 docs: mongodb broker 2015-09-25 20:57:47 +02:00
Ilan Steemers b5842827dd adds pymongo to requirements for testing 2015-09-25 20:10:30 +02:00
Ilan Steemers 863f6f1aa9 adds mongodb to travis 2015-09-25 20:05:56 +02:00
Ilan Steemers 826178c463 Adds a MongoDB broker
* adds mongo broker tests
* adds mongo brokers docs

* broker info is now cached when it needs to connect to a server, to reduce traffic.
2015-09-25 20:03:39 +02:00
Ilan Steemers ef6a60478a Merge pull request #74 from Koed00/dev
Removes root imports for Django 1.9
2015-09-25 12:35:10 +02:00
Ilan Steemers 3aa50bc503 brokers: updates boto3 for testing 2015-09-25 12:24:00 +02:00
Ilan Steemers b3381d6dae removes root imports for django 1.9
typo in test
2015-09-24 15:47:40 +02:00
Ilan Steemers cef48da789 removes root imports for django 1.9
Updated docs to promote submodule imports
2015-09-24 15:41:32 +02:00
Ilan Steemers dd8ea03a18 Merge pull request #73 from Koed00/gevent
Removes pycharm stdin bug workaround
2015-09-24 11:33:05 +02:00
Ilan Steemers 131a37daf3 Removes Pycharm stdin bug workaround 2015-09-24 11:21:50 +02:00
Ilan Steemers 985fbb31cc tests cluster stop when already stopped 2015-09-24 11:21:28 +02:00
Ilan Steemers 253202cb93 Merge pull request #72 from Koed00/dev
adds compatibility section to docs
2015-09-24 11:11:01 +02:00
Ilan Steemers 956e79a3a0 docs: compatibility 2015-09-22 18:46:39 +02:00
Ilan Steemers 04470c1a87 docs: compatibility 2015-09-22 18:22:08 +02:00
Ilan Steemers 5e80675492 Merge pull request #71 from Koed00/dev
Only show lock count when available and greater than zero
2015-09-19 17:31:51 +02:00
Ilan Steemers dc47ebef3c test for lock size in monitor 2015-09-19 17:25:02 +02:00
Ilan Steemers 7532cac93a test for lock_size in main class 2015-09-19 15:52:28 +02:00
Ilan Steemers 93a8f71157 Only show lock count when available and greater than zero 2015-09-19 15:42:35 +02:00
Ilan Steemers 000415a567 Merge pull request #70 from Koed00/dev
Python 3.5 compatibility
2015-09-19 15:41:46 +02:00