fork/django-q2
1
0
Fork 0
mirror of https://github.com/django-q2/django-q2.git synced 2026-10-08 02:58:12 +08:00
Code Issues Packages Projects Releases Wiki Activity
644 Commits 9 Branches 31 Tags
2df29b908c07e3bb809b75ac8cb53a3fdafeb26f
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ilan Steemers 2df29b908c Adds tests for task chains 
adds several small improvements based on the problems that surfaced during writing the tests
 2015-10-17 18:49:45 +02:00
Ilan Steemers 6dcead7310 Adds task chains 2015-10-17 12:13:29 +02:00
Ilan Steemers 5eb84c600f Updates botocore for testing 2015-10-16 12:24:05 +02:00
Ilan Steemers 142ce8c167 Updates Requests and Blessed requirements for testing 2015-10-14 13:18:56 +02:00
Ilan Steemers fa5f47cb14 Updates Arrow and Blessed for testing 2015-10-12 11:38:46 +02:00
Ilan Steemers 8701c37d65 updates botocore for testing 2015-10-09 10:24:39 +02:00
Ilan Steemers 3b25396f00 adds ipython notebook and redis dumpfiles to gitignore 2015-10-09 10:21:14 +02:00
Ilan Steemers 993d305fc9 docs: example paste error 2015-10-08 13:57:21 +02:00
Ilan Steemers 1abe23d229 V0.7.9 2015-10-08 12:53:47 +02:00
Ilan Steemers 2e9e20828a Merge pull request #91 from Koed00/dev 
Updated botocore for testing
 2015-10-08 12:08:57 +02:00
Ilan Steemers 8deacc0f5f Updated botocore for testing 2015-10-08 11:43:58 +02:00
Ilan Steemers fdc6583215 Merge pull request #90 from Koed00/dev 
adds version info to qinfo
 2015-10-07 17:48:53 +02:00
Ilan Steemers 44fce5ff03 linted 2015-10-07 17:08:05 +02:00
Ilan Steemers 680aac8405 adds version and hides None values for qinfo config 2015-10-07 17:06:50 +02:00
Ilan Steemers 2ba9d9e52e Merge pull request #89 from Koed00/dev 
Adds version and broker info to qinfo
 2015-10-07 15:42:53 +02:00
Ilan Steemers d4aa010428 adds version and broker info to qinfo command 2015-10-07 14:07:39 +02:00
Ilan Steemers bd242b9de3 docs: minor tweaks to cached group example 2015-10-07 13:55:13 +02:00
Ilan Steemers c39a8a06cd Merge pull request #88 from Koed00/dev 
Updates botocore, requests and six for testing
 2015-10-07 10:17:20 +02:00
Ilan Steemers 76cd10d5f8 Updates botocore, requests and six for testing 2015-10-07 10:04:01 +02:00
Ilan Steemers 89eb65f986 Merge pull request #87 from Koed00/dev 
adds `cached` option to `async_iter`
 2015-10-06 19:46:03 +02:00
Ilan Steemers 2ba88f2d17 adds cached option to async_iter 2015-10-06 19:37:02 +02:00
Ilan Steemers c9f3e64bf1 Merge pull request #86 from Koed00/dev 
moves hook signal in separate module
 2015-10-05 17:24:10 +02:00
Ilan Steemers 913edcb3da moves hook signal in separate module 
By moving signals in their own module, we can now follow Django guidelines and register signals on app.ready.
 2015-10-05 13:46:47 +02:00
Ilan Steemers 6486ee9d7e Merge pull request #85 from Koed00/dev 
Updates psutil to 3.2.2
 2015-10-05 10:38:28 +02:00
Ilan Steemers 693e182d90 Updated psutil 2015-10-05 10:14:03 +02:00
Ilan Steemers efed61f786 docs: some tweaks on the new functions 2015-10-04 16:47:42 +02:00
Ilan Steemers a6ef7e00e0 v 0.7.8 2015-10-04 15:36:41 +02:00
Ilan Steemers ee87333c43 Merge pull request #84 from Koed00/dev 
Adds cached result backend
 2015-10-04 14:43:20 +02:00
Ilan Steemers 5d6efbb3bb docs: updated group example 2015-10-04 14:36:42 +02:00
Ilan Steemers 486a0021c7 docs: adds async_iter 2015-10-04 12:44:59 +02:00
Ilan Steemers edf188e7bc adds async iter tests 2015-10-04 11:52:43 +02:00
Ilan Steemers 0c2da87e27 adds async iter tests 2015-10-04 11:49:07 +02:00
Ilan Steemers bc0724c967 Merge branch 'updates' 
# Conflicts:
#	requirements.txt
 2015-10-04 09:57:07 +02:00
Ilan Steemers e724b9bac1 Update tests for Django 1.8.5 
Also updated botocore and blessed
 2015-10-04 09:49:28 +02:00
Ilan Steemers f73ae66c0f Adds async_iter command 
With async iter you can quickly run the same function on an iterable set of arguments. The results are held in the cache until all are done and collated into a database result.
 2015-10-03 18:07:57 +02:00
Ilan Steemers 9243731a9c Updates test for new wait and count options 2015-10-02 20:03:38 +02:00
Ilan Steemers 7911419642 docs: updated cache and group operations 2015-10-02 18:31:52 +02:00
Ilan Steemers 81d5abbd00 adds count and wait option to group result and fetch 
result_group and fetch_group can now be told to block for a certain number of results or a number of miliseconds or a combination of both.
 2015-10-02 18:29:03 +02:00
Ilan Steemers 9cfc41f1cb fixed global cached for fetch group 
And added docstrings
 2015-10-02 16:40:31 +02:00
Ilan Steemers bcdb62404b updated botocore and dependency 2015-10-02 13:16:13 +02:00
Ilan Steemers f6d14bc7b3 adds delete_cached 2015-10-01 19:25:43 +02:00
Ilan Steemers 6127b551ae fixes tests for cache with better coverage 2015-10-01 17:21:26 +02:00
Ilan Steemers 7107e9ea35 fetch group should default to non cached 2015-10-01 15:06:43 +02:00
Ilan Steemers 33282cb2e5 cached result backend 
first version of a result backend using django's cache framework
 2015-10-01 14:58:28 +02:00
Ilan Steemers 36139eaa7b Merge pull request #81 from Koed00/dev 
updates botocore to 1.2.6 for testing
 2015-09-30 16:09:50 +02:00
Ilan Steemers 109a5fefa2 update botocore to 1.2.6 for testing 2015-09-30 16:03:56 +02:00
Ilan Steemers 477761a17f :docs: replaced some old redis references with brokers 2015-09-30 10:12:16 +02:00
Ilan Steemers 07a7851b54 v0.7.7 2015-09-29 22:59:40 +02:00
Ilan Steemers d478911160 v0.7.6 2015-09-29 18:33:18 +02:00
Ilan Steemers 76aab3d52a v0.7.6 2015-09-29 18:31:56 +02:00
Ilan Steemers 00236990af Merge pull request #80 from Koed00/dev 
#79  close django db connection before fork
 2015-09-29 11:20:59 +02:00
Ilan Steemers 1aed7c2d00 #79 close django db connection before fork 
The sentinel saves a statistic to the cache provider just before forking the workers. If this cache provider is a database backend, the connection stays open and gets forked and it crashes. Solution is to close any db connection before forking.
 2015-09-29 10:47:22 +02:00
Ilan Steemers ca79228b95 v0.7.5 2015-09-28 18:23:02 +02:00
Ilan Steemers a07cfbb2e1 Merge pull request #78 from Koed00/dev 
docs: mention Django 1.9a1 support
 2015-09-28 16:06:50 +02:00
Ilan Steemers bcad7614b3 docs: mention Django 1.9a1 support 2015-09-28 15:14:22 +02:00
Ilan Steemers f8fe7ca2c1 Merge pull request #77 from Koed00/dev 
Adds stale db connection check before every transaction
 2015-09-28 13:49:10 +02:00
Ilan Steemers 765c84301f #76 checks for stale connections always 
It turns out that checking stale connections on a timer takes between 1-2 times as long as just checking them always. This also has the benefit of catching timeouts that happen between timer loops.
 2015-09-28 12:48:11 +02:00
Ilan Steemers 7075a91d37 #76 adds connection checked with timeout 
Adds a check for old connections in both the workers and the monitor , every DB_TIMEOUT seconds
 2015-09-28 11:42:48 +02:00
Ilan Steemers 4ceee42be9 #76 resets stale db connection on every scheduler ping 2015-09-28 10:42:08 +02:00
Ilan Steemers 96543e4b75 Merge pull request #75 from Koed00/dev 
Adds MongoDB broker
 2015-09-26 18:12:57 +02:00
Ilan Steemers 08104ef777 check for default database on mongo connection 
correction
 2015-09-26 13:13:25 +02:00
Ilan Steemers b8bb186471 check for default database on mongo connection 2015-09-26 13:01:15 +02:00
Ilan Steemers 6c81840047 docs: updated management command example 2015-09-26 10:52:19 +02:00
Ilan Steemers 7847e3b560 docs: adds shell command example 2015-09-26 10:51:03 +02:00
Ilan Steemers 8bdbcdaf55 revert to info method 2015-09-25 21:27:33 +02:00
Ilan Steemers 1fd9ca2441 docs: mongodb broker 2015-09-25 20:57:47 +02:00
Ilan Steemers b5842827dd adds pymongo to requirements for testing 2015-09-25 20:10:30 +02:00
Ilan Steemers 863f6f1aa9 adds mongodb to travis 2015-09-25 20:05:56 +02:00
Ilan Steemers 826178c463 Adds a MongoDB broker 
* adds mongo broker tests
* adds mongo brokers docs

* broker info is now cached when it needs to connect to a server, to reduce traffic.
 2015-09-25 20:03:39 +02:00
Ilan Steemers ef6a60478a Merge pull request #74 from Koed00/dev 
Removes root imports for Django 1.9
 2015-09-25 12:35:10 +02:00
Ilan Steemers 3aa50bc503 brokers: updates boto3 for testing 2015-09-25 12:24:00 +02:00
Ilan Steemers b3381d6dae removes root imports for django 1.9 
typo in test
 2015-09-24 15:47:40 +02:00
Ilan Steemers cef48da789 removes root imports for django 1.9 
Updated docs to promote submodule imports
 2015-09-24 15:41:32 +02:00
Ilan Steemers dd8ea03a18 Merge pull request #73 from Koed00/gevent 
Removes pycharm stdin bug workaround
 2015-09-24 11:33:05 +02:00
Ilan Steemers 131a37daf3 Removes Pycharm stdin bug workaround 2015-09-24 11:21:50 +02:00
Ilan Steemers 985fbb31cc tests cluster stop when already stopped 2015-09-24 11:21:28 +02:00
Ilan Steemers 253202cb93 Merge pull request #72 from Koed00/dev 
adds compatibility section to docs
 2015-09-24 11:11:01 +02:00
Ilan Steemers 956e79a3a0 docs: compatibility 2015-09-22 18:46:39 +02:00
Ilan Steemers 04470c1a87 docs: compatibility 2015-09-22 18:22:08 +02:00
Ilan Steemers 5e80675492 Merge pull request #71 from Koed00/dev 
Only show lock count when available and greater than zero
 2015-09-19 17:31:51 +02:00
Ilan Steemers dc47ebef3c test for lock size in monitor 2015-09-19 17:25:02 +02:00
Ilan Steemers 7532cac93a test for lock_size in main class 2015-09-19 15:52:28 +02:00
Ilan Steemers 93a8f71157 Only show lock count when available and greater than zero 2015-09-19 15:42:35 +02:00
Ilan Steemers 000415a567 Merge pull request #70 from Koed00/dev 
Python 3.5 compatibility
 2015-09-19 15:41:46 +02:00
Ilan Steemers 54789a9597 Back to 3.4 for now 
Django 1.7.10 has a known bug with Python 3.5.
Will wait until compatible version is released.
Djang 1.8 tests are passing with 3.5
 2015-09-19 15:34:09 +02:00
Ilan Steemers 24d1e9d950 Updated pytest for python 3.5 
sticky keys
 2015-09-19 15:25:22 +02:00
Ilan Steemers c135975456 Updated pytest for python 3.5 
force upgrade on Travis
 2015-09-19 15:23:32 +02:00
Ilan Steemers 3a7e83f7b2 Updated pytest for python 3.5 2015-09-19 15:16:36 +02:00
Ilan Steemers 754fb1ad19 adds python 3.5 for testing 2015-09-19 15:09:19 +02:00
Ilan Steemers cfb53b48bb Merge pull request #69 from Koed00/dev 
docs: Replaced redis pooling with broker pooling example.
 2015-09-18 21:13:42 +02:00
Ilan Steemers 370ffd4061 docs: Replaced redis pooling with broker pooling example. 
* moves get_broker to main module
 2015-09-18 21:07:18 +02:00
Ilan Steemers 270d8dba88 v0.7.3 2015-09-18 20:02:19 +02:00
Ilan Steemers e60414d5b1 Merge pull request #68 from Koed00/dev 
Adds a wait option for results.
 2015-09-18 19:31:35 +02:00
Ilan Steemers 16c28a88e2 adds (approximate) lock_size to SQS broker 
docs: added lock_size
 2015-09-18 15:40:30 +02:00
Ilan Steemers 6af852fcee checks if broker has lock_size method 2015-09-18 15:23:31 +02:00
Ilan Steemers ce409a6f80 Updates boto3 for testing 2015-09-18 14:26:23 +02:00
Ilan Steemers 43d90da271 docs: typo 2015-09-18 11:03:41 +02:00
Ilan Steemers a493f9cc78 Adds wait option to result() and fetch() 2015-09-18 10:57:09 +02:00
Ilan Steemers a30e5d2c28 v0.7.2 2015-09-17 20:19:20 +02:00
Ilan Steemers 2b543635c1 Update README.rst 2015-09-17 20:02:45 +02:00