fork/django-q2
1
0
Fork 0
mirror of https://github.com/django-q2/django-q2.git synced 2026-10-07 17:58:11 +08:00
Code Issues Packages Projects Releases Wiki Activity
613 Commits 9 Branches 31 Tags
5d6efbb3bb92b78a3d12e903c4bede8444f8dc0c
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ilan Steemers 5d6efbb3bb docs: updated group example 2015-10-04 14:36:42 +02:00
Ilan Steemers 486a0021c7 docs: adds async_iter 2015-10-04 12:44:59 +02:00
Ilan Steemers edf188e7bc adds async iter tests 2015-10-04 11:52:43 +02:00
Ilan Steemers 0c2da87e27 adds async iter tests 2015-10-04 11:49:07 +02:00
Ilan Steemers f73ae66c0f Adds async_iter command 
With async iter you can quickly run the same function on an iterable set of arguments. The results are held in the cache until all are done and collated into a database result.
 2015-10-03 18:07:57 +02:00
Ilan Steemers 9243731a9c Updates test for new wait and count options 2015-10-02 20:03:38 +02:00
Ilan Steemers 7911419642 docs: updated cache and group operations 2015-10-02 18:31:52 +02:00
Ilan Steemers 81d5abbd00 adds count and wait option to group result and fetch 
result_group and fetch_group can now be told to block for a certain number of results or a number of miliseconds or a combination of both.
 2015-10-02 18:29:03 +02:00
Ilan Steemers 9cfc41f1cb fixed global cached for fetch group 
And added docstrings
 2015-10-02 16:40:31 +02:00
Ilan Steemers bcdb62404b updated botocore and dependency 2015-10-02 13:16:13 +02:00
Ilan Steemers f6d14bc7b3 adds delete_cached 2015-10-01 19:25:43 +02:00
Ilan Steemers 6127b551ae fixes tests for cache with better coverage 2015-10-01 17:21:26 +02:00
Ilan Steemers 7107e9ea35 fetch group should default to non cached 2015-10-01 15:06:43 +02:00
Ilan Steemers 33282cb2e5 cached result backend 
first version of a result backend using django's cache framework
 2015-10-01 14:58:28 +02:00
Ilan Steemers 109a5fefa2 update botocore to 1.2.6 for testing 2015-09-30 16:03:56 +02:00
Ilan Steemers 477761a17f :docs: replaced some old redis references with brokers 2015-09-30 10:12:16 +02:00
Ilan Steemers 07a7851b54 v0.7.7 2015-09-29 22:59:40 +02:00
Ilan Steemers d478911160 v0.7.6 2015-09-29 18:33:18 +02:00
Ilan Steemers 76aab3d52a v0.7.6 2015-09-29 18:31:56 +02:00
Ilan Steemers 00236990af Merge pull request #80 from Koed00/dev 
#79  close django db connection before fork
 2015-09-29 11:20:59 +02:00
Ilan Steemers 1aed7c2d00 #79 close django db connection before fork 
The sentinel saves a statistic to the cache provider just before forking the workers. If this cache provider is a database backend, the connection stays open and gets forked and it crashes. Solution is to close any db connection before forking.
 2015-09-29 10:47:22 +02:00
Ilan Steemers ca79228b95 v0.7.5 2015-09-28 18:23:02 +02:00
Ilan Steemers a07cfbb2e1 Merge pull request #78 from Koed00/dev 
docs: mention Django 1.9a1 support
 2015-09-28 16:06:50 +02:00
Ilan Steemers bcad7614b3 docs: mention Django 1.9a1 support 2015-09-28 15:14:22 +02:00
Ilan Steemers f8fe7ca2c1 Merge pull request #77 from Koed00/dev 
Adds stale db connection check before every transaction
 2015-09-28 13:49:10 +02:00
Ilan Steemers 765c84301f #76 checks for stale connections always 
It turns out that checking stale connections on a timer takes between 1-2 times as long as just checking them always. This also has the benefit of catching timeouts that happen between timer loops.
 2015-09-28 12:48:11 +02:00
Ilan Steemers 7075a91d37 #76 adds connection checked with timeout 
Adds a check for old connections in both the workers and the monitor , every DB_TIMEOUT seconds
 2015-09-28 11:42:48 +02:00
Ilan Steemers 4ceee42be9 #76 resets stale db connection on every scheduler ping 2015-09-28 10:42:08 +02:00
Ilan Steemers 96543e4b75 Merge pull request #75 from Koed00/dev 
Adds MongoDB broker
 2015-09-26 18:12:57 +02:00
Ilan Steemers 08104ef777 check for default database on mongo connection 
correction
 2015-09-26 13:13:25 +02:00
Ilan Steemers b8bb186471 check for default database on mongo connection 2015-09-26 13:01:15 +02:00
Ilan Steemers 6c81840047 docs: updated management command example 2015-09-26 10:52:19 +02:00
Ilan Steemers 7847e3b560 docs: adds shell command example 2015-09-26 10:51:03 +02:00
Ilan Steemers 8bdbcdaf55 revert to info method 2015-09-25 21:27:33 +02:00
Ilan Steemers 1fd9ca2441 docs: mongodb broker 2015-09-25 20:57:47 +02:00
Ilan Steemers b5842827dd adds pymongo to requirements for testing 2015-09-25 20:10:30 +02:00
Ilan Steemers 863f6f1aa9 adds mongodb to travis 2015-09-25 20:05:56 +02:00
Ilan Steemers 826178c463 Adds a MongoDB broker 
* adds mongo broker tests
* adds mongo brokers docs

* broker info is now cached when it needs to connect to a server, to reduce traffic.
 2015-09-25 20:03:39 +02:00
Ilan Steemers ef6a60478a Merge pull request #74 from Koed00/dev 
Removes root imports for Django 1.9
 2015-09-25 12:35:10 +02:00
Ilan Steemers 3aa50bc503 brokers: updates boto3 for testing 2015-09-25 12:24:00 +02:00
Ilan Steemers b3381d6dae removes root imports for django 1.9 
typo in test
 2015-09-24 15:47:40 +02:00
Ilan Steemers cef48da789 removes root imports for django 1.9 
Updated docs to promote submodule imports
 2015-09-24 15:41:32 +02:00
Ilan Steemers dd8ea03a18 Merge pull request #73 from Koed00/gevent 
Removes pycharm stdin bug workaround
 2015-09-24 11:33:05 +02:00
Ilan Steemers 131a37daf3 Removes Pycharm stdin bug workaround 2015-09-24 11:21:50 +02:00
Ilan Steemers 985fbb31cc tests cluster stop when already stopped 2015-09-24 11:21:28 +02:00
Ilan Steemers 253202cb93 Merge pull request #72 from Koed00/dev 
adds compatibility section to docs
 2015-09-24 11:11:01 +02:00
Ilan Steemers 956e79a3a0 docs: compatibility 2015-09-22 18:46:39 +02:00
Ilan Steemers 04470c1a87 docs: compatibility 2015-09-22 18:22:08 +02:00
Ilan Steemers 5e80675492 Merge pull request #71 from Koed00/dev 
Only show lock count when available and greater than zero
 2015-09-19 17:31:51 +02:00
Ilan Steemers dc47ebef3c test for lock size in monitor 2015-09-19 17:25:02 +02:00
Ilan Steemers 7532cac93a test for lock_size in main class 2015-09-19 15:52:28 +02:00
Ilan Steemers 93a8f71157 Only show lock count when available and greater than zero 2015-09-19 15:42:35 +02:00
Ilan Steemers 000415a567 Merge pull request #70 from Koed00/dev 
Python 3.5 compatibility
 2015-09-19 15:41:46 +02:00
Ilan Steemers 54789a9597 Back to 3.4 for now 
Django 1.7.10 has a known bug with Python 3.5.
Will wait until compatible version is released.
Djang 1.8 tests are passing with 3.5
 2015-09-19 15:34:09 +02:00
Ilan Steemers 24d1e9d950 Updated pytest for python 3.5 
sticky keys
 2015-09-19 15:25:22 +02:00
Ilan Steemers c135975456 Updated pytest for python 3.5 
force upgrade on Travis
 2015-09-19 15:23:32 +02:00
Ilan Steemers 3a7e83f7b2 Updated pytest for python 3.5 2015-09-19 15:16:36 +02:00
Ilan Steemers 754fb1ad19 adds python 3.5 for testing 2015-09-19 15:09:19 +02:00
Ilan Steemers cfb53b48bb Merge pull request #69 from Koed00/dev 
docs: Replaced redis pooling with broker pooling example.
 2015-09-18 21:13:42 +02:00
Ilan Steemers 370ffd4061 docs: Replaced redis pooling with broker pooling example. 
* moves get_broker to main module
 2015-09-18 21:07:18 +02:00
Ilan Steemers 270d8dba88 v0.7.3 2015-09-18 20:02:19 +02:00
Ilan Steemers e60414d5b1 Merge pull request #68 from Koed00/dev 
Adds a wait option for results.
 2015-09-18 19:31:35 +02:00
Ilan Steemers 16c28a88e2 adds (approximate) lock_size to SQS broker 
docs: added lock_size
 2015-09-18 15:40:30 +02:00
Ilan Steemers 6af852fcee checks if broker has lock_size method 2015-09-18 15:23:31 +02:00
Ilan Steemers ce409a6f80 Updates boto3 for testing 2015-09-18 14:26:23 +02:00
Ilan Steemers 43d90da271 docs: typo 2015-09-18 11:03:41 +02:00
Ilan Steemers a493f9cc78 Adds wait option to result() and fetch() 2015-09-18 10:57:09 +02:00
Ilan Steemers a30e5d2c28 v0.7.2 2015-09-17 20:19:20 +02:00
Ilan Steemers 2b543635c1 Update README.rst 2015-09-17 20:02:45 +02:00
Ilan Steemers 0d335d2254 Merge pull request #67 from Koed00/dev 
orm: Improves locking behavior
 2015-09-17 19:07:29 +02:00
Ilan Steemers a6ad47b181 Adds lock count to monitor for orm broker 2015-09-17 18:55:29 +02:00
Ilan Steemers 1d12107524 Changed locking mechanism 
* all new tasks start as timeouts. This makes the queries a lot simpler.

* In BULK mode, the bulk update for the lock was causing actual database locks.  The lock updates are now iterated.
 2015-09-17 18:49:03 +02:00
Ilan Steemers 8ec07cd478 Merge pull request #66 from Koed00/dev 
tests orm queue admin overrides
 2015-09-17 17:08:48 +02:00
Ilan Steemers 3ecd47fc7b tests orm queue admin overrides 2015-09-17 16:54:41 +02:00
Ilan Steemers ef9079a256 Merge pull request #65 from Koed00/dev 
Adds remote orm admin view
 2015-09-17 16:13:33 +02:00
Ilan Steemers 6523501399 codecov badge 2015-09-17 16:07:15 +02:00
Ilan Steemers 1ec1598200 Adds remote orm queue to admin view 2015-09-17 14:50:19 +02:00
Ilan Steemers 4c5b6776fc codecov 2015-09-17 00:37:52 +02:00
Ilan Steemers 4d7416914c v0.7.1 2015-09-16 18:50:33 +02:00
Ilan Steemers 57169a7ab5 Merge pull request #64 from Koed00/dev 
Adds configuration output and other enhancements
 2015-09-16 18:15:32 +02:00
Ilan Steemers bd9f7da095 docs: qinfo --config 2015-09-16 18:03:08 +02:00
Ilan Steemers f7d30561a2 docs: group functions for task instances 
updated group example to reflect easier syntax.
 2015-09-16 17:01:23 +02:00
Ilan Steemers 061775b3bb Adds group commands to task instances 
* adds task.group_result()
* adds task.group_count()
* adds task.group_delete()
 2015-09-16 15:47:39 +02:00
Ilan Steemers c0aa2dd12e sqs: Updated botocore for tests 2015-09-16 12:13:48 +02:00
Ilan Steemers 1222285107 Adds --config option to qinfo command 
Outputs current configuration constants
 2015-09-15 21:39:38 +02:00
Ilan Steemers 548af6c4ad Tests no cache configuration 2015-09-15 20:29:09 +02:00
Ilan Steemers 7fb1142e4e Shares Sentinel broker with Monitor 2015-09-15 20:07:33 +02:00
Ilan Steemers 6a564639d4 docs: updates for broker changes 2015-09-15 17:41:41 +02:00
Ilan Steemers dbf0b20ba5 Fixes test for admin view 2015-09-15 17:14:08 +02:00
Ilan Steemers 5450e59119 Adds name, function and task id to orm queue admin 2015-09-15 16:49:22 +02:00
Ilan Steemers a060b3508a Moves bulk iteration to pusher 2015-09-15 14:45:06 +02:00
Ilan Steemers 9b7c76b9d3 Getting ready for v0.7.0 2015-09-14 17:10:46 +02:00
Ilan Steemers a9f73bf242 Merge branch 'orm' 2015-09-14 17:06:34 +02:00
Ilan Steemers ff5531aa99 Merge branch 'master' into orm 
# Conflicts:
#	docs/conf.py
 2015-09-14 16:57:28 +02:00
Ilan Steemers d67e6b9d10 docs: version 7 2015-09-14 16:49:31 +02:00
Ilan Steemers cefc7e0dc1 Adds test for orm queued task admin 2015-09-14 16:06:18 +02:00
Ilan Steemers 789f934208 docs: Django ORM broker 2015-09-14 15:38:16 +02:00
Ilan Steemers 2bffcf554b Django ORM broker 2015-09-14 13:24:43 +02:00
Ilan Steemers dfe1b10227 Merge pull request #62 from Koed00/orm 
Updated wcwidth
 2015-09-14 11:33:10 +02:00
Ilan Steemers 9b84bf9110 Updated wcwidth 2015-09-14 10:45:05 +02:00