fork/django-q2
1
0
Fork 0
mirror of https://github.com/django-q2/django-q2.git synced 2026-10-06 13:28:13 +08:00
Code Issues Packages Projects Releases Wiki Activity
352 Commits 9 Branches 31 Tags
f75593aebbeb307dfdce2ff85991f2b30e421427
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ilan Steemers f75593aebb Moves unpacking task from Worker to Pusher. 
Makes more sense and gives us more options to work with control queues from the pusher in the future. Does not seem to affect performance.
 2015-07-31 12:29:10 +02:00
Ilan a13b959bfb Merge remote-tracking branch 'origin/dev' into dev 2015-07-27 12:31:47 +02:00
Ilan ba58b4face closes db connection on worker and monitor spawn 
This should prevent some problems with Postgresql where the workers would use stale db connections  and cause errors.
 2015-07-27 12:31:38 +02:00
Ilan 82bd93d67f docstring linting 2015-07-27 10:45:43 +02:00
Ilan 25b4b03544 Updated future==0.15.0 2015-07-27 10:45:43 +02:00
Ilan 38829f25c2 adds group filter to admin 2015-07-27 10:45:43 +02:00
Ilan Steemers c350ea13f1 monitor TQ will indicate green when queue_limit has been reached. 2015-07-27 10:45:43 +02:00
Ilan 0919d546ab docstring linting 2015-07-25 17:01:06 +02:00
Ilan cb4555d9eb Updated future==0.15.0 2015-07-25 16:58:48 +02:00
Ilan ac41d50bf2 adds group filter to admin 2015-07-24 20:47:35 +02:00
Ilan Steemers 421eecd0ea monitor TQ will indicate green when queue_limit has been reached. 2015-07-24 14:57:33 +02:00
Ilan 266a0dbcb1 minor linting 2015-07-24 13:36:51 +02:00
Ilan 3d58e3e3eb docs: typo 2015-07-24 12:25:49 +02:00
Ilan f77aa54f26 version 0.4.3 2015-07-24 12:22:24 +02:00
Ilan Steemers 510ef6ea30 Merge pull request #32 from Koed00/dev 
Adds queue limit and encryption salt
 2015-07-24 02:55:27 -07:00
Ilan a44fc66682 docs: added queue_limit information 2015-07-24 11:28:52 +02:00
Ilan 0e7a5c4afb docs: added queue_limit information 2015-07-24 11:13:58 +02:00
Ilan cf325f8199 queue block is true by default. 2015-07-24 10:52:30 +02:00
Ilan d31e9e2b97 adds a limit to the queue 2015-07-24 01:04:58 +02:00
Ilan 805d160bbe use PREFIX as salt 
Updated docs for this
 2015-07-24 00:38:51 +02:00
Ilan ac3d0d2161 use PREFIX as salt 2015-07-24 00:26:40 +02:00
Ilan Steemers f15bc42eb1 Merge pull request #31 from Koed00/dev 
adds Haystack example
 2015-07-23 06:00:36 -07:00
Ilan f8c9ef1bfa adds short delay in test 
On some platforms the cluster is not always ready in time for test assertion
 2015-07-23 14:57:00 +02:00
Ilan 6ca899cdfc adds Haystack example 2015-07-23 14:41:56 +02:00
Ilan 2e3e86b0fc new release 0.4.2 2015-07-22 17:30:37 +02:00
Ilan Steemers 73c8e13616 Merge pull request #30 from Koed00/dev 
Minor linting and fixes
 2015-07-22 08:23:49 -07:00
Ilan a8b562bc04 some minor linting 2015-07-22 17:13:29 +02:00
Ilan 1a24bb60dd removed old import 2015-07-22 17:03:49 +02:00
Ilan Steemers bbdeac5757 Merge pull request #29 from Koed00/dev 
timeout fix
 2015-07-22 05:47:28 -07:00
Ilan Steemers a26ffbf03b tuning timeout 2015-07-22 14:25:32 +02:00
Ilan f6cbd9817a fix for timeout 2015-07-22 13:11:52 +02:00
Ilan 4b4c64b7dd requirement should not list django 2015-07-22 09:21:25 +02:00
Ilan 0d1f106470 docs: adds 'save' option to function references 2015-07-21 14:23:57 +02:00
Ilan 4ceff55b43 bumping to v0.4.1 2015-07-21 13:02:42 +02:00
Ilan Steemers 9e331740cd Merge pull request #27 from Koed00/dev 
Adds `save` override options for tasks
 2015-07-21 03:55:57 -07:00
Ilan ad3a76be4f removed old manifest entry 2015-07-21 12:49:10 +02:00
Ilan dca0c89950 using pip-sync for requirement now. 2015-07-21 11:40:34 +02:00
Ilan 9f90b69fbe docs version 0.4.1 2015-07-21 11:23:16 +02:00
Ilan 41970ef2fe docs: some formatting updates and minor fixes 2015-07-21 10:50:10 +02:00
Ilan 3ce0048606 adds Stat to root module 2015-07-21 09:50:58 +02:00
Ilan a25ac7da57 docs: added info about the save override keyword 
docs: added explanation of the `q_options` dict
 2015-07-20 21:02:57 +02:00
Ilan c5b8b800f6 Adds save override option for tasks 
Also adds `q_options` dict for async and schedule options
 2015-07-20 19:43:27 +02:00
Ilan Steemers 61b859b046 Merge pull request #26 from Koed00/dev 
Expanding coverage
 2015-07-20 03:53:37 -07:00
Ilan 5fd436021f Expanding coverage 2015-07-20 12:17:12 +02:00
Ilan 7999e0168a docs: small updates to cluster and installation 2015-07-19 20:27:01 +02:00
Ilan 9acf50becb Updated README 
added groups
 2015-07-19 17:38:28 +02:00
Ilan 8200e45bd6 Getting ready for 0.4.0 2015-07-19 16:25:06 +02:00
Ilan Steemers dee0f86b93 Merge pull request #25 from Koed00/dev 
Added a group example
 2015-07-19 07:21:31 -07:00
Ilan 7a57253345 Added a group example 2015-07-19 15:55:58 +02:00
Ilan Steemers 6541eb6ba7 Merge pull request #24 from Koed00/dev 
Adds failure filtering to group functions
 2015-07-19 06:26:45 -07:00
Ilan d7ecaee18d Added tests for failures filtering 
fixed a bug
 2015-07-19 15:21:06 +02:00
Ilan 52e72fde1c Adds failed tasks filtering to groups 2015-07-19 15:15:57 +02:00
Ilan 72f913ab97 switching hook to post_save 
This might delay a hook slightly, but it makes more sense if you want to perform hook actions on groups since Pre_save the latest member of the group won't be available yet.
 2015-07-19 14:29:40 +02:00
Ilan Steemers 80eddae1e4 Merge pull request #23 from Koed00/dev 
Adds count_group() and delete_group()
 2015-07-19 05:23:48 -07:00
Ilan e75fbecda8 fixed typo and added group tests 2015-07-19 13:56:16 +02:00
Ilan ff102630f7 adds count_group() and delete_group() 2015-07-19 13:19:46 +02:00
Ilan Steemers e22203d857 Merge pull request #22 from Koed00/dev 
decoding values_list on a picklefield is faster
 2015-07-19 03:29:37 -07:00
Ilan 9f9c94c983 decoding values_list on a picklefield turns out to be 10 times faster than using list_comprehension 2015-07-19 12:26:10 +02:00
Ilan Steemers 9fbfc06878 Merge pull request #21 from Koed00/dev 
Adds task groups
 2015-07-19 02:42:41 -07:00
Ilan f65c05624d Schedule name and task group should have same max length 2015-07-18 22:32:32 +02:00
Ilan 58a671fb45 docs: added a fetch_group example 2015-07-18 20:50:16 +02:00
Ilan e4737d765a Schedule name is optional 
For backwards compatibility the schedule name is an optional keyword in the `schedule` function.

Adjusted docs accordingly
 2015-07-18 19:41:21 +02:00
Ilan 05d6ecb7a2 renamed get_group_result to get_result_group 
I think I fumbled a commit
 2015-07-18 18:55:47 +02:00
Ilan e1d483e1c1 docs: describes the new group options 2015-07-18 18:50:14 +02:00
Ilan a5d4c5186c renamed get_group_result to get_result_group 2015-07-18 18:49:50 +02:00
Ilan c127604f10 Adds task groups 
* task now takes an optional keyword `group`
* added result_group()  and fetch_group()
* added group column to Success admin
* group column in searchable
* added `name` field to Schedules
* Scheduled tasks take schedule name as group
 2015-07-18 17:20:50 +02:00
Ilan Steemers 05c8f3bc16 Merge pull request #20 from Koed00/dev 
Tests now run with logging level debug
 2015-07-17 05:28:59 -07:00
Ilan 688d25c76d Getting ready for v0.3.6 2015-07-17 14:27:45 +02:00
Ilan 84ac19b6a9 Updated README 
added some documentation links
 2015-07-17 14:26:39 +02:00
Ilan c12884cc44 Updated gitignore with .idea and djq 2015-07-17 14:20:50 +02:00
Ilan b876b1e06d Tests now run with logging level DEBUG 2015-07-17 14:17:40 +02:00
Ilan Steemers b58f5038db Merge pull request #19 from Koed00/docs 
docs: small edits
 2015-07-16 22:09:40 +02:00
Ilan Steemers 1e7b3f6ce0 Merge pull request #18 from Koed00/dev 
Adds a `timeout` override per task
 2015-07-16 21:57:47 +02:00
Ilan 40ac0bfce5 Minor updates to timeout docs 2015-07-16 21:01:27 +02:00
Ilan af5e99249f Paste accidents happen 2015-07-16 20:47:14 +02:00
Ilan af735c328e Adds a timeout override per task 
* added a `timeout` keyword to tasks.
* timeouts now count down instead of up
* `timeout` in task overrides global timeout setting
* added tests for timeout override
* added a test for recycling
 2015-07-16 20:35:29 +02:00
Ilan c0ea483784 docs: small edits 2015-07-16 18:32:45 +02:00
Ilan Steemers afda141ed1 Merge pull request #17 from Koed00/dev 
Adds management commands to the tests
 2015-07-16 18:22:10 +02:00
Ilan 91520e9ca7 removes some unused test code 2015-07-16 17:26:08 +02:00
Ilan 0dbeccdfda Optparse needs named arguments in call_command 2015-07-16 16:11:32 +02:00
Ilan 80887ffd9c Django 1.7 doesn't like argparse for management commands. 
Changed to optparse for compatibility
 2015-07-16 15:54:38 +02:00
Ilan Steemers 3cd3a12b16 Merge pull request #16 from Koed00/docs 
Docs: Added a report example
 2015-07-16 15:20:32 +02:00
Ilan 5a3f875baa Added management commands to tests 
* added --run-once option to the management commands for testing
 2015-07-16 15:17:15 +02:00
Ilan 218b6a9795 removed unused import 2015-07-16 14:36:36 +02:00
Ilan 6826e75a37 docs: Added a report example 
Also added  a test based on the example.
 2015-07-16 14:03:07 +02:00
Ilan 28d57cb03b docs: minor changed before release 2015-07-15 23:42:02 +02:00
Ilan b26a2d2950 getting ready for new version 2015-07-15 23:18:13 +02:00
Ilan 4a7feb8e50 getting ready for new version 2015-07-15 23:14:37 +02:00
Ilan Steemers 5b63b2d52c Merge pull request #15 from Koed00/dev 
Adds cpu affinity to workers
 2015-07-15 23:04:35 +02:00
Ilan 1e81cc413d Missing newline 2015-07-15 22:50:53 +02:00
Ilan 9857f33e3e Workaround for Travis 
fixed typo
 2015-07-15 22:34:40 +02:00
Ilan a5580c75a1 Workaround for Travis 
Travis doesn't support cpu affinity in their virtuals so I've added a setting TESTING that will bypass the actual affinity setting, but will still cover most of the code.
Might be useful for future workarounds.
 2015-07-15 22:17:13 +02:00
Ilan 464255fa88 Changed cpu affinity docs slightly 2015-07-15 22:06:17 +02:00
Ilan 1f28bf1c68 Travis doesn't like cpu affinity. I'm guessing 2015-07-15 20:15:46 +02:00
Ilan 2bef73c22f Tweaked cpu affinity docs 2015-07-15 20:01:55 +02:00
Ilan 2d0820e80b Adds cpu affinity for the workers. Courtesy of the optional psutil module. 2015-07-15 19:53:13 +02:00
Ilan Steemers 507ccf7e11 Merge pull request #14 from Koed00/dev 
Clean up redis key after test
 2015-07-15 13:05:33 +02:00
Ilan e5708a1ab2 Clean up redis after test 2015-07-15 12:45:11 +02:00
Ilan d92f71c470 docs: changed header 2015-07-15 09:33:54 +02:00
Ilan a37d721fa3 docs: wording 2015-07-13 18:01:55 +02:00