Commit Graph
100 Commits
Author SHA1 Message Date
Ilan 964d01c7c6 Updated monitor readme 2015-07-27 19:25:16 +02:00
Ilan c244075195 Bumping to 0.4.4 2015-07-27 18:08:32 +02:00
Ilan Steemers f327563985 Merge pull request #35 from Koed00/dev
closes old db connections on monitor and worker spawn
2015-07-27 09:07:03 -07:00
Ilan a13b959bfb Merge remote-tracking branch 'origin/dev' into dev 2015-07-27 12:31:47 +02:00
Ilan ba58b4face closes db connection on worker and monitor spawn
This should prevent some problems with Postgresql where the workers would use stale db connections  and cause errors.
2015-07-27 12:31:38 +02:00
Ilan 82bd93d67f docstring linting 2015-07-27 10:45:43 +02:00
Ilan 25b4b03544 Updated future==0.15.0 2015-07-27 10:45:43 +02:00
Ilan 38829f25c2 adds group filter to admin 2015-07-27 10:45:43 +02:00
Ilan Steemers c350ea13f1 monitor TQ will indicate green when queue_limit has been reached. 2015-07-27 10:45:43 +02:00
Ilan Steemers 876be415a0 Merge pull request #34 from Koed00/dev
Updated to future 0.15.0
2015-07-26 06:47:47 -07:00
Ilan 0919d546ab docstring linting 2015-07-25 17:01:06 +02:00
Ilan cb4555d9eb Updated future==0.15.0 2015-07-25 16:58:48 +02:00
Ilan Steemers d72d90b1f0 Merge pull request #33 from Koed00/dev
Group filter and queue limit indicator
2015-07-24 11:55:03 -07:00
Ilan ac41d50bf2 adds group filter to admin 2015-07-24 20:47:35 +02:00
Ilan Steemers 421eecd0ea monitor TQ will indicate green when queue_limit has been reached. 2015-07-24 14:57:33 +02:00
Ilan 266a0dbcb1 minor linting 2015-07-24 13:36:51 +02:00
Ilan 3d58e3e3eb docs: typo 2015-07-24 12:25:49 +02:00
Ilan f77aa54f26 version 0.4.3 2015-07-24 12:22:24 +02:00
Ilan Steemers 510ef6ea30 Merge pull request #32 from Koed00/dev
Adds queue limit and encryption salt
2015-07-24 02:55:27 -07:00
Ilan a44fc66682 docs: added queue_limit information 2015-07-24 11:28:52 +02:00
Ilan 0e7a5c4afb docs: added queue_limit information 2015-07-24 11:13:58 +02:00
Ilan cf325f8199 queue block is true by default. 2015-07-24 10:52:30 +02:00
Ilan d31e9e2b97 adds a limit to the queue 2015-07-24 01:04:58 +02:00
Ilan 805d160bbe use PREFIX as salt
Updated docs for this
2015-07-24 00:38:51 +02:00
Ilan ac3d0d2161 use PREFIX as salt 2015-07-24 00:26:40 +02:00
Ilan Steemers f15bc42eb1 Merge pull request #31 from Koed00/dev
adds Haystack example
2015-07-23 06:00:36 -07:00
Ilan f8c9ef1bfa adds short delay in test
On some platforms the cluster is not always ready in time for test assertion
2015-07-23 14:57:00 +02:00
Ilan 6ca899cdfc adds Haystack example 2015-07-23 14:41:56 +02:00
Ilan 2e3e86b0fc new release 0.4.2 2015-07-22 17:30:37 +02:00
Ilan Steemers 73c8e13616 Merge pull request #30 from Koed00/dev
Minor linting and fixes
2015-07-22 08:23:49 -07:00
Ilan a8b562bc04 some minor linting 2015-07-22 17:13:29 +02:00
Ilan 1a24bb60dd removed old import 2015-07-22 17:03:49 +02:00
Ilan Steemers bbdeac5757 Merge pull request #29 from Koed00/dev
timeout fix
2015-07-22 05:47:28 -07:00
Ilan Steemers a26ffbf03b tuning timeout 2015-07-22 14:25:32 +02:00
Ilan f6cbd9817a fix for timeout 2015-07-22 13:11:52 +02:00
Ilan 4b4c64b7dd requirement should not list django 2015-07-22 09:21:25 +02:00
Ilan 0d1f106470 docs: adds 'save' option to function references 2015-07-21 14:23:57 +02:00
Ilan 4ceff55b43 bumping to v0.4.1 2015-07-21 13:02:42 +02:00
Ilan Steemers 9e331740cd Merge pull request #27 from Koed00/dev
Adds `save` override options for tasks
2015-07-21 03:55:57 -07:00
Ilan ad3a76be4f removed old manifest entry 2015-07-21 12:49:10 +02:00
Ilan dca0c89950 using pip-sync for requirement now. 2015-07-21 11:40:34 +02:00
Ilan 9f90b69fbe docs version 0.4.1 2015-07-21 11:23:16 +02:00
Ilan 41970ef2fe docs: some formatting updates and minor fixes 2015-07-21 10:50:10 +02:00
Ilan 3ce0048606 adds Stat to root module 2015-07-21 09:50:58 +02:00
Ilan a25ac7da57 docs: added info about the save override keyword
docs: added explanation of the `q_options` dict
2015-07-20 21:02:57 +02:00
Ilan c5b8b800f6 Adds save override option for tasks
Also adds `q_options` dict for async and schedule options
2015-07-20 19:43:27 +02:00
Ilan Steemers 61b859b046 Merge pull request #26 from Koed00/dev
Expanding coverage
2015-07-20 03:53:37 -07:00
Ilan 5fd436021f Expanding coverage 2015-07-20 12:17:12 +02:00
Ilan 7999e0168a docs: small updates to cluster and installation 2015-07-19 20:27:01 +02:00
Ilan 9acf50becb Updated README
added groups
2015-07-19 17:38:28 +02:00
Ilan 8200e45bd6 Getting ready for 0.4.0 2015-07-19 16:25:06 +02:00
Ilan Steemers dee0f86b93 Merge pull request #25 from Koed00/dev
Added a group example
2015-07-19 07:21:31 -07:00
Ilan 7a57253345 Added a group example 2015-07-19 15:55:58 +02:00
Ilan Steemers 6541eb6ba7 Merge pull request #24 from Koed00/dev
Adds failure filtering to group functions
2015-07-19 06:26:45 -07:00
Ilan d7ecaee18d Added tests for failures filtering
fixed a bug
2015-07-19 15:21:06 +02:00
Ilan 52e72fde1c Adds failed tasks filtering to groups 2015-07-19 15:15:57 +02:00
Ilan 72f913ab97 switching hook to post_save
This might delay a hook slightly, but it makes more sense if you want to perform hook actions on groups since Pre_save the latest member of the group won't be available yet.
2015-07-19 14:29:40 +02:00
Ilan Steemers 80eddae1e4 Merge pull request #23 from Koed00/dev
Adds count_group() and delete_group()
2015-07-19 05:23:48 -07:00
Ilan e75fbecda8 fixed typo and added group tests 2015-07-19 13:56:16 +02:00
Ilan ff102630f7 adds count_group() and delete_group() 2015-07-19 13:19:46 +02:00
Ilan Steemers e22203d857 Merge pull request #22 from Koed00/dev
decoding values_list on a picklefield is faster
2015-07-19 03:29:37 -07:00
Ilan 9f9c94c983 decoding values_list on a picklefield turns out to be 10 times faster than using list_comprehension 2015-07-19 12:26:10 +02:00
Ilan Steemers 9fbfc06878 Merge pull request #21 from Koed00/dev
Adds task groups
2015-07-19 02:42:41 -07:00
Ilan f65c05624d Schedule name and task group should have same max length 2015-07-18 22:32:32 +02:00
Ilan 58a671fb45 docs: added a fetch_group example 2015-07-18 20:50:16 +02:00
Ilan e4737d765a Schedule name is optional
For backwards compatibility the schedule name is an optional keyword in the `schedule` function.

Adjusted docs accordingly
2015-07-18 19:41:21 +02:00
Ilan 05d6ecb7a2 renamed get_group_result to get_result_group
I think I fumbled a commit
2015-07-18 18:55:47 +02:00
Ilan e1d483e1c1 docs: describes the new group options 2015-07-18 18:50:14 +02:00
Ilan a5d4c5186c renamed get_group_result to get_result_group 2015-07-18 18:49:50 +02:00
Ilan c127604f10 Adds task groups
* task now takes an optional keyword `group`
* added result_group()  and fetch_group()
* added group column to Success admin
* group column in searchable
* added `name` field to Schedules
* Scheduled tasks take schedule name as group
2015-07-18 17:20:50 +02:00
Ilan Steemers 05c8f3bc16 Merge pull request #20 from Koed00/dev
Tests now run with logging level debug
2015-07-17 05:28:59 -07:00
Ilan 688d25c76d Getting ready for v0.3.6 2015-07-17 14:27:45 +02:00
Ilan 84ac19b6a9 Updated README
added some documentation links
2015-07-17 14:26:39 +02:00
Ilan c12884cc44 Updated gitignore with .idea and djq 2015-07-17 14:20:50 +02:00
Ilan b876b1e06d Tests now run with logging level DEBUG 2015-07-17 14:17:40 +02:00
Ilan Steemers b58f5038db Merge pull request #19 from Koed00/docs
docs: small edits
2015-07-16 22:09:40 +02:00
Ilan Steemers 1e7b3f6ce0 Merge pull request #18 from Koed00/dev
Adds a `timeout` override per task
2015-07-16 21:57:47 +02:00
Ilan 40ac0bfce5 Minor updates to timeout docs 2015-07-16 21:01:27 +02:00
Ilan af5e99249f Paste accidents happen 2015-07-16 20:47:14 +02:00
Ilan af735c328e Adds a timeout override per task
* added a `timeout` keyword to tasks.
* timeouts now count down instead of up
* `timeout` in task overrides global timeout setting
* added tests for timeout override
* added a test for recycling
2015-07-16 20:35:29 +02:00
Ilan c0ea483784 docs: small edits 2015-07-16 18:32:45 +02:00
Ilan Steemers afda141ed1 Merge pull request #17 from Koed00/dev
Adds management commands to the tests
2015-07-16 18:22:10 +02:00
Ilan 91520e9ca7 removes some unused test code 2015-07-16 17:26:08 +02:00
Ilan 0dbeccdfda Optparse needs named arguments in call_command 2015-07-16 16:11:32 +02:00
Ilan 80887ffd9c Django 1.7 doesn't like argparse for management commands.
Changed to optparse for compatibility
2015-07-16 15:54:38 +02:00
Ilan Steemers 3cd3a12b16 Merge pull request #16 from Koed00/docs
Docs: Added a report example
2015-07-16 15:20:32 +02:00
Ilan 5a3f875baa Added management commands to tests
* added --run-once option to the management commands for testing
2015-07-16 15:17:15 +02:00
Ilan 218b6a9795 removed unused import 2015-07-16 14:36:36 +02:00
Ilan 6826e75a37 docs: Added a report example
Also added  a test based on the example.
2015-07-16 14:03:07 +02:00
Ilan 28d57cb03b docs: minor changed before release 2015-07-15 23:42:02 +02:00
Ilan b26a2d2950 getting ready for new version 2015-07-15 23:18:13 +02:00
Ilan 4a7feb8e50 getting ready for new version 2015-07-15 23:14:37 +02:00
Ilan Steemers 5b63b2d52c Merge pull request #15 from Koed00/dev
Adds cpu affinity to workers
2015-07-15 23:04:35 +02:00
Ilan 1e81cc413d Missing newline 2015-07-15 22:50:53 +02:00
Ilan 9857f33e3e Workaround for Travis
fixed typo
2015-07-15 22:34:40 +02:00
Ilan a5580c75a1 Workaround for Travis
Travis doesn't support cpu affinity in their virtuals so I've added a setting TESTING that will bypass the actual affinity setting, but will still cover most of the code.
Might be useful for future workarounds.
2015-07-15 22:17:13 +02:00
Ilan 464255fa88 Changed cpu affinity docs slightly 2015-07-15 22:06:17 +02:00
Ilan 1f28bf1c68 Travis doesn't like cpu affinity. I'm guessing 2015-07-15 20:15:46 +02:00
Ilan 2bef73c22f Tweaked cpu affinity docs 2015-07-15 20:01:55 +02:00
Ilan 2d0820e80b Adds cpu affinity for the workers. Courtesy of the optional psutil module. 2015-07-15 19:53:13 +02:00