Commit Graph
595 Commits
Author SHA1 Message Date
Gouri JavedandJaved Gouri e205674d31 added long polling support (#506)
* added long pooling support for  sqs broker

* changed the parameter name

* added long polling support ,

introduce new parameter in broker sqs block
parameter for long polling is receive_message_wait_time_seconds

eg :
Q_CLUSTER = {
      'name': 'test-queue',
      'sqs': {
         'aws_region': AWS_S3_REGION_NAME,
         'aws_access_key_id': AWS_ACCESS_KEY_ID,
         'aws_secret_access_key': AWS_SECRET_ACCESS_KEY,
         'receive_message_wait_time_seconds':20
     }
}

* added receive_message_wait_time_seconds parameter in test_broker.py

Co-authored-by: Javed Gouri <you@example.com>
2021-03-21 12:04:16 +01:00
weiyang 1869a94118 Use 'timezone.localtime()' when calculating the next run time (#520)
Signed-off-by: weiyang <weiyang.ones@gmail.com>
2021-03-21 12:02:22 +01:00
Ilan Steemers ef3cffb738 Getting ready for 1.3.5 2021-02-26 14:12:24 +01:00
RubenandIlan Steemers 7892aef70a Add a warning for misconfiguration. (#509)
* Add a warning  for misconfiguration.

As specified in the docs, by default the settings result in a configuration where slow tasks that run for more than 60s cause repeated running of tasks, which has caused a few issues. This warning doesn't change the defaults, which would be a marge larger change, but instead provides a, hopefully, helpful message to the user.

* fixed missing bracket

* Update conf.py

fixed spelling

* Update conf.py

Made bool work for python 3.6+

* Fixing typo

Co-authored-by: Ilan Steemers <koed00@gmail.com>
2021-02-26 13:54:56 +01:00
Ilan Steemers 7d03536e89 Migrate to Github Action CI (#507)
* Some small refactors

* Initial test script

* Fixes django matrix

* Trying to set up Disque

* Disque as a docker service

* lowercase action name

* Remove Travis

* Replaces Travis badge with Github actions badge

* Show django version in step

* Typo
2021-02-14 18:59:04 +01:00
Telmo Barros 1d6d996fd0 enhanced admin ormq panel fix and schedules with broker_name 2021-02-06 18:52:17 +00:00
Telmo Barros 10df8351ff Queued tasks admin list page enhancement 2021-02-06 17:56:03 +00:00
Jonas Winkler 11744bf33c Added german translation 2021-01-15 15:54:47 +01:00
Ilan Steemers 552af9db8c Getting read for 1.3.4 2020-10-26 10:59:13 +01:00
Ilan Steemers 6184a1c662 Merge pull request #478 from fallenhitokiri/sqs-get-queue-before-create
try to get SQS queue before creating it
2020-10-20 14:05:31 +02:00
Ilan Steemers 87390509ef Merge pull request #477 from fallenhitokiri/fix-get-broker-sqs
empty dictionary as configuration value for SQS
2020-10-20 14:04:30 +02:00
Ilan Steemers d97e7d772f Merge pull request #479 from alx-sdv/bugs/model-str
Model.__unicode__() has no effect in Python 3.X
2020-10-20 14:01:40 +02:00
Ilan Steemers 6886c8612b Merge pull request #483 from Djailla/warning
Fix deprecation warning RemovedInDjango40Warning
2020-10-20 14:00:47 +02:00
Bastien Vallet 3144d0c80a Fix deprecation warning RemovedInDjango40Warning
RemovedInDjango40Warning: The providing_args argument is deprecated. As it is purely documentational, it has no replacement. If you rely on this argument as documentation, you can move the text to a code comment or docstring.
2020-10-19 12:12:37 +02:00
ihuk 5076367168 More work on fix for #424 - TypeError: can't pickle _thread.lock objects.
AWS and Mongo brockers should be pickeled correctly now.
2020-10-16 18:40:26 +02:00
ihuk 8b3d6b7d2a Initial work on fix for #424 - TypeError: can't pickle _thread.lock objects.
Made `Broker` and `Queue` classes pickable which fixes the the problem with new default `spawn` proces start method.
2020-10-14 22:21:40 +02:00
Daniel Trembath 3e8fc91d46 Change Django documentation URLs from v1.8 to v2.2
URLs were linking to a now unsupported version of Django. Django v2.2 is a LTS version, and also matches the documentation intersphinx_mapping in docs/conf.py.
2020-10-07 17:56:23 +11:00
alx-sdv 28197dc4fa Model.__unicode__() has no effect 2020-10-05 12:30:11 +03:00
Timo Zimmermann 9be4da76c1 try to get SQS queue before creating it
In some environments permissions for an IAM role or access key might not include "SQS create".
The broker should first try to get the queue and if this fails try to create it as fall back to the current default behaviour.
2020-09-22 15:58:06 +02:00
Timo Zimmermann 73ca8edcf5 empty dictionary as configuration value for SQS
The [documentation](https://django-q.readthedocs.io/en/latest/configure.html#sqs-configuration) lists all keys as optional, but the way `get_broker` is implemented it will evaluate to false and return Redis. One way around this would be checking if the type of `Conf.SQS` is `dict`.
2020-09-22 15:42:38 +02:00
Ilan Steemers aba36e2884 Getting ready for 1.3.3 2020-08-16 18:47:55 +02:00
Tim O'Meara 655f0aadb5 rename config var to max_retries, remove attempt_count form admin , add admin ui customization to docs 2020-08-13 11:58:00 -05:00
Tim O'Meara 991cca5844 Revert "version bump"
This reverts commit 3b2f444738.
2020-08-11 17:32:48 -05:00
Tim O'Meara 3b2f444738 version bump 2020-08-11 17:32:08 -05:00
Tim O'Meara f26de929d6 adds tests 2020-08-11 11:48:23 -05:00
Tim O'Meara d5a0363af3 add attempt_count to admin 2020-08-11 10:48:46 -05:00
Tim O'Meara 45b0b2cc27 add attempt_count to config docs, set value to 1 in inital task save 2020-08-11 10:42:28 -05:00
Tim O'Meara 3c3395f24b add attempt_count to task 2020-08-11 10:16:31 -05:00
Ilan Steemers e384e0dfb8 Getting ready for 1.3.2 2020-07-08 23:02:08 +02:00
Ilan Steemers 0095a93b45 Adds max rss test 2020-07-08 22:52:07 +02:00
Ilan Steemers 572f810651 Adds max rss test 2020-07-08 22:47:35 +02:00
Ilan Steemers c94f2cb816 Adds psutil support for max_rss on other platforms 2020-07-05 18:18:43 +02:00
Ilan Steemers b16878f36f Allow for platforms not supporting resource module 2020-07-05 17:45:07 +02:00
Ilan Steemers 83b8b7c0d7 Adds max_rss memory limit for recycle 2020-07-05 17:04:16 +02:00
Ilan Steemers 05a5d1f008 Getting ready for 1.3.1 2020-07-02 18:11:58 +02:00
Ilan Steemers d3ac0563f4 Adds validator migration 2020-07-02 18:09:01 +02:00
Ilan Steemers 6e4c32ca9d Getting ready for 1.3.0 2020-07-02 13:28:18 +02:00
Ilan Steemers f223cfcb30 Removing value check 2020-07-01 14:25:51 +02:00
Ilan Steemers 532199fff3 Trigger cron validation 2020-07-01 14:18:04 +02:00
Ilan Steemers e6f82c5158 test model unicode 2020-06-30 22:00:31 +02:00
Ilan Steemers b17fd24682 Test for no nodes config 2020-06-30 21:35:57 +02:00
Ilan Steemers d46d08e94e Adds qinfo ids check 2020-06-30 21:19:15 +02:00
Ilan Steemers dda0c3c44d Test get_ids 2020-06-30 20:56:11 +02:00
Ilan Steemers f0061dccd6 Moves optional import to root 2020-06-29 19:08:33 +02:00
Ilan Steemers 34293cfcad Test cron validator 2020-06-29 19:08:08 +02:00
Ilan Steemers 5fe5b5fe37 Adds cron kwarg 2020-06-29 11:38:50 +02:00
Ilan Steemers a02ded0ade Get correct type name 2020-06-28 20:24:22 +02:00
Ilan Steemers a57f7e3f89 Check for nodes 2020-06-28 20:23:56 +02:00
Ilan Steemers 5bf2cd49eb Fixes deprecation 2020-06-28 20:23:46 +02:00
Ilan Steemers 5509fbb496 Fixes test for cron 2020-06-28 19:58:03 +02:00