Commit Graph
56 Commits
Author SHA1 Message Date
Ilan Steemers 15155c7a99 Build improvements (#569)
* Black linting

* Adding Black to dev dependencies and upping minimal python to 3.6.2 for compatibility

* Updating packages

* Removing pip-tools input and exporting requirements with poetry

* Deleting old setup files and test runner

* Trying 1.3.7

* Looser extras requirements to prevent conflicts

* Sorted imports with isort

* Added iSort to dev dependencies

* Fixes localtime for naive setups
2021-05-30 17:10:07 +02:00
Gouri JavedandJaved Gouri e205674d31 added long polling support (#506)
* added long pooling support for  sqs broker

* changed the parameter name

* added long polling support ,

introduce new parameter in broker sqs block
parameter for long polling is receive_message_wait_time_seconds

eg :
Q_CLUSTER = {
      'name': 'test-queue',
      'sqs': {
         'aws_region': AWS_S3_REGION_NAME,
         'aws_access_key_id': AWS_ACCESS_KEY_ID,
         'aws_secret_access_key': AWS_SECRET_ACCESS_KEY,
         'receive_message_wait_time_seconds':20
     }
}

* added receive_message_wait_time_seconds parameter in test_broker.py

Co-authored-by: Javed Gouri <you@example.com>
2021-03-21 12:04:16 +01:00
Ilan Steemers 7d03536e89 Migrate to Github Action CI (#507)
* Some small refactors

* Initial test script

* Fixes django matrix

* Trying to set up Disque

* Disque as a docker service

* lowercase action name

* Remove Travis

* Replaces Travis badge with Github actions badge

* Show django version in step

* Typo
2021-02-14 18:59:04 +01:00
Ilan Steemers b17fd24682 Test for no nodes config 2020-06-30 21:35:57 +02:00
valentinogagliardi c12e6184eb add test for Redis URL 2020-01-12 20:10:06 +01:00
Ilan Steemers 7d5c9f8b46 removes xrange compat 2018-08-05 13:39:04 +02:00
Ilan Steemers acebdaa850 Renames async/enqueue to async_task. 2018-08-01 15:20:34 +02:00
Benjamin Bach 5ea55e3718 Import python3 version of range 2017-07-09 21:44:25 +02:00
ilan 79c4b5bb7e removing sqs tests 2017-04-05 13:43:10 +03:00
ilan f057ca94ca Skip SQS test for now 2017-04-05 13:31:30 +03:00
ilan 7c28b16adb Skip SQS test for now 2017-04-05 13:24:03 +03:00
ilan eae1bcf283 Checks if SQS is retrying in time 2017-04-05 13:12:17 +03:00
ilan 8c6058003f removes false assert for now 2017-04-05 13:03:55 +03:00
ilan 1983a523fc Pause on dequeue for sqs 2017-04-05 12:56:40 +03:00
Harm Geerts cf37efb1eb Replace global Conf mangling with monkeypatch
The test suite, especially for the brokers, was heavily dependant on the
success of the tests preceeding it to pass. This commit should eliminate
that dependency and allow tests to fail without affecting others.
It also removes the need to cleanup globals manually after a test.
2016-11-29 18:08:52 +01:00
Ilan Steemers c17468ef86 docs: Adds Custom broker class documentation
Also changes some of the variable and settings names, to make them less ambiguous.
2016-01-27 12:06:49 +01:00
Ilan Steemers b1b4a33c51 Fixes typo 2016-01-27 10:40:45 +01:00
Ilan Steemers d2d00e4f94 Adds test for custom broker configuration 2016-01-27 10:33:19 +01:00
Ilan Steemers edb0ffbed3 Retry test is broken 2016-01-07 14:37:55 +01:00
Ilan Steemers 5791089497 Temporarily disabling annoying ironmq bug 2016-01-07 14:09:01 +01:00
Ilan Steemers 0879e4d128 Iron mq is being pendantic 2016-01-07 12:38:13 +01:00
Ilan Steemers 826178c463 Adds a MongoDB broker
* adds mongo broker tests
* adds mongo brokers docs

* broker info is now cached when it needs to connect to a server, to reduce traffic.
2015-09-25 20:03:39 +02:00
Ilan Steemers 7532cac93a test for lock_size in main class 2015-09-19 15:52:28 +02:00
Ilan Steemers 16c28a88e2 adds (approximate) lock_size to SQS broker
docs: added lock_size
2015-09-18 15:40:30 +02:00
Ilan Steemers 1d12107524 Changed locking mechanism
* all new tasks start as timeouts. This makes the queries a lot simpler.

* In BULK mode, the bulk update for the lock was causing actual database locks.  The lock updates are now iterated.
2015-09-17 18:49:03 +02:00
Ilan Steemers 548af6c4ad Tests no cache configuration 2015-09-15 20:29:09 +02:00
Ilan Steemers a060b3508a Moves bulk iteration to pusher 2015-09-15 14:45:06 +02:00
Ilan Steemers 2bffcf554b Django ORM broker 2015-09-14 13:24:43 +02:00
Ilan Steemers 8543c5b328 Adds Fastack option to Disque broker 2015-09-11 17:58:16 +02:00
Ilan Steemers 3894019708 Disque now passes the double ack test 2015-09-11 15:36:46 +02:00
Ilan Steemers 4c413fc659 Prevents crash on duplicate acknowledge 2015-09-10 13:31:37 +02:00
Ilan Steemers 5195464c31 tests: sqs is not atomic 2015-09-10 11:34:35 +02:00
Ilan Steemers 0fe6c4cbde SQS only supports max 10 messages in bulk mode
* capped bulk at 10
* added tests
2015-09-09 19:34:06 +02:00
Ilan Steemers d7ce945f03 Amazon SQS broker 2015-09-09 18:10:03 +02:00
Ilan Steemers 69df45ea4e queue size is not atomic on ironmq 2015-09-08 16:22:38 +02:00
Ilan Steemers 52f353fb37 random queue names for ironmq test 2015-09-08 16:11:27 +02:00
Ilan Steemers 661987b368 updated delete job test 2015-09-08 15:56:53 +02:00
Ilan Steemers 7fb12fce49 fixes iron-mq test
purging a queue that never had a message in it raises a not found error. So we queue one message to initialize.
2015-09-08 15:19:40 +02:00
Ilan Steemers d849774c86 Adds bulk option to disque broker
adds tests
2015-09-08 14:06:38 +02:00
Ilan Steemers 0ffae4519b Adds bulk get to ironmq 2015-09-08 13:37:33 +02:00
Ilan Steemers b56cc9da8f IronMQ broker 2015-09-08 11:20:31 +02:00
Ilan Steemers d90db10f5e Just use local disque for testing 2015-09-06 12:28:12 +02:00
Ilan Steemers 3be488f918 Adds Tynd envs for Travis
attempt #3
2015-09-04 15:48:43 +02:00
Ilan Steemers 8340a2ae57 Adds Tynd envs for Travis 2015-09-04 15:27:10 +02:00
Ilan Steemers 3524ad2dee Adds Tynd envs for Travis
and fixes timeout tests
2015-09-04 15:16:30 +02:00
Ilan Steemers e76e65640b removes AUTH for Travis test 2015-09-04 14:53:42 +02:00
Ilan Steemers 3f75e7fa05 removed SQS and IronMQ brokers for now
Both brokers are not atomic and cause all kinds of problems during testing. Needs more time.
Meanwhile I want to release the pluggable broker backend.
2015-09-04 14:49:17 +02:00
Ilan Steemers b1f2143a3d uses disque_nodes convention 2015-09-03 12:55:49 +02:00
Ilan Steemers e22980834c Fixes connectionerror bug on 2.7 2015-09-02 20:17:44 +02:00
Ilan Steemers dfb1b03cd0 Experimenting with disque build on travis 2015-09-02 20:12:00 +02:00