Commit Graph

37 Commits

Author SHA1 Message Date
sinowood
52c04217e9 Multiple queue, multiple cluster in one site (#71)
* Support for multi-queue, multi-cluster configuration. API changes include:
  * Adding `cluster` to async_task() parameters and Task model
  * Adding argument --name to qcluster command
  * Necessary adjustments to Conf and Broker classes
  * Some admin improvements

* Add settings.Q_CLUSTER['ALT_CLUSTERS']: q_cluster config overrides for alternative clusters;
Add Conf.CLUSTER_NAME: separate usage from Conf.PREFIX;
QueueAdmin/OrmQ detail page enhanced: now displaying args/kwargs/q_options instead of encrypted payload.

* if `cluster` argument is not set (the default), async_task() and schedule() will be handled by the default cluster; Documentation update.

* Text cleanup

* Documentation update.

* Fix TIMEOUT setting in Windows for non-default cluster

---------

Co-authored-by: Stan Triepels <1939656+GDay@users.noreply.github.com>
2023-04-02 16:36:17 +02:00
Stan Triepels
3c0c32758d Chore: Flake8, isort and Black (#40) 2022-11-16 01:45:40 +01:00
Stan Triepels
e3f959c258 Admin improvements (#11)
* Add the group column to OrmQ admin page

* Add group field to tasks list and search_field

* Add search by name to Schedule admin page

* Limit succesful task history per schedule with SAVE_LIMIT_GROUP config

* Improve ScheduleAdmin list view performance

Co-authored-by: Marc Sabatier <marc@sabatier.online>
2022-10-14 17:13:48 +02:00
Ilan Steemers
15155c7a99 Build improvements (#569)
* Black linting

* Adding Black to dev dependencies and upping minimal python to 3.6.2 for compatibility

* Updating packages

* Removing pip-tools input and exporting requirements with poetry

* Deleting old setup files and test runner

* Trying 1.3.7

* Looser extras requirements to prevent conflicts

* Sorted imports with isort

* Added iSort to dev dependencies

* Fixes localtime for naive setups
2021-05-30 17:10:07 +02:00
Dimitri
957f807598 Allow tasks to be scheduled on a specific cluster (#555)
* Allows schedule by cluster

* Update docs

* Add example in doc

* Fixes cluster field must be blank

* Adds cluster arg to schedule func

* Adds cluster field in list_display/filter for admin

* Uses Q filter to fetch schedule

* Fixes ref in doc

* Adds tests
2021-05-14 13:42:54 +02:00
Telmo Barros
1d6d996fd0 enhanced admin ormq panel fix and schedules with broker_name 2021-02-06 18:52:17 +00:00
Telmo Barros
10df8351ff Queued tasks admin list page enhancement 2021-02-06 17:56:03 +00:00
Ilan Steemers
c94f2cb816 Adds psutil support for max_rss on other platforms 2020-07-05 18:18:43 +02:00
Ilan Steemers
f0061dccd6 Moves optional import to root 2020-06-29 19:08:33 +02:00
Ilan Steemers
ace3d01da7 Optional Cron expression scheduling - inital commit 2020-06-28 15:26:53 +02:00
Djailla
d8524e8d42 [py27] Remove last traces of py27 2020-01-27 17:15:10 +01:00
Jake Bell
dc65f5e1de Replacing ugettext_ functions with gettext_ for Django 3 2020-01-07 15:57:37 -06:00
Ilan Steemers
4076795dc3 truncate error description in admin
Also removes old conditional imports
2018-08-13 18:50:35 +02:00
Ilan Steemers
3116e97f9b Fixes overrides 2018-08-05 15:11:43 +02:00
Ilan Steemers
acebdaa850 Renames async/enqueue to async_task. 2018-08-01 15:20:34 +02:00
Pierre-Elliott Bécue
ae75a84f7f Replaces async occurrences with alternatives
* async is now a reserved word in python3.7
 * Rename async function to enqueue
 * Rename all async_ functions to enqueue_
 * Rename Async class to AsyncTask
 * Updates the docs.
2018-07-07 21:33:43 +02:00
ilan
8a7567bc77 Replaces some relative imports 2017-10-10 12:13:33 +02:00
Ilan Steemers
1ec1598200 Adds remote orm queue to admin view 2015-09-17 14:50:19 +02:00
Ilan Steemers
5450e59119 Adds name, function and task id to orm queue admin 2015-09-15 16:49:22 +02:00
Ilan Steemers
cefc7e0dc1 Adds test for orm queued task admin 2015-09-14 16:06:18 +02:00
Ilan Steemers
2bffcf554b Django ORM broker 2015-09-14 13:24:43 +02:00
Ilan
0919d546ab docstring linting 2015-07-25 17:01:06 +02:00
Ilan
ac41d50bf2 adds group filter to admin 2015-07-24 20:47:35 +02:00
Ilan
c127604f10 Adds task groups
* task now takes an optional keyword `group`
* added result_group()  and fetch_group()
* added group column to Success admin
* group column in searchable
* added `name` field to Schedules
* Scheduled tasks take schedule name as group
2015-07-18 17:20:50 +02:00
Ilan Steemers
e590628612 linting some blank lines 2015-07-10 12:14:57 +02:00
Ilan Steemers
fd168b3202 Added stopped column in admin and sorting models on stopped field. 2015-07-10 12:05:00 +02:00
Ilan Steemers
9f54a52de9 edit link on the func column in the schedule admin 2015-07-10 11:30:54 +02:00
Ilan Steemers
2ec424fce0 Adds func to searchable fields in admin 2015-07-05 14:37:39 +02:00
Ilan Steemers
b113a52825 Restructured all the modules
The core module was becoming too large.
By splitting it in  cluster, monitor and tasks it becomes more manageable. It also reflects the documentation structure.
2015-07-03 15:12:11 +02:00
Ilan Steemers
83c1601546 Fixes bug with resubmitting none args 2015-07-01 11:42:57 +02:00
Ilan Steemers
9bd3b1fa40 renamed scheduled task result to 'last run'. Makes more sense 2015-06-27 21:54:09 +02:00
Ilan Steemers
d06de5769b added scheduled tasks with admin interface 2015-06-25 19:48:38 +02:00
Ilan Steemers
0ed1da8f05 Refactoring to make testing more stable 2015-06-23 21:12:08 +02:00
Ilan Steemers
bed64c7313 Added re-submit function to Failed Task admin 2015-06-18 17:03:34 +02:00
Ilan Steemers
e473665760 Added admin pages for failures and success.
SAVE_LIMIT can now be set to limit the amount of saved tasks results.
2015-06-17 15:32:54 +02:00
Ilan Steemers
f095c52e73 - Added logging with coloredlogs (for now)
- Added task model and admin
- Moved pusher into it's own process
2015-06-16 14:58:44 +02:00
Ilan Steemers
8c0a26e0b4 Testing basic layout 2015-06-15 16:02:50 +02:00