Commit Graph
39 Commits
Author SHA1 Message Date
Ilan Steemers 15155c7a99 Build improvements (#569)
* Black linting

* Adding Black to dev dependencies and upping minimal python to 3.6.2 for compatibility

* Updating packages

* Removing pip-tools input and exporting requirements with poetry

* Deleting old setup files and test runner

* Trying 1.3.7

* Looser extras requirements to prevent conflicts

* Sorted imports with isort

* Added iSort to dev dependencies

* Fixes localtime for naive setups
2021-05-30 17:10:07 +02:00
Kenny Heinonen 728a1b85d0 Add "qmemory" command (#553)
* Add qmemory command

* Update README, add test

* Redesign qmemory

* Add optional argument to show each worker's memory usage

* Add --workers argument to test_qmemory
2021-05-14 13:44:40 +02:00
Ilan Steemers 7d03536e89 Migrate to Github Action CI (#507)
* Some small refactors

* Initial test script

* Fixes django matrix

* Trying to set up Disque

* Disque as a docker service

* lowercase action name

* Remove Travis

* Replaces Travis badge with Github actions badge

* Show django version in step

* Typo
2021-02-14 18:59:04 +01:00
Ilan 0bca3cbd7a Replacing format with f-strings 2020-02-17 16:59:12 +01:00
Jason McVetta 93a8c3520c truncate cluster_id from the other end 2020-02-12 18:56:54 +07:00
Jason McVetta aa51413d81 cast cluster_id UUID to str 2020-02-12 18:52:45 +07:00
Jason McVetta abc8b397fc Revert "wider column for cluster_id, and cast to string"
This reverts commit a37d3b7af0.
2020-02-12 18:52:25 +07:00
Jason McVetta 7f9f6c3a04 Revert "terminal position"
This reverts commit db70d14754.
2020-02-12 18:52:24 +07:00
Jason McVetta db70d14754 terminal position 2020-02-12 18:51:41 +07:00
Jason McVetta a37d3b7af0 wider column for cluster_id, and cast to string 2020-02-12 18:50:46 +07:00
Jason McVetta cb01620a5d truncate cluster_id UUID to fit column 2020-02-12 18:43:31 +07:00
Jake Bell dc65f5e1de Replacing ugettext_ functions with gettext_ for Django 3 2020-01-07 15:57:37 -06:00
ilan e84422530b Fixes merge conflicts 2017-04-05 16:44:21 +03:00
Ilan Steemers d4aa010428 adds version and broker info to qinfo command 2015-10-07 14:07:39 +02:00
Ilan Steemers 93a8f71157 Only show lock count when available and greater than zero 2015-09-19 15:42:35 +02:00
Ilan Steemers 6af852fcee checks if broker has lock_size method 2015-09-18 15:23:31 +02:00
Ilan Steemers a6ad47b181 Adds lock count to monitor for orm broker 2015-09-17 18:55:29 +02:00
Ilan Steemers cba7b60fcc fixing term clear 2015-09-06 19:58:04 +02:00
Ilan Steemers d72dd8b338 adds bottom bar with broker info 2015-09-06 15:19:05 +02:00
Ilan Steemers da20ebe734 fixes connection creation on import 2015-08-31 15:15:24 +02:00
Ilan Steemers 0740c90148 adds pluggable brokers
* added redis broker
 * added django_redis broker
 * added task acknowledgement
2015-08-29 18:54:07 +02:00
Ilan Steemers 439c8a2f77 Moves Status to it's own file
This way only qmonitor and qinfo need Curses and you can still run the cluster without it.
2015-08-26 13:11:58 +02:00
Ilan ac2dc02b4c consolidated redis ping 2015-08-17 14:25:32 +02:00
Ilan df7f8bbcaf Adds more stats to the qinfo command
* Average execution time
* Tasks per day/hour/minute/second
* Number of schedules
2015-08-12 12:39:14 +02:00
Ilan e86308b434 adds qinfo management command
It seems more practical to give this its own command instead of `qmonitor --info`
2015-08-10 13:20:17 +02:00
Ilan 79393dee16 adds --info summary to monitor command 2015-08-09 19:29:24 +02:00
Ilan af61270f62 #40 qsize not implemented 2015-08-04 12:26:23 +02:00
Ilan Steemers c350ea13f1 monitor TQ will indicate green when queue_limit has been reached. 2015-07-27 10:45:43 +02:00
Ilan 266a0dbcb1 minor linting 2015-07-24 13:36:51 +02:00
Ilan 2d0820e80b Adds cpu affinity for the workers. Courtesy of the optional psutil module. 2015-07-15 19:53:13 +02:00
Ilan Steemers e62fd1ee70 Fixes #7
* added a synchronous cluster simulation

* added a test for the sync function

* moved signing into its own module

* refactored imports to solve circular import problems stemming from the task module pretending to be a cluster

* added documentation for the new sync option
2015-07-09 20:16:21 +02:00
Ilan Steemers f8708cfd73 Task now uses a UUID4 instead of a LUID 2015-07-08 13:33:03 +02:00
Ilan Steemers 4ee47fc38f upping the coverage 2015-07-07 20:20:28 +02:00
Ilan Steemers b801c480f5 Handle Redis errors better 2015-07-07 17:47:49 +02:00
Ilan Steemers 38dc20043c Stabilize the stop procedure after forced termination of the monitor causes an unstable queue.
* added timeout to final stop
* ony terminate on timeouts
* renamed done_queue to result_queue
2015-07-07 15:48:13 +02:00
Ilan Steemers fb44f4f0bf raises a redis exception 2015-07-03 18:31:04 +02:00
Ilan Steemers 891d017c00 Added STOPPING status to monitor 2015-07-03 17:32:46 +02:00
Ilan Steemers e0a92d2b24 Monitor starts with pinging Redis. 2015-07-03 16:57:26 +02:00
Ilan Steemers b113a52825 Restructured all the modules
The core module was becoming too large.
By splitting it in  cluster, monitor and tasks it becomes more manageable. It also reflects the documentation structure.
2015-07-03 15:12:11 +02:00