Commit Graph
100 Commits
Author SHA1 Message Date
Ilan Steemers cba7b60fcc fixing term clear 2015-09-06 19:58:04 +02:00
Ilan Steemers 61306143bd adds brokers to manifest 2015-09-06 19:57:53 +02:00
Ilan Steemers ba4a6f104a removed boto and ironmq for now 2015-09-06 17:52:52 +02:00
Ilan Steemers a4bdc809dc getting ready for new release 2015-09-06 17:14:43 +02:00
Ilan Steemers 43065233f6 Updated README 2015-09-06 16:55:46 +02:00
Ilan Steemers 73d15c3608 docs: minor updates 2015-09-06 16:54:20 +02:00
Ilan Steemers 87c3b7c9ce docs: minor changes 2015-09-06 16:22:06 +02:00
Ilan Steemers 815cbeede9 docs: defaults queue_limit to workers squared. 2015-09-06 16:21:58 +02:00
Ilan Steemers b201979eae defaults queue_limit to workers squared. 2015-09-06 15:45:17 +02:00
Ilan Steemers d72dd8b338 adds bottom bar with broker info 2015-09-06 15:19:05 +02:00
Ilan Steemers 5e5bf2cc8d docs: adjusted for multiple brokers 2015-09-06 14:48:33 +02:00
Ilan Steemers 44473ca408 Adds broker and receipts to architecture flowchart 2015-09-06 12:29:21 +02:00
Ilan Steemers d90db10f5e Just use local disque for testing 2015-09-06 12:28:12 +02:00
Ilan Steemers c7039168cf Updated psutil 2015-09-06 12:07:43 +02:00
Ilan Steemers 3be488f918 Adds Tynd envs for Travis
attempt #3
2015-09-04 15:48:43 +02:00
Ilan Steemers 8340a2ae57 Adds Tynd envs for Travis 2015-09-04 15:27:10 +02:00
Ilan Steemers 3524ad2dee Adds Tynd envs for Travis
and fixes timeout tests
2015-09-04 15:16:30 +02:00
Ilan Steemers e76e65640b removes AUTH for Travis test 2015-09-04 14:53:42 +02:00
Ilan Steemers 3f75e7fa05 removed SQS and IronMQ brokers for now
Both brokers are not atomic and cause all kinds of problems during testing. Needs more time.
Meanwhile I want to release the pluggable broker backend.
2015-09-04 14:49:17 +02:00
Ilan Steemers 1ccfc66254 adds fail method to broker 2015-09-03 16:34:00 +02:00
Ilan Steemers 7be533d9a6 moved auth to redis py 2015-09-03 16:14:20 +02:00
Ilan Steemers 2e4c1c86ed Adds extra AUTH before PING 2015-09-03 15:50:22 +02:00
Ilan Steemers 453fc3b133 Changes Disque ping to hello 2015-09-03 15:13:44 +02:00
Ilan Steemers a342aaf009 Changes Disque ping to hello 2015-09-03 15:13:25 +02:00
Ilan Steemers 1f5952044e Changes Disque ping to hello 2015-09-03 15:08:55 +02:00
Ilan Steemers c0f7df3f07 Changes Disque ping to hello 2015-09-03 14:59:57 +02:00
Ilan Steemers 653ae80477 Disque: If retry is 0 , explicitly set replicate to 1 2015-09-03 14:41:03 +02:00
Ilan Steemers c626c3137c Defaults RETRY to 60 2015-09-03 14:40:32 +02:00
Ilan Steemers 01f8d9ce47 adds info method to brokers 2015-09-03 14:29:03 +02:00
Ilan Steemers b1f2143a3d uses disque_nodes convention 2015-09-03 12:55:49 +02:00
Ilan Steemers e22980834c Fixes connectionerror bug on 2.7 2015-09-02 20:17:44 +02:00
Ilan Steemers dfb1b03cd0 Experimenting with disque build on travis 2015-09-02 20:12:00 +02:00
Ilan Steemers b901039a44 Experimenting with disque build on travis 2015-09-02 20:08:20 +02:00
Ilan Steemers 1a61fa2821 Experimenting with disque build on travis 2015-09-02 20:04:48 +02:00
Ilan Steemers 0756fb9896 Experimenting with disque build on travis 2015-09-02 20:00:43 +02:00
Ilan Steemers 46ae50043c Fixes class super for python 2.7 2015-09-02 19:50:04 +02:00
Ilan Steemers 8ce441bed5 Adds more brokers
* added IronMQ
* added Aws SQS
* removed SafeRedis.
 During tests the 'safe' part wasn't consistent enough
2015-09-02 19:04:03 +02:00
Ilan Steemers da20ebe734 fixes connection creation on import 2015-08-31 15:15:24 +02:00
Ilan Steemers 9e04d8c9a8 Fixes import problems in python 2.7 2015-08-30 21:12:47 +02:00
Ilan Steemers c4b0a92e74 Fixes typo in travis conf 2015-08-30 21:07:11 +02:00
Ilan Steemers 5171f1a183 Disabled Disque tests for now 2015-08-30 21:04:07 +02:00
Ilan Steemers 452f53f899 New container build on Travis 2015-08-30 20:57:05 +02:00
Ilan Steemers 3a27af0877 Adds disque build to Travis 2015-08-30 20:33:23 +02:00
Ilan Steemers d6b9b10e3e Adds tests for brokers
* test for redis and django-redis
* test for disque

TODO add disque to Travis
2015-08-30 20:26:30 +02:00
Ilan Steemers 4f39062785 Adds django cache as monitor cache
Not the best solution yet, but it solves monitoring problems with brokers that don't have a pattern getter for cluster stats.
2015-08-30 18:28:26 +02:00
Ilan Steemers d3283571a6 First draft of a Disque broker
TODO monitoring doesn't work yet
2015-08-30 14:33:35 +02:00
Ilan Steemers 93cbfc37e2 fixes import confusion in python 2.7 2015-08-29 19:08:19 +02:00
Ilan Steemers 0740c90148 adds pluggable brokers
* added redis broker
 * added django_redis broker
 * added task acknowledgement
2015-08-29 18:54:07 +02:00
Ilan 0de742b417 Updated README
out of Alpha
2015-08-28 15:47:26 +02:00
Ilan ababf2c5d0 Updated README
fixed some links
2015-08-28 15:47:26 +02:00
Ilan 57d9c40ae8 Updated README
fixed some links
2015-08-28 15:47:26 +02:00
Ilan Steemers 439c8a2f77 Moves Status to it's own file
This way only qmonitor and qinfo need Curses and you can still run the cluster without it.
2015-08-26 13:11:58 +02:00
Ilan Steemers 3e92fddcdd #50 removes redis connection argument from pusher process 2015-08-24 10:08:43 +02:00
Ilan Steemers b414b637eb #50 adds psutil as alternative os.getppid provider 2015-08-23 21:19:35 +02:00
Ilan 9dfb65a7af docs: minor updates 2015-08-19 13:57:46 +02:00
Ilan Steemers 2011efbe0a Merge pull request #49 from Koed00/dev
v0.5.3
2015-08-19 04:02:27 -07:00
Ilan 9fbf859472 Updates to Django 1.7.10 and 1.8.4 2015-08-19 12:56:04 +02:00
Ilan 5ccd86a254 v0.5.3 2015-08-19 12:40:29 +02:00
Ilan da5e265333 Updated comment on catch up 2015-08-19 12:39:56 +02:00
Ilan 6610277b93 docs: moved Configuration to its own section
* added more info on schedule catch up.
2015-08-19 12:38:15 +02:00
Ilan Steemers 97a3fc9c9f Merge pull request #48 from Koed00/dev
adds `catch_up` configuration option
2015-08-18 15:19:35 -07:00
Ilan b99e16f108 adds catch_up configuration option
When a cluster hasn't run for a while, the default behavior is to keep executing schedules until they are caught up with the present time.
By setting `catch_up` to False, schedules will not play catch up and instead get rescheduled to the future.
2015-08-18 11:57:15 +02:00
Ilan Steemers 5158d312b5 Merge pull request #47 from Koed00/dev
consolidates redis ping
2015-08-17 10:46:25 -07:00
Ilan ac2dc02b4c consolidated redis ping 2015-08-17 14:25:32 +02:00
Ilan 47a92f8e56 added to translations
fixed _ conflict
2015-08-17 12:57:59 +02:00
Ilan ad110f8b45 docs: minor updates 2015-08-15 17:03:56 +02:00
Ilan Steemers 06765742ac Merge pull request #46 from Koed00/dev
Adds global `sync` configuration option
2015-08-13 10:52:45 -07:00
Ilan 12e9e2035e Version 0.5.2 2015-08-13 19:49:36 +02:00
Ilan 265ae9abd9 docs: added sync configuration reference 2015-08-13 18:13:45 +02:00
Ilan 6c37b09151 adds global sync configuration option
Setting the `sync` configuration option will force all async() calls to be run with `sync=True`. Useful for testing.
2015-08-13 18:02:38 +02:00
Ilan 3d12c1d36e adds queue_size()
returns the size of the current redis queue
2015-08-13 15:54:57 +02:00
Ilan Steemers 101775734c Merge pull request #45 from Koed00/dev
Adds `qinfo` management command
2015-08-12 05:07:57 -07:00
Ilan 204377228f v0.5.1 2015-08-12 13:46:25 +02:00
Ilan 5e2305ad80 docs: addsqinfo management command 2015-08-12 12:39:59 +02:00
Ilan df7f8bbcaf Adds more stats to the qinfo command
* Average execution time
* Tasks per day/hour/minute/second
* Number of schedules
2015-08-12 12:39:14 +02:00
Ilan e86308b434 adds qinfo management command
It seems more practical to give this its own command instead of `qmonitor --info`
2015-08-10 13:20:17 +02:00
Ilan 63030aa9d1 Tests schedule creation via model 2015-08-10 13:18:50 +02:00
Ilan 79393dee16 adds --info summary to monitor command 2015-08-09 19:29:24 +02:00
Ilan d8fd93cc0e docs: expanded schedule example 2015-08-08 19:12:47 +02:00
Ilan Steemers e26f1d9ac6 Update README.rst 2015-08-08 19:07:07 +02:00
Ilan Steemers ddc610297d Update README.rst 2015-08-08 19:01:53 +02:00
Ilan Steemers a4aa0fa4fc Merge pull request #44 from Koed00/dev
Adds a n-minutes option to the scheduler
2015-08-06 01:40:42 -07:00
Ilan dea61a87e3 docs: adds screenshots to the admin section 2015-08-05 21:57:46 +02:00
Ilan c22b98e202 v0.5.0 2015-08-05 21:49:10 +02:00
Ilan de5d0f2725 Adds a 'minutes' option to the scheduler 2015-08-05 20:30:29 +02:00
Ilan 77395acbbb Preparing v0.4.6 2015-08-04 21:45:51 +02:00
Ilan Steemers 7fed9b17e4 Merge pull request #42 from Koed00/dev
Replaces qsize == 0 with empty()
2015-08-04 09:40:34 -07:00
Ilan ae0b6f6f8c updated docs 2015-08-04 18:36:52 +02:00
Ilan f470fbf975 uses empty() instead of qsize() == 0 2015-08-04 18:30:07 +02:00
Ilan Steemers 220183b03d Merge pull request #41 from Koed00/dev
Workaround for osx implementation
2015-08-04 07:49:12 -07:00
Ilan b85738675a docs: mention possible cpu_count failure 2015-08-04 16:43:39 +02:00
Ilan ae8745ab39 Checks if cpu_count is implemented
On rare occasions, usually on win32, cpu_count will raise a NotImplemented error.  If psutil is installed we will use this to get the correct count, otherwise we default to 4
2015-08-04 16:28:19 +02:00
Ilan 25dcec4572 Merge branch 'master' into dev
# Conflicts:
#	docs/monitor.rst
2015-08-04 15:15:45 +02:00
Ilan 3ca7978d8c Added docs for #40 2015-08-04 13:07:53 +02:00
Ilan 4bae1fc99f #40 typo 2015-08-04 12:59:24 +02:00
Ilan 337ec04ad4 just linux 2015-08-04 12:44:01 +02:00
Ilan 24b5e76eed trying osx build for travis 2015-08-04 12:40:20 +02:00
Ilan af61270f62 #40 qsize not implemented 2015-08-04 12:26:23 +02:00
Ilan db1906030e removed python 2.6 2015-08-01 22:24:18 +02:00
Ilan b50e2a9006 ready for 0.4.5 2015-08-01 15:55:21 +02:00