Cluster3 axon - #11

Open

inexplicable wants to merge 249 commits into

inexplicable:cluster3_axonfrom

cubejs:cluster3_axon

Commits on Sep 2, 2013

cluster3
huzhou
committed
124dfc5
mock mon app
huzhou
committed
15b70a8

Commits on Sep 3, 2013

+ ecv
huzhou
committed
8d4bc48
+ updates
huzhou
committed
aafac9b
+ debug workers features
huzhou
committed
61d7db2

Commits on Sep 4, 2013

+ emitter bugfixes
huzhou
committed
1d6c800
+ debug live working!
huzhou
committed
c7e34e1
+ status bugfix, indeed an emitter's issue, must replicate the workers' handlers whenever a new worker is given
huzhou
committed
c915fc5
+ worker gracefully exit whenStop
huzhou
committed
fa34e32
Create README.md
inexplicable
committed
d75fc74
Update README.md
inexplicable
committed
0a2ebe0
+ status bugfix when a worker disconnects
huzhou
committed
1ca47c6
Merge remote-tracking branch 'origin/cluster3' into cluster3
huzhou
committed
a7b33f3

Commits on Sep 5, 2013

+ bugfix of duplicate master 'debug-finished'
huzhou
committed
92f8284
cache api detailed
inexplicable
committed
a46b8bd
Update README.md
inexplicable
committed
94e5b7a
+ caches monitor view supported
huzhou
committed
da2eafe
Merge remote-tracking branch 'origin/cluster3' into cluster3
huzhou
committed
43ced3d

Commits on Sep 6, 2013

bugfixes
huzhou
committed
ee93427

Commits on Sep 11, 2013

+ adding simple logger support
inexplicable
committed
7d7955b
+ heuristic design
inexplicable
committed
ccf482c
+ updated .gitignore
huzhou
committed
70731cc
Merge remote-tracking branch 'origin/cluster3' into cluster3
huzhou
committed
8322c2c
+ refactorings
huzhou
committed
0154951

Commits on Sep 12, 2013

+ designed & implemented the heuristics of #markOld
huzhou
committed
bd43553
+ event handler dedup
huzhou
committed
04b5588

Commits on Sep 13, 2013

+ refactorings & doc
huzhou
committed
0888756

Commits on Sep 14, 2013

+ update deps
huzhou
committed
75759be
+ enforce message encoding/decoding to avoid '\r\n' symbols
inexplicable
committed
0012988
Merge branch 'cluster3' of https://github.com/inexplicable/cubejs-cluster2 into cluster3
inexplicable
committed
6820505

Commits on Sep 17, 2013

Merge branch 'cluster3' of https://github.com/inexplicable/cubejs-cluster2 into inexplicable-cluster3
huzhou
committed
f0873e9

Commits on Sep 18, 2013

~ cluster3 debugging experience improvements
huzhou
committed
6a92267
Merge pull request #3 from cubejs/cluster3
inexplicable
committed
41573ce

Commits on Sep 19, 2013

Commits on Sep 20, 2013

+ tests for ECV started
inexplicable
committed
bba5874
+ renamed exitIfBusyPort to rejectIfPortBusy to align with the promise's intent
inexplicable
committed
47cfa1d
+ finished 'control' mode ecv unit test
inexplicable
committed
04f6a02
+ pickAvailablePort to utils.js
huzhou
committed
dc991b4
+ unit test for utils, bugfixes of utils.js
huzhou
committed
9f46ce3
+ 'use strict' & fixed octal literal
huzhou
committed
b42aa2d

Commits on Sep 21, 2013

Commits on Sep 22, 2013

+ pending cluster-status cluster unit test
inexplicable
committed
f12c3ef
+ simple shutdown support
inexplicable
committed
2734eac

Commits on Sep 23, 2013

+ major cache api rewrite, added 'namespace' and let user deal with 'cache' alone
huzhou
committed
2b4a1ff

Commits on Sep 24, 2013

+ cache monitor draft support
huzhou
committed
da92bb4
+ namespace related bugfixes
inexplicable
committed
d7ef3e9
Merge pull request #23 from inexplicable/cluster3
inexplicable
committed
b1a307f
+ refactor socket usage in monitor-app.js
inexplicable
committed
be5660c
+ spread status & caches view to all workers, whether new or existings, avoid unnecessary listeners completely, efficient socket communications.
huzhou
committed
ae8336f
+ refactor Slave to standalone puppet.js class for better unit test and naming
huzhou
committed
345271f
+ refactor moved node-inspector creation to utils to further simplify master and make easier for unit test
huzhou
committed
d8c0cd6
+ refactorings, moved startInspector to utils.js
huzhou
committed
eb4da6b
Merge pull request #24 from inexplicable/cluster3
inexplicable
committed
c47f831

Commits on Sep 25, 2013

+ refactorings, renamed monitor-app.js to monitor to allow dependency as:
inexplicable
committed
a06634c
~ bugfix & refactorings of cache-mgr.js
inexplicable
committed
c587712
Update README.md
inexplicable
committed
79c64b4
Update README.md
inexplicable
committed
687ed2a
+ refactorings to alter the order of watch callback for 'null' key, which aligns with the watch callback for non null
inexplicable
committed
cbc3305
Merge remote-tracking branch 'origin/cluster3' into cluster3
inexplicable
committed
dabd850
+ refactorings and simplifications
huzhou
committed
aa6319d
~ adding 'isMaster', 'isWorker' api to give same api for 'cluster'
huzhou
committed
7aef21e
Merge pull request #25 from inexplicable/cluster3
inexplicable
committed
41eb5ad
~ fix #markOld
huzhou
committed
135235a
+ persistence meta: lastModified, lastPersisted to avoid unneeded persistence
huzhou
committed
c304ec9
+
huzhou
committed
064059c

Commits on Sep 26, 2013

+ experimental support for #run compared with #listen
huzhou
committed
3352821
Update README.md
inexplicable
committed
a92a528
Update README.md
inexplicable
committed
6f1c1c9
+ markOld bugfix, and API updates
huzhou
committed
938e77e
Merge pull request #26 from inexplicable/cluster3
inexplicable
committed
ba97188
extracted assertOld to utils and added unit test for it
inexplicable
committed
92e8986
+ added stat to cache.js & cache-usr.js
huzhou
committed
e65cca6
+ expose emitter, status, cache, monitor, ecv from index.js to allow either form of dependency declaration:
huzhou
committed
2ad35ca
refactorings
huzhou
committed
a5c3295

Commits on Sep 27, 2013

+ extracted deathQueue logic out of puppet.js and moved to utils.js for unit test, verified the sequence and guarantee that no more than one worker will suicide at the same time
huzhou
committed
9f643a8
- .js
inexplicable
committed
06695d1
Merge remote-tracking branch 'origin/cluster3' into cluster3
inexplicable
committed
08e713c
fixed locking, added 'lock' support from mgr/usr, no adhoc '/lock' key needed
inexplicable
committed
8c60ff4
fixed npm test and refactorings of puppet.js
inexplicable
committed
84dc850
just some refactorings
inexplicable
committed
7f2857c
puppet bugfix and unit test
inexplicable
committed
0c222bd
+ cache persistence bugfix
huzhou
committed
e744d0a
+ fixed #listen promise rejected issue from both master & worker
huzhou
committed
0f4b350
+ fixed worker issue 'this.emitter' missing this scope
huzhou
committed
f9a3010

Commits on Sep 28, 2013

+ worker unit test & gc info bugfix
huzhou
committed
703a10d
+ refactorings
huzhou
committed
56e9f7d
puppet unit test
inexplicable
committed
78fa957
Merge branch 'cluster3' of https://github.com/inexplicable/cubejs-cluster2 into cluster3
inexplicable
committed
91a5da7
fix monitor server issue conflict between node-gc & socket.io?
inexplicable
committed
379e715
temp fix node-gc & socket.io conflict, added gc monitor option, added master unit test
inexplicable
committed
3066596
Merge pull request #27 from inexplicable/cluster3
inexplicable
committed
3c4d8b6
remove redundant port no.
inexplicable
committed
b3a197d
travis branch narrow to cluster3
inexplicable
committed
5e7989e
npm pretest to create ./log
inexplicable
committed
085d8d7
travis node version
inexplicable
committed
7804435
defer ecv markup till all workers initially created got warmup
inexplicable
committed
153911b
cache api udpate, use is now synchronous, meta, stats async instead, cache persistence and load driven by meta now, readme updated
inexplicable
committed
21ee7e1
must find an alternative to node-gc, it causes problem with node-inspector as well as socket.io
inexplicable
committed
083c3de

Commits on Sep 29, 2013

Commits on Sep 30, 2013

+ added 'configureApp' to allow 'before' server listen application configure (to separate from 'warmUp' which is 'after' server listen)
huzhou
committed
23204ba
+ warmup fix, separated configureapp out
huzhou
committed
e04d957
+ added /deps route, fixed max depth issue, updated README
huzhou
committed
8a86e91
+ allow configureApp to return promise
inexplicable
committed
1116ebd
Update README.md
inexplicable
committed
923fd4c
shutdown
huzhou
committed
60ba2fb
+ solve shutdown issue which gets obsolete master pid
huzhou
committed
a4cbf73

Commits on Oct 1, 2013

+ emitter api update, added
huzhou
committed
0c218c7
Merge pull request #28 from inexplicable/cluster3
inexplicable
committed
3ca9c70
+ simplified ecv control to use 'url' only, event based mechanism withdrawed
inexplicable
committed
6f78bc7
+ refactorings
inexplicable
committed
c704b38
+ shutdown now has complete check and guard
inexplicable
committed
6cee8cc
Merge pull request #29 from inexplicable/cluster3
inexplicable
committed
643f3ce

Commits on Oct 2, 2013

- remove obsolete comment
inexplicable
committed
90a7ce3
+ fixed usage of `timeout`
inexplicable
committed
c40e790
use bdd style
huzhou
committed
6b94cbb
+ fixed warm up issue
huzhou
committed
06f33fc

Commits on Oct 3, 2013

Commits on Oct 4, 2013

+ fixed deathQueue's corner case
inexplicable
committed
f08403e

Commits on Oct 5, 2013

+ fix unit tests failures due to 'monConfigureApp'
inexplicable
committed
067d8fc
Merge pull request #36 from inexplicable/cluster3
inexplicable
committed
02d902e
+ fix travis
inexplicable
committed
95e5f8b
+ try fixing travis...
inexplicable
committed
d914f3f
+ try switching port range
inexplicable
committed
c5b372e
+ all unit tests fixed, pending restored cluster-status-test.js
inexplicable
committed
92381f6
Merge pull request #37 from inexplicable/cluster3
inexplicable
committed
1ea5da4
api updates, use latest code, explained application flow
inexplicable
committed
b707f3f
Merge pull request #5 from cubejs/cluster3
inexplicable
committed
38e375f

Commits on Oct 6, 2013

Commits on Oct 7, 2013

refactorings, documentations for index#listen
huzhou
committed
2b048ff

Commits on Oct 8, 2013

Merge pull request #38 from inexplicable/cluster3
inexplicable
committed
0078248
Update master-test.js
inexplicable
committed
8428d25

Commits on Oct 12, 2013

updates
huzhou
committed
8ed9146
~ allow require('cluster2/cache') to work, otherwise has to be require('cluster2/lib/cache')
huzhou
committed
f739b08
Merge pull request #44 from inexplicable/cluster3
inexplicable
committed
931f37d

Commits on Oct 14, 2013

~ make deathQueue monitorable
huzhou
committed
7b84f9a

Commits on Oct 16, 2013

~ bugfix and refactorings
huzhou
committed
3c35dff

Commits on Oct 21, 2013

~ allow 'pids' path to be overwritten, from cmd argv or params
huzhou
committed
408b013

Commits on Oct 22, 2013

Merge pull request #45 from inexplicable/cluster3
inexplicable
committed
faf094b
~ don't require 'getLogger' explicitly
huzhou
committed
b287833
~ prevent multiple caching request
huzhou
committed
a8d335a
Merge pull request #46 from inexplicable/cluster3
inexplicable
committed
f6d188f
+ moved shutdown to top level
huzhou
committed
98bf7d6
~ shutdown script update
huzhou
committed
385cd40
Merge pull request #47 from inexplicable/cluster3
inexplicable
committed
4574624

Commits on Oct 30, 2013

Merge pull request #3 from cubejs/master
zhuchenwang
committed
d9cc3eb

Commits on Nov 3, 2013

Added warm up code
zhuwang
committed
254f4ba
Clean the branch
zhuwang
committed
77a6df9
Clean the branch
zhuwang
committed
603db02
Added test cases to test cache performance
zhuwang
committed
762c3a9
Merge branch 'cluster3' of https://github.com/cubejs/cluster2 into cubejs-cluster3
zhuwang
committed
5926018
merge
zhuwang
committed
c1f41b5

Commits on Nov 5, 2013

Merge pull request #50 from zhuchenwang/cluster3
inexplicable
committed
90faeff

Commits on Nov 19, 2013

+ support for worker pause & resume initial commit
huzhou
committed
ea6e52a
Merge pull request #7 from cubejs/cluster3
inexplicable
committed
484e7c9
Merge pull request #52 from inexplicable/cluster3
inexplicable
committed
7be1261
+ pause/resume implemented, added to monitor
huzhou
committed
66ea7a3
Merge pull request #53 from inexplicable/cluster3
inexplicable
committed
c29bdeb

Commits on Nov 20, 2013

Merge pull request #7 from cubejs/cluster3
zhuchenwang
committed
3e680ae
Added test cases to test pause and resume worker
zhuwang
committed
229a3fa
+ warmup enhancements
huzhou
committed
4be6cd8
Merge pull request #55 from inexplicable/cluster3
inexplicable
committed
57a2869
Merge pull request #8 from cubejs/cluster3
zhuchenwang
committed
08f8bdb
Moved the cache performance test to a separate folder
zhuwang
committed
8c5c249
~ bugfix of master warmup
huzhou
committed
a68be91
Merge pull request #56 from inexplicable/cluster3
inexplicable
committed
b749e3e
Merge branch 'cluster3' of https://github.com/cubejs/cluster2 into cubejs-cluster3
zhuwang
committed
c80ce55
~ fix failure of test case, where cache info got overwritten by concurrent test cases
huzhou
committed
0e9f0d7
Merge pull request #57 from inexplicable/cluster3
inexplicable
committed
2e30517
~ fix of address returning to warmup callback
huzhou
committed
fd79dc5
Merge pull request #58 from inexplicable/cluster3
inexplicable
committed
82c2320

Commits on Nov 21, 2013

Merge branch 'cluster3' of https://github.com/cubejs/cluster2 into cubejs-cluster3
zhuwang
committed
64639f3
Merge branch 'cluster3' of https://github.com/cubejs/cluster2 into cubejs-cluster3
zhuwang
committed
7b7385e
~ fixed duplicate listening event in puppet
inexplicable
committed
997dd70
~ fixed duplicate listening event in puppet
inexplicable
committed
622ab0f
Merge pull request #59 from inexplicable/cluster3
inexplicable
committed
d894460
Merge pull request #10 from cubejs/cluster3
zhuchenwang
committed
97bc55f
Fixed bug that work does not actually warm up on different ports
zhuwang
committed
7ec35c0
~
huzhou
committed
a7758ea
~ manually merged: https://github.com/zhuchenwang/cluster2/commit/7ec35c020b86635455bb6641ee42928f48c09ad6#commitcomment-4670675
huzhou
committed
af53120
https://github.com/zhuchenwang/cluster2/commit/7ec35c020b86635455bb6641ee42928f48c09ad6#commitcomment-4670675
huzhou
committed
ce84693
Merge pull request #60 from inexplicable/cluster3
inexplicable
committed
4ac069b

Commits on Nov 22, 2013

~ refactorings and fixing 'emitter#to' missing
huzhou
committed
a7a37a5
~ refactorings
huzhou
committed
4e40b7b
Merge branch 'cluster3' of https://github.com/cubejs/cluster2 into cubejs-cluster3
zhuwang
committed
ff279f2
Modified test cases to pick up available ports
zhuwang
committed
270051d
Merge pull request #54 from zhuchenwang/cubejs-cluster3
zhuchenwang
committed
14c205c
Modified the execution order in master.js
zhuwang
committed
aefde29
Increased the timeout for cluster-cache-test
zhuwang
committed
b21af27
Decreased the load of cluster-cache-test
zhuwang
committed
618a090
Merge pull request #61 from zhuchenwang/cubejs-cluster3
inexplicable
committed
7c58e53
Merge pull request #8 from cubejs/cluster3
inexplicable
committed
8487ced

Commits on Nov 23, 2013

~ refactorings
huzhou
committed
775d90d

Commits on Nov 24, 2013

refactorings
inexplicable
committed
93abc70
Merge pull request #62 from inexplicable/cluster3
inexplicable
committed
5eee012

Commits on Nov 25, 2013

Commits on Nov 26, 2013

strict warmup, stop ecv markup if any warmup failed
inexplicable
committed
38379e1
Merge pull request #64 from inexplicable/cluster3
inexplicable
committed
46311cc
Wrapped the sockets into one socket
zhuwang
committed
0f8aeb9
bugfixes
huzhou
committed
6850dbc
~ minor bugfix
huzhou
committed
462df44
Merge pull request #65 from inexplicable/cluster3
inexplicable
committed
52abffe
Modifed to use cacheSocket in cache
zhuwang
committed
dbc2479

Commits on Nov 27, 2013

Modifed to use cacheSocket in cache
zhuwang
committed
b23a49e
Used axon to implement cache
zhuwang
committed
8b32937

Commits on Dec 2, 2013

~ updated 'monitor'
huzhou
committed
81abde7
Merge pull request #66 from inexplicable/cluster3
inexplicable
committed
112ba32
~ set publishConfig
huzhou
committed
1c876b5
Merge pull request #67 from inexplicable/cluster3
inexplicable
committed
215f26c
~ fixed package.json
huzhou
committed
6bba3f5
Merge pull request #68 from inexplicable/cluster3
inexplicable
committed
ee97003

Commits on Dec 3, 2013

Merge pull request #9 from cubejs/cluster3
inexplicable
committed
4f8a720

Commits on Dec 4, 2013

Commits on Dec 5, 2013

fix multiple instances in a single process
inexplicable
committed
27055d5

Commits on Dec 8, 2013

Merge pull request #13 from cubejs/cluster3
zhuchenwang
committed
f4bb249
axon rewrite
zhuwang
committed
babc1ee
Merge branch 'cubejs-cluster3' into cluster3_axon
zhuwang
committed
4776b60
Rewrited cache mechanism using axon
zhuwang
committed
93eb03c

Commits on Dec 11, 2013

Merge pull request #69 from inexplicable/cluster3
zhuchenwang
committed
aca582b
Merge pull request #74 from cubejs/cluster3
zhuchenwang
committed
0c85c04
Merge pull request #15 from cubejs/cluster3
zhuchenwang
committed
9579663
~ avoid duplicate #whenStop calls
huzhou
committed
4ec944c

Commits on Dec 12, 2013

Commits on Dec 17, 2013

Merge pull request #73 from zhuchenwang/cluster3_axon
inexplicable
committed
14beebe