[prev in list] [next in list] [prev in thread] [next in thread]
List: openais
Subject: [Openais] timeouts and recovery
From: Mark Haverkamp <markh () osdl ! org>
Date: 2004-12-10 23:08:06
Message-ID: 1102720086.20683.43.camel () markh1 ! pdx ! osdl ! net
[Download RAW message or body]
Steve,
When we talked the other day about the reconfigurations that I have been
seeing with the new patch, you mentioned that maybe udp packets were
being dropped. I got a dump of the statistics on the switch being used
and didn't see that packets were being dropped or corrupted. Could it
be that the timeouts aren't long enough anymore and I'm see false token
timeouts and loss? I have added some extra debug here and there to to
try to see the process of the reconfig. Anyway here is a recent log from
my 4 machines. If you look at the first one, it seems odd, among other
things, that I'm getting so many join messages after consensus was
reached.
--
Mark Haverkamp <markh@osdl.org>
["aisexec-1.log" (aisexec-1.log)]
========= cl008 ========
Dec 10 13:27:15 [WARNING ] [GMI ] Token being retransmitted.
Dec 10 13:27:16 [NOTICE ] [GMI ] Got attempt join from 192.168.1.18
Dec 10 13:27:16 [NOTICE ] [GMI ] entering GATHER state.
Dec 10 13:27:16 [NOTICE ] [GMI ] SENDING attempt join because this node is ring \
rep. Dec 10 13:27:16 [NOTICE ] [GMI ] ATTEMPT JOIN: state gather
Dec 10 13:27:16 [NOTICE ] [GMI ] Got attempt join from 192.168.1.19
Dec 10 13:27:16 [NOTICE ] [GMI ] ATTEMPT JOIN: state gather
Dec 10 13:27:16 [WARNING ] [GMI ] Token loss in GATHER or COMMIT.
Dec 10 13:27:16 [NOTICE ] [GMI ] Got attempt join from 192.168.1.17
Dec 10 13:27:16 [NOTICE ] [GMI ] ATTEMPT JOIN: state gather
Dec 10 13:27:16 [NOTICE ] [GMI ] GATHER timeout:
Dec 10 13:27:16 [NOTICE ] [GMI ] host 0 attempted to join 192.168.1.8
Dec 10 13:27:16 [NOTICE ] [GMI ] host 1 attempted to join 192.168.1.17
Dec 10 13:27:16 [NOTICE ] [GMI ] host 2 attempted to join 192.168.1.18
Dec 10 13:27:16 [NOTICE ] [GMI ] host 3 attempted to join 192.168.1.19
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.18
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.17
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:16 [NOTICE ] [GMI ] CONSENSUS reached!
Dec 10 13:27:16 [NOTICE ] [GMI ] This node responsible for sending the FORM token.
Send membership form token to 192.168.1.17
Dec 10 13:27:16 [NOTICE ] [GMI ] swallowing ORF token 414845.
Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from 192.168.1.17
Dec 10 13:27:17 [WARNING ] [GMI ] JOIN in form, ignoring since consensus reached in \
state machine. Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from \
192.168.1.17 Dec 10 13:27:17 [WARNING ] [GMI ] JOIN in form, ignoring since \
consensus reached in state machine. Dec 10 13:27:17 [NOTICE ] [GMI ] Received \
member join from 192.168.1.19 Dec 10 13:27:17 [WARNING ] [GMI ] JOIN in form, \
ignoring since consensus reached in state machine. Dec 10 13:27:17 [NOTICE ] [GMI ] \
Received member join from 192.168.1.17 Dec 10 13:27:17 [WARNING ] [GMI ] JOIN in \
form, ignoring since consensus reached in state machine. Dec 10 13:27:17 [NOTICE ] \
[GMI ] Received member join from 192.168.1.18 Dec 10 13:27:17 [WARNING ] [GMI ] \
JOIN in form, ignoring since consensus reached in state machine. Dec 10 13:27:17 \
[NOTICE ] [GMI ] Received member join from 192.168.1.19 Dec 10 13:27:17 [WARNING ] \
[GMI ] JOIN in form, ignoring since consensus reached in state machine. Dec 10 \
13:27:17 [NOTICE ] [GMI ] Received member join from 192.168.1.17 Dec 10 13:27:17 \
[WARNING ] [GMI ] JOIN in form, ignoring since consensus reached in state machine. \
Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from 192.168.1.19 Dec 10 \
13:27:17 [WARNING ] [GMI ] JOIN in form, ignoring since consensus reached in state \
machine. Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from 192.168.1.18
Dec 10 13:27:17 [WARNING ] [GMI ] JOIN in form, ignoring since consensus reached in \
state machine. Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from \
192.168.1.17 Dec 10 13:27:17 [WARNING ] [GMI ] JOIN in form, ignoring since \
consensus reached in state machine. Dec 10 13:27:17 [NOTICE ] [GMI ] Received \
member join from 192.168.1.19 Dec 10 13:27:17 [WARNING ] [GMI ] JOIN in form, \
ignoring since consensus reached in state machine. Dec 10 13:27:17 [NOTICE ] [GMI ] \
Received member join from 192.168.1.18 Dec 10 13:27:17 [WARNING ] [GMI ] JOIN in \
form, ignoring since consensus reached in state machine. Dec 10 13:27:17 [NOTICE ] \
[GMI ] Received member join from 192.168.1.17 Dec 10 13:27:17 [WARNING ] [GMI ] \
JOIN in form, ignoring since consensus reached in state machine. Dec 10 13:27:17 \
[NOTICE ] [GMI ] Received member join from 192.168.1.19 Dec 10 13:27:17 [WARNING ] \
[GMI ] JOIN in form, ignoring since consensus reached in state machine. Dec 10 \
13:27:17 [NOTICE ] [GMI ] Received member join from 192.168.1.18 Dec 10 13:27:17 \
[WARNING ] [GMI ] JOIN in form, ignoring since consensus reached in state machine. \
Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from 192.168.1.17 Dec 10 \
13:27:17 [WARNING ] [GMI ] JOIN in form, ignoring since consensus reached in state \
machine. Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:17 [WARNING ] [GMI ] JOIN in form, ignoring since consensus reached in \
state machine. Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from \
192.168.1.18 Dec 10 13:27:17 [WARNING ] [GMI ] JOIN in form, ignoring since \
consensus reached in state machine. Dec 10 13:27:17 [NOTICE ] [GMI ] Received \
member join from 192.168.1.19 Dec 10 13:27:17 [WARNING ] [GMI ] JOIN in form, \
ignoring since consensus reached in state machine. Got membership form token from \
192.168.1.19 conf_desc_list 1
highest seq 0 1381255
setting barrier seq to 1381255
setting barrier seq to 1381256
Send membership form token to 192.168.1.17
Dec 10 13:27:19 [NOTICE ] [GMI ] Got attempt join from 192.168.1.17
Dec 10 13:27:19 [ERROR ] [GMI ] memb_attempt_join: FORM, EVS 4
Dec 10 13:27:19 [NOTICE ] [GMI ] Got attempt join from 192.168.1.19
Dec 10 13:27:19 [ERROR ] [GMI ] memb_attempt_join: FORM, EVS 4
Dec 10 13:27:19 [WARNING ] [GMI ] Token loss in FORM state
Dec 10 13:27:19 [NOTICE ] [GMI ] entering GATHER state.
Dec 10 13:27:19 [NOTICE ] [GMI ] SENDING attempt join because this node is ring \
rep. Dec 10 13:27:19 [NOTICE ] [GMI ] Got attempt join from 192.168.1.18
Dec 10 13:27:19 [NOTICE ] [GMI ] ATTEMPT JOIN: state gather
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.17
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.18
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.18
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.18
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.18
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.18
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] CONSENSUS reached!
Dec 10 13:27:19 [NOTICE ] [GMI ] This node responsible for sending the FORM token.
Send membership form token to 192.168.1.18
Got membership form token from 192.168.1.19
conf_desc_list 1
highest seq 0 1381255
setting barrier seq to 1381255
setting barrier seq to 1381256
Send membership form token to 192.168.1.18
Got membership form token from 192.168.1.19
Dec 10 13:27:19 [NOTICE ] [GMI ] Swallowing FORM token in EVS state.
FORM CONF ENTRIES 1
Dec 10 13:27:19 [NOTICE ] [GMI ] EVS recovery of messages complete, transitioning \
to operational. CONFCHG ENTRIES 4
calling recovery
Dec 10 13:27:19 [NOTICE ] [CLM ] CLM CONFIGURATION CHANGE
Dec 10 13:27:19 [NOTICE ] [CLM ] New Configuration:
Dec 10 13:27:19 [NOTICE ] [CLM ] 192.168.1.8
Dec 10 13:27:19 [NOTICE ] [CLM ] 192.168.1.18
Dec 10 13:27:19 [NOTICE ] [CLM ] 192.168.1.19
Dec 10 13:27:19 [NOTICE ] [CLM ] Members Left:
Dec 10 13:27:19 [NOTICE ] [CLM ] 192.168.1.17
Dec 10 13:27:19 [NOTICE ] [CLM ] Members Joined:
Dec 10 13:27:19 [NOTICE ] [CLM ] CLM CONFIGURATION CHANGE
Dec 10 13:27:19 [NOTICE ] [CLM ] New Configuration:
Dec 10 13:27:19 [NOTICE ] [CLM ] 192.168.1.8
Dec 10 13:27:19 [NOTICE ] [CLM ] 192.168.1.18
Dec 10 13:27:19 [NOTICE ] [CLM ] 192.168.1.19
Dec 10 13:27:19 [NOTICE ] [CLM ] Members Left:
Dec 10 13:27:19 [NOTICE ] [CLM ] Members Joined:
Dec 10 13:27:19 [NOTICE ] [CLM ] got nodejoin message 192.168.1.18
Dec 10 13:27:19 [NOTICE ] [CLM ] got nodejoin message 192.168.1.19
Dec 10 13:27:19 [NOTICE ] [GMI ] All services unplugged, unplugging processor
Dec 10 13:27:19 [NOTICE ] [EVT ] Channel EVENT_TEST_CHANNEL, total 5, local 2
Dec 10 13:27:19 [NOTICE ] [EVT ] Node 0x801a8c0, count 2
Dec 10 13:27:19 [NOTICE ] [EVT ] Node 0x1201a8c0, count 1
Dec 10 13:27:19 [NOTICE ] [EVT ] Node 0x1301a8c0, count 2
Dec 10 13:27:19 [NOTICE ] [GMI ] All processors unplugged, allowing messages to be \
transmitted. Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from \
192.168.1.17 Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.17
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] No members sent join, keeping old ring and \
transitioning to operational. Dec 10 13:27:20 [WARNING ] [GMI ] Token being \
retransmitted. Dec 10 13:27:21 [WARNING ] [GMI ] Token loss in OPERATIONAL.
Dec 10 13:27:21 [NOTICE ] [GMI ] entering GATHER state.
Dec 10 13:27:21 [NOTICE ] [GMI ] SENDING attempt join because this node is ring \
rep. Dec 10 13:27:21 [NOTICE ] [GMI ] GATHER timeout:
Dec 10 13:27:21 [NOTICE ] [GMI ] host 0 attempted to join 192.168.1.8
Dec 10 13:27:21 [NOTICE ] [GMI ] I am the only member.
Dec 10 13:27:21 [NOTICE ] [CLM ] CLM CONFIGURATION CHANGE
Dec 10 13:27:21 [NOTICE ] [CLM ] New Configuration:
Dec 10 13:27:21 [NOTICE ] [CLM ] 192.168.1.8
Dec 10 13:27:21 [NOTICE ] [CLM ] Members Left:
Dec 10 13:27:21 [NOTICE ] [CLM ] 192.168.1.18
Dec 10 13:27:21 [NOTICE ] [CLM ] 192.168.1.19
Dec 10 13:27:21 [NOTICE ] [CLM ] Members Joined:
Dec 10 13:27:21 [NOTICE ] [CLM ] CLM CONFIGURATION CHANGE
Dec 10 13:27:21 [NOTICE ] [CLM ] New Configuration:
Dec 10 13:27:21 [NOTICE ] [CLM ] 192.168.1.8
Dec 10 13:27:21 [NOTICE ] [CLM ] Members Left:
Dec 10 13:27:21 [NOTICE ] [CLM ] Members Joined:
======= cl017 ========
Dec 10 13:27:16 [WARNING ] [GMI ] Token loss in OPERATIONAL.
Dec 10 13:27:16 [NOTICE ] [GMI ] entering GATHER state.
Dec 10 13:27:16 [NOTICE ] [GMI ] SENDING attempt join because this node is ring \
rep. Dec 10 13:27:16 [NOTICE ] [GMI ] Got attempt join from 192.168.1.18
Dec 10 13:27:16 [NOTICE ] [GMI ] ATTEMPT JOIN: state gather
Dec 10 13:27:16 [NOTICE ] [GMI ] Got attempt join from 192.168.1.8
Dec 10 13:27:16 [NOTICE ] [GMI ] ATTEMPT JOIN: state gather
Dec 10 13:27:16 [NOTICE ] [GMI ] Got attempt join from 192.168.1.19
Dec 10 13:27:16 [NOTICE ] [GMI ] ATTEMPT JOIN: state gather
already received token 1659376 1659376
Dec 10 13:27:16 [NOTICE ] [GMI ] GATHER timeout:
Dec 10 13:27:16 [NOTICE ] [GMI ] host 0 attempted to join 192.168.1.8
Dec 10 13:27:16 [NOTICE ] [GMI ] host 1 attempted to join 192.168.1.17
Dec 10 13:27:16 [NOTICE ] [GMI ] host 2 attempted to join 192.168.1.18
Dec 10 13:27:16 [NOTICE ] [GMI ] host 3 attempted to join 192.168.1.19
Dec 10 13:27:16 [NOTICE ] [GMI ] I am the only member.
Dec 10 13:27:16 [NOTICE ] [CLM ] CLM CONFIGURATION CHANGE
Dec 10 13:27:16 [NOTICE ] [CLM ] New Configuration:
Dec 10 13:27:16 [NOTICE ] [CLM ] 192.168.1.17
Dec 10 13:27:16 [NOTICE ] [CLM ] Members Left:
Dec 10 13:27:16 [NOTICE ] [CLM ] 192.168.1.8
Dec 10 13:27:16 [NOTICE ] [CLM ] 192.168.1.18
Dec 10 13:27:16 [NOTICE ] [CLM ] 192.168.1.19
Dec 10 13:27:16 [NOTICE ] [CLM ] Members Joined:
Dec 10 13:27:16 [NOTICE ] [CLM ] CLM CONFIGURATION CHANGE
Dec 10 13:27:16 [NOTICE ] [CLM ] New Configuration:
Dec 10 13:27:16 [NOTICE ] [CLM ] 192.168.1.17
Dec 10 13:27:16 [NOTICE ] [CLM ] Members Left:
Dec 10 13:27:16 [NOTICE ] [CLM ] Members Joined:
Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:17 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:17 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from 192.168.1.18
Dec 10 13:27:17 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:17 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:17 [NOTICE ] [GMI ] I am the only member.
Dec 10 13:27:17 [NOTICE ] [CLM ] CLM CONFIGURATION CHANGE
Dec 10 13:27:17 [NOTICE ] [CLM ] New Configuration:
Dec 10 13:27:17 [NOTICE ] [CLM ] 192.168.1.17
Dec 10 13:27:17 [NOTICE ] [CLM ] Members Left:
Dec 10 13:27:17 [NOTICE ] [CLM ] Members Joined:
Dec 10 13:27:17 [NOTICE ] [CLM ] CLM CONFIGURATION CHANGE
Dec 10 13:27:17 [NOTICE ] [CLM ] New Configuration:
Dec 10 13:27:17 [NOTICE ] [CLM ] 192.168.1.17
Dec 10 13:27:17 [NOTICE ] [CLM ] Members Left:
Dec 10 13:27:17 [NOTICE ] [CLM ] Members Joined:
Dec 10 13:27:17 [NOTICE ] [EVT ] Already in config change, Starting over, m 1, c 0
Got membership form token from 192.168.1.8
Send membership form token to 192.168.1.18
Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:17 [WARNING ] [GMI ] JOIN in form, ignoring since consensus reached in \
state machine. Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from \
192.168.1.18 Dec 10 13:27:17 [WARNING ] [GMI ] JOIN in form, ignoring since \
consensus reached in state machine. Dec 10 13:27:17 [NOTICE ] [GMI ] Received \
member join from 192.168.1.19 Dec 10 13:27:17 [WARNING ] [GMI ] JOIN in form, \
ignoring since consensus reached in state machine. Dec 10 13:27:18 [NOTICE ] [GMI ] \
Received member join from 192.168.1.19 Dec 10 13:27:18 [WARNING ] [GMI ] JOIN in \
form, ignoring since consensus reached in state machine. Dec 10 13:27:18 [NOTICE ] \
[GMI ] Received member join from 192.168.1.18 Dec 10 13:27:18 [WARNING ] [GMI ] \
JOIN in form, ignoring since consensus reached in state machine. Dec 10 13:27:18 \
[NOTICE ] [GMI ] Received member join from 192.168.1.19 Dec 10 13:27:18 [WARNING ] \
[GMI ] JOIN in form, ignoring since consensus reached in state machine. Dec 10 \
13:27:18 [NOTICE ] [GMI ] Received member join from 192.168.1.18 Dec 10 13:27:18 \
[WARNING ] [GMI ] JOIN in form, ignoring since consensus reached in state machine. \
Dec 10 13:27:18 [NOTICE ] [GMI ] Received member join from 192.168.1.19 Dec 10 \
13:27:18 [WARNING ] [GMI ] JOIN in form, ignoring since consensus reached in state \
machine. Dec 10 13:27:18 [NOTICE ] [GMI ] Received member join from 192.168.1.18
Dec 10 13:27:18 [WARNING ] [GMI ] JOIN in form, ignoring since consensus reached in \
state machine. Dec 10 13:27:18 [NOTICE ] [GMI ] Received member join from \
192.168.1.19 Dec 10 13:27:18 [WARNING ] [GMI ] JOIN in form, ignoring since \
consensus reached in state machine. Dec 10 13:27:19 [WARNING ] [GMI ] Token loss in \
FORM state Dec 10 13:27:19 [NOTICE ] [GMI ] entering GATHER state.
Dec 10 13:27:19 [NOTICE ] [GMI ] SENDING attempt join because this node is ring \
rep. Dec 10 13:27:19 [NOTICE ] [GMI ] GATHER timeout:
Dec 10 13:27:19 [NOTICE ] [GMI ] host 0 attempted to join 192.168.1.17
Dec 10 13:27:19 [NOTICE ] [GMI ] I am the only member.
Dec 10 13:27:19 [NOTICE ] [CLM ] CLM CONFIGURATION CHANGE
Dec 10 13:27:19 [NOTICE ] [CLM ] New Configuration:
Dec 10 13:27:19 [NOTICE ] [CLM ] 192.168.1.17
Dec 10 13:27:19 [NOTICE ] [CLM ] Members Left:
Dec 10 13:27:19 [NOTICE ] [CLM ] Members Joined:
Dec 10 13:27:19 [NOTICE ] [CLM ] CLM CONFIGURATION CHANGE
Dec 10 13:27:19 [NOTICE ] [CLM ] New Configuration:
Dec 10 13:27:19 [NOTICE ] [CLM ] 192.168.1.17
Dec 10 13:27:19 [NOTICE ] [CLM ] Members Left:
Dec 10 13:27:19 [NOTICE ] [CLM ] Members Joined:
Dec 10 13:27:19 [NOTICE ] [EVT ] Already in config change, Starting over, m 1, c 0
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.18
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Got membership form token from 192.168.1.8
Send membership form token to 192.168.1.18
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:19 [WARNING ] [GMI ] JOIN in form, ignoring since consensus reached in \
state machine. Dec 10 13:27:19 [NOTICE ] [GMI ] Got attempt join from 192.168.1.19
Dec 10 13:27:19 [ERROR ] [GMI ] memb_attempt_join: FORM, EVS 3
Dec 10 13:27:19 [NOTICE ] [GMI ] Got attempt join from 192.168.1.18
Dec 10 13:27:19 [ERROR ] [GMI ] memb_attempt_join: FORM, EVS 3
Dec 10 13:27:19 [NOTICE ] [GMI ] Got attempt join from 192.168.1.8
Dec 10 13:27:19 [ERROR ] [GMI ] memb_attempt_join: FORM, EVS 3
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:19 [WARNING ] [GMI ] JOIN in form, ignoring since consensus reached in \
state machine. Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from \
192.168.1.18 Dec 10 13:27:19 [WARNING ] [GMI ] JOIN in form, ignoring since \
consensus reached in state machine. Dec 10 13:27:19 [NOTICE ] [GMI ] Received \
member join from 192.168.1.19 Dec 10 13:27:19 [WARNING ] [GMI ] JOIN in form, \
ignoring since consensus reached in state machine. Dec 10 13:27:19 [NOTICE ] [GMI ] \
Received member join from 192.168.1.8 Dec 10 13:27:19 [WARNING ] [GMI ] JOIN in \
form, ignoring since consensus reached in state machine. Dec 10 13:27:19 [NOTICE ] \
[GMI ] Received member join from 192.168.1.18 Dec 10 13:27:19 [WARNING ] [GMI ] \
JOIN in form, ignoring since consensus reached in state machine. Dec 10 13:27:19 \
[NOTICE ] [GMI ] Received member join from 192.168.1.8 Dec 10 13:27:19 [WARNING ] \
[GMI ] JOIN in form, ignoring since consensus reached in state machine. Dec 10 \
13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.8 Dec 10 13:27:19 \
[WARNING ] [GMI ] JOIN in form, ignoring since consensus reached in state machine. \
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.19 Dec 10 \
13:27:19 [WARNING ] [GMI ] JOIN in form, ignoring since consensus reached in state \
machine. Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:19 [WARNING ] [GMI ] JOIN in form, ignoring since consensus reached in \
state machine. Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from \
192.168.1.19 Dec 10 13:27:19 [WARNING ] [GMI ] JOIN in form, ignoring since \
consensus reached in state machine. Dec 10 13:27:19 [NOTICE ] [GMI ] Received \
member join from 192.168.1.8 Dec 10 13:27:19 [WARNING ] [GMI ] JOIN in form, \
ignoring since consensus reached in state machine. Dec 10 13:27:19 [NOTICE ] [GMI ] \
Received member join from 192.168.1.18 Dec 10 13:27:19 [WARNING ] [GMI ] JOIN in \
form, ignoring since consensus reached in state machine. Dec 10 13:27:19 [NOTICE ] \
[GMI ] Received member join from 192.168.1.19 Dec 10 13:27:19 [WARNING ] [GMI ] \
JOIN in form, ignoring since consensus reached in state machine. Dec 10 13:27:19 \
[NOTICE ] [GMI ] Received member join from 192.168.1.8 Dec 10 13:27:19 [WARNING ] \
[GMI ] JOIN in form, ignoring since consensus reached in state machine. Dec 10 \
13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.18 Dec 10 13:27:19 \
[WARNING ] [GMI ] JOIN in form, ignoring since consensus reached in state machine. \
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.19 Dec 10 \
13:27:19 [WARNING ] [GMI ] JOIN in form, ignoring since consensus reached in state \
machine. Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:19 [WARNING ] [GMI ] JOIN in form, ignoring since consensus reached in \
state machine. Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from \
192.168.1.18 Dec 10 13:27:19 [WARNING ] [GMI ] JOIN in form, ignoring since \
consensus reached in state machine. Dec 10 13:27:19 [NOTICE ] [GMI ] Received \
member join from 192.168.1.19 Dec 10 13:27:19 [WARNING ] [GMI ] JOIN in form, \
ignoring since consensus reached in state machine. Dec 10 13:27:19 [NOTICE ] [GMI ] \
Received member join from 192.168.1.8 Dec 10 13:27:19 [WARNING ] [GMI ] JOIN in \
form, ignoring since consensus reached in state machine. Dec 10 13:27:19 [NOTICE ] \
[GMI ] Received member join from 192.168.1.8 Dec 10 13:27:19 [WARNING ] [GMI ] JOIN \
in form, ignoring since consensus reached in state machine. Got membership form token \
from 192.168.1.19 conf_desc_list 2
highest seq 0 1381255
setting barrier seq to 1381255
highest seq 1 425
setting barrier seq to 1381256
Send membership form token to 192.168.1.18
Got membership form token from 192.168.1.19
Dec 10 13:27:19 [NOTICE ] [GMI ] Swallowing FORM token in EVS state.
FORM CONF ENTRIES 2
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:19 [NOTICE ] [GMI ] memb_join: DEFAULT case 4, shouldn't happen!!Dec \
10 13:27:20 [NOTICE ] [GMI ] EVS recovery of messages complete, transitioning to \
operational. CONFCHG ENTRIES 1
calling recovery
New queue for ip 192.168.1.8
New queue for ip 192.168.1.18
New queue for ip 192.168.1.18
New queue for ip 192.168.1.19
New queue for ip 192.168.1.19
Dec 10 13:27:20 [NOTICE ] [CLM ] CLM CONFIGURATION CHANGE
Dec 10 13:27:20 [NOTICE ] [CLM ] New Configuration:
Dec 10 13:27:20 [NOTICE ] [CLM ] 192.168.1.8
Dec 10 13:27:20 [NOTICE ] [CLM ] 192.168.1.17
Dec 10 13:27:20 [NOTICE ] [CLM ] 192.168.1.17
Dec 10 13:27:20 [NOTICE ] [CLM ] 192.168.1.18
Dec 10 13:27:20 [NOTICE ] [CLM ] 192.168.1.18
Dec 10 13:27:20 [NOTICE ] [CLM ] 192.168.1.19
Dec 10 13:27:20 [NOTICE ] [CLM ] 192.168.1.19
Dec 10 13:27:20 [NOTICE ] [CLM ] Members Left:
Dec 10 13:27:20 [NOTICE ] [CLM ] Members Joined:
Dec 10 13:27:20 [NOTICE ] [CLM ] 192.168.1.8
Dec 10 13:27:20 [NOTICE ] [CLM ] 192.168.1.18
Dec 10 13:27:20 [NOTICE ] [CLM ] 192.168.1.18
Dec 10 13:27:20 [NOTICE ] [CLM ] 192.168.1.19
Dec 10 13:27:20 [NOTICE ] [CLM ] 192.168.1.19
Dec 10 13:27:20 [NOTICE ] [EVT ] Already in config change, Starting over, m 1, c 0
Dec 10 13:27:20 [NOTICE ] [CLM ] got nodejoin message 192.168.1.18
Dec 10 13:27:20 [NOTICE ] [CLM ] got nodejoin message 192.168.1.19
Dec 10 13:27:20 [NOTICE ] [CLM ] got nodejoin message 192.168.1.17
Dec 10 13:27:21 [NOTICE ] [GMI ] Got attempt join from 192.168.1.8
Dec 10 13:27:21 [NOTICE ] [GMI ] rep is 192.168.1.8, not handling attempt join.
Dec 10 13:27:21 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:21 [NOTICE ] [GMI ] not the rep for this ring, not handling join.
======= cl018 ==========
Dec 10 13:27:16 [WARNING ] [GMI ] Token loss in OPERATIONAL.
Dec 10 13:27:16 [NOTICE ] [GMI ] entering GATHER state.
Dec 10 13:27:16 [NOTICE ] [GMI ] SENDING attempt join because this node is ring \
rep. Dec 10 13:27:16 [NOTICE ] [GMI ] Got attempt join from 192.168.1.8
Dec 10 13:27:16 [NOTICE ] [GMI ] ATTEMPT JOIN: state gather
Dec 10 13:27:16 [NOTICE ] [GMI ] Got attempt join from 192.168.1.19
Dec 10 13:27:16 [NOTICE ] [GMI ] ATTEMPT JOIN: state gather
Dec 10 13:27:16 [NOTICE ] [GMI ] Got attempt join from 192.168.1.17
Dec 10 13:27:16 [NOTICE ] [GMI ] ATTEMPT JOIN: state gather
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.17
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:16 [NOTICE ] [GMI ] CONSENSUS reached!
Dec 10 13:27:16 [NOTICE ] [GMI ] I am the only member.
Dec 10 13:27:16 [NOTICE ] [CLM ] CLM CONFIGURATION CHANGE
Dec 10 13:27:16 [NOTICE ] [CLM ] New Configuration:
Dec 10 13:27:16 [NOTICE ] [CLM ] 192.168.1.18
Dec 10 13:27:16 [NOTICE ] [CLM ] Members Left:
Dec 10 13:27:16 [NOTICE ] [CLM ] 192.168.1.8
Dec 10 13:27:16 [NOTICE ] [CLM ] 192.168.1.17
Dec 10 13:27:16 [NOTICE ] [CLM ] 192.168.1.19
Dec 10 13:27:16 [NOTICE ] [CLM ] Members Joined:
Dec 10 13:27:16 [NOTICE ] [CLM ] CLM CONFIGURATION CHANGE
Dec 10 13:27:16 [NOTICE ] [CLM ] New Configuration:
Dec 10 13:27:16 [NOTICE ] [CLM ] 192.168.1.18
Dec 10 13:27:16 [NOTICE ] [CLM ] Members Left:
Dec 10 13:27:16 [NOTICE ] [CLM ] Members Joined:
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.17
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.17
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.17
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.17
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.17
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.17
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.17
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Got membership form token from 192.168.1.17
Send membership form token to 192.168.1.19
Dec 10 13:27:18 [NOTICE ] [GMI ] Got attempt join from 192.168.1.17
Dec 10 13:27:18 [ERROR ] [GMI ] memb_attempt_join: FORM, EVS 3
Dec 10 13:27:18 [WARNING ] [GMI ] Token loss in FORM state
Dec 10 13:27:18 [NOTICE ] [GMI ] entering GATHER state.
Dec 10 13:27:18 [NOTICE ] [GMI ] SENDING attempt join because this node is ring \
rep. Dec 10 13:27:18 [NOTICE ] [GMI ] Got attempt join from 192.168.1.19
Dec 10 13:27:18 [NOTICE ] [GMI ] ATTEMPT JOIN: state gather
Dec 10 13:27:18 [NOTICE ] [GMI ] Got attempt join from 192.168.1.8
Dec 10 13:27:18 [NOTICE ] [GMI ] ATTEMPT JOIN: state gather
Dec 10 13:27:18 [NOTICE ] [GMI ] Received member join from 192.168.1.17
Dec 10 13:27:18 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:18 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:18 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:18 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:18 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:18 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:18 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:18 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:18 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:18 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:18 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:18 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:18 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:18 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:18 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:18 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:18 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:18 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:18 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:18 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:18 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:18 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:18 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:18 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:18 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:18 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:18 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:18 [NOTICE ] [GMI ] Received member join from 192.168.1.19
Dec 10 13:27:18 [NOTICE ] [GMI ] JOIN in commit
Got membership form token from 192.168.1.8
Send membership form token to 192.168.1.19
Got membership form token from 192.168.1.8
conf_desc_list 1
highest seq 0 1381255
setting barrier seq to 1381255
setting barrier seq to 1381256
Send membership form token to 192.168.1.19
Dec 10 13:27:18 [NOTICE ] [GMI ] EVS recovery of messages complete, transitioning \
to operational. CONFCHG ENTRIES 1
calling recovery
New queue for ip 192.168.1.8
New queue for ip 192.168.1.19
Dec 10 13:27:18 [NOTICE ] [CLM ] CLM CONFIGURATION CHANGE
Dec 10 13:27:18 [NOTICE ] [CLM ] New Configuration:
Dec 10 13:27:18 [NOTICE ] [CLM ] 192.168.1.8
Dec 10 13:27:18 [NOTICE ] [CLM ] 192.168.1.18
Dec 10 13:27:18 [NOTICE ] [CLM ] 192.168.1.19
Dec 10 13:27:18 [NOTICE ] [CLM ] Members Left:
Dec 10 13:27:18 [NOTICE ] [CLM ] Members Joined:
Dec 10 13:27:18 [NOTICE ] [CLM ] 192.168.1.8
Dec 10 13:27:18 [NOTICE ] [CLM ] 192.168.1.19
Dec 10 13:27:18 [NOTICE ] [EVT ] Already in config change, Starting over, m 1, c 0
Dec 10 13:27:18 [NOTICE ] [CLM ] got nodejoin message 192.168.1.18
Dec 10 13:27:18 [NOTICE ] [CLM ] got nodejoin message 192.168.1.19
Dec 10 13:27:18 [NOTICE ] [GMI ] All services unplugged, unplugging processor
Dec 10 13:27:18 [NOTICE ] [EVT ] Channel EVENT_TEST_CHANNEL, total 5, local 1
Dec 10 13:27:18 [NOTICE ] [EVT ] Node 0x1201a8c0, count 1
Dec 10 13:27:18 [NOTICE ] [EVT ] Node 0x1301a8c0, count 2
Dec 10 13:27:18 [NOTICE ] [EVT ] Node 0x801a8c0, count 2
Dec 10 13:27:18 [NOTICE ] [GMI ] All processors unplugged, allowing messages to be \
transmitted. Dec 10 13:27:18 [NOTICE ] [GMI ] Received member join from \
192.168.1.17 Dec 10 13:27:18 [NOTICE ] [GMI ] not the rep for this ring, not \
handling join.Got membership form token from 192.168.1.17 Send membership form token \
to 192.168.1.19 Dec 10 13:27:18 [NOTICE ] [GMI ] Received member join from \
192.168.1.17 Dec 10 13:27:18 [NOTICE ] [GMI ] not the rep for this ring, not \
handling join.Dec 10 13:27:18 [NOTICE ] [GMI ] Received member join from \
192.168.1.8 Dec 10 13:27:18 [NOTICE ] [GMI ] not the rep for this ring, not \
handling join.Dec 10 13:27:18 [NOTICE ] [GMI ] Received member join from \
192.168.1.8 Dec 10 13:27:18 [NOTICE ] [GMI ] not the rep for this ring, not \
handling join.Dec 10 13:27:18 [NOTICE ] [GMI ] swallowing ORF token 416049. Got \
membership form token from 192.168.1.17 conf_desc_list 2
highest seq 0 1381255
setting barrier seq to 1381255
highest seq 1 425
setting barrier seq to 1381256
Send membership form token to 192.168.1.19
Dec 10 13:27:18 [NOTICE ] [GMI ] EVS recovery of messages complete, transitioning \
to operational. CONFCHG ENTRIES 3
calling recovery
New queue for ip 192.168.1.17
New queue for ip 192.168.1.17
Dec 10 13:27:19 [NOTICE ] [CLM ] CLM CONFIGURATION CHANGE
Dec 10 13:27:19 [NOTICE ] [CLM ] New Configuration:
Dec 10 13:27:19 [NOTICE ] [CLM ] 192.168.1.8
Dec 10 13:27:19 [NOTICE ] [CLM ] 192.168.1.17
Dec 10 13:27:19 [NOTICE ] [CLM ] 192.168.1.17
Dec 10 13:27:19 [NOTICE ] [CLM ] 192.168.1.18
Dec 10 13:27:19 [NOTICE ] [CLM ] 192.168.1.18
Dec 10 13:27:19 [NOTICE ] [CLM ] 192.168.1.19
Dec 10 13:27:19 [NOTICE ] [CLM ] 192.168.1.19
Dec 10 13:27:19 [NOTICE ] [CLM ] Members Left:
Dec 10 13:27:19 [NOTICE ] [CLM ] Members Joined:
Dec 10 13:27:19 [NOTICE ] [CLM ] 192.168.1.17
Dec 10 13:27:19 [NOTICE ] [CLM ] 192.168.1.17
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:19 [NOTICE ] [GMI ] not the rep for this ring, not handling join.Dec \
10 13:27:19 [NOTICE ] [CLM ] got nodejoin message 192.168.1.18 Dec 10 13:27:19 \
[NOTICE ] [CLM ] got nodejoin message 192.168.1.19 Dec 10 13:27:19 [NOTICE ] [CLM \
] got nodejoin message 192.168.1.17 already received token 63 1245
Dec 10 13:27:20 [NOTICE ] [GMI ] Got attempt join from 192.168.1.8
Dec 10 13:27:20 [NOTICE ] [GMI ] rep is 192.168.1.8, not handling attempt join.
Dec 10 13:27:20 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:20 [NOTICE ] [GMI ] not the rep for this ring, not handling join.
========= cl019 =========
Dec 10 13:27:16 [NOTICE ] [GMI ] Got attempt join from 192.168.1.18
Dec 10 13:27:16 [NOTICE ] [GMI ] rep is 192.168.1.8, not handling attempt join.
Dec 10 13:27:16 [NOTICE ] [GMI ] Got attempt join from 192.168.1.8
Dec 10 13:27:16 [NOTICE ] [GMI ] rep is 192.168.1.8, not handling attempt join.
Dec 10 13:27:16 [WARNING ] [GMI ] Token loss in OPERATIONAL.
Dec 10 13:27:16 [NOTICE ] [GMI ] entering GATHER state.
Dec 10 13:27:16 [NOTICE ] [GMI ] SENDING attempt join because this node is ring \
rep. Dec 10 13:27:16 [NOTICE ] [GMI ] Got attempt join from 192.168.1.17
Dec 10 13:27:16 [NOTICE ] [GMI ] ATTEMPT JOIN: state gather
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.18
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:16 [NOTICE ] [GMI ] Received member join from 192.168.1.17
Dec 10 13:27:16 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:16 [NOTICE ] [GMI ] CONSENSUS reached!
Dec 10 13:27:16 [NOTICE ] [GMI ] I am the only member.
Dec 10 13:27:16 [NOTICE ] [CLM ] CLM CONFIGURATION CHANGE
Dec 10 13:27:16 [NOTICE ] [CLM ] New Configuration:
Dec 10 13:27:16 [NOTICE ] [CLM ] 192.168.1.19
Dec 10 13:27:16 [NOTICE ] [CLM ] Members Left:
Dec 10 13:27:16 [NOTICE ] [CLM ] 192.168.1.8
Dec 10 13:27:16 [NOTICE ] [CLM ] 192.168.1.17
Dec 10 13:27:16 [NOTICE ] [CLM ] 192.168.1.18
Dec 10 13:27:16 [NOTICE ] [CLM ] Members Joined:
Dec 10 13:27:16 [NOTICE ] [CLM ] CLM CONFIGURATION CHANGE
Dec 10 13:27:16 [NOTICE ] [CLM ] New Configuration:
Dec 10 13:27:16 [NOTICE ] [CLM ] 192.168.1.19
Dec 10 13:27:16 [NOTICE ] [CLM ] Members Left:
Dec 10 13:27:16 [NOTICE ] [CLM ] Members Joined:
Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from 192.168.1.17
Dec 10 13:27:17 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from 192.168.1.17
Dec 10 13:27:17 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from 192.168.1.17
Dec 10 13:27:17 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:17 [NOTICE ] [GMI ] CONSENSUS reached!
Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from 192.168.1.18
Dec 10 13:27:17 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from 192.168.1.17
Dec 10 13:27:17 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from 192.168.1.18
Dec 10 13:27:17 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from 192.168.1.17
Dec 10 13:27:17 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from 192.168.1.18
Dec 10 13:27:17 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from 192.168.1.17
Dec 10 13:27:17 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from 192.168.1.18
Dec 10 13:27:17 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from 192.168.1.17
Dec 10 13:27:17 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:17 [NOTICE ] [GMI ] Received member join from 192.168.1.18
Dec 10 13:27:17 [NOTICE ] [GMI ] JOIN in commit
Got membership form token from 192.168.1.18
Send membership form token to 192.168.1.8
Dec 10 13:27:19 [NOTICE ] [GMI ] Got attempt join from 192.168.1.17
Dec 10 13:27:19 [ERROR ] [GMI ] memb_attempt_join: FORM, EVS 3
Dec 10 13:27:19 [WARNING ] [GMI ] Token loss in FORM state
Dec 10 13:27:19 [NOTICE ] [GMI ] entering GATHER state.
Dec 10 13:27:19 [NOTICE ] [GMI ] SENDING attempt join because this node is ring \
rep. Dec 10 13:27:19 [NOTICE ] [GMI ] Got attempt join from 192.168.1.18
Dec 10 13:27:19 [NOTICE ] [GMI ] ATTEMPT JOIN: state gather
Dec 10 13:27:19 [NOTICE ] [GMI ] Got attempt join from 192.168.1.8
Dec 10 13:27:19 [NOTICE ] [GMI ] ATTEMPT JOIN: state gather
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.17
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.18
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.18
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.18
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.18
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.18
Dec 10 13:27:19 [NOTICE ] [GMI ] JOIN in commit
Dec 10 13:27:19 [NOTICE ] [GMI ] CONSENSUS reached!
Got membership form token from 192.168.1.18
Send membership form token to 192.168.1.8
Got membership form token from 192.168.1.18
conf_desc_list 1
highest seq 0 1381255
setting barrier seq to 1381255
setting barrier seq to 1381256
Send membership form token to 192.168.1.8
Dec 10 13:27:19 [NOTICE ] [GMI ] EVS recovery of messages complete, transitioning \
to operational. CONFCHG ENTRIES 1
calling recovery
New queue for ip 192.168.1.8
New queue for ip 192.168.1.18
Dec 10 13:27:19 [NOTICE ] [CLM ] CLM CONFIGURATION CHANGE
Dec 10 13:27:19 [NOTICE ] [CLM ] New Configuration:
Dec 10 13:27:19 [NOTICE ] [CLM ] 192.168.1.8
Dec 10 13:27:19 [NOTICE ] [CLM ] 192.168.1.18
Dec 10 13:27:19 [NOTICE ] [CLM ] 192.168.1.19
Dec 10 13:27:19 [NOTICE ] [CLM ] Members Left:
Dec 10 13:27:19 [NOTICE ] [CLM ] Members Joined:
Dec 10 13:27:19 [NOTICE ] [CLM ] 192.168.1.8
Dec 10 13:27:19 [NOTICE ] [CLM ] 192.168.1.18
Dec 10 13:27:19 [NOTICE ] [EVT ] Already in config change, Starting over, m 1, c 0
Dec 10 13:27:19 [NOTICE ] [CLM ] got nodejoin message 192.168.1.18
Dec 10 13:27:19 [NOTICE ] [CLM ] got nodejoin message 192.168.1.19
Dec 10 13:27:19 [NOTICE ] [GMI ] All services unplugged, unplugging processor
Dec 10 13:27:19 [NOTICE ] [EVT ] Channel EVENT_TEST_CHANNEL, total 5, local 2
Dec 10 13:27:19 [NOTICE ] [EVT ] Node 0x1301a8c0, count 2
Dec 10 13:27:19 [NOTICE ] [EVT ] Node 0x1201a8c0, count 1
Dec 10 13:27:19 [NOTICE ] [EVT ] Node 0x801a8c0, count 2
Dec 10 13:27:19 [NOTICE ] [GMI ] All processors unplugged, allowing messages to be \
transmitted. Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from \
192.168.1.17 Dec 10 13:27:19 [NOTICE ] [GMI ] not the rep for this ring, not \
handling join.Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from \
192.168.1.17 Dec 10 13:27:19 [NOTICE ] [GMI ] not the rep for this ring, not \
handling join.Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from \
192.168.1.8 Dec 10 13:27:19 [NOTICE ] [GMI ] not the rep for this ring, not \
handling join.Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from \
192.168.1.8 Dec 10 13:27:19 [NOTICE ] [GMI ] not the rep for this ring, not \
handling join.Got membership form token from 192.168.1.18 Send membership form token \
to 192.168.1.17 Got membership form token from 192.168.1.18
conf_desc_list 2
highest seq 0 1381255
setting barrier seq to 1381255
highest seq 1 425
setting barrier seq to 1381256
Send membership form token to 192.168.1.17
Dec 10 13:27:19 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:19 [NOTICE ] [GMI ] not the rep for this ring, not handling join.Dec \
10 13:27:19 [NOTICE ] [GMI ] EVS recovery of messages complete, transitioning to \
operational. CONFCHG ENTRIES 3
calling recovery
New queue for ip 192.168.1.17
New queue for ip 192.168.1.17
Dec 10 13:27:20 [NOTICE ] [CLM ] CLM CONFIGURATION CHANGE
Dec 10 13:27:20 [NOTICE ] [CLM ] New Configuration:
Dec 10 13:27:20 [NOTICE ] [CLM ] 192.168.1.8
Dec 10 13:27:20 [NOTICE ] [CLM ] 192.168.1.17
Dec 10 13:27:20 [NOTICE ] [CLM ] 192.168.1.17
Dec 10 13:27:20 [NOTICE ] [CLM ] 192.168.1.18
Dec 10 13:27:20 [NOTICE ] [CLM ] 192.168.1.18
Dec 10 13:27:20 [NOTICE ] [CLM ] 192.168.1.19
Dec 10 13:27:20 [NOTICE ] [CLM ] 192.168.1.19
Dec 10 13:27:20 [NOTICE ] [CLM ] Members Left:
Dec 10 13:27:20 [NOTICE ] [CLM ] Members Joined:
Dec 10 13:27:20 [NOTICE ] [CLM ] 192.168.1.17
Dec 10 13:27:20 [NOTICE ] [CLM ] 192.168.1.17
Dec 10 13:27:20 [NOTICE ] [CLM ] got nodejoin message 192.168.1.18
Dec 10 13:27:20 [NOTICE ] [CLM ] got nodejoin message 192.168.1.19
Dec 10 13:27:20 [NOTICE ] [CLM ] got nodejoin message 192.168.1.17
Dec 10 13:27:21 [NOTICE ] [GMI ] Got attempt join from 192.168.1.8
Dec 10 13:27:21 [NOTICE ] [GMI ] rep is 192.168.1.8, not handling attempt join.
Dec 10 13:27:21 [NOTICE ] [GMI ] Received member join from 192.168.1.8
Dec 10 13:27:21 [NOTICE ] [GMI ] not the rep for this ring, not handling join.
_______________________________________________
Openais mailing list
Openais@lists.osdl.org
http://lists.osdl.org/mailman/listinfo/openais
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic