[prev in list] [next in list] [prev in thread] [next in thread] 

List:       lucene-dev
Subject:    [JENKINS] Lucene-Solr-4.x-MacOSX (64bit/jdk1.7.0) - Build # 1575 - Still Failing!
From:       Policeman Jenkins Server <jenkins () thetaphi ! de>
Date:       2014-05-31 16:58:48
Message-ID: 1342544866.53.1401555548403.JavaMail.jenkins () serv1 ! sd-datasolutions ! de
[Download RAW message or body]

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-MacOSX/1575/
Java: 64bit/jdk1.7.0 -XX:+UseCompressedOops -XX:+UseSerialGC

1 tests failed.
FAILED:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch

Error Message:
No live SolrServers available to handle this \
request:[http://127.0.0.1:55851/collection1, http://127.0.0.1:55857/collection1, \
http://127.0.0.1:55887/collection1, http://127.0.0.1:55881/collection1, \
http://127.0.0.1:55847/collection1, http://127.0.0.1:55838/collection1, \
http://127.0.0.1:55841/collection1, http://127.0.0.1:55844/collection1, \
http://127.0.0.1:55869/collection1, http://127.0.0.1:55893/collection1, \
http://127.0.0.1:55875/collection1, http://127.0.0.1:55863/collection1]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to \
handle this request:[http://127.0.0.1:55851/collection1, \
http://127.0.0.1:55857/collection1, http://127.0.0.1:55887/collection1, \
http://127.0.0.1:55881/collection1, http://127.0.0.1:55847/collection1, \
http://127.0.0.1:55838/collection1, http://127.0.0.1:55841/collection1, \
http://127.0.0.1:55844/collection1, http://127.0.0.1:55869/collection1, \
http://127.0.0.1:55893/collection1, http://127.0.0.1:55875/collection1, \
http://127.0.0.1:55863/collection1]  at \
__randomizedtesting.SeedInfo.seed([6FEB1EEAFFA9C377:EE0D90F288F6A34B]:0)  at \
org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:319) \
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:650)
  at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:91)
	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1149)
  at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1118)
  at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:150)
  at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
  at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
  at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
  at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
  at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
  at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
  at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
  at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
  at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: \
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to \
handle this request:[http://127.0.0.1:55881/collection1, \
http://127.0.0.1:55847/collection1, http://127.0.0.1:55841/collection1, \
http://127.0.0.1:55838/collection1, http://127.0.0.1:55869/collection1, \
http://127.0.0.1:55863/collection1]  at \
org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:554)
  at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
  at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
  at org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:340)
  at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:301)
                
	... 47 more




Build Log:
[...truncated 11221 lines...]
   [junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
   [junit4]   2> Creating dataDir: \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/init-core-data-001
  [junit4]   2> 2126148 T6933 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl \
(false) and clientAuth (false)  [junit4]   2> 2126148 T6933 \
oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system \
property: /  [junit4]   2> 2126176 T6933 oas.SolrTestCaseJ4.setUp ###Starting \
testDistribSearch  [junit4]   2> 2126176 T6933 oasc.ZkTestServer.run STARTING ZK TEST \
SERVER  [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2126177 T6934 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting \
server  [junit4]   2> 2126278 T6933 oasc.ZkTestServer.run start zk server on \
port:55831  [junit4]   2> 2126283 T6933 oascc.ConnectionManager.waitForConnected \
Waiting for client to connect to ZooKeeper  [junit4]   2> 2126293 T6940 \
oascc.ConnectionManager.process Watcher \
org.apache.solr.common.cloud.ConnectionManager@71ce4ae1 name:ZooKeeperConnection \
Watcher:127.0.0.1:55831 got event WatchedEvent state:SyncConnected type:None \
path:null path:null type:None  [junit4]   2> 2126294 T6933 \
oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper  [junit4]   \
2> 2126295 T6933 oascc.SolrZkClient.makePath makePath: /solr  [junit4]   2> 2126321 \
T6933 oascc.ConnectionManager.waitForConnected Waiting for client to connect to \
ZooKeeper  [junit4]   2> 2126328 T6942 oascc.ConnectionManager.process Watcher \
org.apache.solr.common.cloud.ConnectionManager@184d4074 name:ZooKeeperConnection \
Watcher:127.0.0.1:55831/solr got event WatchedEvent state:SyncConnected type:None \
path:null path:null type:None  [junit4]   2> 2126328 T6933 \
oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper  [junit4]   \
2> 2126329 T6933 oascc.SolrZkClient.makePath makePath: /collections/collection1  \
[junit4]   2> 2126340 T6933 oascc.SolrZkClient.makePath makePath: \
/collections/collection1/shards  [junit4]   2> 2126357 T6933 \
oascc.SolrZkClient.makePath makePath: /collections/control_collection  [junit4]   2> \
2126361 T6933 oascc.SolrZkClient.makePath makePath: \
/collections/control_collection/shards  [junit4]   2> 2126369 T6933 \
oasc.AbstractZkTestCase.putConfig put \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml \
to /configs/conf1/solrconfig.xml  [junit4]   2> 2126370 T6933 \
oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml  [junit4]   2> \
2126381 T6933 oasc.AbstractZkTestCase.putConfig put \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema15.xml \
to /configs/conf1/schema.xml  [junit4]   2> 2126381 T6933 oascc.SolrZkClient.makePath \
makePath: /configs/conf1/schema.xml  [junit4]   2> 2126388 T6933 \
oasc.AbstractZkTestCase.putConfig put \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml \
to /configs/conf1/solrconfig.snippet.randomindexconfig.xml  [junit4]   2> 2126388 \
T6933 oascc.SolrZkClient.makePath makePath: \
/configs/conf1/solrconfig.snippet.randomindexconfig.xml  [junit4]   2> 2126395 T6933 \
oasc.AbstractZkTestCase.putConfig put \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt \
to /configs/conf1/stopwords.txt  [junit4]   2> 2126396 T6933 \
oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt  [junit4]   2> \
2126404 T6933 oasc.AbstractZkTestCase.putConfig put \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt \
to /configs/conf1/protwords.txt  [junit4]   2> 2126404 T6933 \
oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt  [junit4]   2> \
2126413 T6933 oasc.AbstractZkTestCase.putConfig put \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml \
to /configs/conf1/currency.xml  [junit4]   2> 2126413 T6933 \
oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml  [junit4]   2> \
2126422 T6933 oasc.AbstractZkTestCase.putConfig put \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml \
to /configs/conf1/enumsConfig.xml  [junit4]   2> 2126424 T6933 \
oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml  [junit4]   2> \
2126433 T6933 oasc.AbstractZkTestCase.putConfig put \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json \
to /configs/conf1/open-exchange-rates.json  [junit4]   2> 2126433 T6933 \
oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json  \
[junit4]   2> 2126445 T6933 oasc.AbstractZkTestCase.putConfig put \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt \
to /configs/conf1/mapping-ISOLatin1Accent.txt  [junit4]   2> 2126446 T6933 \
oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt  \
[junit4]   2> 2126456 T6933 oasc.AbstractZkTestCase.putConfig put \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt \
to /configs/conf1/old_synonyms.txt  [junit4]   2> 2126457 T6933 \
oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt  [junit4]   2> \
2126465 T6933 oasc.AbstractZkTestCase.putConfig put \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt \
to /configs/conf1/synonyms.txt  [junit4]   2> 2126465 T6933 \
oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt  [junit4]   2> \
2128024 T6933 oejs.Server.doStart jetty-8.1.10.v20130312  [junit4]   2> 2128030 T6933 \
oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55834  \
[junit4]   2> 2128031 T6933 oass.SolrDispatchFilter.init SolrDispatchFilter.init()  \
[junit4]   2> 2128031 T6933 oasc.SolrResourceLoader.locateSolrHome JNDI not \
configured for solr (NoInitialContextEx)  [junit4]   2> 2128032 T6933 \
oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: \
./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-002  [junit4]   \
2> 2128032 T6933 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: \
'./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-002/'  [junit4]  \
2> 2128071 T6933 oasc.ConfigSolr.fromFile Loading container configuration from \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-002/solr.xml
  [junit4]   2> 2128159 T6933 oasc.CoreContainer.<init> New CoreContainer 504666239
   [junit4]   2> 2128160 T6933 oasc.CoreContainer.load Loading cores into \
CoreContainer [instanceDir=./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-002/]
  [junit4]   2> 2128162 T6933 oashc.HttpShardHandlerFactory.getParameter Setting \
socketTimeout to: 90000  [junit4]   2> 2128162 T6933 \
oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:   [junit4]   2> \
2128163 T6933 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: \
15000  [junit4]   2> 2128163 T6933 oashc.HttpShardHandlerFactory.getParameter Setting \
maxConnectionsPerHost to: 20  [junit4]   2> 2128163 T6933 \
oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0  [junit4]   2> \
2128163 T6933 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: \
2147483647  [junit4]   2> 2128164 T6933 oashc.HttpShardHandlerFactory.getParameter \
Setting maxThreadIdleTime to: 5  [junit4]   2> 2128164 T6933 \
oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1  [junit4]   2> \
2128164 T6933 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: \
false  [junit4]   2> 2128165 T6933 oasl.LogWatcher.createWatcher SLF4J impl is \
org.slf4j.impl.Log4jLoggerFactory  [junit4]   2> 2128165 T6933 \
oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j \
(org.slf4j.impl.Log4jLoggerFactory)]  [junit4]   2> 2128166 T6933 \
oasc.CoreContainer.load Host Name: 127.0.0.1  [junit4]   2> 2128166 T6933 \
oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55831/solr  [junit4]   2> \
2128167 T6933 oasc.ZkController.checkChrootPath zkHost includes chroot  [junit4]   2> \
2128168 T6933 oascc.ConnectionManager.waitForConnected Waiting for client to connect \
to ZooKeeper  [junit4]   2> 2128172 T6953 oascc.ConnectionManager.process Watcher \
org.apache.solr.common.cloud.ConnectionManager@5a27c946 name:ZooKeeperConnection \
Watcher:127.0.0.1:55831 got event WatchedEvent state:SyncConnected type:None \
path:null path:null type:None  [junit4]   2> 2128173 T6933 \
oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper  [junit4]   \
2> 2128181 T6933 oascc.ConnectionManager.waitForConnected Waiting for client to \
connect to ZooKeeper  [junit4]   2> 2128184 T6955 oascc.ConnectionManager.process \
Watcher org.apache.solr.common.cloud.ConnectionManager@265f36e7 \
name:ZooKeeperConnection Watcher:127.0.0.1:55831/solr got event WatchedEvent \
state:SyncConnected type:None path:null path:null type:None  [junit4]   2> 2128184 \
T6933 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper  \
[junit4]   2> 2128188 T6933 oascc.SolrZkClient.makePath makePath: /overseer/queue  \
[junit4]   2> 2128197 T6933 oascc.SolrZkClient.makePath makePath: \
/overseer/collection-queue-work  [junit4]   2> 2128205 T6933 \
oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running  [junit4]   2> \
2128215 T6933 oascc.SolrZkClient.makePath makePath: \
/overseer/collection-map-completed  [junit4]   2> 2128224 T6933 \
oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure  [junit4]   2> \
2128232 T6933 oascc.SolrZkClient.makePath makePath: /live_nodes  [junit4]   2> \
2128236 T6933 oasc.ZkController.createEphemeralLiveNode Register node as live in \
ZooKeeper:/live_nodes/127.0.0.1:55834_  [junit4]   2> 2128238 T6933 \
oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55834_  [junit4]   2> \
2128245 T6933 oascc.SolrZkClient.makePath makePath: /overseer_elect  [junit4]   2> \
2128252 T6933 oascc.SolrZkClient.makePath makePath: /overseer_elect/election  \
[junit4]   2> 2128261 T6933 oasc.OverseerElectionContext.runLeaderProcess I am going \
to be the leader 127.0.0.1:55834_  [junit4]   2> 2128261 T6933 \
oascc.SolrZkClient.makePath makePath: /overseer_elect/leader  [junit4]   2> 2128267 \
T6933 oasc.Overseer.start Overseer \
(id=91852180029702147-127.0.0.1:55834_-n_0000000000) starting  [junit4]   2> 2128274 \
T6933 oascc.SolrZkClient.makePath makePath: /overseer/queue-work  [junit4]   2> \
2128302 T6957 oasc.OverseerCollectionProcessor.run Process current queue of \
collection creations  [junit4]   2> 2128303 T6933 oascc.SolrZkClient.makePath \
makePath: /clusterstate.json  [junit4]   2> 2128310 T6933 oascc.SolrZkClient.makePath \
makePath: /aliases.json  [junit4]   2> 2128315 T6933 \
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from \
ZooKeeper...   [junit4]   2> 2128324 T6956 oasc.Overseer$ClusterStateUpdater.run \
Starting to work on the main queue  [junit4]   2> 2128335 T6958 \
oasc.ZkController.publish publishing core=collection1 state=down \
collection=control_collection  [junit4]   2> 2128336 T6958 oasc.ZkController.publish \
numShards not found on descriptor - reading it from system property  [junit4]   2> \
2128338 T6955 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired \
on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  [junit4]   2> \
2128338 T6958 oasc.ZkController.waitForCoreNodeName look for our core node name  \
[junit4]   2> 2128343 T6956 oascc.ZkStateReader.updateClusterState Updating cloud \
state from ZooKeeper...   [junit4]   2> 2128345 T6956 \
oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={  \
[junit4]   2> 	  "operation":"state",  [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55834",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55834_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 2128345 T6956 oasc.Overseer$ClusterStateUpdater.createCollection \
Create collection control_collection with shards [shard1]  [junit4]   2> 2128345 \
T6956 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard \
shard=shard1  [junit4]   2> 2128354 T6955 \
oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: \
/overseer/queue state: SyncConnected type NodeChildrenChanged  [junit4]   2> 2128356 \
T6955 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 1)  [junit4]   2> 2129340 T6958 \
oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for \
collection1  [junit4]   2> 2129340 T6958 oasc.ZkController.createCollectionZkNode \
Check for collection zkNode:control_collection  [junit4]   2> 2129342 T6958 \
oasc.ZkController.createCollectionZkNode Collection zkNode exists  [junit4]   2> \
2129343 T6958 oascc.ZkStateReader.readConfigName Load collection config \
from:/collections/control_collection  [junit4]   2> 2129346 T6958 \
oascc.ZkStateReader.readConfigName path=/collections/control_collection \
configName=conf1 specified config exists in ZooKeeper  [junit4]   2> 2129347 T6958 \
oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: \
'./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-002/collection1/'
  [junit4]   2> 2129349 T6958 oasc.SolrResourceLoader.replaceClassLoader Adding \
'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/sol \
r.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-002/collection1/lib/.svn/' \
to classloader  [junit4]   2> 2129350 T6958 \
oasc.SolrResourceLoader.replaceClassLoader Adding \
'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/sol \
r.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-002/collection1/lib/classes/' \
to classloader  [junit4]   2> 2129352 T6958 \
oasc.SolrResourceLoader.replaceClassLoader Adding \
'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/sol \
r.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-002/collection1/lib/README' \
to classloader  [junit4]   2> 2129458 T6958 oasc.SolrConfig.<init> Using Lucene \
MatchVersion: LUCENE_4_9  [junit4]   2> 2129536 T6958 oasc.SolrConfig.<init> Loaded \
SolrConfig: solrconfig.xml  [junit4]   2> 2129541 T6958 oass.IndexSchema.readSchema \
Reading Solr Schema from schema.xml  [junit4]   2> 2129559 T6958 \
oass.IndexSchema.readSchema [collection1] Schema name=test  [junit4]   2> 2130288 \
T6958 oass.IndexSchema.readSchema default search field in schema is text  [junit4]   \
2> 2130293 T6958 oass.IndexSchema.readSchema unique key field: id  [junit4]   2> \
2130297 T6958 oass.FileExchangeRateProvider.reload Reloading exchange rates from file \
currency.xml  [junit4]   2> 2130307 T6958 oass.FileExchangeRateProvider.reload \
Reloading exchange rates from file currency.xml  [junit4]   2> 2130379 T6958 \
oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from \
collection control_collection  [junit4]   2> 2130380 T6958 \
oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory  [junit4]   2> \
2130380 T6958 oasc.SolrCore.<init> [collection1] Opening new SolrCore at \
./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-002/collection1/, \
dataDir=./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/control/data/
  [junit4]   2> 2130380 T6958 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. \
Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@cc77302  \
[junit4]   2> 2130382 T6958 oasc.CachingDirectoryFactory.get return new directory for \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/control/data
  [junit4]   2> 2130383 T6958 oasc.SolrCore.getNewIndexDir New index directory \
detected: old=null new=./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/control/data/index/
  [junit4]   2> 2130384 T6958 oasc.SolrCore.initIndex WARN [collection1] Solr index \
directory './solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/control/data/index' \
doesn't exist. Creating new index...  [junit4]   2> 2130385 T6958 \
oasc.CachingDirectoryFactory.get return new directory for \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/control/data/index
  [junit4]   2> 2130385 T6958 oasu.RandomMergePolicy.<init> RandomMergePolicy \
wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: \
minMergeSize=1000, mergeFactor=19, maxMergeSize=9223372036854775807, \
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, \
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]  \
[junit4]   2> 2130391 T6958 oasc.SolrDeletionPolicy.onCommit \
SolrDeletionPolicy.onCommit: commits: num=1  [junit4]   2> \
commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J \
0/solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/control/data/index,segFN=segments_1,generation=1}
  [junit4]   2> 2130391 T6958 oasc.SolrDeletionPolicy.updateCommits newest commit \
generation = 1  [junit4]   2> 2130396 T6958 oasup.UpdateRequestProcessorChain.init \
creating updateRequestProcessorChain "nodistrib"  [junit4]   2> 2130397 T6958 \
oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"  \
[junit4]   2> 2130397 T6958 oasup.UpdateRequestProcessorChain.init inserting \
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"  [junit4] \
2> 2130398 T6958 oasup.UpdateRequestProcessorChain.init creating \
updateRequestProcessorChain "stored_sig"  [junit4]   2> 2130398 T6958 \
oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory \
into updateRequestProcessorChain "stored_sig"  [junit4]   2> 2130399 T6958 \
oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain \
"distrib-dup-test-chain-explicit"  [junit4]   2> 2130399 T6958 \
oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain \
"distrib-dup-test-chain-implicit"  [junit4]   2> 2130400 T6958 \
oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory \
into updateRequestProcessorChain "distrib-dup-test-chain-implicit"  [junit4]   2> \
2130400 T6958 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain \
defined as default, creating implicit default  [junit4]   2> 2130401 T6958 \
oasc.RequestHandlers.initHandlersFromConfig created standard: \
solr.StandardRequestHandler  [junit4]   2> 2130402 T6958 \
oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler  \
[junit4]   2> 2130402 T6958 oasc.RequestHandlers.initHandlersFromConfig adding lazy \
requestHandler: solr.ReplicationHandler  [junit4]   2> 2130402 T6958 \
oasc.RequestHandlers.initHandlersFromConfig created /replication: \
solr.ReplicationHandler  [junit4]   2> 2130403 T6958 \
oasc.RequestHandlers.initHandlersFromConfig created /update: \
solr.UpdateRequestHandler  [junit4]   2> 2130404 T6958 \
oasc.RequestHandlers.initHandlersFromConfig created /admin/: \
org.apache.solr.handler.admin.AdminHandlers  [junit4]   2> 2130405 T6958 \
oasc.RequestHandlers.initHandlersFromConfig created /admin/file: \
solr.admin.ShowFileRequestHandler  [junit4]   2> 2130423 T6958 oashl.XMLLoader.init \
xsltCacheLifetimeSeconds=60  [junit4]   2> 2130428 T6958 oasu.CommitTracker.<init> \
Hard AutoCommit: disabled  [junit4]   2> 2130429 T6958 oasu.CommitTracker.<init> Soft \
AutoCommit: disabled  [junit4]   2> 2130429 T6958 oasu.RandomMergePolicy.<init> \
RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: \
[TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=33, \
maxMergedSegmentMB=44.14453125, floorSegmentMB=0.638671875, \
forceMergeDeletesPctAllowed=25.299205909566332, segmentsPerTier=38.0, \
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8772573479417266  [junit4]   \
2> 2130432 T6958 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: \
num=1  [junit4]   2> \
commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J \
0/solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/control/data/index,segFN=segments_1,generation=1}
  [junit4]   2> 2130432 T6958 oasc.SolrDeletionPolicy.updateCommits newest commit \
generation = 1  [junit4]   2> 2130433 T6958 oass.SolrIndexSearcher.<init> Opening \
Searcher@fc4eb68[collection1] main  [junit4]   2> 2130433 T6958 \
oascc.ZkStateReader.readConfigName Load collection config \
from:/collections/control_collection  [junit4]   2> 2130436 T6958 \
oascc.ZkStateReader.readConfigName path=/collections/control_collection \
configName=conf1 specified config exists in ZooKeeper  [junit4]   2> 2130437 T6958 \
oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the \
RestManager with znodeBase: /configs/conf1  [junit4]   2> 2130439 T6958 \
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured \
ZooKeeperStorageIO with znodeBase: /configs/conf1  [junit4]   2> 2130439 T6958 \
oasr.RestManager.init Initializing RestManager with initArgs: {}  [junit4]   2> \
2130440 T6958 oasr.ManagedResourceStorage.load Reading _rest_managed.json using \
ZooKeeperStorageIO:path=/configs/conf1  [junit4]   2> 2130442 T6958 \
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for \
znode /configs/conf1/_rest_managed.json  [junit4]   2> 2130443 T6958 \
oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using \
ZooKeeperStorageIO:path=/configs/conf1  [junit4]   2> 2130443 T6958 \
oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for \
/rest/managed  [junit4]   2> 2130444 T6958 oasr.RestManager.init Initializing 0 \
registered ManagedResources  [junit4]   2> 2130448 T6959 \
oasc.SolrCore.registerSearcher [collection1] Registered new searcher \
Searcher@fc4eb68[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}  \
[junit4]   2> 2130449 T6958 oasc.CoreContainer.registerCore registering core: \
collection1  [junit4]   2> 2130452 T6962 oasc.ZkController.register Register replica \
- core:collection1 address:http://127.0.0.1:55834 collection:control_collection \
shard:shard1  [junit4]   2> 2130453 T6933 oass.SolrDispatchFilter.init \
user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0 \
[junit4]   2> 2130453 T6933 oass.SolrDispatchFilter.init SolrDispatchFilter.init() \
done  [junit4]   2> 2130455 T6962 oascc.SolrZkClient.makePath makePath: \
/collections/control_collection/leader_elect/shard1/election  [junit4]   2> 2130456 \
T6933 oascc.ConnectionManager.waitForConnected Waiting for client to connect to \
ZooKeeper  [junit4]   2> 2130462 T6964 oascc.ConnectionManager.process Watcher \
org.apache.solr.common.cloud.ConnectionManager@421f611c name:ZooKeeperConnection \
Watcher:127.0.0.1:55831/solr got event WatchedEvent state:SyncConnected type:None \
path:null path:null type:None  [junit4]   2> 2130463 T6933 \
oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper  [junit4]   \
2> 2130466 T6933 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating \
cluster state from ZooKeeper...   [junit4]   2> 2130475 T6933 \
oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection \
loss:false  [junit4]   2> 2130477 T6962 \
oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard \
shard1  [junit4]   2> 2130483 T6962 \
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to \
continue.  [junit4]   2> 2130483 T6962 \
oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and \
sync  [junit4]   2> ASYNC  NEW_CORE C1840 name=collection1 \
org.apache.solr.core.SolrCore@61caa3e6 url=http://127.0.0.1:55834/collection1 \
node=127.0.0.1:55834_ C1840_STATE=coll:control_collection core:collection1 \
props:{state=down, base_url=http://127.0.0.1:55834, core=collection1, \
node_name=127.0.0.1:55834_}  [junit4]   2> 2130484 T6962 C1840 P55834 \
oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55834/collection1/  [junit4] \
2> 2130485 T6962 C1840 P55834 oasc.SyncStrategy.syncReplicas Sync Success - now sync \
replicas to me  [junit4]   2> 2130485 T6962 C1840 P55834 oasc.SyncStrategy.syncToMe \
http://127.0.0.1:55834/collection1/ has no replicas  [junit4]   2> 2130485 T6962 \
oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: \
http://127.0.0.1:55834/collection1/ shard1  [junit4]   2> 2130486 T6962 \
oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1  \
[junit4]   2> 2130485 T6955 oasc.DistributedQueue$LatchChildWatcher.process \
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type \
NodeChildrenChanged  [junit4]   2> 2130493 T6956 \
oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...   \
[junit4]   2> 2130507 T6955 oasc.DistributedQueue$LatchChildWatcher.process \
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type \
NodeChildrenChanged  [junit4]   2> 2130513 T6955 oascc.ZkStateReader$2.process A \
cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged \
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)  [junit4]   \
2> 2130517 T6964 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 1)  [junit4]   2> 2130535 T6956 \
oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...   \
[junit4]   2> 2130555 T6955 oasc.DistributedQueue$LatchChildWatcher.process \
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type \
NodeChildrenChanged  [junit4]   2> 2130673 T6964 oascc.ZkStateReader$2.process A \
cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged \
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)  [junit4]   \
2> 2130679 T6955 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 1)  [junit4]   2> 2130682 T6962 \
oasc.ZkController.register We are http://127.0.0.1:55834/collection1/ and leader is \
http://127.0.0.1:55834/collection1/  [junit4]   2> 2130682 T6962 \
oasc.ZkController.register No LogReplay needed for core=collection1 \
baseURL=http://127.0.0.1:55834  [junit4]   2> 2130683 T6962 \
oasc.ZkController.checkRecovery I am the leader, no recovery necessary  [junit4]   2> \
2130683 T6962 oasc.ZkController.publish publishing core=collection1 state=active \
collection=control_collection  [junit4]   2> 2130683 T6962 oasc.ZkController.publish \
numShards not found on descriptor - reading it from system property  [junit4]   2> \
2130686 T6955 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired \
on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  [junit4]   2> \
2130687 T6955 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired \
on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  [junit4]   2> \
2130688 T6955 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired \
on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  [junit4]   2> \
   [junit4]   2> 2130692 T6956 oascc.ZkStateReader.updateClusterState Updating cloud \
state from ZooKeeper...   [junit4]   2> 2130693 T6956 \
oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={  \
[junit4]   2> 	  "operation":"state",  [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55834",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55834_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 2130699 T6955 oasc.DistributedQueue$LatchChildWatcher.process \
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type \
NodeChildrenChanged  [junit4]   2> 2130806 T6955 oascc.ZkStateReader$2.process A \
cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged \
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)  [junit4]   \
2> 2130807 T6964 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 1)  [junit4]   2> 2132318 T6933 \
oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1  [junit4]   2> 2132320 \
T6933 oejs.Server.doStart jetty-8.1.10.v20130312  [junit4]   2> 2132327 T6933 \
oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55838  \
[junit4]   2> 2132329 T6933 oass.SolrDispatchFilter.init SolrDispatchFilter.init()  \
[junit4]   2> 2132329 T6933 oasc.SolrResourceLoader.locateSolrHome JNDI not \
configured for solr (NoInitialContextEx)  [junit4]   2> 2132329 T6933 \
oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: \
./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-003  [junit4]   \
2> 2132330 T6933 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: \
'./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-003/'  [junit4]  \
2> 2132374 T6933 oasc.ConfigSolr.fromFile Loading container configuration from \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-003/solr.xml
  [junit4]   2> 2132476 T6933 oasc.CoreContainer.<init> New CoreContainer 64550301
   [junit4]   2> 2132477 T6933 oasc.CoreContainer.load Loading cores into \
CoreContainer [instanceDir=./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-003/]
  [junit4]   2> 2132478 T6933 oashc.HttpShardHandlerFactory.getParameter Setting \
socketTimeout to: 90000  [junit4]   2> 2132478 T6933 \
oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:   [junit4]   2> \
2132479 T6933 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: \
15000  [junit4]   2> 2132479 T6933 oashc.HttpShardHandlerFactory.getParameter Setting \
maxConnectionsPerHost to: 20  [junit4]   2> 2132479 T6933 \
oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0  [junit4]   2> \
2132479 T6933 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: \
2147483647  [junit4]   2> 2132480 T6933 oashc.HttpShardHandlerFactory.getParameter \
Setting maxThreadIdleTime to: 5  [junit4]   2> 2132480 T6933 \
oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1  [junit4]   2> \
2132480 T6933 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: \
false  [junit4]   2> 2132481 T6933 oasl.LogWatcher.createWatcher SLF4J impl is \
org.slf4j.impl.Log4jLoggerFactory  [junit4]   2> 2132482 T6933 \
oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j \
(org.slf4j.impl.Log4jLoggerFactory)]  [junit4]   2> 2132482 T6933 \
oasc.CoreContainer.load Host Name: 127.0.0.1  [junit4]   2> 2132483 T6933 \
oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55831/solr  [junit4]   2> \
2132483 T6933 oasc.ZkController.checkChrootPath zkHost includes chroot  [junit4]   2> \
2132511 T6933 oascc.ConnectionManager.waitForConnected Waiting for client to connect \
to ZooKeeper  [junit4]   2> 2132512 T6975 oascc.ConnectionManager.process Watcher \
org.apache.solr.common.cloud.ConnectionManager@18e51864 name:ZooKeeperConnection \
Watcher:127.0.0.1:55831 got event WatchedEvent state:SyncConnected type:None \
path:null path:null type:None  [junit4]   2> 2132514 T6933 \
oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper  [junit4]   \
2> 2132520 T6933 oascc.ConnectionManager.waitForConnected Waiting for client to \
connect to ZooKeeper  [junit4]   2> 2132526 T6977 oascc.ConnectionManager.process \
Watcher org.apache.solr.common.cloud.ConnectionManager@120430f2 \
name:ZooKeeperConnection Watcher:127.0.0.1:55831/solr got event WatchedEvent \
state:SyncConnected type:None path:null path:null type:None  [junit4]   2> 2132526 \
T6933 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper  \
[junit4]   2> 2132553 T6933 oascc.ZkStateReader.createClusterStateWatchersAndUpdate \
Updating cluster state from ZooKeeper...   [junit4]   2> 2133565 T6933 \
oasc.ZkController.createEphemeralLiveNode Register node as live in \
ZooKeeper:/live_nodes/127.0.0.1:55838_  [junit4]   2> 2133571 T6933 \
oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55838_  [junit4]   2> \
2133587 T6964 oascc.ZkStateReader$3.process Updating live nodes... (2)  [junit4]   2> \
2133590 T6977 oascc.ZkStateReader$3.process Updating live nodes... (2)  [junit4]   2> \
2133591 T6955 oascc.ZkStateReader$3.process Updating live nodes... (2)  [junit4]   2> \
2133647 T6978 oasc.ZkController.publish publishing core=collection1 state=down \
collection=collection1  [junit4]   2> 2133648 T6978 oasc.ZkController.publish \
numShards not found on descriptor - reading it from system property  [junit4]   2> \
2133651 T6955 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired \
on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  [junit4]   2> \
2133651 T6955 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired \
on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  [junit4]   2> \
2133651 T6955 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired \
on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  [junit4]   2> \
2133651 T6978 oasc.ZkController.waitForCoreNodeName look for our core node name  \
[junit4]   2> 2133655 T6956 oascc.ZkStateReader.updateClusterState Updating cloud \
state from ZooKeeper...   [junit4]   2> 2133657 T6956 \
oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={  \
[junit4]   2> 	  "operation":"state",  [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55838",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55838_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 2133657 T6956 oasc.Overseer$ClusterStateUpdater.createCollection \
Create collection collection1 with shards [shard1, shard2, shard3]  [junit4]   2> \
2133657 T6956 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to \
shard shard=shard3  [junit4]   2> 2133663 T6955 \
oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: \
/overseer/queue state: SyncConnected type NodeChildrenChanged  [junit4]   2> 2133664 \
T6955 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 2)  [junit4]   2> 2133665 T6964 \
oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 2)  [junit4]   2> 2133666 T6977 \
oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 2)  [junit4]   2> 2134654 T6978 \
oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for \
collection1  [junit4]   2> 2134654 T6978 oasc.ZkController.createCollectionZkNode \
Check for collection zkNode:collection1  [junit4]   2> 2134656 T6978 \
oasc.ZkController.createCollectionZkNode Collection zkNode exists  [junit4]   2> \
2134656 T6978 oascc.ZkStateReader.readConfigName Load collection config \
from:/collections/collection1  [junit4]   2> 2134660 T6978 \
oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 \
specified config exists in ZooKeeper  [junit4]   2> 2134660 T6978 \
oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: \
'./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-003/collection1/'
  [junit4]   2> 2134663 T6978 oasc.SolrResourceLoader.replaceClassLoader Adding \
'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/sol \
r.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-003/collection1/lib/.svn/' \
to classloader  [junit4]   2> 2134663 T6978 \
oasc.SolrResourceLoader.replaceClassLoader Adding \
'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/sol \
r.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-003/collection1/lib/classes/' \
to classloader  [junit4]   2> 2134664 T6978 \
oasc.SolrResourceLoader.replaceClassLoader Adding \
'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/sol \
r.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-003/collection1/lib/README' \
to classloader  [junit4]   2> 2134772 T6978 oasc.SolrConfig.<init> Using Lucene \
MatchVersion: LUCENE_4_9  [junit4]   2> 2134854 T6978 oasc.SolrConfig.<init> Loaded \
SolrConfig: solrconfig.xml  [junit4]   2> 2134858 T6978 oass.IndexSchema.readSchema \
Reading Solr Schema from schema.xml  [junit4]   2> 2134868 T6978 \
oass.IndexSchema.readSchema [collection1] Schema name=test  [junit4]   2> 2135513 \
T6978 oass.IndexSchema.readSchema default search field in schema is text  [junit4]   \
2> 2135517 T6978 oass.IndexSchema.readSchema unique key field: id  [junit4]   2> \
2135519 T6978 oass.FileExchangeRateProvider.reload Reloading exchange rates from file \
currency.xml  [junit4]   2> 2135526 T6978 oass.FileExchangeRateProvider.reload \
Reloading exchange rates from file currency.xml  [junit4]   2> 2135588 T6978 \
oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from \
collection collection1  [junit4]   2> 2135588 T6978 \
oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory  [junit4]   2> \
2135589 T6978 oasc.SolrCore.<init> [collection1] Opening new SolrCore at \
./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-003/collection1/, \
dataDir=./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/jetty1/
  [junit4]   2> 2135589 T6978 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. \
Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@cc77302  \
[junit4]   2> 2135590 T6978 oasc.CachingDirectoryFactory.get return new directory for \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/jetty1
  [junit4]   2> 2135591 T6978 oasc.SolrCore.getNewIndexDir New index directory \
detected: old=null new=./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/jetty1/index/
  [junit4]   2> 2135592 T6978 oasc.SolrCore.initIndex WARN [collection1] Solr index \
directory './solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/jetty1/index' \
doesn't exist. Creating new index...  [junit4]   2> 2135593 T6978 \
oasc.CachingDirectoryFactory.get return new directory for \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/jetty1/index
  [junit4]   2> 2135593 T6978 oasu.RandomMergePolicy.<init> RandomMergePolicy \
wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: \
minMergeSize=1000, mergeFactor=19, maxMergeSize=9223372036854775807, \
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, \
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]  \
[junit4]   2> 2135600 T6978 oasc.SolrDeletionPolicy.onCommit \
SolrDeletionPolicy.onCommit: commits: num=1  [junit4]   2> \
commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J \
0/solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/jetty1/index,segFN=segments_1,generation=1}
  [junit4]   2> 2135601 T6978 oasc.SolrDeletionPolicy.updateCommits newest commit \
generation = 1  [junit4]   2> 2135608 T6978 oasup.UpdateRequestProcessorChain.init \
creating updateRequestProcessorChain "nodistrib"  [junit4]   2> 2135608 T6978 \
oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"  \
[junit4]   2> 2135609 T6978 oasup.UpdateRequestProcessorChain.init inserting \
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"  [junit4] \
2> 2135609 T6978 oasup.UpdateRequestProcessorChain.init creating \
updateRequestProcessorChain "stored_sig"  [junit4]   2> 2135610 T6978 \
oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory \
into updateRequestProcessorChain "stored_sig"  [junit4]   2> 2135610 T6978 \
oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain \
"distrib-dup-test-chain-explicit"  [junit4]   2> 2135611 T6978 \
oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain \
"distrib-dup-test-chain-implicit"  [junit4]   2> 2135611 T6978 \
oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory \
into updateRequestProcessorChain "distrib-dup-test-chain-implicit"  [junit4]   2> \
2135611 T6978 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain \
defined as default, creating implicit default  [junit4]   2> 2135612 T6978 \
oasc.RequestHandlers.initHandlersFromConfig created standard: \
solr.StandardRequestHandler  [junit4]   2> 2135613 T6978 \
oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler  \
[junit4]   2> 2135613 T6978 oasc.RequestHandlers.initHandlersFromConfig adding lazy \
requestHandler: solr.ReplicationHandler  [junit4]   2> 2135613 T6978 \
oasc.RequestHandlers.initHandlersFromConfig created /replication: \
solr.ReplicationHandler  [junit4]   2> 2135614 T6978 \
oasc.RequestHandlers.initHandlersFromConfig created /update: \
solr.UpdateRequestHandler  [junit4]   2> 2135614 T6978 \
oasc.RequestHandlers.initHandlersFromConfig created /admin/: \
org.apache.solr.handler.admin.AdminHandlers  [junit4]   2> 2135615 T6978 \
oasc.RequestHandlers.initHandlersFromConfig created /admin/file: \
solr.admin.ShowFileRequestHandler  [junit4]   2> 2135629 T6978 oashl.XMLLoader.init \
xsltCacheLifetimeSeconds=60  [junit4]   2> 2135633 T6978 oasu.CommitTracker.<init> \
Hard AutoCommit: disabled  [junit4]   2> 2135633 T6978 oasu.CommitTracker.<init> Soft \
AutoCommit: disabled  [junit4]   2> 2135634 T6978 oasu.RandomMergePolicy.<init> \
RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: \
[TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=33, \
maxMergedSegmentMB=44.14453125, floorSegmentMB=0.638671875, \
forceMergeDeletesPctAllowed=25.299205909566332, segmentsPerTier=38.0, \
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8772573479417266  [junit4]   \
2> 2135636 T6978 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: \
num=1  [junit4]   2> \
commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J \
0/solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/jetty1/index,segFN=segments_1,generation=1}
  [junit4]   2> 2135636 T6978 oasc.SolrDeletionPolicy.updateCommits newest commit \
generation = 1  [junit4]   2> 2135637 T6978 oass.SolrIndexSearcher.<init> Opening \
Searcher@5d6e449a[collection1] main  [junit4]   2> 2135637 T6978 \
oascc.ZkStateReader.readConfigName Load collection config \
from:/collections/collection1  [junit4]   2> 2135640 T6978 \
oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 \
specified config exists in ZooKeeper  [junit4]   2> 2135640 T6978 \
oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the \
RestManager with znodeBase: /configs/conf1  [junit4]   2> 2135642 T6978 \
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured \
ZooKeeperStorageIO with znodeBase: /configs/conf1  [junit4]   2> 2135642 T6978 \
oasr.RestManager.init Initializing RestManager with initArgs: {}  [junit4]   2> \
2135643 T6978 oasr.ManagedResourceStorage.load Reading _rest_managed.json using \
ZooKeeperStorageIO:path=/configs/conf1  [junit4]   2> 2135645 T6978 \
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for \
znode /configs/conf1/_rest_managed.json  [junit4]   2> 2135645 T6978 \
oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using \
ZooKeeperStorageIO:path=/configs/conf1  [junit4]   2> 2135645 T6978 \
oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for \
/rest/managed  [junit4]   2> 2135646 T6978 oasr.RestManager.init Initializing 0 \
registered ManagedResources  [junit4]   2> 2135653 T6979 \
oasc.SolrCore.registerSearcher [collection1] Registered new searcher \
Searcher@5d6e449a[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}  \
[junit4]   2> 2135657 T6978 oasc.CoreContainer.registerCore registering core: \
collection1  [junit4]   2> 2135659 T6982 oasc.ZkController.register Register replica \
- core:collection1 address:http://127.0.0.1:55838 collection:collection1 shard:shard3 \
[junit4]   2> 2135660 T6933 oass.SolrDispatchFilter.init \
user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0 \
[junit4]   2> 2135661 T6933 oass.SolrDispatchFilter.init SolrDispatchFilter.init() \
done  [junit4]   2> 2135663 T6982 oascc.SolrZkClient.makePath makePath: \
/collections/collection1/leader_elect/shard3/election  [junit4]   2> 2135678 T6982 \
oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard \
shard3  [junit4]   2> 2135682 T6982 \
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to \
continue.  [junit4]   2> 2135682 T6982 \
oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and \
sync  [junit4]   2> ASYNC  NEW_CORE C1841 name=collection1 \
org.apache.solr.core.SolrCore@27af1e52 url=http://127.0.0.1:55838/collection1 \
node=127.0.0.1:55838_ C1841_STATE=coll:collection1 core:collection1 \
props:{state=down, base_url=http://127.0.0.1:55838, core=collection1, \
node_name=127.0.0.1:55838_}  [junit4]   2> 2135683 T6982 C1841 P55838 \
oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55838/collection1/  [junit4] \
2> 2135683 T6982 C1841 P55838 oasc.SyncStrategy.syncReplicas Sync Success - now sync \
replicas to me  [junit4]   2> 2135683 T6982 C1841 P55838 oasc.SyncStrategy.syncToMe \
http://127.0.0.1:55838/collection1/ has no replicas  [junit4]   2> 2135683 T6982 \
oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: \
http://127.0.0.1:55838/collection1/ shard3  [junit4]   2> 2135684 T6982 \
oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3  \
[junit4]   2> 2135684 T6955 oasc.DistributedQueue$LatchChildWatcher.process \
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type \
NodeChildrenChanged  [junit4]   2> 2135694 T6956 \
oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...   \
[junit4]   2> 2135702 T6955 oasc.DistributedQueue$LatchChildWatcher.process \
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type \
NodeChildrenChanged  [junit4]   2> 2135708 T6955 oascc.ZkStateReader$2.process A \
cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged \
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)  [junit4]   \
2> 2135709 T6977 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 2)  [junit4]   2> 2135713 T6964 \
oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 2)  [junit4]   2> 2135720 T6956 \
oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...   \
[junit4]   2> 2135725 T6955 oasc.DistributedQueue$LatchChildWatcher.process \
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type \
NodeChildrenChanged  [junit4]   2> 2135830 T6955 oascc.ZkStateReader$2.process A \
cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged \
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)  [junit4]   \
2> 2135830 T6964 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 2)  [junit4]   2> 2135831 T6977 \
oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 2)  [junit4]   2> 2135861 T6982 \
oasc.ZkController.register We are http://127.0.0.1:55838/collection1/ and leader is \
http://127.0.0.1:55838/collection1/  [junit4]   2> 2135862 T6982 \
oasc.ZkController.register No LogReplay needed for core=collection1 \
baseURL=http://127.0.0.1:55838  [junit4]   2> 2135862 T6982 \
oasc.ZkController.checkRecovery I am the leader, no recovery necessary  [junit4]   2> \
2135862 T6982 oasc.ZkController.publish publishing core=collection1 state=active \
collection=collection1  [junit4]   2> 2135865 T6982 oasc.ZkController.publish \
numShards not found on descriptor - reading it from system property  [junit4]   2> \
2135869 T6955 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired \
on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  [junit4]   2> \
2135870 T6955 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired \
on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  [junit4]   2> \
   [junit4]   2> 2135872 T6982 oascc.ZkStateReader.updateClusterState Updating cloud \
state from ZooKeeper...   [junit4]   2> 2135877 T6956 \
oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...   \
[junit4]   2> 2135878 T6956 oasc.Overseer$ClusterStateUpdater.updateState Update \
state numShards=3 message={  [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55838",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55838_",
   [junit4]   2> 	  "shard":"shard3",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 2135884 T6955 oasc.DistributedQueue$LatchChildWatcher.process \
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type \
NodeChildrenChanged  [junit4]   2> 2135991 T6955 oascc.ZkStateReader$2.process A \
cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged \
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)  [junit4]   \
2> 2135991 T6977 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 2)  [junit4]   2> 2135991 T6964 \
oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 2)  [junit4]   2> 2137280 T6933 \
oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2  [junit4]   2> 2137280 \
T6933 oejs.Server.doStart jetty-8.1.10.v20130312  [junit4]   2> 2137284 T6933 \
oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55841  \
[junit4]   2> 2137286 T6933 oass.SolrDispatchFilter.init SolrDispatchFilter.init()  \
[junit4]   2> 2137287 T6933 oasc.SolrResourceLoader.locateSolrHome JNDI not \
configured for solr (NoInitialContextEx)  [junit4]   2> 2137287 T6933 \
oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: \
../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/s \
olr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-004
  [junit4]   2> 2137288 T6933 oasc.SolrResourceLoader.<init> new SolrResourceLoader \
for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-Mac \
OSX/solr/build/solr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-004/'
  [junit4]   2> 2137334 T6933 oasc.ConfigSolr.fromFile Loading container \
configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-cor \
e/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/so \
lr/build/solr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-004/solr.xml
  [junit4]   2> 2137460 T6933 oasc.CoreContainer.<init> New CoreContainer 926764590
   [junit4]   2> 2137460 T6933 oasc.CoreContainer.load Loading cores into \
CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-S \
olr-4.x-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-004/]
  [junit4]   2> 2137462 T6933 oashc.HttpShardHandlerFactory.getParameter Setting \
socketTimeout to: 90000  [junit4]   2> 2137462 T6933 \
oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:   [junit4]   2> \
2137462 T6933 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: \
15000  [junit4]   2> 2137462 T6933 oashc.HttpShardHandlerFactory.getParameter Setting \
maxConnectionsPerHost to: 20  [junit4]   2> 2137463 T6933 \
oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0  [junit4]   2> \
2137463 T6933 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: \
2147483647  [junit4]   2> 2137463 T6933 oashc.HttpShardHandlerFactory.getParameter \
Setting maxThreadIdleTime to: 5  [junit4]   2> 2137464 T6933 \
oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1  [junit4]   2> \
2137464 T6933 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: \
false  [junit4]   2> 2137464 T6933 oasl.LogWatcher.createWatcher SLF4J impl is \
org.slf4j.impl.Log4jLoggerFactory  [junit4]   2> 2137465 T6933 \
oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j \
(org.slf4j.impl.Log4jLoggerFactory)]  [junit4]   2> 2137465 T6933 \
oasc.CoreContainer.load Host Name: 127.0.0.1  [junit4]   2> 2137466 T6933 \
oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55831/solr  [junit4]   2> \
2137466 T6933 oasc.ZkController.checkChrootPath zkHost includes chroot  [junit4]   2> \
2137468 T6933 oascc.ConnectionManager.waitForConnected Waiting for client to connect \
to ZooKeeper  [junit4]   2> 2137474 T6993 oascc.ConnectionManager.process Watcher \
org.apache.solr.common.cloud.ConnectionManager@19d7ca57 name:ZooKeeperConnection \
Watcher:127.0.0.1:55831 got event WatchedEvent state:SyncConnected type:None \
path:null path:null type:None  [junit4]   2> 2137474 T6933 \
oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper  [junit4]   \
2> 2137481 T6933 oascc.ConnectionManager.waitForConnected Waiting for client to \
connect to ZooKeeper  [junit4]   2> 2137484 T6995 oascc.ConnectionManager.process \
Watcher org.apache.solr.common.cloud.ConnectionManager@5960b59 \
name:ZooKeeperConnection Watcher:127.0.0.1:55831/solr got event WatchedEvent \
state:SyncConnected type:None path:null path:null type:None  [junit4]   2> 2137485 \
T6933 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper  \
[junit4]   2> 2137504 T6933 oascc.ZkStateReader.createClusterStateWatchersAndUpdate \
Updating cluster state from ZooKeeper...   [junit4]   2> 2138515 T6933 \
oasc.ZkController.createEphemeralLiveNode Register node as live in \
ZooKeeper:/live_nodes/127.0.0.1:55841_  [junit4]   2> 2138522 T6933 \
oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55841_  [junit4]   2> \
2138542 T6955 oascc.ZkStateReader$3.process Updating live nodes... (3)  [junit4]   2> \
2138548 T6964 oascc.ZkStateReader$3.process Updating live nodes... (3)  [junit4]   2> \
2138549 T6977 oascc.ZkStateReader$3.process Updating live nodes... (3)  [junit4]   2> \
2138552 T6995 oascc.ZkStateReader$3.process Updating live nodes... (3)  [junit4]   2> \
2138592 T6996 oasc.ZkController.publish publishing core=collection1 state=down \
collection=collection1  [junit4]   2> 2138593 T6996 oasc.ZkController.publish \
numShards not found on descriptor - reading it from system property  [junit4]   2> \
2138595 T6955 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired \
on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  [junit4]   2> \
2138596 T6955 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired \
on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  [junit4]   2> \
2138596 T6955 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired \
on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  [junit4]   2> \
2138596 T6996 oasc.ZkController.waitForCoreNodeName look for our core node name  \
[junit4]   2> 2138600 T6956 oascc.ZkStateReader.updateClusterState Updating cloud \
state from ZooKeeper...   [junit4]   2> 2138602 T6956 \
oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={  \
[junit4]   2> 	  "operation":"state",  [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55841",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55841_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 2138603 T6956 oasc.Overseer$ClusterStateUpdater.updateState \
Collection already exists with numShards=3  [junit4]   2> 2138603 T6956 \
oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard \
shard=shard1  [junit4]   2> 2138611 T6955 \
oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: \
/overseer/queue state: SyncConnected type NodeChildrenChanged  [junit4]   2> 2138614 \
T6955 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 3)  [junit4]   2> 2138615 T6995 \
oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 3)  [junit4]   2> 2138614 T6964 \
oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 3)  [junit4]   2> 2138614 T6977 \
oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 3)  [junit4]   2> 2139598 T6996 \
oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for \
collection1  [junit4]   2> 2139598 T6996 oasc.ZkController.createCollectionZkNode \
Check for collection zkNode:collection1  [junit4]   2> 2139600 T6996 \
oasc.ZkController.createCollectionZkNode Collection zkNode exists  [junit4]   2> \
2139600 T6996 oascc.ZkStateReader.readConfigName Load collection config \
from:/collections/collection1  [junit4]   2> 2139604 T6996 \
oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 \
specified config exists in ZooKeeper  [junit4]   2> 2139604 T6996 \
oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: \
'../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/ \
solr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-004/collection1/'
  [junit4]   2> 2139606 T6996 oasc.SolrResourceLoader.replaceClassLoader Adding \
'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/sol \
r.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-004/collection1/lib/.svn/' \
to classloader  [junit4]   2> 2139607 T6996 \
oasc.SolrResourceLoader.replaceClassLoader Adding \
'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/sol \
r.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-004/collection1/lib/classes/' \
to classloader  [junit4]   2> 2139607 T6996 \
oasc.SolrResourceLoader.replaceClassLoader Adding \
'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/sol \
r.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-004/collection1/lib/README' \
to classloader  [junit4]   2> 2139691 T6996 oasc.SolrConfig.<init> Using Lucene \
MatchVersion: LUCENE_4_9  [junit4]   2> 2139777 T6996 oasc.SolrConfig.<init> Loaded \
SolrConfig: solrconfig.xml  [junit4]   2> 2139781 T6996 oass.IndexSchema.readSchema \
Reading Solr Schema from schema.xml  [junit4]   2> 2139798 T6996 \
oass.IndexSchema.readSchema [collection1] Schema name=test  [junit4]   2> 2140470 \
T6996 oass.IndexSchema.readSchema default search field in schema is text  [junit4]   \
2> 2140474 T6996 oass.IndexSchema.readSchema unique key field: id  [junit4]   2> \
2140478 T6996 oass.FileExchangeRateProvider.reload Reloading exchange rates from file \
currency.xml  [junit4]   2> 2140485 T6996 oass.FileExchangeRateProvider.reload \
Reloading exchange rates from file currency.xml  [junit4]   2> 2140550 T6996 \
oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from \
collection collection1  [junit4]   2> 2140550 T6996 \
oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory  [junit4]   2> \
2140551 T6996 oasc.SolrCore.<init> [collection1] Opening new SolrCore at \
../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/s \
olr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-004/collection1/, \
dataDir=./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/jetty2/
  [junit4]   2> 2140551 T6996 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. \
Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@cc77302  \
[junit4]   2> 2140552 T6996 oasc.CachingDirectoryFactory.get return new directory for \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/jetty2
  [junit4]   2> 2140552 T6996 oasc.SolrCore.getNewIndexDir New index directory \
detected: old=null new=./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/jetty2/index/
  [junit4]   2> 2140553 T6996 oasc.SolrCore.initIndex WARN [collection1] Solr index \
directory './solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/jetty2/index' \
doesn't exist. Creating new index...  [junit4]   2> 2140554 T6996 \
oasc.CachingDirectoryFactory.get return new directory for \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/jetty2/index
  [junit4]   2> 2140554 T6996 oasu.RandomMergePolicy.<init> RandomMergePolicy \
wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: \
minMergeSize=1000, mergeFactor=19, maxMergeSize=9223372036854775807, \
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, \
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]  \
[junit4]   2> 2140557 T6996 oasc.SolrDeletionPolicy.onCommit \
SolrDeletionPolicy.onCommit: commits: num=1  [junit4]   2> \
commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J \
0/solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/jetty2/index,segFN=segments_1,generation=1}
  [junit4]   2> 2140558 T6996 oasc.SolrDeletionPolicy.updateCommits newest commit \
generation = 1  [junit4]   2> 2140564 T6996 oasup.UpdateRequestProcessorChain.init \
creating updateRequestProcessorChain "nodistrib"  [junit4]   2> 2140564 T6996 \
oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"  \
[junit4]   2> 2140565 T6996 oasup.UpdateRequestProcessorChain.init inserting \
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"  [junit4] \
2> 2140565 T6996 oasup.UpdateRequestProcessorChain.init creating \
updateRequestProcessorChain "stored_sig"  [junit4]   2> 2140565 T6996 \
oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory \
into updateRequestProcessorChain "stored_sig"  [junit4]   2> 2140566 T6996 \
oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain \
"distrib-dup-test-chain-explicit"  [junit4]   2> 2140567 T6996 \
oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain \
"distrib-dup-test-chain-implicit"  [junit4]   2> 2140567 T6996 \
oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory \
into updateRequestProcessorChain "distrib-dup-test-chain-implicit"  [junit4]   2> \
2140568 T6996 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain \
defined as default, creating implicit default  [junit4]   2> 2140568 T6996 \
oasc.RequestHandlers.initHandlersFromConfig created standard: \
solr.StandardRequestHandler  [junit4]   2> 2140569 T6996 \
oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler  \
[junit4]   2> 2140569 T6996 oasc.RequestHandlers.initHandlersFromConfig adding lazy \
requestHandler: solr.ReplicationHandler  [junit4]   2> 2140570 T6996 \
oasc.RequestHandlers.initHandlersFromConfig created /replication: \
solr.ReplicationHandler  [junit4]   2> 2140570 T6996 \
oasc.RequestHandlers.initHandlersFromConfig created /update: \
solr.UpdateRequestHandler  [junit4]   2> 2140570 T6996 \
oasc.RequestHandlers.initHandlersFromConfig created /admin/: \
org.apache.solr.handler.admin.AdminHandlers  [junit4]   2> 2140571 T6996 \
oasc.RequestHandlers.initHandlersFromConfig created /admin/file: \
solr.admin.ShowFileRequestHandler  [junit4]   2> 2140582 T6996 oashl.XMLLoader.init \
xsltCacheLifetimeSeconds=60  [junit4]   2> 2140587 T6996 oasu.CommitTracker.<init> \
Hard AutoCommit: disabled  [junit4]   2> 2140588 T6996 oasu.CommitTracker.<init> Soft \
AutoCommit: disabled  [junit4]   2> 2140588 T6996 oasu.RandomMergePolicy.<init> \
RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: \
[TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=33, \
maxMergedSegmentMB=44.14453125, floorSegmentMB=0.638671875, \
forceMergeDeletesPctAllowed=25.299205909566332, segmentsPerTier=38.0, \
maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8772573479417266  [junit4]   \
2> 2140590 T6996 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: \
num=1  [junit4]   2> \
commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J \
0/solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/jetty2/index,segFN=segments_1,generation=1}
  [junit4]   2> 2140590 T6996 oasc.SolrDeletionPolicy.updateCommits newest commit \
generation = 1  [junit4]   2> 2140591 T6996 oass.SolrIndexSearcher.<init> Opening \
Searcher@7576f622[collection1] main  [junit4]   2> 2140591 T6996 \
oascc.ZkStateReader.readConfigName Load collection config \
from:/collections/collection1  [junit4]   2> 2140593 T6996 \
oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 \
specified config exists in ZooKeeper  [junit4]   2> 2140594 T6996 \
oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the \
RestManager with znodeBase: /configs/conf1  [junit4]   2> 2140595 T6996 \
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured \
ZooKeeperStorageIO with znodeBase: /configs/conf1  [junit4]   2> 2140595 T6996 \
oasr.RestManager.init Initializing RestManager with initArgs: {}  [junit4]   2> \
2140595 T6996 oasr.ManagedResourceStorage.load Reading _rest_managed.json using \
ZooKeeperStorageIO:path=/configs/conf1  [junit4]   2> 2140596 T6996 \
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for \
znode /configs/conf1/_rest_managed.json  [junit4]   2> 2140597 T6996 \
oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using \
ZooKeeperStorageIO:path=/configs/conf1  [junit4]   2> 2140597 T6996 \
oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for \
/rest/managed  [junit4]   2> 2140597 T6996 oasr.RestManager.init Initializing 0 \
registered ManagedResources  [junit4]   2> 2140607 T6997 \
oasc.SolrCore.registerSearcher [collection1] Registered new searcher \
Searcher@7576f622[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}  \
[junit4]   2> 2140610 T6996 oasc.CoreContainer.registerCore registering core: \
collection1  [junit4]   2> 2140612 T7000 oasc.ZkController.register Register replica \
- core:collection1 address:http://127.0.0.1:55841 collection:collection1 shard:shard1 \
[junit4]   2> 2140613 T6933 oass.SolrDispatchFilter.init \
user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0 \
[junit4]   2> 2140613 T6933 oass.SolrDispatchFilter.init SolrDispatchFilter.init() \
done  [junit4]   2> 2140614 T7000 oascc.SolrZkClient.makePath makePath: \
/collections/collection1/leader_elect/shard1/election  [junit4]   2> 2140627 T7000 \
oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard \
shard1  [junit4]   2> 2140631 T6955 oasc.DistributedQueue$LatchChildWatcher.process \
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type \
NodeChildrenChanged  [junit4]   2> 2140636 T7000 \
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to \
continue.  [junit4]   2> 2140636 T7000 \
oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and \
sync  [junit4]   2> ASYNC  NEW_CORE C1842 name=collection1 \
org.apache.solr.core.SolrCore@35e3ae2a url=http://127.0.0.1:55841/collection1 \
node=127.0.0.1:55841_ C1842_STATE=coll:collection1 core:collection1 \
props:{state=down, base_url=http://127.0.0.1:55841, core=collection1, \
node_name=127.0.0.1:55841_}  [junit4]   2> 2140636 T7000 C1842 P55841 \
oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55841/collection1/  [junit4] \
2> 2140636 T7000 C1842 P55841 oasc.SyncStrategy.syncReplicas Sync Success - now sync \
replicas to me  [junit4]   2> 2140637 T7000 C1842 P55841 oasc.SyncStrategy.syncToMe \
http://127.0.0.1:55841/collection1/ has no replicas  [junit4]   2> 2140637 T7000 \
oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: \
http://127.0.0.1:55841/collection1/ shard1  [junit4]   2> 2140638 T7000 \
oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1  \
[junit4]   2> 2140638 T6956 oascc.ZkStateReader.updateClusterState Updating cloud \
state from ZooKeeper...   [junit4]   2> 2140645 T6955 \
oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: \
/overseer/queue state: SyncConnected type NodeChildrenChanged  [junit4]   2> 2140648 \
T6977 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 3)  [junit4]   2> 2140648 T6964 \
oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 3)  [junit4]   2> 2140649 T6955 \
oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 3)  [junit4]   2> 2140651 T6995 \
oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 3)  [junit4]   2> 2140663 T6956 \
oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...   \
[junit4]   2> 2140669 T6955 oasc.DistributedQueue$LatchChildWatcher.process \
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type \
NodeChildrenChanged  [junit4]   2> 2140775 T6964 oascc.ZkStateReader$2.process A \
cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged \
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)  [junit4]   \
2> 2140775 T6995 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 3)  [junit4]   2> 2140776 T6955 \
oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 3)  [junit4]   2> 2140775 T6977 \
oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 3)  [junit4]   2> 2140816 T7000 \
oasc.ZkController.register We are http://127.0.0.1:55841/collection1/ and leader is \
   [junit4]   2> 2140816 T7000 oasc.ZkController.checkRecovery I am the leader, no \
recovery necessary  [junit4]   2> 2140816 T7000 oasc.ZkController.publish publishing \
core=collection1 state=active collection=collection1  [junit4]   2> 2140817 T7000 \
oasc.ZkController.publish numShards not found on descriptor - reading it from system \
property  [junit4]   2> 2140821 T6955 oasc.DistributedQueue$LatchChildWatcher.process \
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type \
NodeChildrenChanged  [junit4]   2> 2140821 T6955 \
oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: \
/overseer/queue state: SyncConnected type NodeChildrenChanged  [junit4]   2> 2140821 \
T6955 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on \
path: /overseer/queue state: SyncConnected type NodeChildrenChanged  [junit4]   2> \
2140824 T7000 oascc.ZkStateReader.updateClusterState Updating cloud state from \
ZooKeeper...   [junit4]   2> 2140825 T6956 oascc.ZkStateReader.updateClusterState \
Updating cloud state from ZooKeeper...   [junit4]   2> 2140828 T6956 \
oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={  \
[junit4]   2> 	  "operation":"state",  [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55841",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55841_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 2140835 T6955 oasc.DistributedQueue$LatchChildWatcher.process \
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type \
NodeChildrenChanged  [junit4]   2> 2140941 T6977 oascc.ZkStateReader$2.process A \
cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged \
path:/clusterstate.json, has occurred - updating... (live nodes size: 3)  [junit4]   \
2> 2140941 T6995 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 3)  [junit4]   2> 2140942 T6964 \
oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 3)  [junit4]   2> 2140942 T6955 \
oascc.ZkStateReader$2.process A cluster state change: WatchedEvent \
state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - \
updating... (live nodes size: 3)  [junit4]   2> 2142255 T6933 \
oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3  [junit4]   2> 2142256 \
T6933 oejs.Server.doStart jetty-8.1.10.v20130312  [junit4]   2> 2142260 T6933 \
oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55844  \
[junit4]   2> 2142262 T6933 oass.SolrDispatchFilter.init SolrDispatchFilter.init()  \
[junit4]   2> 2142263 T6933 oasc.SolrResourceLoader.locateSolrHome JNDI not \
configured for solr (NoInitialContextEx)  [junit4]   2> 2142263 T6933 \
oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: \
./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-005  [junit4]   \
2> 2142263 T6933 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: \
'./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-005/'  [junit4]  \
2> 2142324 T6933 oasc.ConfigSolr.fromFile Loading container configuration from \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-005/solr.xml
  [junit4]   2> 2142423 T6933 oasc.CoreContainer.<init> New CoreContainer 1666291875
   [junit4]   2> 2142424 T6933 oasc.CoreContainer.load Loading cores into \
CoreContainer [instanceDir=./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-005/]
  [junit4]   2> 2142426 T6933 oashc.HttpShardHandlerFactory.getParameter Setting \
socketTimeout to: 90000  [junit4]   2> 2142426 T6933 \
oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:   [junit4]   2> \
2142426 T6933 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: \
15000  [junit4]   2> 2142427 T6933 oashc.HttpShardHandlerFactory.getParameter Setting \
maxConnectionsPerHost to: 20  [junit4]   2> 2142427 T6933 \
oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0  [junit4]   2> \
2142428 T6933 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: \
2147483647  [junit4]   2> 2142428 T6933 oashc.HttpShardHandlerFactory.getParameter \
Setting maxThreadIdleTime to: 5  [junit4]   2> 2142428 T6933 \
oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1  [junit4]   2> \
2142429 T6933 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: \
false  [junit4]   2> 2142429 T6933 oasl.LogWatcher.createWatcher SLF4J impl is \
org.slf4j.impl.Log4jLoggerFactory  [junit4]   2> 2142430 T6933 \
oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j \
(org.slf4j.impl.Log4jLoggerFactory)]  [junit4]   2> 2142430 T6933 \
oasc.CoreContainer.load Host Name: 127.0.0.1  [junit4]   2> 2142430 T6933 \
oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55831/solr  [junit4]   2> \
2142431 T6933 oasc.ZkController.checkChrootPath zkHost includes chroot  [junit4]   2> \
2142433 T6933 oascc.ConnectionManager.waitForConnected Waiting for client to connect \
to ZooKeeper  [junit4]   2> 2142439 T7011 oascc.ConnectionManager.process Watcher \
org.apache.solr.common.cloud.ConnectionManager@1fc2846 name:ZooKeeperConnection \
Watcher:127.0.0.1:55831 got event WatchedEvent state:SyncConnected type:None \
path:null path:null type:None  [junit4]   2> 2142439 T6933 \
oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper  [junit4]   \
2> 2142444 T6933 oascc.ConnectionManager.waitForConnected Waiting for client to \
connect to ZooKeeper  [junit4]   2> 2142448 T7013 oascc.ConnectionManager.process \
Watcher org.apache.solr.common.cloud.ConnectionManager@619163ca \
name:ZooKeeperConnection Watcher:127.0.0.1:55831/solr got event WatchedEvent \
state:SyncConnected type:None path:null path:null type:None  [junit4]   2> 2142449 \
T6933 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper  \
[junit4]   2> 2142473 T6933 oascc.ZkStateReader.createClusterStateWatchersAndUpdate \
Updating cluster state from ZooKeeper...   [junit4]   2> 2143485 T6933 \
oasc.ZkController.createEphemeralLiveNode Register node as live in \
ZooKeeper:/live_nodes/127.0.0.1:55844_  [junit4]   2> 2143490 T6933 \
oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55844_  [junit4]   2> \
2143506 T6995 oascc.ZkStateReader$3.process Updating live nodes... (4)  [junit4]   2> \
2143507 T6964 oascc.ZkStateReader$3.process Updating live nodes... (4)  [junit4]   2> \
2143507 T7013 oascc.ZkStateReader$3.process Updating live nodes... (4)  [junit4]   2> \
2143510 T6977 oascc.ZkStateReader$3.process Updating live nodes... (4)  [junit4]   2> \
2143510 T6955 oascc.ZkStateReader$3.process Updating live nodes... (4)  [junit4]   2> \
2143544 T7014 oasc.ZkController.publish publishing core=collection1 state=down \
collection=collection1  [junit4]   2> 2143544 T7014 oasc.ZkController.publish \
numShards not found on descriptor - reading it from system property  [junit4]   2> \
2143549 T6955 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired \
on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  [junit4]   2> \
2143549 T6955 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired \
on path: /overseer/queue state: SyncConnected type NodeChildrenChanged  [junit4]   2> \
2143550 T6955 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired \
on path: /overseer/queue state: SyncConnected type NodeChildrenCh

[...truncated too long message...]

_size=6586,transaction_logs_total_number=2}
   [junit4]   2> 2214781 T7198 oasu.SolrCoreState.decrefSolrCoreState Closing \
SolrCoreState  [junit4]   2> 2214781 T7198 oasu.DefaultSolrCoreState.closeIndexWriter \
SolrCoreState ref count has reached 0 - closing IndexWriter  [junit4]   2> 2214781 \
T7198 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with \
IndexWriterCloser  [junit4]   2> 2214783 T7198 oasc.SolrCore.closeSearcher \
[collection1] Closing main searcher on request.  [junit4]   2> 2214787 T7198 \
oasc.CachingDirectoryFactory.close Closing StandardDirectoryFactory - 2 directories \
currently being tracked  [junit4]   2> 2214787 T7198 \
oasc.CachingDirectoryFactory.closeCacheValue looking to close \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/solr.clou \
d.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/jetty12/index.20140531111827370 \
[CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build \
/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/jetty12/index.20140531111827370;done=false>>]
  [junit4]   2> 2214787 T7198 oasc.CachingDirectoryFactory.close Closing directory: \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/solr.clou \
d.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/jetty12/index.20140531111827370
  [junit4]   2> 2214787 T7198 oasc.CachingDirectoryFactory.closeCacheValue looking to \
close /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/jetty12 \
[CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build \
/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/jetty12;done=false>>]
  [junit4]   2> 2214788 T7198 oasc.CachingDirectoryFactory.close Closing directory: \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001/tempDir-001/jetty12
  [junit4]   2> 2214788 T7198 oascc.ZkStateReader$3.process WARN ZooKeeper watch \
triggered, but Solr cannot talk to ZK  [junit4]   2> 2214789 T7198 \
oasc.LeaderElector$ElectionWatcher.process WARN  \
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = \
Session expired for /overseer_elect/election  [junit4]   2> 	at \
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)  [junit4]   2> \
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)  [junit4]   \
2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)  [junit4]   2> \
at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)  \
[junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
  [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
  [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
  [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
  [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
  [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
  [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
  [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
  [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-6FEB1EEAFFA9C377-001
  [junit4]   2> NOTE: test params are: codec=Lucene3x, sim=DefaultSimilarity, \
locale=ar_DZ, timezone=America/Coral_Harbour  [junit4]   2> NOTE: Mac OS X 10.8.5 \
x86_64/Oracle Corporation 1.7.0_55 \
(64-bit)/cpus=2,threads=1,free=75403000,total=349831168  [junit4]   2> NOTE: All \
tests run in this JVM: [HdfsSyncSliceTest, TestTrie, PrimUtilsTest, ZkControllerTest, \
BlockDirectoryTest, UpdateRequestProcessorFactoryTest, \
DefaultValueUpdateProcessorTest, DistributedDebugComponentTest, CustomCollectionTest, \
TestManagedResource, TestFuzzyAnalyzedSuggestions, DirectUpdateHandlerTest, \
TestSolrDeletionPolicy2, TestOverriddenPrefixQueryForCustomFieldType, \
SolrCoreCheckLockOnStartupTest, TestDocSet, TestJmxMonitoredMap, TestWriterPerf, \
EnumFieldTest, ChangedSchemaMergeTest, OutputWriterTest, RequiredFieldsTest, \
TestExceedMaxTermLength, TestValueSourceCache, TestSolrXMLSerializer, TestNRTOpen, \
TestStressUserVersions, TestPhraseSuggestions, TestGroupingSearch, \
TestStressRecovery, BinaryUpdateRequestHandlerTest, MergeStrategyTest, \
TestFieldTypeResource, TestCoreContainer, TestShardHandlerFactory, TestSearcherReuse, \
CacheHeaderTest, TestSolrDeletionPolicy1, SpellCheckComponentTest, \
DistributedTermsComponentTest, ShardRoutingTest, MultiThreadedOCPTest, \
TestFunctionQuery, PreAnalyzedFieldTest, ZkNodePropsTest, FileBasedSpellCheckerTest, \
TestJmxIntegration, SpellCheckCollatorTest, TestSort, EchoParamsTest, \
LeaderElectionTest, SolrIndexConfigTest, NotRequiredUniqueKeyTest, BadComponentTest, \
TestSuggestSpellingConverter, TestBlendedInfixSuggestions, TestQueryUtils, \
HdfsDirectoryTest, TestLMDirichletSimilarityFactory, TestRangeQuery, \
TermVectorComponentDistributedTest, JSONWriterTest, SimplePostToolTest, \
TestNoOpRegenerator, MBeansHandlerTest, ShardRoutingCustomTest, TestFastLRUCache, \
TestCharFilters, TestDistribDocBasedVersion, BlockCacheTest, TestJoin, \
ConnectionManagerTest, SOLR749Test, TestAnalyzeInfixSuggestions, \
TestDefaultSimilarityFactory, OpenExchangeRatesOrgProviderTest, \
TestPHPSerializedResponseWriter, PeerSyncTest, TestSerializedLuceneMatchVersion, \
DistributedExpandComponentTest, SignatureUpdateProcessorFactoryTest, TestReload, \
RecoveryZkTest, TestReplicationHandler, InfoHandlerTest, UnloadDistributedZkTest, \
TestLMJelinekMercerSimilarityFactory, TestAtomicUpdateErrorCases, \
TestRandomMergePolicy, FieldMutatingUpdateProcessorTest, XmlUpdateRequestHandlerTest, \
FileUtilsTest, TestUniqueKeyFieldResource, TestLuceneMatchVersion, \
TestDFRSimilarityFactory, AnalysisErrorHandlingTest, DistributedSuggestComponentTest, \
DOMUtilTest, URLClassifyProcessorTest, SolrInfoMBeanTest, \
TestPartialUpdateDeduplication, TestRequestStatusCollectionAPI, SolrPluginUtilsTest, \
TestFieldSortValues, TestReloadAndDeleteDocs, CSVRequestHandlerTest, \
CachingDirectoryFactoryTest, TestXIncludeConfig, DirectSolrSpellCheckerTest, \
SearchHandlerTest, CoreAdminCreateDiscoverTest, TestDocumentBuilder, TestRecovery, \
OverseerCollectionProcessorTest, TestIBSimilarityFactory, DateFieldTest, \
TestPostingsSolrHighlighter, FastVectorHighlighterTest, TestDistributedMissingSort, \
TestHighFrequencyDictionaryFactory, SolrXmlInZkTest, AliasIntegrationTest, \
TestRestManager, DeleteReplicaTest, TestCloudManagedSchema, TestStressVersions, \
DocExpirationUpdateProcessorFactoryTest, HdfsUnloadDistributedZkTest, \
ScriptEngineTest, LeaderElectionIntegrationTest, SolrTestCaseJ4Test, \
SynonymTokenizerTest, TestSolrXmlPersistor, LegacyHTMLStripCharFilterTest, \
MultiTermTest, HdfsCollectionsAPIDistributedZkTest, SpellingQueryConverterTest, \
TestElisionMultitermQuery, TestCustomSort, BasicDistributedZk2Test, SuggesterTest, \
BJQParserTest, ClusterStateUpdateTest, DocValuesTest, TestManagedSchema, \
SolrRequestParserTest, TestStandardQParsers, TestSolr4Spatial, HighlighterTest, \
JsonLoaderTest, RemoteQueryErrorTest, DeleteShardTest, TestSolrQueryParserResource, \
FullSolrCloudDistribCmdsTest, TestMiniSolrCloudCluster, AutoCommitTest, \
TestCloudInspectUtil, TestHashPartitioner, ParsingFieldUpdateProcessorsTest, \
SpellPossibilityIteratorTest, CursorPagingTest, TestBinaryResponseWriter, \
DistributedQueryComponentCustomSortTest, TestManagedStopFilterFactory, \
ConvertedLegacyTest, AddSchemaFieldsUpdateProcessorFactoryTest, \
TestSchemaNameResource, HdfsChaosMonkeySafeLeaderTest, SyncSliceTest, \
ExternalFileFieldSortTest, TestDistributedGrouping, BadIndexSchemaTest, \
TestInitQParser, SortByFunctionTest, TestUpdate, PingRequestHandlerTest, \
PluginInfoTest, DirectUpdateHandlerOptimizeTest, WordBreakSolrSpellCheckerTest, \
MinimalSchemaTest, TestSchemaSimilarityResource, TestBadConfig, DateMathParserTest, \
HdfsLockFactoryTest, CollectionsAPIAsyncDistributedZkTest, \
QueryElevationComponentTest, TestCollationKeyRangeQueries, \
TestDefaultSearchFieldResource, SampleTest, OverseerStatusTest, TermsComponentTest, \
BasicDistributedZkTest, ChaosMonkeySafeLeaderTest]  [junit4] Completed in 88.82s, 1 \
test, 1 error <<< FAILURES!

[...truncated 615 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:467: The following error \
occurred while executing this line: \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:447: The following error \
occurred while executing this line: \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:45: The following error \
occurred while executing this line: \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/extra-targets.xml:37: The following \
error occurred while executing this line: \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build.xml:189: The following \
error occurred while executing this line: \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/common-build.xml:496: The \
following error occurred while executing this line: \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:1297: The \
following error occurred while executing this line: \
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:921: There \
were test failures: 396 suites, 1640 tests, 1 error, 41 ignored (14 assumptions)

Total time: 113 minutes 57 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:+UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org

[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic