[prev in list] [next in list] [prev in thread] [next in thread] 

List:       lucene-dev
Subject:    BadApple report
From:       Erick Erickson <erickerickson () gmail ! com>
Date:       2020-10-26 13:35:07
Message-ID: 880906CD-B808-48FF-8874-4BE7F6806AA3 () gmail ! com
[Download RAW message or body]

Still working through the failures on the reference impl, so AFAIK, the tests failing \
large percentages of the time are on that branch.

Processing file (History bit 3): HOSS-2020-10-26.csv
Processing file (History bit 2): HOSS-2020-10-19.csv
Processing file (History bit 1): HOSS-2020-10-12.csv
Processing file (History bit 0): HOSS-2020-10-05.csv


Number of AwaitsFix: 31 Number of BadApples: 3


**Annotated tests that didn't fail in the last 4 weeks.

  **Tests removed from the next two lists because they were specified in \
'doNotEnable' in the properties file  MoveReplicaHDFSTest.testNormalFailedMove

  **Annotations can be removed from the following tests because they haven't failed \
in the last 4 rollups.

  **Methods: 0


Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  150 failures
Week: 1  had  174 failures
Week: 2  had  142 failures
Week: 3  had  153 failures


********Failures in Hoss' reports in every one of the last 4 rollups.

There were 397 unannotated tests that failed in Hoss' rollups. Ordered by the date I \
downloaded the rollup file, newest->oldest. See above for the dates the files were \
collected  These tests were NOT BadApple'd or AwaitsFix'd

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123 100.0       35     35      AssignTest.classMethod
     0123 100.0      255    255      AsyncCallRequestStatusResponseTest.classMethod
     0123   0.8     1916     13      CachingDirectoryFactoryTest.stressTest
     0123 100.0      155    155      CollectionsAPIDistributedZkTest.classMethod
     0123   3.8     1960     51      \
                CollectionsAPIDistributedZkTest.testBadActionNames
     0123   3.8     1960     51      \
                CollectionsAPIDistributedZkTest.testMissingNumShards
     0123   3.8     1960     51      \
                CollectionsAPIDistributedZkTest.testMissingRequiredParameters
     0123   3.8     1960     51      \
                CollectionsAPIDistributedZkTest.testNoConfigSetExist
     0123   3.8     1960     51      \
CollectionsAPIDistributedZkTest.testZeroNumShards  0123 100.0      205    205      \
                CollectionsAPISolrJTest.classMethod
     0123 100.0      250    250      \
ConcurrentUpdateSolrClientMultiCollectionTest.classMethod  0123 100.0      205    205 \
DeleteNodeTest.classMethod  0123   1.8     1565     56      \
HttpPartitionOnCommitTest.test  0123   1.1     1546     33      \
                HttpPartitionTest.test
     0123 100.0      250    250      JsonRequestApiHeatmapFacetingTest.classMethod
     0123 100.0      250    250      JsonRequestApiTest.classMethod
     0123   2.2     1576     53      MultiThreadedOCPTest.test
     0123 100.0      205    205      OverseerModifyCollectionTest.classMethod
     0123   1.7      988     11      TestCircuitBreaker.testResponseWithCBTiming
     0123   0.7     1521      6      TestCustomStream.testDynamicLoadingCustomStream
     0123   1.3     1256     25      TestHdfsCloudBackupRestore.test
     0123   1.1     1509     26      TestLocalFSCloudBackupRestore.test
     0123   1.4     1513     25      TestPackages.testPluginLoading
     0123  13.7     1982    233      \
TestSTUniformSplitPostingFormat.testCheckIntegrityReadsAllBytes  0123  26.0     1981  \
451      TestSynonymFilterFactory.testFormat  0123  26.0     1981    451      \
TestSynonymFilterFactory.testSynonyms  0123  26.1     1983    452      \
TestSysoutsLimits.OverHardLimit  0123  26.1     1983    452      \
                TestSysoutsLimits.testOverSoftLimit
     0123   0.4     1519      6      TestSystemCollAutoCreate.testAutoCreate
     0123  13.7     1982    233      \
                TestUniformSplitPostingFormat.testCheckIntegrityReadsAllBytes
     0123 100.0      250    250      UsingSolrJRefGuideExamplesTest.classMethod
     0123 100.0      250    250      ZkConfigFilesTest.classMethod
********************************************


["e-mail-2020-10-26.txt" (e-mail-2020-10-26.txt)]

DO NOT ENABLE LIST:
    MoveReplicaHDFSTest.testFailedMove
    MoveReplicaHDFSTest.testNormalFailedMove
    TestControlledRealTimeReopenThread.testCRTReopen
    TestICUNormalizer2CharFilter.testRandomStrings
    TestICUTokenizerCJK
    TestImpersonationWithHadoopAuth.testForwarding
    TestLTRReRankingPipeline.testDifferentTopN
    TestRandomChains


DO NOT ANNOTATE LIST
    CdcrBidirectionalTest.testBiDir
    IndexSizeTriggerTest.testMergeIntegration
    IndexSizeTriggerTest.testMixedBounds
    IndexSizeTriggerTest.testSplitIntegration
    IndexSizeTriggerTest.testTrigger
    InfixSuggestersTest.testShutdownDuringBuild
    ShardSplitTest.test
    ShardSplitTest.testSplitMixedReplicaTypes
    ShardSplitTest.testSplitWithChaosMonkey
    Test2BPostings.test
    TestLatLonShapeQueries.testRandomBig
    TestPackedInts.testPackedLongValues
    TestRandomChains.testRandomChainsWithLargeStrings
    TestTriggerIntegration.testSearchRate

SuppressWarnings count: last week: 4,484, this week: 4,484, delta 0


*************** Files with increased @SuppressWarnings annotations:

Suppress count increase in: \
solr/core/src/test/org/apache/solr/cloud/TestConfigSetsAPIShareSchema.java. Was: \
null, now: 1

*************** Files with decreased @SuppressWarnings annotations:


Processing file (History bit 3): HOSS-2020-10-26.csv
Processing file (History bit 2): HOSS-2020-10-19.csv
Processing file (History bit 1): HOSS-2020-10-12.csv
Processing file (History bit 0): HOSS-2020-10-05.csv


Number of AwaitsFix: 31 Number of BadApples: 3


**Annotated tests that didn't fail in the last 4 weeks.

  **Tests removed from the next two lists because they were specified in \
'doNotEnable' in the properties file  MoveReplicaHDFSTest.testNormalFailedMove

  **Annotations can be removed from the following tests because they haven't failed \
in the last 4 rollups.

  **Methods: 0


Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  150 failures
Week: 1  had  174 failures
Week: 2  had  142 failures
Week: 3  had  153 failures


********Failures in Hoss' reports in every one of the last 4 rollups.

There were 397 unannotated tests that failed in Hoss' rollups. Ordered by the date I \
downloaded the rollup file, newest->oldest. See above for the dates the files were \
collected  These tests were NOT BadApple'd or AwaitsFix'd

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123 100.0       35     35      AssignTest.classMethod
     0123 100.0      255    255      AsyncCallRequestStatusResponseTest.classMethod
     0123   0.8     1916     13      CachingDirectoryFactoryTest.stressTest
     0123 100.0      155    155      CollectionsAPIDistributedZkTest.classMethod
     0123   3.8     1960     51      \
                CollectionsAPIDistributedZkTest.testBadActionNames
     0123   3.8     1960     51      \
                CollectionsAPIDistributedZkTest.testMissingNumShards
     0123   3.8     1960     51      \
                CollectionsAPIDistributedZkTest.testMissingRequiredParameters
     0123   3.8     1960     51      \
                CollectionsAPIDistributedZkTest.testNoConfigSetExist
     0123   3.8     1960     51      \
CollectionsAPIDistributedZkTest.testZeroNumShards  0123 100.0      205    205      \
                CollectionsAPISolrJTest.classMethod
     0123 100.0      250    250      \
ConcurrentUpdateSolrClientMultiCollectionTest.classMethod  0123 100.0      205    205 \
DeleteNodeTest.classMethod  0123   1.8     1565     56      \
HttpPartitionOnCommitTest.test  0123   1.1     1546     33      \
                HttpPartitionTest.test
     0123 100.0      250    250      JsonRequestApiHeatmapFacetingTest.classMethod
     0123 100.0      250    250      JsonRequestApiTest.classMethod
     0123   2.2     1576     53      MultiThreadedOCPTest.test
     0123 100.0      205    205      OverseerModifyCollectionTest.classMethod
     0123   1.7      988     11      TestCircuitBreaker.testResponseWithCBTiming
     0123   0.7     1521      6      TestCustomStream.testDynamicLoadingCustomStream
     0123   1.3     1256     25      TestHdfsCloudBackupRestore.test
     0123   1.1     1509     26      TestLocalFSCloudBackupRestore.test
     0123   1.4     1513     25      TestPackages.testPluginLoading
     0123  13.7     1982    233      \
TestSTUniformSplitPostingFormat.testCheckIntegrityReadsAllBytes  0123  26.0     1981  \
451      TestSynonymFilterFactory.testFormat  0123  26.0     1981    451      \
TestSynonymFilterFactory.testSynonyms  0123  26.1     1983    452      \
TestSysoutsLimits.OverHardLimit  0123  26.1     1983    452      \
                TestSysoutsLimits.testOverSoftLimit
     0123   0.4     1519      6      TestSystemCollAutoCreate.testAutoCreate
     0123  13.7     1982    233      \
                TestUniformSplitPostingFormat.testCheckIntegrityReadsAllBytes
     0123 100.0      250    250      UsingSolrJRefGuideExamplesTest.classMethod
     0123 100.0      250    250      ZkConfigFilesTest.classMethod
********************************************

Failures over the last 4 weeks, but not every week. Ordered most-recent first:



   Report   Pct     runs    fails           test
     012    0.3     1425      4      CloudHttp2SolrClientTest.testRouting
     012    0.6      551      4      ExecutePlanActionTest.testTaskTimeout
     012    0.4     1058     19      ShardSplitTest.testSplitMixedReplicaTypesLink
     012  100.0        8      8      TestJsonFacets.classMethod
     012    0.7     1031      8      \
                TestPullReplicaErrorHandling.testCantConnectToLeader
     012    1.1     1031      9      \
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper  01 3   0.4     \
1120     13      AssignBackwardCompatibilityTest.test  01 3   0.4     1116      3     \
                MoveReplicaTest.testFailedMove
     01 3   1.4     1122      6      \
SolrCloudExampleTest.testLoadDocsIntoGettingStartedCollection  01 3 100.0        3    \
3      TestCloudConsistency.classMethod  01 3   1.3      587      4      \
TestDynamicLoading.testDynamicLoading  01 3   0.4     1107      7      \
                TestPointFields.testFloatPointStats
     01 3   1.2     1189      8      \
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast  01   100.0      \
                2      2      AnalysisErrorHandlingTest.classMethod
     01     0.6      342      2      \
                AutoAddReplicasIntegrationTest.testClusterPropOverridesCollecitonProp
     01     0.3      856      2      \
                CloudHttp2SolrClientTest.testNonRetryableRequests
     01     0.4      630      2      CollectionsAPIDistributedZkTest.addReplicaTest
     01     0.4      632     18      LeaderFailoverAfterPartitionTest.test
     01     0.3      696      2      \
ManagedSchemaRoundRobinCloudTest.testAddFieldsRoundRobin  01     0.3      696     16  \
                MoveReplicaTest.test
     01     0.6      339      2      \
                NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState
     01     0.6      340      2      \
NodeMarkersRegistrationTest.testNodeMarkersRegistration  01   100.0        2      2   \
PeerSyncReplicationTest.classMethod  01     0.3      692     18      \
RecoveryZkTest.test  01     0.4      643     18      ShardSplitTest.testSplitLocking
     01     0.4      643     18      ShardSplitTest.testSplitStaticIndexReplication
     01     0.4      643     18      \
                ShardSplitTest.testSplitStaticIndexReplicationLink
     01     4.5       39      3      ShardSplitTest.testSplitWithChaosMonkey
     01     0.4      630      2      SolrShardReporterTest.test
     01     0.3      691      2      TestBlobHandler.doBlobHandlerTest
     01     0.9      530      3      \
                TestDelegationWithHadoopAuth.testDelegationTokenRenew
     01   100.0        2      2      TestLocalFSCloudBackupRestore.classMethod
     01     5.7      429     30      TestSpanExplanations.testExplainWithoutScoring
     01     5.7      427     30      \
TestSpanExplanationsOfNonMatches.testExplainWithoutScoring  01     0.4      636     \
                18      TestTlogReplica.testDeleteById
     01     0.8      147      2      TestVectorValues.testAddIndexesDirectory01
     0 23   0.4     1185      8      BasicDistributedZkTest.test
     0 23   0.4     1157      3      PeerSyncReplicationTest.test
     0 23   0.4     1164      3      \
TestCollectionAPI.testRecreateCollectionAfterFailure  0 23   0.7     1157      8      \
                TestInPlaceUpdatesDistrib.test
     0 2    1.4      931      6      \
                CloudHttp2SolrClientTest.testRetryUpdatesWhenClusterStateIsStale
     0 2    0.3      931      2      CloudHttp2SolrClientTest.testVersionsAreReturned
     0 2  100.0        2      2      DeleteStatusTest.classMethod
     0 2    0.4      675      2      TestCloudSchemaless.test
     0 2    1.0      694      4      TestDistributedSearch.test
     0 2    0.3      742      2      TestPrepRecovery.testLeaderUnloaded
     0  3   0.6      401      3      \
ComputePlanActionTest.testSelectedCollectionsByPolicy  0  3   0.3      814      2     \
                DeleteShardTest.test
     0  3   0.3      812      2      \
DocValuesNotIndexedTest.testGroupingDVOnlySortFirst  0  3   0.4      761      4      \
                TestRandomRequestDistribution.test
     0  3   0.3      813      2      TestSegmentSorting.testSegmentTerminateEarly
     0  3 100.0        2      2      TestSizeLimitedDistributedMap.classMethod
     0    100.0       50     50      AddReplicaTest.classMethod
     0      0.3      363      1      AnalyticsMergeStrategyTest.test
     0      1.6       61      1      \
                CloudHttp2SolrClientWireMockTest.testConcurrentParallelUpdates
     0    100.0       30     30      CollectionsAPIAsyncDistributedZkTest.classMethod
     0      2.9      344     10      \
                CollectionsAPIAsyncDistributedZkTest.testAsyncIdRaceCondition
     0      3.3       61      2      \
                CollectionsAPIDistClusterPerZkTest.testCollectionReload
     0      0.4      273      1      \
                CollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes
     0      3.2      344     11      \
CollectionsAPIDistributedZkTest.testDeleteNonExistentCollection  0      0.6      159  \
1      ComputePlanActionTest.testNodeAdded  0    100.0       50     50      \
                ConfigSetsAPITest.classMethod
     0      0.4      278      1      ConnectionManagerTest.testLikelyExpired
     0      0.3      334      1      CustomCollectionTest.testCreateShardRepFactor
     0      0.6      334      2      CustomCollectionTest.testCustomCollectionsAPI
     0    100.0       30     30      DeleteReplicaTest.classMethod
     0      0.3      335      1      DeleteReplicaTest.deleteReplicaByCount
     0      0.4      278      1      HealthCheckHandlerTest.testHealthCheckHandler
     0    100.0        2      2      HttpSolrCallGetCoreTest.classMethod
     0      0.3      354      1      HttpSolrCallGetCoreTest.test
     0    100.0        8      8      MissingSegmentRecoveryTest.classMethod
     0      0.3      359      1      OverseerModifyCollectionTest.testModifyColl
     0    100.0        1      1      RollingRestartTest.classMethod
     0      0.6      154      1      SearchRateTriggerTest.testWaitForElapsed
     0     14.1       71     10      SimpleCollectionCreateDeleteTest.test
     0      0.4      244      1      \
                SoftAutoCommitTest.testSoftCommitWithinAndHardCommitMaxTimeMixedAdds
     0      0.4      278      1      SolrCloudReportersTest.testExplicitConfiguration
     0      0.3      371      1      \
                SolrExampleStreamingBinaryTest.testCommitWithinOnAdd
     0      0.3      363      1      StatsReloadRaceTest.testParallelReloadAndStats
     0      0.6      358      2      TestChildDocTransformer.testAllParams
     0      0.6      358      2      TestChildDocTransformer.testParentFilter
     0      0.3      338      1      \
                TestCloudCollectionsListeners.testCollectionDeletion
     0      0.9      338      3      \
TestCloudCollectionsListeners.testSimpleCloudCollectionsListener  0      0.4      279 \
                1      TestCloudPivotFacet.test
     0      4.8       21      1      \
TestCompressingStoredFieldsFormat.testBigDocuments  0      4.4      273     12      \
TestContainerPlugin.testApi  0      0.5      380      2      \
                TestDemoParallelLeafReader.testBasic
     0      1.3      383      5      \
                TestDemoParallelLeafReader.testRandomMultipleSchemaGens
     0      2.2      279      6      TestDistributedStatsComponentCardinality.test
     0    100.0        1      1      TestExclusionRuleCollectionAccess.classMethod
     0      0.4      251      1      TestFileListEntityProcessor.testNTOT
     0    100.0        1      1      TestHdfsCloudBackupRestore.classMethod
     0      0.3      379      1      TestNRTThreads.testNRTThreads
     0      0.6      154      1      TestNamedUpdateProcessors.test
     0      0.4      283      1      TestPackages.testSchemaPlugins
     0      2.1      384      8      \
                TestRandomChains.testRandomChainsWithLargeStrings
     0      3.5      284     10      TestReRankQParserPlugin.testMinExactCount
     0    100.0        2      2      TestSegmentSorting.classMethod
     0      0.4      279      1      TestShortCircuitedRequests.test
     0    100.0        1      1      TestWaitForStateWithJettyShutdowns.classMethod
     0    100.0        1      1      TestWithCJKBigramFilter.classMethod
     0      0.3      377      1      TestWithCJKBigramFilter.testMix2
     0      0.3      335      1      ZkShardTermsTest.testParticipationOfReplicas
      123   0.3     1247      4      \
                ConnectionManagerTest.testReconnectWhenZkDisappeared
      123   0.3     1243      3      \
                DeleteReplicaTest.deleteReplicaAndVerifyDirectoryCleanup
      123   4.8     1252     24      HttpPartitionWithTlogReplicasTest.test
      123   0.3     1242      3      LBSolrClientTest.testServerIteratorTimeAllowed
      123  50.0        6      3      SharedFSAutoReplicaFailoverTest.test
      123   0.0     7512      3      TestJsonFacets.testTolerant
      123 100.0        4      4      TestReplicationHandler.classMethod
      123   0.6     1244      9      TestSolrConfigHandlerCloud.test
      12    4.8      764     18      BasicDistributedZk2Test.test
      12    4.2      764     16      ChaosMonkeySafeLeaderWithPullReplicasTest.test
      12    0.4      516      4      OverseerTest.testShardLeaderChange
      12    2.8      764     13      ReplaceNodeTest.test
      12    5.1      768     20      ReplicationFactorTest.test
      12    5.0      776     20      ShardSplitTest.testSplitMixedReplicaTypes
      12  100.0        2      2      TestBM25SimilarityFactory.classMethod
      12    7.1       28      2      \
                TestIndexingSequenceNumbers.testStressConcurrentCommit
      12    7.1       28      2      TestInetAddressRangeQueries.testRandomBig
      12  100.0        2      2      TestLegacyBM25SimilarityFactory.classMethod
      12    0.6      757      3      TestPointFields.testDoublePointStats
      1 3   1.1      840      7      ChaosMonkeyNothingIsSafeTest.test
      1 3   4.8      833     19      \
                CollectionsAPIAsyncDistributedZkTest.testAsyncRequests
      1 3   0.3      845      2      MathExpressionTest.testZipFDistribution
      1 3   0.5      427      2      MetricTriggerIntegrationTest.testMetricTrigger
      1 3   0.3      839      3      RollingRestartTest.test
      1 3   5.3      839     20      \
                TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess
      1 3   0.3      843      2      TestConfigSetsAPIExclusivity.testAPIExclusivity
      1 3   0.6      418      2      TestRequestRateLimiter.testConcurrentQueries
      1 3   5.0      838     19      TestTlogReplica.testRebalanceLeaders
      1 3   4.7      838     18      TestTlogReplica.testRemoveLeader
      1     0.2      494      1      BJQParserTest.testToParentFilters
      1     4.2      357     15      \
ChaosMonkeyNothingIsSafeWithPullReplicasTest.test  1     1.4      355      5      \
ChaosMonkeySafeLeaderTest.test  1   100.0        4      4      \
                CloudHttp2SolrClientTest.classMethod
      1     0.4      494      2      CloudHttp2SolrClientTest.preferReplicaTypesTest
      1     0.2      494      1      \
                CloudHttp2SolrClientTest.singleShardedPreferenceRules
      1     0.2      494      1      CloudHttp2SolrClientTest.testParallelUpdateQTime
      1     0.3      357      1      \
                CollectionsAPIDistributedZkTest.testCreateNodeSet
      1     0.3      357      1      \
                CustomCollectionTest.testRouteFieldForImplicitRouter
      1     5.0      359     18      \
                DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica
      1     7.1       14      1      ForceLeaderTest.testReplicasInLowerTerms
      1     7.7       13      1      \
                ForceLeaderWithTlogReplicasTest.testReplicasInLowerTerms
      1     0.3      357      1      InfixSuggestersTest.testReloadDuringBuild
      1   100.0        4      4      JsonQueryRequestHeatmapFacetingTest.classMethod
      1     4.8      357     17      LeaderFailureAfterFreshStartTest.test
      1     4.8      356     17      \
                LeaderVoteWaitTimeoutTest.testMostInSyncReplicasCanWinElection
      1     4.8      357     17      MigrateRouteKeyTest.multipleShardMigrateTest
      1     4.8      357     17      MissingSegmentRecoveryTest.testLeaderRecovery
      1     4.8      357     17      RecoveryAfterSoftCommitTest.test
      1     0.3      358      1      ReindexCollectionTest.testReshapeReindexing
      1     0.3      357      1      ShardRoutingTest.test
      1   100.0        2      2      ShardSplitTest.classMethod
      1     5.9       17      1      ShardSplitTest.test
      1     0.2      495      1      SolrExampleBinaryHttp2Test.testCommitWithinOnAdd
      1   100.0        1      1      SolrXmlInZkTest.classMethod
      1     4.8      356     17      SyncSliceTest.test
      1   100.0        1      1      TestAtomicUpdateErrorCases.classMethod
      1     4.8      357     17      TestCloudRecovery.corruptedLogTest
      1     5.0      357     18      TestCloudRecovery2.test
      1   100.0        1      1      TestCloudSearcherWarming.classMethod
      1     0.1     1050      1      TestJsonFacets.testFacetValueTypesDistrib
      1     0.0     2166      1      TestJsonFacets.testStatsDistrib
      1     4.7      358     17      TestLeaderElectionWithEmptyReplica.test
      1   100.0        1      1      TestMiniSolrCloudClusterSSL.classMethod
      1   100.0        1      1      TestPHPSerializedResponseWriter.classMethod
      1   100.0        3      3      TestPackages.classMethod
      1     0.3      358      1      \
TestRandomFlRTGCloud.testRandomizedUpdatesAndRTGs  1     4.7      358     17      \
                TestReplicationHandler.doTestDetails
      1     4.7      358     17      \
                TestReplicationHandler.doTestIndexAndConfigAliasReplication
      1     4.7      358     17      \
                TestReplicationHandler.doTestIndexAndConfigReplication
      1     4.7      358     17      \
                TestReplicationHandler.doTestIndexFetchOnLeaderRestart
      1     4.7      358     17      \
                TestReplicationHandler.doTestIndexFetchWithLeaderUrl
      1     4.7      358     17      \
                TestReplicationHandler.doTestReplicateAfterCoreReload
      1     4.7      358     17      \
                TestReplicationHandler.doTestReplicateAfterStartup
      1     4.7      358     17      \
TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity  1     4.7      358  \
                17      TestReplicationHandler.doTestStopPoll
      1     4.7      358     17      TestReplicationHandler.doTestStressReplication
      1     4.7      358     17      \
                TestReplicationHandler.testRateLimitedReplication
      1     0.1     4970      6      \
TestSolr4Spatial2.testLLPDecodeIsStableAndPrecise  1     4.5      355     16      \
                TestSolrCloudSnapshots.testSnapshots
      1     0.6      357      2      TestStressCloudBlindAtomicUpdates.test_dv
      1     0.6      357      2      TestStressCloudBlindAtomicUpdates.test_dv_idx
      1     0.6      357      2      TestStressCloudBlindAtomicUpdates.test_dv_stored
      1     0.6      357      2      \
                TestStressCloudBlindAtomicUpdates.test_dv_stored_idx
      1     0.6      357      2      \
TestStressCloudBlindAtomicUpdates.test_stored_idx  1     3.9      358     14      \
                TestTlogReplica.testAddDocs
      1     4.7      358     17      TestTlogReplica.testBasicLeaderElection
      1     4.7      358     17      TestTlogReplica.testKillLeader
      1     4.7      358     17      TestTlogReplica.testOnlyLeaderIndexes
      1     4.7      358     17      \
TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates  1     4.7      358     17      \
                TestTlogReplica.testRecovery
      1     7.1       14      1      TlogReplayBufferedWhileIndexingTest.test
      1     0.2      494      1      \
UninvertDocValuesMergePolicyTest.testIndexAndAddDocValues  1     5.0      357     18  \
                UnloadDistributedZkTest.test
       23   0.2     1078     19      \
ConcurrentUpdateSolrClientMultiCollectionTest.testEnsureDocumentsSentToCorrectCollection
                
       23   0.3      549      2      \
                StreamDecoratorTest.testParallelTerminatingDaemonUpdateStream
       23   0.3      537      2      StreamExpressionTest.testFeaturesSelectionStream
       23   0.2      879      2      \
TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader  23 100.0        2      \
2      TestCloudSchemaless.classMethod  23   0.2      885      2      \
TestCollectionAPI.test  23   1.5      919     41      TestExportWriter.testExpr
       23   0.2      887      2      \
                TestSolrCloudWithDelegationTokens.testDelegationTokenRenew
       23   0.2     4474    150      TestUnifiedHighlighterStrictPhrases.testBasics
       2    0.2      566      1      \
                AsyncCallRequestStatusResponseTest.testAsyncCallStatusResponse
       2  100.0        1      1      BinaryUpdateRequestHandlerTest.classMethod
       2    0.2      569      1      \
CloudHttp2SolrClientTest.testInitializationWithSolrUrls  2  100.0        1      1     \
CloudSolrClientRetryTest.classMethod  2  100.0        1      1      \
                CloudSolrClientTest.classMethod
       2  100.0        1      1      CrossCollectionJoinQueryTest.classMethod
       2    0.5      401      2      CustomHighlightComponentTest.test
       2  100.0        1      1      DefaultValueUpdateProcessorTest.classMethod
       2    0.2      402      1      \
                DistributedQueueTest.testDistributedQueueBlocking
       2    0.4      284      1      DistributedUpdateProcessorTest.testVersionDelete
       2    8.3       12      1      HdfsBasicDistributedZkTest.test
       2  100.0        1      1      IndexSchemaTest.classMethod
       2  100.0        1      1      JdbcTest.classMethod
       2    0.5      405      2      \
MetricsHistoryWithAuthIntegrationTest.testValuesAreCollected  2  100.0        1      \
1      NotRequiredUniqueKeyTest.classMethod  2    0.4      283      1      \
                OverseerTest.testReplay
       2  100.0        1      1      \
                PreAnalyzedFieldManagedSchemaCloudTest.classMethod
       2    0.5      209      1      \
ScheduledMaintenanceTriggerTest.testInactiveMarkersCleanup  2  100.0        1      1  \
                ShardRoutingCustomTest.classMethod
       2    0.3      366      1      \
                SoftAutoCommitTest.testSoftAndHardCommitMaxTimeMixedAdds
       2    0.2      409      1      SolrExampleJettyTest.testCommitWithinOnDelete
       2  100.0        1      1      SortSpecParsingTest.classMethod
       2    0.2      404      1      \
StreamDecoratorTest.testParallelDaemonUpdateStream  2  100.0        1      1      \
TestBadConfig.classMethod  2    0.3      590      2      \
                TestBoolean2.testRandomQueries
       2    0.2      572      1      TestCloudJSONFacetJoinDomain.testRandom
       2  100.0        1      1      TestCollectionAPI.classMethod
       2    0.2      405      1      \
                TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete
                
       2  100.0        1      1      TestConfigSetsAPIExclusivity.classMethod
       2  100.0        1      1      TestDFISimilarityFactory.classMethod
       2    0.2      590      1      TestDemoParallelLeafReader.testRandom
       2    0.2      590      1      \
TestDemoParallelLeafReader.testRandomMultipleSchemaGensSameField  2  100.0        1   \
                1      TestDistributedMap.classMethod
       2    0.5      207      1      TestDynamicLoadingUrl.testDynamicLoadingUrl
       2    0.5      407      2      TestFieldSortOptimizationSkipping.testDocSort
       2    0.8      265      2      \
                TestFieldSortOptimizationSkipping.testDocSortOptimizationWithAfter
       2    0.5      407      2      \
                TestFieldSortOptimizationSkipping.testFloatSortOptimization
       2    0.2      407      1      \
                TestFieldSortOptimizationSkipping.testLongSortOptimization
       2    0.5      407      2      \
                TestFieldSortOptimizationSkipping.testSortOptimizationEqualValues
       2    0.2      407      1      \
TestFieldSortOptimizationSkipping.testSortOptimizationWithMissingValues  2    0.2     \
                590      1      TestIndexFileDeleter.testExcInDecRef
       2    0.2      406      1      TestPrepRecovery.testLeaderNotResponding
       2  100.0        1      1      TestQuerySenderListener.classMethod
       2  100.0        1      1      TestSearchPerf.classMethod
       2    0.2      567      1      \
                TestSegmentSorting.testAtomicUpdateOfSegmentSortField
       2    0.5      204      1      TestSimTriggerIntegration.testEventQueue
       2    3.0      607     18      \
TestSimpleSearchEquivalence.testBooleanReqExclVersusTerm  2  100.0        1      1    \
                TestSimpleTextNormsFormat.classMethod
       2    0.2      590      1      TestSimpleTextNormsFormat.testShortRange
       2  100.0        1      1      TestSkipOverseerOperations.classMethod
       2    0.5      207      1      TestSnapshotCloudManager.testComplexSnapshot
       2    0.5      207      1      \
                TestSnapshotCloudManager.testSimulatorFromSnapshot
       2    0.3      590      2      \
                TestTopFieldCollector.testSortWithoutTotalHitTracking
       2  100.0        1      1      TestWordDelimiterFilterFactory.classMethod
       2    0.2      582      1      \
                TestWordDelimiterFilterFactory.testRetainPositionIncrement
       2    1.0      209      2      \
                TriggerSetPropertiesIntegrationTest.testSetProperties
        3   0.4      236      1      CdcrVersionReplicationTest.testCdcrDocVersions
        3   0.2      499      1      \
                CloudSolrClientTest.testRetryUpdatesWhenClusterStateIsStale
        3   0.4      242      1      \
                ComputePlanActionTest.testNodeAddedTriggerWithAddReplicaPreferredOpReplicaType_1Shard
                
        3   0.4      242      1      \
                ComputePlanActionTest.testSelectedCollectionsByName
        3   3.5      509     18      \
ConcurrentUpdateHttp2SolrClientMultiCollectionTest.testEnsureDocumentsSentToCorrectCollection
                
        3   0.8      484      4      DistribJoinFromCollectionTest.testNoScore
        3   0.2      484      1      DistribJoinFromCollectionTest.testScore
        3 100.0        1      1      DistributedDebugComponentTest.classMethod
        3   0.2      481      1      DistributedIntervalFacetingTest.test
        3 100.0        1      1      DistributedVersionInfoTest.classMethod
        3   0.4      240      1      ExecutePlanActionTest.testTaskFail
        3 100.0        1      1      HdfsNNFailoverTest.classMethod
        3   0.4      242      1      IndexSizeTriggerTest.testSplitIntegration
        3   4.7      511     24      JsonLoaderTest.testAddBigIntegerValueToTrieField
        3   0.2      482      1      \
                OverseerTaskQueueTest.testDistributedQueueBlocking
        3   0.2      482      1      OverseerTaskQueueTest.testPeekElements
        3   0.2      476      1      ReindexCollectionTest.testLossySchema
        3   0.4      239      1      \
                ScheduledTriggerIntegrationTest.testScheduledTrigger
        3   0.2      482      1      ShardSplitTest.testSplitShardWithRuleLink
        3   0.2      478      1      \
                SimpleCollectionCreateDeleteTest.testCreateAndDeleteThenCreateAgain
        3   0.2      430      1      \
                SoftAutoCommitTest.testHardCommitWithinAndSoftCommitMaxTimeMixedAdds
        3   0.2      493      1      SolrExampleEmbeddedTest.testCommitWithinOnAdd
        3 100.0        1      1      StreamDecoratorTest.classMethod
        3   0.2      479      1      StreamDecoratorTest.testExecutorStream
        3   0.2      494      1      StreamDecoratorTest.testParallelFetchStream
        3   0.4      486      2      SystemCollectionCompatTest.testBackCompat
        3   3.7      492     18      \
                TestBulkSchemaAPI.testAddFieldMatchingExistingDynamicField
        3   3.7      492     18      \
                TestBulkSchemaAPI.testAddFieldWithExistingCatchallDynamicField
        3   3.7      492     18      TestBulkSchemaAPI.testAddNewFieldAndQuery
        3   3.7      492     18      TestBulkSchemaAPI.testAnalyzerClass
        3   3.7      492     18      TestBulkSchemaAPI.testCopyFieldRules
        3   3.7      492     18      TestBulkSchemaAPI.testDeleteAndReplace
        3   3.7      492     18      TestBulkSchemaAPI.testMultipleCommands
        3   3.7      492     18      TestBulkSchemaAPI.testSimilarityParser
        3   3.7      492     18      \
TestBulkSchemaAPI.testSortableTextFieldWithAnalyzer  3   0.2      476      1      \
TestCloudManagedSchema.test  3 100.0        1      1      \
TestCloudPivotFacet.classMethod  3 100.0        1      1      \
TestConfigSetsAPI.classMethod  3   0.4      240      1      TestCryptoKeys.test
        3 100.0        1      1      TestDownShardTolerantSearch.classMethod
        3   0.2      483      1      \
TestIndexWriterMergePolicy.testStressUpdateSameDocumentWithMergeOnCommit  3   0.2     \
484      1      TestLBHttp2SolrClient.testSimple  3   0.2      484      1      \
TestLBHttp2SolrClient.testTwoServers  3   0.2      496      1      \
                TestLockTree.testLocks
        3   3.5      508     18      \
                TestManagedStopFilterFactory.testManagedStopwords
        3   3.5      508     18      \
                TestManagedSynonymFilterFactory.testManagedSynonyms
        3   3.6      507     18      \
                TestManagedSynonymGraphFilterFactory.testManagedSynonyms
        3 100.0        1      1      TestOnReconnectListenerSupport.classMethod
        3 100.0        1      1      TestRandomFlRTGCloud.classMethod
        3   0.3      397      1      TestRecoveryHdfs.testExistOldBufferLog
        3   0.3      397      1      TestRecoveryHdfs.testRecoveryMultipleLogs
        3   0.2      483      1      TestReplicaProperties.test
        3 100.0        1      1      TestStressCloudBlindAtomicUpdates.classMethod
        3   3.5      509     18      TestUseDocValuesAsStored2.testSchemaAPI
        3   0.2      499      1      ZkConfigFilesTest.testCanUploadConfigToZk
        3   0.2      480      1      ZookeeperStatusHandlerTest.monitorZookeeper



***********************Annotations report

*****************AwaitsFix Annotations:


************Lucene AwaitsFix
TestAllFilesDetectBitFlips.TestAllFilesDetectBitFlips suite
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-9356")

TestAllFilesDetectTruncation.TestAllFilesDetectTruncation suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-9409")

TestControlledRealTimeReopenThread.testCRTReopen
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737")

TestICUNormalizer2CharFilter.testRandomStrings
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595")

TestICUTokenizerCJK.TestICUTokenizerCJK suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222")

TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161")


    ************Solr AwaitsFix
CollectionsAPISolrJTest.testCreateAndDeleteShard
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13021")

ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite
   @LuceneTestCase.AwaitsFix(bugUrl = \
"https://issues.apache.org/jira/browse/SOLR-12386") // "Can't find resource"

LeaderTragicEventTest.LeaderTragicEventTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13237")

MoveReplicaHDFSTest.MoveReplicaHDFSTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13924")

MoveReplicaHDFSTest.testFailedMove
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12080") // added \
03-Oct-2018

RoutedAliasUpdateProcessorTest.alias,
   @org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13696")


SSLMigrationTest.SSLMigrationTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // \
17-Mar-2018

SaslZkACLProviderTest.testSaslZkACLProvider
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13075")

SecurityHeadersTest.SecurityHeadersTest suite
   @org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-14903")


SolrExporterIntegrationTest.SolrExporterIntegrationTest suite
   @org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13786")


Tagger2Test.testStopWords
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344")

TestImpersonationWithHadoopAuth.testForwarding
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893")

TestJsonFacetRefinement.testIndexAscRefineConsistency
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-14595")

TestJsonFacetRefinement.testProcessEmptyRefinement
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556")

TestJsonFacetRefinement.testSortedSubFacetRefinementWhenParentOnlyReturnedByOneShardProcessEmpty
  @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556")

TestLTRReRankingPipeline.testDifferentTopN
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134")

TestMinMaxOnMultiValuedField.testDoubleFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709")

TestMinMaxOnMultiValuedField.testFloatFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709")

TestMinMaxOnMultiValuedField.testIntFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709")

TestMinMaxOnMultiValuedField.testLongFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709")

TestPullReplica.TestPullReplica suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

TestStressRecovery.TestStressRecovery suite
   @LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") \
// 6-Sep-2018

TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183")


TimeRoutedAliasUpdateProcessorTest.testDateMathInStart
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13943")

TriLevelCompositeIdRoutingTest.test
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13369")



*****************BadApple Annotations:

************Lucene BadApple

************Solr BadApple
MoveReplicaHDFSTest.testNormalFailedMove
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // \
14-Oct-2018

SharedFSAutoReplicaFailoverTest.SharedFSAutoReplicaFailoverTest suite
   @LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") \
// added 20-Jul-2018

TimeRoutedAliasUpdateProcessorTest.TimeRoutedAliasUpdateProcessorTest suite
   @LuceneTestCase.BadApple(bugUrl = \
"https://issues.apache.org/jira/browse/SOLR-13059")





---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org

[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic