[prev in list] [next in list] [prev in thread] [next in thread] 

List:       solr-dev
Subject:    BadApple report
From:       Erick Erickson <erickerickson () gmail ! com>
Date:       2020-11-23 13:31:51
Message-ID: C4A0571C-FFB2-4FD1-93EF-BC77CD77EFBE () gmail ! com
[Download RAW message or body]

Unfortunately, the reference impl is creating quite a bit of noise in Hoss' rollups. \
That said, I have a mail filter for test failures that puts the reference impl tests \
in a different mail folder and my sense is that the regular branch is getting an \
increasing number of failures.

If I have the energy, I'll try to collect some of them.


Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  210 failures
Week: 1  had  112 failures
Week: 2  had  110 failures
Week: 3  had  150 failures


********Failures in Hoss' reports in every one of the last 4 rollups.

There were 390 unannotated tests that failed in Hoss' rollups. Ordered by the date I \
downloaded the rollup file, newest->oldest. See above for the dates the files were \
collected  These tests were NOT BadApple'd or AwaitsFix'd

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123   0.5     1745     10      CachingDirectoryFactoryTest.stressTest
     0123 100.0      159    159      CollectionsAPIAsyncDistributedZkTest.classMethod
     0123   2.9     1759     49      \
                CollectionsAPIAsyncDistributedZkTest.testAsyncIdRaceCondition
     0123   3.0     1744     50      \
                CollectionsAPIDistributedZkTest.testDeleteNonExistentCollection
     0123   3.0     1772     53      \
                CollectionsAPIDistributedZkTest.testNoConfigSetExist
     0123 100.0      209    209      JsonRequestApiHeatmapFacetingTest.classMethod
     0123 100.0      209    209      JsonRequestApiTest.classMethod
     0123   0.4     1708      7      \
ManagedSchemaRoundRobinCloudTest.testAddFieldsRoundRobin  0123   3.1     1737     32  \
                MoveReplicaTest.test
     0123   1.9     1366     23      TestCircuitBreaker.testResponseWithCBTiming
     0123   8.5     1275     94      TestContainerPlugin.testApi
     0123   2.5     1368     36      TestDistributedStatsComponentCardinality.test
     0123   0.3     1069      8      TestHdfsCloudBackupRestore.test
     0123   0.2     1277      9      TestLocalFSCloudBackupRestore.test
     0123   1.9     1313     17      TestPackages.testPluginLoading
     0123   1.7     1575     20      \
                TestPullReplicaErrorHandling.testCantConnectToLeader
     0123   1.9     1575     31      \
                TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
     0123 100.0      209    209      UsingSolrJRefGuideExamplesTest.classMethod
     0123 100.0      192    192      ZkConfigFilesTest.classMethod
********************************************


["e-mail-2020-11-23.txt" (e-mail-2020-11-23.txt)]

DO NOT ENABLE LIST:
    MoveReplicaHDFSTest.testFailedMove
    MoveReplicaHDFSTest.testNormalFailedMove
    TestControlledRealTimeReopenThread.testCRTReopen
    TestICUNormalizer2CharFilter.testRandomStrings
    TestICUTokenizerCJK
    TestImpersonationWithHadoopAuth.testForwarding
    TestLTRReRankingPipeline.testDifferentTopN
    TestRandomChains


DO NOT ANNOTATE LIST
    CdcrBidirectionalTest.testBiDir
    IndexSizeTriggerTest.testMergeIntegration
    IndexSizeTriggerTest.testMixedBounds
    IndexSizeTriggerTest.testSplitIntegration
    IndexSizeTriggerTest.testTrigger
    InfixSuggestersTest.testShutdownDuringBuild
    ShardSplitTest.test
    ShardSplitTest.testSplitMixedReplicaTypes
    ShardSplitTest.testSplitWithChaosMonkey
    Test2BPostings.test
    TestLatLonShapeQueries.testRandomBig
    TestPackedInts.testPackedLongValues
    TestRandomChains.testRandomChainsWithLargeStrings
    TestTriggerIntegration.testSearchRate

SuppressWarnings count: last week: 4,481, this week: 4,487, delta 6


*************** Files with increased @SuppressWarnings annotations:

Suppress count increase in: \
lucene/analysis/common/src/java/org/tartarus/snowball/ext/YiddishStemmer.java. Was: \
null, now: 1 Suppress count increase in: \
lucene/core/src/test/org/apache/lucene/util/hnsw/TestHnsw.java. Was: null, now: 1 \
Suppress count increase in: \
lucene/grouping/src/test/org/apache/lucene/search/grouping/TestAllGroupHeadsCollector.java. \
Was: null, now: 1 Suppress count increase in: \
lucene/grouping/src/test/org/apache/lucene/search/grouping/TestDistinctValuesCollector.java. \
Was: null, now: 5 Suppress count increase in: \
lucene/grouping/src/test/org/apache/lucene/search/grouping/TestTopGroups.java. Was: \
null, now: 2 Suppress count increase in: \
lucene/misc/src/java/org/apache/lucene/misc/index/MultiPassIndexSplitter.java. Was: \
null, now: 1 Suppress count increase in: \
lucene/misc/src/java/org/apache/lucene/misc/util/fst/ListOfOutputs.java. Was: null, \
now: 1 Suppress count increase in: \
lucene/misc/src/java/org/apache/lucene/misc/util/fst/UpToTwoPositiveIntOutputs.java. \
Was: null, now: 1 Suppress count increase in: \
lucene/replicator/src/test/org/apache/lucene/replicator/TestIndexAndTaxonomyReplicationClient.java. \
Was: null, now: 2 Suppress count increase in: \
lucene/replicator/src/test/org/apache/lucene/replicator/TestIndexAndTaxonomyRevision.java. \
Was: null, now: 1 Suppress count increase in: \
lucene/replicator/src/test/org/apache/lucene/replicator/TestIndexReplicationClient.java. \
Was: null, now: 2 Suppress count increase in: \
lucene/replicator/src/test/org/apache/lucene/replicator/TestIndexRevision.java. Was: \
null, now: 2 Suppress count increase in: \
lucene/spatial-extras/src/test/org/apache/lucene/spatial/prefix/TestRandomSpatialOpFuzzyPrefixTree.java. \
Was: null, now: 1 Suppress count increase in: \
solr/contrib/ltr/src/java/org/apache/solr/ltr/response/transform/LTRInterleavingTransformerFactory.java. \
Was: null, now: 2 Suppress count increase in: \
solr/core/src/java/org/apache/solr/api/ContainerPluginsRegistry.java. Was: 4, now: 6 \
Suppress count increase in: \
solr/core/src/test/org/apache/solr/metrics/MetricsConfigTest.java. Was: 0, now: 1 \
Suppress count increase in: \
solr/core/src/test/org/apache/solr/search/SolrIndexSearcherTest.java. Was: 0, now: 1

*************** Files with decreased @SuppressWarnings annotations:

Suppress count decrease in: \
solr/core/src/test/org/apache/solr/handler/TestContainerPlugin.java. Was: 2, now: 1 \
Suppress count decrease in: \
solr/solrj/src/java/org/apache/solr/client/solrj/routing/RequestReplicaListTransformerGenerator.java. \
Was: 1, now: 0

Processing file (History bit 3): HOSS-2020-11-23.csv
Processing file (History bit 2): HOSS-2020-11-09.csv
Processing file (History bit 1): HOSS-2020-11-02.csv
Processing file (History bit 0): HOSS-2020-10-26.csv


Number of AwaitsFix: 31 Number of BadApples: 3


**Annotated tests that didn't fail in the last 4 weeks.

  **Tests removed from the next two lists because they were specified in \
'doNotEnable' in the properties file  MoveReplicaHDFSTest.testNormalFailedMove

  **Annotations can be removed from the following tests because they haven't failed \
in the last 4 rollups.

  **Methods: 0


Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  210 failures
Week: 1  had  112 failures
Week: 2  had  110 failures
Week: 3  had  150 failures


********Failures in Hoss' reports in every one of the last 4 rollups.

There were 390 unannotated tests that failed in Hoss' rollups. Ordered by the date I \
downloaded the rollup file, newest->oldest. See above for the dates the files were \
collected  These tests were NOT BadApple'd or AwaitsFix'd

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123   0.5     1745     10      CachingDirectoryFactoryTest.stressTest
     0123 100.0      159    159      CollectionsAPIAsyncDistributedZkTest.classMethod
     0123   2.9     1759     49      \
                CollectionsAPIAsyncDistributedZkTest.testAsyncIdRaceCondition
     0123   3.0     1744     50      \
                CollectionsAPIDistributedZkTest.testDeleteNonExistentCollection
     0123   3.0     1772     53      \
                CollectionsAPIDistributedZkTest.testNoConfigSetExist
     0123 100.0      209    209      JsonRequestApiHeatmapFacetingTest.classMethod
     0123 100.0      209    209      JsonRequestApiTest.classMethod
     0123   0.4     1708      7      \
ManagedSchemaRoundRobinCloudTest.testAddFieldsRoundRobin  0123   3.1     1737     32  \
                MoveReplicaTest.test
     0123   1.9     1366     23      TestCircuitBreaker.testResponseWithCBTiming
     0123   8.5     1275     94      TestContainerPlugin.testApi
     0123   2.5     1368     36      TestDistributedStatsComponentCardinality.test
     0123   0.3     1069      8      TestHdfsCloudBackupRestore.test
     0123   0.2     1277      9      TestLocalFSCloudBackupRestore.test
     0123   1.9     1313     17      TestPackages.testPluginLoading
     0123   1.7     1575     20      \
                TestPullReplicaErrorHandling.testCantConnectToLeader
     0123   1.9     1575     31      \
                TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
     0123 100.0      209    209      UsingSolrJRefGuideExamplesTest.classMethod
     0123 100.0      192    192      ZkConfigFilesTest.classMethod
********************************************

Failures over the last 4 weeks, but not every week. Ordered most-recent first:



   Report   Pct     runs    fails           test
     012    2.9     1409     39      ClusterStateUpdateTest.testCoreRegistration
     012    2.9     1390     37      \
                CollectionsAPIAsyncDistributedZkTest.testSolrJAPICalls
     012  100.0       49     49      CustomHighlightComponentTest.classMethod
     012    0.2     1370      3      CustomHighlightComponentTest.test
     012    3.1     1397     37      ShardSplitTest.testSplitShardWithRule
     012   19.9     1302    245      \
TestPullReplicaErrorHandling.testCantConnectToPullReplica  012    2.1     1387     44 \
                TestSchemalessBufferedUpdates.test
     012  100.0       14     14      TestSolrConfigHandlerConcurrent.classMethod
     01 3   0.2     1012      7      HttpPartitionOnCommitTest.test
     01 3   1.7     1035     15      MultiThreadedOCPTest.test
     01     0.2      740      2      ChaosMonkeySafeLeaderWithPullReplicasTest.test
     01    14.4      290     57      ClusterEventProducerTest.testEvents
     01     0.4     1027      3      DistributedExpandComponentTest.test
     01     0.2      743      3      DistributedFacetPivotLongTailTest.test
     01     0.2     1029      2      DistributedQueryComponentCustomSortTest.test
     01   100.0       37     37      DocValuesNotIndexedTest.classMethod
     01     0.2      746      2      \
MetricsHistoryWithAuthIntegrationTest.testValuesAreCollected  01     0.4      482     \
2      OverseerTest.testShardLeaderChange  01     1.0      745      5      \
RollingRestartTest.test  01   100.0        3      2      \
SharedFSAutoReplicaFailoverTest.test  01     2.9     1039     18      \
                SplitShardTest.testSplitFuzz
     01     0.2      737      2      \
                TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess
     01     0.4      972      4      \
TestPullReplicaErrorHandling.testCloseHooksDeletedOnReconnect  01     0.2      776    \
44      TestRandomFaceting.testRandomFaceting  01     0.2      738      3      \
TestReplicaProperties.test  01     0.2      737      2      \
TestSolrConfigHandlerCloud.test  0 23 100.0       37     37      \
HttpSolrCallGetCoreTest.classMethod  0 23   2.9     1205     29      \
TestCloudPivotFacet.test  0 23   2.9     1201     42      TestCloudSchemaless.test
     0 23   2.9     1262     19      ZkShardTermsTest.testParticipationOfReplicas
     0 2    2.9      935     18      CloudHttp2SolrClientTest.testParallelUpdateQTime
     0 2    0.2      675      3      \
                CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesNewFormat
                
     0 2    2.9      935     18      \
ConcurrentUpdateSolrClientMultiCollectionTest.testEnsureDocumentsSentToCorrectCollection
                
     0 2  100.0       35     35      \
JsonQueryRequestFacetingIntegrationTest.classMethod  0 2    0.2      676      2      \
LeaderVoteWaitTimeoutTest.basicTest  0 2   11.2      259     37      \
ShardRoutingTest.doAtomicUpdate  0 2   10.1      259     33      \
ShardRoutingTest.doHashingTest  0 2    9.5      259     32      \
                ShardRoutingTest.doTestNumRequests
     0 2    2.9      928     20      TestDynamicFieldNamesIndexCorrectly.test
     0 2    0.5      322      2      TestRequestRateLimiter.testConcurrentQueries
     0 2  100.0       35     35      V2ApiIntegrationTest.classMethod
     0  3   0.2      928      2      AnalyticsMergeStrategyTest.test
     0  3   0.2      676      2      AssignBackwardCompatibilityTest.test
     0  3   0.2      676      2      BasicDistributedZkTest.test
     0  3   2.9      950     18      \
                CloudHttp2SolrClientTest.testNonRetryableRequests
     0  3   2.9      950     18      CloudHttp2SolrClientTest.testVersionsAreReturned
     0  3   9.4      241     19      \
CollectionsAPIDistClusterPerZkTest.testCollectionReload  0  3   0.5      365      2   \
                ComputePlanActionTest.testNodeAdded
     0  3   2.9      913     18      DeleteReplicaTest.deleteReplicaByCount
     0  3   0.2      686      2      HealthCheckHandlerTest.testHealthCheckHandler
     0  3   0.5      681      5      HttpPartitionTest.test
     0  3   0.2      690      2      MoveReplicaTest.testFailedMove
     0  3   2.9      940     18      OverseerModifyCollectionTest.testModifyColl
     0  3   2.9      916     18      RecoveryZkTest.test
     0  3   0.5      360      2      SearchRateTriggerTest.testWaitForElapsed
     0  3   5.9       39      2      ShardSplitTest.testSplitWithChaosMonkey
     0  3 100.0        6      6      TestExclusionRuleCollectionAccess.classMethod
     0  3 100.0        2      2      TestHdfsCloudBackupRestore.classMethod
     0  3   0.2      976      9      \
                TestRandomChains.testRandomChainsWithLargeStrings
     0  3   1.5      691     16      TestReRankQParserPlugin.testMinExactCount
     0  3   3.1      859     19      TestShortCircuitedRequests.test
     0  3   2.9      861     18      TestSystemCollAutoCreate.testAutoCreate
     0    100.0        1      1      AliasIntegrationTest.classMethod
     0    100.0       34     34      AtomicUpdateRemovalJavabinTest.classMethod
     0      4.0      226      9      AutoscalingHistoryHandlerTest.testHistory
     0      2.9      581     17      BasicAuthOnSingleNodeTest.basicTest
     0      0.2      407      1      BasicDistributedZk2Test.test
     0      0.5      403      2      \
                ChaosMonkeyNothingIsSafeWithPullReplicasTest.test
     0    100.0       17     17      CloudHttp2SolrClientBadInputTest.classMethod
     0      2.9      588     17      \
                CloudHttp2SolrClientTest.testInitializationWithSolrUrls
     0    100.0       17     17      CloudSolrClientBadInputTest.classMethod
     0      0.2      413      1      \
                CloudSolrClientTest.testRetryUpdatesWhenClusterStateIsStale
     0      4.5      380     17      CollectionStateZnodeTest.testZkNodeLocation
     0      9.4      180     17      \
                CollectionsAPIDistClusterPerZkTest.addReplicaTest
     0      9.4      180     17      \
                CollectionsAPIDistClusterPerZkTest.testCreateNodeSet
     0      9.4      180     17      \
                CollectionsAPIDistClusterPerZkTest.testSpecificConfigsets
     0      2.9      586     17      CollectionsAPISolrJTest.testAddAndDeleteReplica
     0      2.9      586     17      \
                CollectionsAPISolrJTest.testCloudInfoInCoreStatus
     0      2.9      586     17      CollectionsAPISolrJTest.testCollectionProp
     0      2.9      586     17      \
                CollectionsAPISolrJTest.testCreateAndDeleteCollection
     0      2.9      586     17      \
                CollectionsAPISolrJTest.testCreateWithDefaultConfigSet
     0      9.4      180     17      ConfigSetsAPITest.testConfigSetDeleteWhenInUse
     0      3.3      572     19      \
                DeleteInactiveReplicaTest.deleteInactiveReplicaTest
     0      2.9      582     17      DeleteLastCustomShardedReplicaTest.test
     0      2.9      578     17      DeleteReplicaTest.deleteLiveReplicaTest
     0      2.9      578     17      DeleteReplicaTest.deleteReplicaOnIndexing
     0      3.0      574     17      DeleteStatusTest.testAsyncIdsMayBeDeleted
     0      3.0      574     17      DeleteStatusTest.testDeleteStatusFlush
     0      3.0      574     17      \
                DeleteStatusTest.testProcessAndWaitDeletesAsyncIds
     0    100.0       34     34      \
DirectJsonQueryRequestFacetingIntegrationTest.classMethod  0    100.0       17     17 \
DirectSolrConnectionTest.classMethod  0    100.0       16     16      \
DirectUpdateHandlerTest.classMethod  0    100.0       51     51      \
                DirectoryFactoryTest.classMethod
     0      2.9      581     17      \
                DirectoryFactoryTest.testGetDataHomeByteBuffersDirectory
     0      2.9      581     17      DirectoryFactoryTest.testGetDataHomeRAMDirectory
     0      0.2      403      1      \
DistributedFacetSimpleRefinementLongTailTest.test  0      0.3      582      2      \
                DistributedMLTComponentTest.test
     0    100.0        4      4      \
                DistributedQueryComponentOptimizationTest.classMethod
     0    100.0       17     17      DistributedSuggestComponentTest.classMethod
     0      0.5      379      2      DistributedUpdateProcessorTest.testVersionAdd
     0      0.8      379      3      DistributedUpdateProcessorTest.testVersionDelete
     0    100.0        1      1      ExtractingRequestHandlerTest.classMethod
     0      0.2      588      1      ExtractingRequestHandlerTest.testArabicPDF
     0      2.9      582     17      FuzzySearchTest.testTooComplex
     0      7.1       14      1      HdfsBasicDistributedZk2Test.test
     0    100.0       35     35      HelloWorldSolrCloudTestCase.classMethod
     0    100.0       34     34      JDBCStreamTest.classMethod
     0    100.0       34     34      JsonQueryRequestHeatmapFacetingTest.classMethod
     0    100.0       34     34      JsonQueryRequestIntegrationTest.classMethod
     0    100.0       17     17      LargeFieldTest.classMethod
     0      0.2      402      1      \
                LeaderElectionIntegrationTest.testSimpleSliceLeaderElection
     0      0.5      408      2      MathExpressionTest.testZipFDistribution
     0    100.0       17     17      MergeIndexesEmbeddedTest.classMethod
     0      3.0      573     17      MissingSegmentRecoveryTest.testLeaderRecovery
     0    100.0       27     27      NestedShardedAtomicUpdateTest.classMethod
     0      4.8      582     28      NestedShardedAtomicUpdateTest.test
     0      0.2      402      1      OverseerRolesTest.testDesignatedOverseerRestarts
     0    100.0       17     17      \
                PeerSyncWithIndexFingerprintCachingTest.classMethod
     0    100.0       17     17      \
                PeerSyncWithLeaderAndIndexFingerprintCachingTest.classMethod
     0    100.0       17     17      PhrasesIdentificationComponentTest.classMethod
     0    100.0       12     12      RecoveryZkTest.classMethod
     0      0.2      402      1      ReplicationFactorTest.test
     0    100.0       17     17      SampleTest.classMethod
     0      3.0      573     17      SearchHandlerTest.testRequireZkConnectedDistrib
     0    100.0       34     34      SelectWithEvaluatorsTest.classMethod
     0      2.9      579     17      ShardRoutingCustomTest.test
     0    100.0       12     12      ShardRoutingTest.classMethod
     0      0.3      370      1      \
SoftAutoCommitTest.testHardCommitWithinAndSoftCommitMaxTimeMixedAdds  0      1.0      \
581      6      SolrJmxReporterTest.testClosedCore  0    100.0        9      9      \
                SolrSchemalessExampleTest.classMethod
     0      0.2      407      1      SpatialHeatmapFacetsTest.testClassicFacets
     0      2.9      581     17      SplitShardTest.doTest
     0    100.0       17     17      SuggesterFSTTest.classMethod
     0    100.0       17     17      SuggesterTest.classMethod
     0      0.2      554      1      TermVectorComponentDistributedTest.test
     0      6.7       15      1      \
                TestBestCompressionLucene80DocValuesFormat.testTermsEnumFixedWidth
     0      6.7       15      1      \
                TestBestCompressionLucene80DocValuesFormat.testTermsEnumLongSharedPrefixes
                
     0      6.7       15      1      \
                TestBestCompressionLucene80DocValuesFormat.testTermsEnumRandomMany
     0      6.7       15      1      \
                TestBestCompressionLucene80DocValuesFormat.testTermsEnumVariableWidth
     0      6.7       15      1      \
                TestBestSpeedLucene80DocValuesFormat.testTermsEnumFixedWidth
     0      6.7       15      1      \
                TestBestSpeedLucene80DocValuesFormat.testTermsEnumLongSharedPrefixes
     0      6.7       15      1      \
                TestBestSpeedLucene80DocValuesFormat.testTermsEnumRandomMany
     0      6.7       15      1      \
TestBestSpeedLucene80DocValuesFormat.testTermsEnumVariableWidth  0    100.0       34  \
                34      TestCloudDeleteByQuery.classMethod
     0      0.2      565      1      \
                TestCloudDeleteByQuery.testMalformedDBQViaCloudClient
     0    100.0       34     34      TestCloudJSONFacetJoinDomain.classMethod
     0    100.0       33     33      TestCloudJSONFacetSKG.classMethod
     0      0.2      407      1      TestCloudRecovery2.test
     0    100.0       17     17      TestClusterProperties.classMethod
     0      3.0      572     17      \
                TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete
                
     0     10.0      170     17      \
TestCollectionsAPIViaSolrCloudCluster.testDeleteUnknownCollection  0    100.0       \
51     51      TestConfigSetsAPI.classMethod  0      2.9      582     17      \
TestConfigSetsAPI.testCreateErrors  0      2.9      582     17      \
                TestConfigSetsAPI.testUpload
     0    100.0       10     10      TestDeleteCollectionOnDownNodes.classMethod
     0      1.1      565      6      \
TestDeleteCollectionOnDownNodes.deleteCollectionWithDownNodes  0    100.0       16    \
                16      TestDistribPackageStore.classMethod
     0      2.9      578     17      \
                TestDownShardTolerantSearch.searchingShouldFailWithoutTolerantSearchSetToTrue
                
     0      0.2      402      1      TestExactStatsCache.testShardsTolerant
     0    100.0       17     17      TestHighFrequencyDictionaryFactory.classMethod
     0    100.0       51     51      TestLBHttpSolrClient.classMethod
     0      2.9      588     17      TestLBHttpSolrClient.testReliability
     0      2.9      588     17      TestLBHttpSolrClient.testSimple
     0      1.0      594      6      TestLatLonPointQueries.testAllLatEqual
     0      4.7      379     18      TestLocalStatsCacheCloud.testBasicStats
     0      2.9      578     17      TestManagedSchemaAPI.test
     0    100.0       17     17      TestManagedStopFilterFactory.classMethod
     0    100.0        3      3      TestOnReconnectListenerSupport.classMethod
     0      0.2      555      1      TestOnReconnectListenerSupport.test
     0      0.2      402      1      \
TestRandomCollapseQParserPlugin.testRandomCollpaseWithSort  0    100.0        1      \
1      TestRandomFaceting.classMethod  0    100.0        4      4      \
TestRandomFlRTGCloud.classMethod  0      0.2      403      1      \
                TestRecovery.stressLogReplay
     0    100.0       17     17      TestReplicationHandlerBackup.classMethod
     0      2.9      580     17      TestRequestForwarding.testMultiCollectionQuery
     0    100.0       17     17      TestSchemalessBufferedUpdates.classMethod
     0    100.0        3      3      TestShortCircuitedRequests.classMethod
     0      0.5      204      1      \
                TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy
                
     0      0.2      402      1      \
TestSolrCloudWithDelegationTokens.testDelegationTokenRenew  0      3.0      574     \
                17      TestSolrConfigHandlerConcurrent.test
     0    100.0       38     38      \
                TestTolerantUpdateProcessorRandomCloud.classMethod
     0      0.2      565      1      \
TestTolerantUpdateProcessorRandomCloud.testRandomUpdates  0    100.0       17     17  \
TestUseDocValuesAsStored.classMethod  0    100.0       17     17      \
                TestUseDocValuesAsStored2.classMethod
     0      0.4      228      1      TestWithCollection.testAddReplicaWithPolicy
     0      3.1      228      7      TestWithCollection.testNodeAdded
     0    100.0       17     17      TestZkConfigManager.classMethod
     0      0.2      556      1      \
V2ApiIntegrationTest.testSetPropertyValidationOfCluster  123 100.0      160    160    \
                AddReplicaTest.classMethod
      123 100.0      108    108      CollectionsAPIDistributedZkTest.classMethod
      123   2.1     1199     36      \
                CollectionsAPIDistributedZkTest.testBadActionNames
      123   2.1     1199     36      \
                CollectionsAPIDistributedZkTest.testMissingNumShards
      123   2.1     1199     36      \
                CollectionsAPIDistributedZkTest.testMissingRequiredParameters
      123   2.1     1199     36      \
                CollectionsAPIDistributedZkTest.testZeroNumShards
      123 100.0      175    175      \
ConcurrentUpdateSolrClientMultiCollectionTest.classMethod  123 100.0       16     16  \
DeleteStatusTest.classMethod  123   7.5      299     32      \
SimpleCollectionCreateDeleteTest.test  123   0.4     1166      5      \
                TestChildDocTransformer.testAllParams
      123   0.4     1166      5      TestChildDocTransformer.testParentFilter
      123   0.7     1144      9      \
                TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
      123  13.1     1212    166      \
TestSTUniformSplitPostingFormat.testCheckIntegrityReadsAllBytes  123  28.7     1209   \
329      TestSynonymFilterFactory.testFormat  123  28.7     1209    329      \
TestSynonymFilterFactory.testSynonyms  123  28.6     1212    330      \
TestSysoutsLimits.OverHardLimit  123  28.6     1212    330      \
                TestSysoutsLimits.testOverSoftLimit
      123  13.1     1212    166      \
TestUniformSplitPostingFormat.testCheckIntegrityReadsAllBytes  12  100.0       66     \
66      ClusterStateUpdateTest.classMethod  12    0.9      600      5      \
DistributedTermsComponentTest.test  12  100.0       54     54      \
                ShardSplitTest.classMethod
      12    0.4      807      3      TestAuthenticationFramework.testBasics
      12    0.3      610      2      TestBulkSchemaConcurrent.test
      12    0.3      609      2      TestDistributedMissingSort.test
      1 3   0.2      796      2      \
                DocValuesNotIndexedTest.testGroupingDVOnlySortFirst
      1 3   0.4      827      3      StatsReloadRaceTest.testParallelReloadAndStats
      1 3   0.3      610      3      TestInPlaceUpdatesDistrib.test
      1     0.2      459      1      CleanupOldIndexTest.test
      1     0.9      340      3      \
CollectionsAPIAsyncDistributedZkTest.testAsyncRequests  1     0.2      458      1     \
                DeleteNodeTest.test
      1     0.2      460      1      DistributedDebugComponentTest.testTolerantSearch
      1     0.2      461      1      DocValuesNotIndexedTest.testGroupingSorting
      1     5.3       19      1      HdfsTlogReplayBufferedWhileIndexingTest.test
      1     0.3      293      1      LBSolrClientTest.testServerIteratorTimeAllowed
      1   100.0        1      1      \
                MetricsHistoryWithAuthIntegrationTest.classMethod
      1     1.3      477      6      \
                TestAssertingDocValuesFormat.testSortedSetFixedLengthSingleValuedVsStoredFields
                
      1   100.0        4      4      TestAuthenticationFramework.classMethod
      1     0.2      472      1      TestCachePurging.testBackgroundPurges
      1     3.3      183      6      \
                TestDirectDocValuesFormat.testSortedFixedLengthVsStoredFields
      1   100.0        1      1      TestHighlightDedupGrouping.classMethod
      1     0.3      340      1      TestLBHttp2SolrClient.testSimple
      1     0.2      487      1      TestLatLonDocValuesQueries.testAllLonEqual
      1     2.3      487     11      TestLatLonDocValuesQueries.testRandomMedium
      1     2.3      485     11      TestLatLonPointQueries.testRandomMedium
      1     0.2      458      1      TestLockTree.testLocks
      1     3.3      183      6      \
                TestLucene70DocValuesFormat.testSortedSetVariableLengthSingleValuedVsStoredFields
                
      1     0.2      472      1      \
                TestLucene80DocValuesFormat.testSortedSetVariableLengthSingleValuedVsStoredFields
                
      1     1.9      314      6      TestOrdinalMap.testOneSegmentWithAllValues
      1     0.2      472      1      \
                TestPerFieldDocValuesFormat.testSortedSetFixedLengthSingleValuedVsStoredFields
                
      1     0.2      472      1      \
TestPerFieldDocValuesFormat.testSortedSetVariableLengthSingleValuedVsStoredFields  1  \
0.3      335      1      TestPointFields.testDoublePointStats  1   100.0        1     \
1      TestPrepRecovery.classMethod  1     0.4      473      2      \
                TestRandomChains.testRandomChains
      1    67.7     1059    717      TestRandomDVFaceting.testRandomFaceting
      1   100.0        1      1      TestReplicaProperties.classMethod
      1   100.0        1      1      TestReplicationHandler.classMethod
      1     0.6      179      1      TestSimTriggerIntegration.testTriggerThrottling
      1     2.3      485     11      \
                TestSimpleTextDocValuesFormat.testSortedSetFixedLengthSingleValuedVsStoredFields
                
      1     0.6      333      2      \
TestSkipOverseerOperations.testSkipDownOperations  1     0.3      334      1      \
                TestStressLiveNodes.testStress
      1     0.2      457      1      \
                TestUseDocValuesAsStored.testRandomSingleAndMultiValued
      1     0.2      464      1      \
UninvertDocValuesMergePolicyTest.testIndexAndAddDocValues  1     0.3      340      1  \
                UnloadDistributedZkTest.test
       23 100.0       90     90      AsyncCallRequestStatusResponseTest.classMethod
       23   0.6      709      7      \
                CloudHttp2SolrClientTest.testRetryUpdatesWhenClusterStateIsStale
       23   0.3      641      3      CustomCollectionTest.testCustomCollectionsAPI
       23 100.0       31     31      DeleteReplicaTest.classMethod
       23 100.0       12     12      MissingSegmentRecoveryTest.classMethod
       23   0.4      554      2      ShardSplitTest.testSplitMixedReplicaTypesLink
       23   0.3      642      2      TestBlobHandler.doBlobHandlerTest
       23   0.3      641      2      \
                TestCloudCollectionsListeners.testCollectionDeletion
       23   0.3      641      4      \
TestCloudCollectionsListeners.testSimpleCloudCollectionsListener  23   2.5      494   \
7      TestFileListEntityProcessor.testNTOT  23 100.0        4      4      \
                TestSegmentSorting.classMethod
       23   0.3      681      2      TestSegmentSorting.testSegmentTerminateEarly
       2    0.3      305      1      \
AsyncCallRequestStatusResponseTest.testAsyncCallStatusResponse  2  100.0        1     \
                1      BlobRepositoryCloudTest.classMethod
       2    0.3      344      1      CollectionPropsTest.testMultipleWatchers
       2    0.3      344      1      CollectionPropsTest.testReadWriteCached
       2    0.4      270      1      \
                ConnectionManagerTest.testReconnectWhenZkDisappeared
       2  100.0        1      1      DistributedDebugComponentTest.classMethod
       2    1.1      264      3      DistributedFacetPivotLargeTest.test
       2    0.3      349      1      DistributedQueryElevationComponentTest.test
       2    0.6      349      2      DistributedSpellCheckComponentTest.test
       2    2.2      269      6      HttpPartitionWithTlogReplicasTest.test
       2  100.0       20     20      LegacyNoFacetCloudTest.classMethod
       2    0.6      345      2      SplitByPrefixTest.doTest
       2  100.0        1      1      StreamingTest.classMethod
       2    0.3      361      1      TestIndexFileDeleter.testExcInDecRef
       2    0.3      366      1      TestIndexWriterReader.testTooManySegments
       2  100.0        2      2      TestLuceneIndexBackCompat.classMethod
       2  100.0        1      1      TestNumericTerms64.classMethod
       2    0.4      269      1      \
TestRangeQuery.testCompareTypesRandomRangeQueries  2    0.4      263      1      \
TestReplicationHandler.doTestDetails  2    0.7      145      1      \
                TestSimScenario.testSuggestions
       2    0.0     3480      1      \
                TestSolr4Spatial2.testLLPDecodeIsStableAndPrecise
       2    0.8      265      2      \
TestSortingCodecReader.testSortOnAddIndicesRandom  2  100.0        1      1      \
                TestStressLockFactories.classMethod
       2    0.3      361      1      TestStressLockFactories.testSimpleFSLockFactory
       2    0.2      540      1      TestTlogReplica.testCreateDelete
       2    0.4      270      1      TestTlogReplica.testRebalanceLeaders
       2    0.3      287      1      \
                TestTolerantUpdateProcessorRandomCloud.testSanityRandomUnsetBit
       2    0.3      345      1      \
TestTrackingShardHandlerFactory.testRequestTracking  2    0.8      121      1      \
TestVectorUtil.testSelfDotProduct  3 100.0        1      1      \
AnalysisErrorHandlingTest.classMethod  3 100.0        3      3      \
                AssignTest.classMethod
        3   0.6      155      1      \
AutoAddReplicasIntegrationTest.testClusterPropOverridesCollecitonProp  3   0.3      \
                362      1      CloudHttp2SolrClientTest.testRouting
        3   1.6       61      1      \
                CloudHttp2SolrClientWireMockTest.testConcurrentParallelUpdates
        3   0.4      273      1      CollectionsAPIDistributedZkTest.addReplicaTest
        3   0.4      273      1      \
CollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes  3 100.0       20  \
                20      CollectionsAPISolrJTest.classMethod
        3   0.6      159      1      \
ComputePlanActionTest.testSelectedCollectionsByPolicy  3 100.0       50     50      \
                ConfigSetsAPITest.classMethod
        3   0.4      278      1      ConnectionManagerTest.testLikelyExpired
        3   0.3      334      1      CustomCollectionTest.testCreateShardRepFactor
        3 100.0       20     20      DeleteNodeTest.classMethod
        3   0.3      335      1      DeleteShardTest.test
        3   0.6      155      1      ExecutePlanActionTest.testTaskTimeout
        3   0.3      354      1      HttpSolrCallGetCoreTest.test
        3   0.4      274      1      LeaderFailoverAfterPartitionTest.test
        3   0.6      154      1      \
                NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState
        3   0.6      154      1      \
                NodeMarkersRegistrationTest.testNodeMarkersRegistration
        3 100.0       20     20      OverseerModifyCollectionTest.classMethod
        3 100.0        1      1      PeerSyncReplicationTest.classMethod
        3   0.4      279      1      PeerSyncReplicationTest.test
        3 100.0        1      1      RollingRestartTest.classMethod
        3   0.4      282      1      ShardSplitTest.testSplitLocking
        3   0.4      282      1      ShardSplitTest.testSplitStaticIndexReplication
        3   0.4      282      1      \
                ShardSplitTest.testSplitStaticIndexReplicationLink
        3   0.4      244      1      \
                SoftAutoCommitTest.testSoftCommitWithinAndHardCommitMaxTimeMixedAdds
        3   1.4      284      4      \
                SolrCloudExampleTest.testLoadDocsIntoGettingStartedCollection
        3   0.4      278      1      SolrCloudReportersTest.testExplicitConfiguration
        3   0.3      371      1      \
SolrExampleStreamingBinaryTest.testCommitWithinOnAdd  3   0.4      274      1      \
SolrShardReporterTest.test  3 100.0        1      1      \
                TestCloudConsistency.classMethod
        3   0.4      279      1      \
                TestCollectionAPI.testRecreateCollectionAfterFailure
        3   4.8       21      1      \
                TestCompressingStoredFieldsFormat.testBigDocuments
        3   0.7      279      2      TestCustomStream.testDynamicLoadingCustomStream
        3   0.9      231      2      \
TestDelegationWithHadoopAuth.testDelegationTokenRenew  3   0.5      380      2      \
                TestDemoParallelLeafReader.testBasic
        3   1.3      383      5      \
TestDemoParallelLeafReader.testRandomMultipleSchemaGens  3   1.0      289      3      \
TestDistributedSearch.test  3   1.3      160      2      \
TestDynamicLoading.testDynamicLoading  3 100.0        1      1      \
                TestJsonFacets.classMethod
        3 100.0        1      1      TestLocalFSCloudBackupRestore.classMethod
        3   0.3      379      1      TestNRTThreads.testNRTThreads
        3   0.6      154      1      TestNamedUpdateProcessors.test
        3   0.4      283      1      TestPackages.testSchemaPlugins
        3   0.4      273      1      TestPointFields.testFloatPointStats
        3   0.3      336      1      TestPrepRecovery.testLeaderUnloaded
        3   0.4      278      1      TestRandomRequestDistribution.test
        3 100.0        1      1      TestSizeLimitedDistributedMap.classMethod
        3   5.7      300     17      TestSpanExplanations.testExplainWithoutScoring
        3   5.7      299     17      \
TestSpanExplanationsOfNonMatches.testExplainWithoutScoring  3   0.4      278      1   \
                TestTlogReplica.testDeleteById
        3   0.8      130      1      TestVectorValues.testAddIndexesDirectory01
        3 100.0        1      1      TestWaitForStateWithJettyShutdowns.classMethod
        3 100.0        1      1      TestWithCJKBigramFilter.classMethod
        3   0.3      377      1      TestWithCJKBigramFilter.testMix2



***********************Annotations report

*****************AwaitsFix Annotations:


************Lucene AwaitsFix
TestAllFilesDetectBitFlips.TestAllFilesDetectBitFlips suite
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-9356")

TestAllFilesDetectTruncation.TestAllFilesDetectTruncation suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-9409")

TestControlledRealTimeReopenThread.testCRTReopen
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737")

TestICUNormalizer2CharFilter.testRandomStrings
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595")

TestICUTokenizerCJK.TestICUTokenizerCJK suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222")

TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161")


    ************Solr AwaitsFix
CollectionsAPISolrJTest.testCreateAndDeleteShard
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13021")

ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite
   @LuceneTestCase.AwaitsFix(bugUrl = \
"https://issues.apache.org/jira/browse/SOLR-12386") // "Can't find resource"

LeaderTragicEventTest.LeaderTragicEventTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13237")

MoveReplicaHDFSTest.MoveReplicaHDFSTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13924")

MoveReplicaHDFSTest.testFailedMove
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12080") // added \
03-Oct-2018

RoutedAliasUpdateProcessorTest.alias,
   @org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13696")


SSLMigrationTest.SSLMigrationTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // \
17-Mar-2018

SaslZkACLProviderTest.testSaslZkACLProvider
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13075")

SecurityHeadersTest.SecurityHeadersTest suite
   @org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-14903")


SolrExporterIntegrationTest.SolrExporterIntegrationTest suite
   @org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13786")


Tagger2Test.testStopWords
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344")

TestImpersonationWithHadoopAuth.testForwarding
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893")

TestJsonFacetRefinement.testIndexAscRefineConsistency
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-14595")

TestJsonFacetRefinement.testProcessEmptyRefinement
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556")

TestJsonFacetRefinement.testSortedSubFacetRefinementWhenParentOnlyReturnedByOneShardProcessEmpty
  @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556")

TestLTRReRankingPipeline.testDifferentTopN
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134")

TestMinMaxOnMultiValuedField.testDoubleFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709")

TestMinMaxOnMultiValuedField.testFloatFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709")

TestMinMaxOnMultiValuedField.testIntFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709")

TestMinMaxOnMultiValuedField.testLongFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709")

TestPullReplica.TestPullReplica suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")

TestStressRecovery.TestStressRecovery suite
   @LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") \
// 6-Sep-2018

TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183")


TimeRoutedAliasUpdateProcessorTest.testDateMathInStart
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13943")

TriLevelCompositeIdRoutingTest.test
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13369")



*****************BadApple Annotations:

************Lucene BadApple

************Solr BadApple
MoveReplicaHDFSTest.testNormalFailedMove
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // \
14-Oct-2018

SharedFSAutoReplicaFailoverTest.SharedFSAutoReplicaFailoverTest suite
   @LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") \
// added 20-Jul-2018

TimeRoutedAliasUpdateProcessorTest.TimeRoutedAliasUpdateProcessorTest suite
   @LuceneTestCase.BadApple(bugUrl = \
"https://issues.apache.org/jira/browse/SOLR-13059")



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org

[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic