Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Add in some concrete action items for fixing MiniDFSCluster

...

  • Update tests using build/test/data, /tmp, etc. to use correct temp
  • Flaky tests
    • TestDFSStripedOutputStreamWithFailure (
      Jira
      serverASF JIRA
      serverId5aa69414-a9e9-3523-82ec-879b028fb15b
      keyHDFS-11600
      )
    • TestWebHdfsTimeouts
    • TestErasureCodingPoliciesWithRandomECPolicy
    • TestErasureCodingPolicies
    • TestDFSStripedOutputStream
    • TestDFSStripedInputStream
    • TestDecommission
    • TestUnsetAndChangeDirectoryEcPolicy
    • TestMaintenanceState
    • TestDataNodeErasureCodingMetrics
    • TestReconstructStripedFile
    • TestReadStripedFileWithDNFailure
  • MiniDFSCluster improvements
    • Reduce the number of threads that get started by MiniDFSCluster
      • Jira
        serverASF JIRA
        columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
        serverId5aa69414-a9e9-3523-82ec-879b028fb15b
        keyHDFS-13265

      • Jira
        serverASF JIRA
        columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
        serverId5aa69414-a9e9-3523-82ec-879b028fb15b
        keyHDFS-13262

  • Over-reliance on MiniDFSCluster
  • Ignored or skipped tests
    •  TestGlobPaths
    • TestHdfsNativeCodeLoader

    • TestSymlinkHdfsFileSystem

    • TestAppendDifferentChecksum

    • TestDecommission

    • TestDFSUpgrade

    • TestFileConcurrentReader

    • TestParallelReadUtil

    • TestWebHDFSAcl

...