Versions Compared

Old Version 3

changes.mady.by.user Brahma Reddy Battula

Saved on

compared with

New Version 4

changes.mady.by.user Chris Douglas

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Scratch space to brainstorm ideas for improving HDFS test stability

Unit tests

  • Update tests using build/test/data, /tmp, etc. to use correct temp
  • Flaky tests
    • TestDFSStripedOutputStreamWithFailure
    • TestWebHdfsTimeouts
    • TestErasureCodingPoliciesWithRandomECPolicy
    • TestErasureCodingPolicies
    • TestDFSStripedOutputStream
    • TestDFSStripedInputStream
    • TestDecommission
    • TestUnsetAndChangeDirectoryEcPolicy
    • TestMaintenanceState
    • TestDataNodeErasureCodingMetrics
    • TestReconstructStripedFile
    • TestReadStripedFileWithDNFailure
  • MiniDFSCluster improvements
  • Over-reliance on MiniDFSCluster
  • Ignored or skipped tests
    •  TestGlobPaths

    • TestHdfsNativeCodeLoader

    • TestSymlinkHdfsFileSystem

    • TestAppendDifferentChecksum

    • TestDecommission

    • TestDFSUpgrade

    • TestFileConcurrentReader

    • TestParallelReadUtil

    • TestWebHDFSAcl

Build

  • HDFS-12711
  • Windows build (stopped running?)
  • Upgrade surefire, unless there's a good reason not to in branch-2 (see HADOOP-15153)

...