You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 2 Next »

Overview

Tez stores its History via a configurable History Logging Service. There are multiple implementations of this available as part of the Tez Framework:

  • SimpleHistoryLoggingService 
    • This writes the history into a log-file. The location is configurable. It can be logged as a file which will become part of the YARN Application's aggregated logs ( i.e. within the Application Master's container logs ) or to a defined location on a Distributed FileSystem such as HDFS
  • ATSHistoryLoggingService and ATSV15HistoryLoggingService
    • These impls make use of YARN Timeline to store the history data
    • The ATSV15 impl ( or to be more clear v1.5 ) makes use of enhancements done as part of YARN-4233 which makes the use of a DistributedFileSystem for most of the data being written and stored.

The Tez UI currently only works with the YARN Timeline based stores. It will not be able to display any data for Tez DAGs that were configured to use the SimpleHistoryLoggingService. 

Tez History Data in YARN Timeline

Securing Access to Tez History Data

Tez UI

Hosting the Tez UI

Tez UI as an Ambari View

 

 

 

 

 

  • No labels