THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
Table of Contents | ||
---|---|---|
|
Overview
Tez stores its History via a configurable History Logging Service. There are multiple implementations of this available as part of the Tez Framework:
- SimpleHistoryLoggingService
- This writes the history into a log-file. The location is configurable. It can be logged as a file which will become part of the YARN Application's aggregated logs ( i.e. within the Application Master's container logs ) or to a defined location on a Distributed FileSystem such as HDFS
- ATSHistoryLoggingService and ATSV15HistoryLoggingService
- These impls make use of YARN Timeline to store the history data
- The ATSV15 impl ( or to be more clear v1.5 ) makes use of enhancements done as part of YARN-4233 which makes the use of a DistributedFileSystem for most of the data being written and stored.
The Tez UI currently only works with the YARN Timeline based stores. It will not be able to display any data for Tez DAGs that were configured to use the SimpleHistoryLoggingService.
Tez History Data in YARN Timeline
Securing Access to Tez History Data
Tez UI
Hosting the Tez UI
Tez UI as an Ambari View