Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

 

Yarn App Log

Tez is a yarn application, so any yarn app diagnose methodology also fit for tez. 

...

Tez will propagate most of the exceptions to client side. So please first check the client side log to look for any useful information about the errors.nIf the client side log still not convey much information, you can check for the yarn application logs. 

Users can invoke command "yarn logs -applicationId {your_app_id}" to fetch the yarn app log to your local directory. This command is only available when the yarn log aggregation is enabled, for how to enable the yarn app log you can refer http://hortonworks.com/blog/simplifying-user-logs-management-and-access-in-yarn/ . If the log aggregation is not enabled, you may have to find the logs on each node manager machines. 

...

First hive client ( hive cli/beeline will print some info if error happens on tez ), if it's not clear you may check the hive log file. Usually it is located in /tmp/{user}/hive.log. It may be also located in other places if you configure it in $HIVE_HOME/conf/hive-log4j.properties.

If the hive log still don't have enough information, you can refer the yarn log (  refer section Yarn App Log )

 

 

Pig on Tez

 

 

 

Cascading on Tez

...