THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
Create and queue a Hadoop streaming MapReduce job.
| Info | ||
|---|---|---|
| ||
As of Hive 0.13.0, GET version/hadoop displays the Hadoop version used for the MapReduce job. |
URL
http://www.myserver.com/templeton/v1/mapreduce/streaming
...
Name | Description |
|---|---|
id | A string containing the job ID similar to "job_201110132141_0001". |
info | A JSON object containing the information returned when the job was queued. See the Hadoop documentation ( |
Example
...
Curl Command
| No Format |
|---|
% curl -s -d user.name=ctdean \ -d input=mydata \ -d output=mycounts \ -d mapper=/bin/cat \ -d reducer="/usr/bin/wc -w" \ 'http://localhost:50111/templeton/v1/mapreduce/streaming?user.name=ekoifman' |
| Info | ||
|---|---|---|
| ||
Prior to Hive 0.13.0, user.name was specified in POST requests as a form parameter: In Hive 0.13.0 onward, user.name should be specified in the query string (as shown above): |
JSON Output
| No Format |
|---|
{
"id": "job_201111111311_0008",
"info": {
"stdout": "packageJobJar: [] [/Users/ctdean/var/hadoop/hadoop-0.20.205.0/share/hadoop/contrib/streaming/hadoop-streaming-0.20.205.0.jar...
templeton-job-id:job_201111111311_0008
",
"stderr": "11/11/11 13:26:43 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments
11/11/11 13:26:43 INFO mapred.FileInputFormat: Total input paths to process : 2
",
"exitcode": 0
}
}
|
...
| Panel | ||||||
|---|---|---|---|---|---|---|
| ||||||
Previous: PUT ddl/database/:db/table/:table/property/:property General: WebHCat Reference – WebHCat Manual – HCatalog Manual – Hive Wiki Home – Hive Project Site |