我想在Hive-Tez上运行查询后得到Map-Reduce日志的解释?INFO:后面的行表达了什么?这里我附上了一个样品
INFO : Session is already open
INFO : Dag name: SELECT a.Model...)
INFO : Tez session was closed. Reopening...
INFO : Session re-established.
INFO :
INFO : Status: Running (Executing on YARN cluster with App id application_14708112341234_1234)
INFO : Map 1: -/- Map 3: -/- Map 4: -/- Map 7: -/- Reducer 2: 0/15 Reducer 5: 0/26 Reducer 6: 0/13
INFO : Map 1: -/- Map 3: 0/118 Map 4: 0/118 Map 7: 0/1 Reducer 2: 0/15 Reducer 5: 0/26 Reducer 6: 0/13
INFO : Map 1: 0/118 Map 3: 0/118 Map 4: 0/118 Map 7: 0/1 Reducer 2: 0/15 Reducer 5: 0/26 Reducer 6: 0/13
INFO : Map 1: 0/118 Map 3: 0/118 Map 4: 0(+5)/118 Map 7: 0/1 Reducer 2: 0/15 Reducer 5: 0/26 Reducer 6: 0/13
INFO : Map 1: 0/118 Map 3: 0(+5)/118 Map 4: 0(+7)/118 Map 7: 0(+1)/1 Reducer 2: 0/15 Reducer 5: 0/26 Reducer 6: 0/13
INFO : Map 1: 0/118 Map 3: 0(+15)/118 Map 4: 0(+18)/118 Map 7: 0(+1)/1 Reducer 2: 0/15 Reducer 5: 0/26 Reducer 6: 0/13
您发布的日志是DAG执行日志。DAG包括Map 1、Map 3、Map 4、Map 7映射器顶点和减速机:减速机2、减速机5、减速机6
Map 1: -/-
-这意味着顶点尚未初始化,映射器的数量尚未计算。
Map 4: 0(+7)/118
-这意味着总共有118个映射器,其中7个正在并行运行,0个已完成,118-7=111个正在等待。
Reducer 2: 0/15
-这意味着总共有15个减速机,其中0个正在运行,0个已完成(15个待挂)。
负数(在你的例子中没有)=失败或被杀死的映射器或reducer的数量
Qubole有关于Tez测井的解释:https://docs.qubole.com/en/latest/user-guide/hive/using-hive-on-tez/hive-tez-tuning.html#understanding-log-pane