I ran a Hive query and it got stucked at 67% ,tried- set hive.execution.engine=tez;,SET mapreduce.job.reduces=100;But no change
Warning: Shuffle Join JOIN[11][tables = [t, wl]] in Stage 'Stage-4:MAPRED' is a cross product
Total jobs = 7
Launching Job 1 out of 7
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
set hive.exec.reducers.bytes.per.reducer=
In order to limit the maximum number of reducers:
set hive.exec.reducers.max=
In order to set a constant number of reducers:
set mapreduce.job.reduces=
Kill Command = /usr/hdp/2.3.4.29-1/hadoop/bin/hadoop job -kill job_1471196291943_529397
Hadoop job information for Stage-4: number of mappers: 755; number of reducers: 1
2016-09-09 07:56:31,939 Stage-4 map = 0%, reduce = 0%
2016-09-09 07:56:52,244 Stage-4 map = 3%, reduce = 0%, Cumulative CPU 193.62 sec
2016-09-09 07:56:53,280 Stage-4 map = 5%, reduce = 0%, Cumulative CPU 384.21 sec
2016-09-09 07:56:54,317 Stage-4 map = 7%, reduce = 0%, Cumulative CPU 575.7 sec
2016-09-09 07:56:55,355 Stage-4 map = 9%, reduce = 0%, Cumulative CPU 2626.4 sec
2016-09-09 07:56:56,401 Stage-4 map = 10%, reduce = 0%, Cumulative CPU 3450.33 sec
2016-09-09 07:56:57,437 Stage-4 map = 11%, reduce = 0%, Cumulative CPU 3682.21 sec
2016-09-09 07:56:58,473 Stage-4 map = 12%, reduce = 0%, Cumulative CPU 4197.15 sec
2016-09-09 07:56:59,509 Stage-4 map = 13%, reduce = 0%, Cumulative CPU 4340.71 sec
2016-09-09 07:57:01,581 Stage-4 map = 15%, reduce = 0%, Cumulative CPU 5034.46 sec
2016-09-09 07:57:02,628 Stage-4 map = 17%, reduce = 0%, Cumulative CPU 5332.0 sec
2016-09-09 07:57:03,666 Stage-4 map = 18%, reduce = 0%, Cumulative CPU 5677.82 sec
2016-09-09 07:57:04,710 Stage-4 map = 20%, reduce = 0%, Cumulative CPU 6447.49 sec
2016-09-09 07:57:05,769 Stage-4 map = 21%, reduce = 0%, Cumulative CPU 6603.47 sec
2016-09-09 07:57:07,837 Stage-4 map = 23%, reduce = 0%, Cumulative CPU 7411.47 sec
2016-09-09 07:57:09,913 Stage-4 map = 24%, reduce = 0%, Cumulative CPU 7809.45 sec
2016-09-09 07:57:10,948 Stage-4 map = 25%, reduce = 0%, Cumulative CPU 8254.21 sec
2016-09-09 07:57:11,982 Stage-4 map = 26%, reduce = 0%, Cumulative CPU 8446.65 sec
2016-09-09 07:57:13,038 Stage-4 map = 27%, reduce = 0%, Cumulative CPU 8621.14 sec
2016-09-09 07:57:14,072 Stage-4 map = 28%, reduce = 0%, Cumulative CPU 9151.16 sec
2016-09-09 07:57:15,114 Stage-4 map = 29%, reduce = 0%, Cumulative CPU 9383.58 sec
2016-09-09 07:57:16,146 Stage-4 map = 30%, reduce = 0%, Cumulative CPU 9621.19 sec
2016-09-09 07:57:17,179 Stage-4 map = 32%, reduce = 0%, Cumulative CPU 10092.41 sec
2016-09-09 07:57:19,245 Stage-4 map = 34%, reduce = 0%, Cumulative CPU 10500.92 sec
2016-09-09 07:57:20,278 Stage-4 map = 35%, reduce = 0%, Cumulative CPU 10947.01 sec
2016-09-09 07:57:21,321 Stage-4 map = 36%, reduce = 0%, Cumulative CPU 11095.63 sec
2016-09-09 07:57:22,356 Stage-4 map = 37%, reduce = 0%, Cumulative CPU 11360.75 sec
2016-09-09 07:57:23,390 Stage-4 map = 39%, reduce = 0%, Cumulative CPU 11739.07 sec
2016-09-09 07:57:25,458 Stage-4 map = 41%, reduce = 0%, Cumulative CPU 12277.33 sec
2016-09-09 07:57:26,492 Stage-4 map = 42%, reduce = 0%, Cumulative CPU 12513.99 sec
2016-09-09 07:57:27,527 Stage-4 map = 43%, reduce = 0%, Cumulative CPU 12741.7 sec
2016-09-09 07:57:28,573 Stage-4 map = 44%, reduce = 0%, Cumulative CPU 12953.45 sec
2016-09-09 07:57:29,608 Stage-4 map = 45%, reduce = 0%, Cumulative CPU 13181.96 sec
2016-09-09 07:57:30,642 Stage-4 map = 47%, reduce = 0%, Cumulative CPU 13464.88 sec
2016-09-09 07:57:31,677 Stage-4 map = 48%, reduce = 0%, Cumulative CPU 13694.24 sec
2016-09-09 07:57:32,714 Stage-4 map = 50%, reduce = 0%, Cumulative CPU 13956.44 sec
2016-09-09 07:57:33,749 Stage-4 map = 51%, reduce = 0%, Cumulative CPU 14185.32 sec
2016-09-09 07:57:34,817 Stage-4 map = 52%, reduce = 0%, Cumulative CPU 14437.2 sec
2016-09-09 07:57:35,880 Stage-4 map = 54%, reduce = 0%, Cumulative CPU 14729.86 sec
2016-09-09 07:57:36,917 Stage-4 map = 56%, reduce = 0%, Cumulative CPU 15063.85 sec
2016-09-09 07:57:37,953 Stage-4 map = 57%, reduce = 0%, Cumulative CPU 15442.46 sec
2016-09-09 07:57:38,991 Stage-4 map = 58%, reduce = 0%, Cumulative CPU 15668.74 sec
2016-09-09 07:57:40,024 Stage-4 map = 59%, reduce = 0%, Cumulative CPU 15993.19 sec
2016-09-09 07:57:41,086 Stage-4 map = 61%, reduce = 0%, Cumulative CPU 16300.79 sec
2016-09-09 07:57:42,143 Stage-4 map = 62%, reduce = 0%, Cumulative CPU 16656.1 sec
2016-09-09 07:57:43,199 Stage-4 map = 63%, reduce = 0%, Cumulative CPU 16916.45 sec
2016-09-09 07:57:44,255 Stage-4 map = 66%, reduce = 0%, Cumulative CPU 17282.84 sec
2016-09-09 07:57:45,312 Stage-4 map = 67%, reduce = 0%, Cumulative CPU 17685.75 sec
2016-09-09 07:57:46,369 Stage-4 map = 68%, reduce = 0%, Cumulative CPU 17986.57 sec
2016-09-09 07:57:47,433 Stage-4 map = 69%, reduce = 0%, Cumulative CPU 18298.74 sec
2016-09-09 07:57:48,492 Stage-4 map = 71%, reduce = 0%, Cumulative CPU 18608.03 sec
2016-09-09 07:57:49,552 Stage-4 map = 73%, reduce = 0%, Cumulative CPU 18926.02 sec
2016-09-09 07:57:51,643 Stage-4 map = 74%, reduce = 0%, Cumulative CPU 19427.48 sec
2016-09-09 07:57:52,680 Stage-4 map = 75%, reduce = 0%, Cumulative CPU 19582.97 sec
2016-09-09 07:57:53,726 Stage-4 map = 76%, reduce = 0%, Cumulative CPU 19873.23 sec
2016-09-09 07:57:54,761 Stage-4 map = 78%, reduce = 0%, Cumulative CPU 20162.92 sec
2016-09-09 07:57:55,795 Stage-4 map = 80%, reduce = 0%, Cumulative CPU 20411.77 sec
2016-09-09 07:57:56,831 Stage-4 map = 83%, reduce = 0%, Cumulative CPU 20691.61 sec
2016-09-09 07:57:57,867 Stage-4 map = 85%, reduce = 0%, Cumulative CPU 20978.6 sec
2016-09-09 07:57:58,902 Stage-4 map = 86%, reduce = 0%, Cumulative CPU 21360.89 sec
2016-09-09 07:57:59,949 Stage-4 map = 88%, reduce = 0%, Cumulative CPU 21776.14 sec
2016-09-09 07:58:00,984 Stage-4 map = 90%, reduce = 0%, Cumulative CPU 22225.09 sec
2016-09-09 07:58:02,020 Stage-4 map = 91%, reduce = 0%, Cumulative CPU 22451.07 sec
2016-09-09 07:58:03,078 Stage-4 map = 92%, reduce = 0%, Cumulative CPU 22620.97 sec
2016-09-09 07:58:04,113 Stage-4 map = 93%, reduce = 0%, Cumulative CPU 22764.4 sec
2016-09-09 07:58:05,171 Stage-4 map = 94%, reduce = 0%, Cumulative CPU 22918.72 sec
2016-09-09 07:58:08,319 Stage-4 map = 95%, reduce = 5%, Cumulative CPU 23263.75 sec
2016-09-09 07:58:11,445 Stage-4 map = 96%, reduce = 5%, Cumulative CPU 23502.15 sec
2016-09-09 07:58:13,569 Stage-4 map = 97%, reduce = 5%, Cumulative CPU 23634.14 sec
2016-09-09 07:58:17,732 Stage-4 map = 98%, reduce = 5%, Cumulative CPU 23838.46 sec
2016-09-09 07:58:22,918 Stage-4 map = 99%, reduce = 5%, Cumulative CPU 24042.8 sec
2016-09-09 07:58:36,430 Stage-4 map = 99%, reduce = 7%, Cumulative CPU 24277.24 sec
2016-09-09 07:59:05,625 Stage-4 map = 100%, reduce = 7%, Cumulative CPU 24363.56 sec
2016-09-09 07:59:06,661 Stage-4 map = 100%, reduce = 8%, Cumulative CPU 24374.37 sec
2016-09-09 07:59:39,932 Stage-4 map = 100%, reduce = 10%, Cumulative CPU 24419.55 sec
2016-09-09 08:00:11,092 Stage-4 map = 100%, reduce = 11%, Cumulative CPU 24455.42 sec
2016-09-09 08:00:14,225 Stage-4 map = 100%, reduce = 12%, Cumulative CPU 24462.83 sec
2016-09-09 08:00:42,314 Stage-4 map = 100%, reduce = 13%, Cumulative CPU 24497.92 sec
2016-09-09 08:00:45,478 Stage-4 map = 100%, reduce = 14%, Cumulative CPU 24507.31 sec
2016-09-09 08:01:14,963 Stage-4 map = 100%, reduce = 16%, Cumulative CPU 24548.48 sec
2016-09-09 08:01:45,478 Stage-4 map = 100%, reduce = 17%, Cumulative CPU 24592.77 sec
2016-09-09 08:02:13,901 Stage-4 map = 100%, reduce = 18%, Cumulative CPU 24629.14 sec
2016-09-09 08:02:17,019 Stage-4 map = 100%, reduce = 19%, Cumulative CPU 24636.02 sec
2016-09-09 08:02:44,373 Stage-4 map = 100%, reduce = 21%, Cumulative CPU 24679.42 sec
2016-09-09 08:03:14,979 Stage-4 map = 100%, reduce = 23%, Cumulative CPU 24717.6 sec
2016-09-09 08:03:42,238 Stage-4 map = 100%, reduce = 25%, Cumulative CPU 24757.64 sec
2016-09-09 08:04:10,479 Stage-4 map = 100%, reduce = 27%, Cumulative CPU 24798.59 sec
2016-09-09 08:04:41,102 Stage-4 map = 100%, reduce = 29%, Cumulative CPU 24840.41 sec
2016-09-09 08:05:08,637 Stage-4 map = 100%, reduce = 30%, Cumulative CPU 24882.21 sec
2016-09-09 08:05:39,243 Stage-4 map = 100%, reduce = 32%, Cumulative CPU 24922.68 sec
2016-09-09 08:06:06,614 Stage-4 map = 100%, reduce = 33%, Cumulative CPU 24953.21 sec
2016-09-09 08:06:37,025 Stage-4 map = 100%, reduce = 54%, Cumulative CPU 24987.91 sec
2016-09-09 08:06:40,138 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 24993.76 sec
2016-09-09 08:07:40,820 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25062.84 sec
2016-09-09 08:08:40,842 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25117.07 sec
2016-09-09 08:09:41,013 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25180.34 sec
2016-09-09 08:10:42,035 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25224.54 sec
2016-09-09 08:11:42,172 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25280.35 sec
2016-09-09 08:12:43,027 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25340.39 sec
2016-09-09 08:13:44,023 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25385.13 sec
2016-09-09 08:14:44,072 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25428.33 sec
2016-09-09 08:15:44,190 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25485.08 sec
2016-09-09 08:16:44,354 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25529.84 sec
2016-09-09 08:17:44,624 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25591.28 sec
2016-09-09 08:18:45,341 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25660.78 sec
2016-09-09 08:19:46,349 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25733.83 sec
2016-09-09 08:20:47,078 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25796.07 sec
2016-09-09 08:21:47,838 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25844.51 sec
2016-09-09 08:22:47,960 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25905.59 sec
2016-09-09 08:23:48,066 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25977.55 sec
2016-09-09 08:24:48,245 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26034.59 sec
2016-09-09 08:25:48,525 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26107.53 sec
2016-09-09 08:26:48,698 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26171.67 sec
2016-09-09 08:27:48,890 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26240.7 sec
2016-09-09 08:28:49,038 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26307.61 sec
2016-09-09 08:29:49,718 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26374.32 sec
2016-09-09 08:30:50,014 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26430.11 sec
2016-09-09 08:31:50,689 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26497.21 sec
2016-09-09 08:32:50,968 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26559.3 sec
2016-09-09 08:33:51,439 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26628.23 sec
2016-09-09 08:34:51,555 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26693.32 sec
2016-09-09 08:35:51,667 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26768.78 sec
2016-09-09 08:36:51,753 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26817.29 sec
2016-09-09 08:37:52,024 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26887.05 sec
2016-09-09 08:38:52,257 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26960.18 sec
2016-09-09 08:39:52,368 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27025.84 sec
2016-09-09 08:40:52,457 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27103.96 sec
2016-09-09 08:41:52,625 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27172.73 sec
2016-09-09 08:42:52,703 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27241.32 sec
2016-09-09 08:43:52,867 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27322.7 sec
2016-09-09 08:44:52,986 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27402.08 sec
2016-09-09 08:45:53,163 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27477.95 sec
2016-09-09 08:46:53,291 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27556.1 sec
2016-09-09 08:47:53,563 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27636.83 sec
2016-09-09 08:48:53,717 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27716.47 sec
2016-09-09 08:49:54,649 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27797.55 sec
2016-09-09 08:50:55,658 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27876.47 sec
2016-09-09 08:51:56,679 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27955.27 sec
2016-09-09 08:52:57,661 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28034.74 sec
2016-09-09 08:53:57,672 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28110.49 sec
2016-09-09 08:54:58,697 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28186.16 sec
2016-09-09 08:55:59,741 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28267.33 sec
2016-09-09 08:57:00,722 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28346.6 sec
2016-09-09 08:58:01,732 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28427.45 sec
2016-09-09 08:59:01,946 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28506.86 sec
2016-09-09 09:00:02,225 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28586.64 sec
2016-09-09 09:01:02,356 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28662.52 sec
2016-09-09 09:02:02,509 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28721.57 sec
2016-09-09 09:03:02,693 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28791.54 sec
2016-09-09 09:04:03,744 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28866.11 sec
2016-09-09 09:05:04,079 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28929.66 sec
2016-09-09 09:06:04,223 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28984.34 sec
2016-09-09 09:07:04,536 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29060.52 sec
2016-09-09 09:08:04,849 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29135.71 sec
2016-09-09 09:09:05,027 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29213.32 sec
2016-09-09 09:10:05,326 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29288.94 sec
2016-09-09 09:11:05,530 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29345.27 sec
2016-09-09 09:12:05,740 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29416.56 sec
2016-09-09 09:13:05,890 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29461.94 sec
2016-09-09 09:14:06,025 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29523.05 sec
2016-09-09 09:15:06,176 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29599.48 sec
2016-09-09 09:16:06,314 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29663.97 sec
2016-09-09 09:17:06,389 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29743.73 sec
2016-09-09 09:18:06,548 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29790.83 sec
2016-09-09 09:19:06,631 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29856.95 sec
2016-09-09 09:20:06,687 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29938.04 sec
2016-09-09 09:21:06,827 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30008.74 sec
2016-09-09 09:22:07,838 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30082.36 sec
2016-09-09 09:23:08,873 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30160.69 sec
2016-09-09 09:24:09,851 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30229.62 sec
2016-09-09 09:25:10,852 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30305.97 sec
2016-09-09 09:26:10,961 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30380.39 sec
2016-09-09 09:27:12,005 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30459.9 sec
2016-09-09 09:28:12,992 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30540.92 sec
2016-09-09 09:29:13,995 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30621.28 sec
2016-09-09 09:30:14,018 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30702.88 sec
2016-09-09 09:31:14,100 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30784.49 sec
2016-09-09 09:32:14,185 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30849.28 sec
2016-09-09 09:33:14,299 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30928.55 sec
2016-09-09 09:34:14,548 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31003.52 sec
2016-09-09 09:35:14,748 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31070.64 sec
2016-09-09 09:36:14,976 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31130.58 sec
2016-09-09 09:37:16,007 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31213.15 sec
2016-09-09 09:38:16,164 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31292.37 sec
2016-09-09 09:39:16,316 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31372.21 sec
2016-09-09 09:40:17,276 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31445.05 sec
2016-09-09 09:41:17,317 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31517.11 sec
2016-09-09 09:42:17,343 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31595.28 sec
2016-09-09 09:43:17,407 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31670.57 sec
2016-09-09 09:44:17,408 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31751.29 sec
2016-09-09 09:45:17,462 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31827.91 sec
2016-09-09 09:46:18,484 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31902.08 sec
2016-09-09 09:47:19,448 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31982.91 sec
2016-09-09 09:48:20,362 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 32063.73 sec
2016-09-09 09:49:21,391 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 32129.59 sec
2016-09-09 09:50:22,409 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 32209.13 sec
2016-09-09 09:51:23,368 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 32281.79 sec
2016-09-09 09:52:23,406 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 32358.09 sec
2016-09-09 09:53:23,481 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 32431.51 sec
2016-09-09 09:54:24,484 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 32515.75 sec
2016-09-09 09:55:25,478 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 32595.34 sec
2016-09-09 09:56:26,492 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 32652.75 sec
2016-09-09 09:57:27,442 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 32731.36 sec
I ran a Hive query and it got stucked at 67% ,tried- set hive.execution.engine=tez;,SET mapreduce.job.reduces=100;But no change
Warning: Shuffle Join JOIN[11][tables = [t, wl]] in Stage 'Stage-4:MAPRED' is a cross product
Total jobs = 7
Launching Job 1 out of 7
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
set hive.exec.reducers.bytes.per.reducer=
In order to limit the maximum number of reducers:
set hive.exec.reducers.max=
In order to set a constant number of reducers:
set mapreduce.job.reduces=
Kill Command = /usr/hdp/2.3.4.29-1/hadoop/bin/hadoop job -kill job_1471196291943_529397
Hadoop job information for Stage-4: number of mappers: 755; number of reducers: 1
2016-09-09 07:56:31,939 Stage-4 map = 0%, reduce = 0%
2016-09-09 07:56:52,244 Stage-4 map = 3%, reduce = 0%, Cumulative CPU 193.62 sec
2016-09-09 07:56:53,280 Stage-4 map = 5%, reduce = 0%, Cumulative CPU 384.21 sec
2016-09-09 07:56:54,317 Stage-4 map = 7%, reduce = 0%, Cumulative CPU 575.7 sec
2016-09-09 07:56:55,355 Stage-4 map = 9%, reduce = 0%, Cumulative CPU 2626.4 sec
2016-09-09 07:56:56,401 Stage-4 map = 10%, reduce = 0%, Cumulative CPU 3450.33 sec
2016-09-09 07:56:57,437 Stage-4 map = 11%, reduce = 0%, Cumulative CPU 3682.21 sec
2016-09-09 07:56:58,473 Stage-4 map = 12%, reduce = 0%, Cumulative CPU 4197.15 sec
2016-09-09 07:56:59,509 Stage-4 map = 13%, reduce = 0%, Cumulative CPU 4340.71 sec
2016-09-09 07:57:01,581 Stage-4 map = 15%, reduce = 0%, Cumulative CPU 5034.46 sec
2016-09-09 07:57:02,628 Stage-4 map = 17%, reduce = 0%, Cumulative CPU 5332.0 sec
2016-09-09 07:57:03,666 Stage-4 map = 18%, reduce = 0%, Cumulative CPU 5677.82 sec
2016-09-09 07:57:04,710 Stage-4 map = 20%, reduce = 0%, Cumulative CPU 6447.49 sec
2016-09-09 07:57:05,769 Stage-4 map = 21%, reduce = 0%, Cumulative CPU 6603.47 sec
2016-09-09 07:57:07,837 Stage-4 map = 23%, reduce = 0%, Cumulative CPU 7411.47 sec
2016-09-09 07:57:09,913 Stage-4 map = 24%, reduce = 0%, Cumulative CPU 7809.45 sec
2016-09-09 07:57:10,948 Stage-4 map = 25%, reduce = 0%, Cumulative CPU 8254.21 sec
2016-09-09 07:57:11,982 Stage-4 map = 26%, reduce = 0%, Cumulative CPU 8446.65 sec
2016-09-09 07:57:13,038 Stage-4 map = 27%, reduce = 0%, Cumulative CPU 8621.14 sec
2016-09-09 07:57:14,072 Stage-4 map = 28%, reduce = 0%, Cumulative CPU 9151.16 sec
2016-09-09 07:57:15,114 Stage-4 map = 29%, reduce = 0%, Cumulative CPU 9383.58 sec
2016-09-09 07:57:16,146 Stage-4 map = 30%, reduce = 0%, Cumulative CPU 9621.19 sec
2016-09-09 07:57:17,179 Stage-4 map = 32%, reduce = 0%, Cumulative CPU 10092.41 sec
2016-09-09 07:57:19,245 Stage-4 map = 34%, reduce = 0%, Cumulative CPU 10500.92 sec
2016-09-09 07:57:20,278 Stage-4 map = 35%, reduce = 0%, Cumulative CPU 10947.01 sec
2016-09-09 07:57:21,321 Stage-4 map = 36%, reduce = 0%, Cumulative CPU 11095.63 sec
2016-09-09 07:57:22,356 Stage-4 map = 37%, reduce = 0%, Cumulative CPU 11360.75 sec
2016-09-09 07:57:23,390 Stage-4 map = 39%, reduce = 0%, Cumulative CPU 11739.07 sec
2016-09-09 07:57:25,458 Stage-4 map = 41%, reduce = 0%, Cumulative CPU 12277.33 sec
2016-09-09 07:57:26,492 Stage-4 map = 42%, reduce = 0%, Cumulative CPU 12513.99 sec
2016-09-09 07:57:27,527 Stage-4 map = 43%, reduce = 0%, Cumulative CPU 12741.7 sec
2016-09-09 07:57:28,573 Stage-4 map = 44%, reduce = 0%, Cumulative CPU 12953.45 sec
2016-09-09 07:57:29,608 Stage-4 map = 45%, reduce = 0%, Cumulative CPU 13181.96 sec
2016-09-09 07:57:30,642 Stage-4 map = 47%, reduce = 0%, Cumulative CPU 13464.88 sec
2016-09-09 07:57:31,677 Stage-4 map = 48%, reduce = 0%, Cumulative CPU 13694.24 sec
2016-09-09 07:57:32,714 Stage-4 map = 50%, reduce = 0%, Cumulative CPU 13956.44 sec
2016-09-09 07:57:33,749 Stage-4 map = 51%, reduce = 0%, Cumulative CPU 14185.32 sec
2016-09-09 07:57:34,817 Stage-4 map = 52%, reduce = 0%, Cumulative CPU 14437.2 sec
2016-09-09 07:57:35,880 Stage-4 map = 54%, reduce = 0%, Cumulative CPU 14729.86 sec
2016-09-09 07:57:36,917 Stage-4 map = 56%, reduce = 0%, Cumulative CPU 15063.85 sec
2016-09-09 07:57:37,953 Stage-4 map = 57%, reduce = 0%, Cumulative CPU 15442.46 sec
2016-09-09 07:57:38,991 Stage-4 map = 58%, reduce = 0%, Cumulative CPU 15668.74 sec
2016-09-09 07:57:40,024 Stage-4 map = 59%, reduce = 0%, Cumulative CPU 15993.19 sec
2016-09-09 07:57:41,086 Stage-4 map = 61%, reduce = 0%, Cumulative CPU 16300.79 sec
2016-09-09 07:57:42,143 Stage-4 map = 62%, reduce = 0%, Cumulative CPU 16656.1 sec
2016-09-09 07:57:43,199 Stage-4 map = 63%, reduce = 0%, Cumulative CPU 16916.45 sec
2016-09-09 07:57:44,255 Stage-4 map = 66%, reduce = 0%, Cumulative CPU 17282.84 sec
2016-09-09 07:57:45,312 Stage-4 map = 67%, reduce = 0%, Cumulative CPU 17685.75 sec
2016-09-09 07:57:46,369 Stage-4 map = 68%, reduce = 0%, Cumulative CPU 17986.57 sec
2016-09-09 07:57:47,433 Stage-4 map = 69%, reduce = 0%, Cumulative CPU 18298.74 sec
2016-09-09 07:57:48,492 Stage-4 map = 71%, reduce = 0%, Cumulative CPU 18608.03 sec
2016-09-09 07:57:49,552 Stage-4 map = 73%, reduce = 0%, Cumulative CPU 18926.02 sec
2016-09-09 07:57:51,643 Stage-4 map = 74%, reduce = 0%, Cumulative CPU 19427.48 sec
2016-09-09 07:57:52,680 Stage-4 map = 75%, reduce = 0%, Cumulative CPU 19582.97 sec
2016-09-09 07:57:53,726 Stage-4 map = 76%, reduce = 0%, Cumulative CPU 19873.23 sec
2016-09-09 07:57:54,761 Stage-4 map = 78%, reduce = 0%, Cumulative CPU 20162.92 sec
2016-09-09 07:57:55,795 Stage-4 map = 80%, reduce = 0%, Cumulative CPU 20411.77 sec
2016-09-09 07:57:56,831 Stage-4 map = 83%, reduce = 0%, Cumulative CPU 20691.61 sec
2016-09-09 07:57:57,867 Stage-4 map = 85%, reduce = 0%, Cumulative CPU 20978.6 sec
2016-09-09 07:57:58,902 Stage-4 map = 86%, reduce = 0%, Cumulative CPU 21360.89 sec
2016-09-09 07:57:59,949 Stage-4 map = 88%, reduce = 0%, Cumulative CPU 21776.14 sec
2016-09-09 07:58:00,984 Stage-4 map = 90%, reduce = 0%, Cumulative CPU 22225.09 sec
2016-09-09 07:58:02,020 Stage-4 map = 91%, reduce = 0%, Cumulative CPU 22451.07 sec
2016-09-09 07:58:03,078 Stage-4 map = 92%, reduce = 0%, Cumulative CPU 22620.97 sec
2016-09-09 07:58:04,113 Stage-4 map = 93%, reduce = 0%, Cumulative CPU 22764.4 sec
2016-09-09 07:58:05,171 Stage-4 map = 94%, reduce = 0%, Cumulative CPU 22918.72 sec
2016-09-09 07:58:08,319 Stage-4 map = 95%, reduce = 5%, Cumulative CPU 23263.75 sec
2016-09-09 07:58:11,445 Stage-4 map = 96%, reduce = 5%, Cumulative CPU 23502.15 sec
2016-09-09 07:58:13,569 Stage-4 map = 97%, reduce = 5%, Cumulative CPU 23634.14 sec
2016-09-09 07:58:17,732 Stage-4 map = 98%, reduce = 5%, Cumulative CPU 23838.46 sec
2016-09-09 07:58:22,918 Stage-4 map = 99%, reduce = 5%, Cumulative CPU 24042.8 sec
2016-09-09 07:58:36,430 Stage-4 map = 99%, reduce = 7%, Cumulative CPU 24277.24 sec
2016-09-09 07:59:05,625 Stage-4 map = 100%, reduce = 7%, Cumulative CPU 24363.56 sec
2016-09-09 07:59:06,661 Stage-4 map = 100%, reduce = 8%, Cumulative CPU 24374.37 sec
2016-09-09 07:59:39,932 Stage-4 map = 100%, reduce = 10%, Cumulative CPU 24419.55 sec
2016-09-09 08:00:11,092 Stage-4 map = 100%, reduce = 11%, Cumulative CPU 24455.42 sec
2016-09-09 08:00:14,225 Stage-4 map = 100%, reduce = 12%, Cumulative CPU 24462.83 sec
2016-09-09 08:00:42,314 Stage-4 map = 100%, reduce = 13%, Cumulative CPU 24497.92 sec
2016-09-09 08:00:45,478 Stage-4 map = 100%, reduce = 14%, Cumulative CPU 24507.31 sec
2016-09-09 08:01:14,963 Stage-4 map = 100%, reduce = 16%, Cumulative CPU 24548.48 sec
2016-09-09 08:01:45,478 Stage-4 map = 100%, reduce = 17%, Cumulative CPU 24592.77 sec
2016-09-09 08:02:13,901 Stage-4 map = 100%, reduce = 18%, Cumulative CPU 24629.14 sec
2016-09-09 08:02:17,019 Stage-4 map = 100%, reduce = 19%, Cumulative CPU 24636.02 sec
2016-09-09 08:02:44,373 Stage-4 map = 100%, reduce = 21%, Cumulative CPU 24679.42 sec
2016-09-09 08:03:14,979 Stage-4 map = 100%, reduce = 23%, Cumulative CPU 24717.6 sec
2016-09-09 08:03:42,238 Stage-4 map = 100%, reduce = 25%, Cumulative CPU 24757.64 sec
2016-09-09 08:04:10,479 Stage-4 map = 100%, reduce = 27%, Cumulative CPU 24798.59 sec
2016-09-09 08:04:41,102 Stage-4 map = 100%, reduce = 29%, Cumulative CPU 24840.41 sec
2016-09-09 08:05:08,637 Stage-4 map = 100%, reduce = 30%, Cumulative CPU 24882.21 sec
2016-09-09 08:05:39,243 Stage-4 map = 100%, reduce = 32%, Cumulative CPU 24922.68 sec
2016-09-09 08:06:06,614 Stage-4 map = 100%, reduce = 33%, Cumulative CPU 24953.21 sec
2016-09-09 08:06:37,025 Stage-4 map = 100%, reduce = 54%, Cumulative CPU 24987.91 sec
2016-09-09 08:06:40,138 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 24993.76 sec
2016-09-09 08:07:40,820 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25062.84 sec
2016-09-09 08:08:40,842 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25117.07 sec
2016-09-09 08:09:41,013 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25180.34 sec
2016-09-09 08:10:42,035 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25224.54 sec
2016-09-09 08:11:42,172 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25280.35 sec
2016-09-09 08:12:43,027 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25340.39 sec
2016-09-09 08:13:44,023 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25385.13 sec
2016-09-09 08:14:44,072 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25428.33 sec
2016-09-09 08:15:44,190 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25485.08 sec
2016-09-09 08:16:44,354 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25529.84 sec
2016-09-09 08:17:44,624 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25591.28 sec
2016-09-09 08:18:45,341 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25660.78 sec
2016-09-09 08:19:46,349 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25733.83 sec
2016-09-09 08:20:47,078 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25796.07 sec
2016-09-09 08:21:47,838 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25844.51 sec
2016-09-09 08:22:47,960 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25905.59 sec
2016-09-09 08:23:48,066 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 25977.55 sec
2016-09-09 08:24:48,245 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26034.59 sec
2016-09-09 08:25:48,525 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26107.53 sec
2016-09-09 08:26:48,698 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26171.67 sec
2016-09-09 08:27:48,890 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26240.7 sec
2016-09-09 08:28:49,038 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26307.61 sec
2016-09-09 08:29:49,718 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26374.32 sec
2016-09-09 08:30:50,014 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26430.11 sec
2016-09-09 08:31:50,689 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26497.21 sec
2016-09-09 08:32:50,968 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26559.3 sec
2016-09-09 08:33:51,439 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26628.23 sec
2016-09-09 08:34:51,555 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26693.32 sec
2016-09-09 08:35:51,667 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26768.78 sec
2016-09-09 08:36:51,753 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26817.29 sec
2016-09-09 08:37:52,024 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26887.05 sec
2016-09-09 08:38:52,257 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 26960.18 sec
2016-09-09 08:39:52,368 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27025.84 sec
2016-09-09 08:40:52,457 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27103.96 sec
2016-09-09 08:41:52,625 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27172.73 sec
2016-09-09 08:42:52,703 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27241.32 sec
2016-09-09 08:43:52,867 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27322.7 sec
2016-09-09 08:44:52,986 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27402.08 sec
2016-09-09 08:45:53,163 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27477.95 sec
2016-09-09 08:46:53,291 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27556.1 sec
2016-09-09 08:47:53,563 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27636.83 sec
2016-09-09 08:48:53,717 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27716.47 sec
2016-09-09 08:49:54,649 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27797.55 sec
2016-09-09 08:50:55,658 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27876.47 sec
2016-09-09 08:51:56,679 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 27955.27 sec
2016-09-09 08:52:57,661 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28034.74 sec
2016-09-09 08:53:57,672 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28110.49 sec
2016-09-09 08:54:58,697 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28186.16 sec
2016-09-09 08:55:59,741 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28267.33 sec
2016-09-09 08:57:00,722 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28346.6 sec
2016-09-09 08:58:01,732 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28427.45 sec
2016-09-09 08:59:01,946 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28506.86 sec
2016-09-09 09:00:02,225 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28586.64 sec
2016-09-09 09:01:02,356 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28662.52 sec
2016-09-09 09:02:02,509 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28721.57 sec
2016-09-09 09:03:02,693 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28791.54 sec
2016-09-09 09:04:03,744 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28866.11 sec
2016-09-09 09:05:04,079 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28929.66 sec
2016-09-09 09:06:04,223 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 28984.34 sec
2016-09-09 09:07:04,536 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29060.52 sec
2016-09-09 09:08:04,849 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29135.71 sec
2016-09-09 09:09:05,027 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29213.32 sec
2016-09-09 09:10:05,326 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29288.94 sec
2016-09-09 09:11:05,530 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29345.27 sec
2016-09-09 09:12:05,740 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29416.56 sec
2016-09-09 09:13:05,890 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29461.94 sec
2016-09-09 09:14:06,025 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29523.05 sec
2016-09-09 09:15:06,176 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29599.48 sec
2016-09-09 09:16:06,314 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29663.97 sec
2016-09-09 09:17:06,389 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29743.73 sec
2016-09-09 09:18:06,548 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29790.83 sec
2016-09-09 09:19:06,631 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29856.95 sec
2016-09-09 09:20:06,687 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 29938.04 sec
2016-09-09 09:21:06,827 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30008.74 sec
2016-09-09 09:22:07,838 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30082.36 sec
2016-09-09 09:23:08,873 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30160.69 sec
2016-09-09 09:24:09,851 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30229.62 sec
2016-09-09 09:25:10,852 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30305.97 sec
2016-09-09 09:26:10,961 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30380.39 sec
2016-09-09 09:27:12,005 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30459.9 sec
2016-09-09 09:28:12,992 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30540.92 sec
2016-09-09 09:29:13,995 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30621.28 sec
2016-09-09 09:30:14,018 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30702.88 sec
2016-09-09 09:31:14,100 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30784.49 sec
2016-09-09 09:32:14,185 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30849.28 sec
2016-09-09 09:33:14,299 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 30928.55 sec
2016-09-09 09:34:14,548 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31003.52 sec
2016-09-09 09:35:14,748 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31070.64 sec
2016-09-09 09:36:14,976 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31130.58 sec
2016-09-09 09:37:16,007 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31213.15 sec
2016-09-09 09:38:16,164 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31292.37 sec
2016-09-09 09:39:16,316 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31372.21 sec
2016-09-09 09:40:17,276 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31445.05 sec
2016-09-09 09:41:17,317 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31517.11 sec
2016-09-09 09:42:17,343 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31595.28 sec
2016-09-09 09:43:17,407 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31670.57 sec
2016-09-09 09:44:17,408 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31751.29 sec
2016-09-09 09:45:17,462 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31827.91 sec
2016-09-09 09:46:18,484 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31902.08 sec
2016-09-09 09:47:19,448 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 31982.91 sec
2016-09-09 09:48:20,362 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 32063.73 sec
2016-09-09 09:49:21,391 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 32129.59 sec
2016-09-09 09:50:22,409 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 32209.13 sec
2016-09-09 09:51:23,368 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 32281.79 sec
2016-09-09 09:52:23,406 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 32358.09 sec
2016-09-09 09:53:23,481 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 32431.51 sec
2016-09-09 09:54:24,484 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 32515.75 sec
2016-09-09 09:55:25,478 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 32595.34 sec
2016-09-09 09:56:26,492 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 32652.75 sec
2016-09-09 09:57:27,442 Stage-4 map = 100%, reduce = 67%, Cumulative CPU 32731.36 sec