[prev in list] [next in list] [prev in thread] [next in thread] 

List:       hadoop-user
Subject:    Hive _SUCCESS flag
From:       Kevin Lasenby <klasenby () blackberry ! com>
Date:       2017-02-14 15:21:46
Message-ID: AA7CD9D75E480548AA884D491689B95AC79E5DB9 () XMB116CNC ! rim ! net
[Download RAW message or body]

Hello Hadoop community,

Does anyone know if there is a way to re-enable the _SUCCESS flag feature f=
or Hive > 0.9.0?  It appears Hive overrides the "mapreduce.fileoutputcommit=
ter.marksuccessfuljobs" setting and there's no way to change it.

Hive JIRA: https://issues.apache.org/jira/browse/HIVE-3700 <-- created 2012=
 with no updates
Discussion about this behavior: http://stackoverflow.com/questions/13017433=
/override-hadoops-mapreduce-fileoutputcommitter-marksuccessfuljobs-in-oozie

Thanks,


Kevin Lasenby


[Attachment #3 (text/html)]

<html xmlns:v="urn:schemas-microsoft-com:vml" \
xmlns:o="urn:schemas-microsoft-com:office:office" \
xmlns:w="urn:schemas-microsoft-com:office:word" \
xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" \
xmlns="http://www.w3.org/TR/REC-html40"> <head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
	{font-family:"Cambria Math";
	panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
	{font-family:Calibri;
	panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0in;
	margin-bottom:.0001pt;
	font-size:11.0pt;
	font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
	{mso-style-priority:99;
	color:#0563C1;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{mso-style-priority:99;
	color:#954F72;
	text-decoration:underline;}
span.EmailStyle17
	{mso-style-type:personal-compose;
	font-family:"Calibri",sans-serif;
	color:windowtext;}
.MsoChpDefault
	{mso-style-type:export-only;}
@page WordSection1
	{size:8.5in 11.0in;
	margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
	{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal">Hello Hadoop community,<o:p></o:p></p>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<p class="MsoNormal">Does anyone know if there is a way to re-enable the _SUCCESS \
flag feature for Hive &gt; 0.9.0?&nbsp; It appears Hive overrides the \
&#8220;mapreduce.fileoutputcommitter.marksuccessfuljobs&#8221; setting and \
there&#8217;s no way to change it.<o:p></o:p></p> <p \
class="MsoNormal"><o:p>&nbsp;</o:p></p> <p class="MsoNormal">Hive JIRA: <a \
href="https://issues.apache.org/jira/browse/HIVE-3700"> \
https://issues.apache.org/jira/browse/HIVE-3700</a> &lt;-- created 2012 with no \
updates <o:p></o:p></p>
<p class="MsoNormal">Discussion about this behavior: <a \
href="http://stackoverflow.com/questions/13017433/override-hadoops-mapreduce-fileoutputcommitter-marksuccessfuljobs-in-oozie">
 http://stackoverflow.com/questions/13017433/override-hadoops-mapreduce-fileoutputcommitter-marksuccessfuljobs-in-oozie</a><o:p></o:p></p>
 <p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<p class="MsoNormal">Thanks,<o:p></o:p></p>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<p class="MsoNormal"><b>Kevin Lasenby<o:p></o:p></b></p>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
</div>
</body>
</html>



[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic