[prev in list] [next in list] [prev in thread] [next in thread]
List: hadoop-dev
Subject: Re: [E] Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4
From: Xiaoqiao He <hexiaoqiao () apache ! org>
Date: 2020-12-24 3:30:14
Message-ID: CAF3Ajaxj=3+s=ud51mkm2B7_237=SVn1f2yY9HZJHp6S2X-+mA () mail ! gmail ! com
[Download RAW message or body]
Thanks Sunil, it makes sense to me. Will backport and prepare another RC
shortly.
- He Xiaoqiao
On Wed, Dec 23, 2020 at 10:59 PM Sunil Govindan <sunilg@apache.org> wrote:
> Hi Xiaoqiao
> This is not an issue. You are missing the CORS config in YARN. I have
> updated those configurations in the jira.
> I feel that we can call a new RC as YARN-10540 is backported already.
>
> Thanks
> Sunil
>
> On Wed, Dec 23, 2020 at 3:54 PM Xiaoqiao He <hexiaoqiao@apache.org> wrote:
>
> > Thanks Jim, Eric and Sunil,
> >
> > I tried to backport YARN-10540 to branch-3.2.2 at local and check yarn
> > ui2, there is still one link that does not work correctly, But I am not
> > sure if it is expected. Detailed information is attached at YARN-10540.
> > If someone could confirm or update, please let me know. I would like to
> > backport then and prepare another RC.
> > NOTE: Hadoop-3.2.2 will not release as we plan because some expected
> > issues are in progress. It will be postponed to 2021/01, and I will try
> my
> > best to push it forward. AND Thanks to all reviewers (too numerous to
> > mention).
> >
> > - He Xiaoqiao
> >
> >
> > On Tue, Dec 22, 2020 at 8:32 AM Wei-Chiu Chuang <weichiu@apache.org>
> > wrote:
> >
> > > We should target
> > > 3.4.0,
> > > 3.3.1
> > > 3.2.3 (or 3.2.2)
> > >
> > > I updated and set 3.3.0 released in YARN.
> > >
> > >
> > > Time to clean up some of the old releases. I'll do that.
> > > On Mon, Dec 21, 2020 at 4:04 PM Eric Badger
> > > <ebadger@verizonmedia.com.invalid> wrote:
> > >
> > > > I've committed https://issues.apache.org/jira/browse/YARN-10540.
> > > > Xiaoqiao,
> > > > feel free to cherry-pick this into the 3.2.2 release branch if you
> think
> > > > it
> > > > is relevant.
> > > >
> > > > Also, can someone tell me which releases we should be targeting?
> > > > Currently
> > > > these versions are all Unreleased on JIRA:
> > > > 3.4.1, 3.4.0
> > > > 3.3.1, 3.3.0
> > > > 3.2.3, 3.2.2
> > > >
> > > > As far as I know, neither trunk nor 3.3 have a release going on. So I
> > > > don't
> > > > know why there are 2 versions as unreleased there.
> > > >
> > > > Eric
> > > >
> > > > On Mon, Dec 21, 2020 at 3:20 PM Jim Brennan
> > > > <james.brennan@verizonmedia.com.invalid> wrote:
> > > >
> > > > > I put up a patch for
> > > > >
> > > >
> https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_Y \
> ARN-2D10540&d=DwIFaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=KVdP1SUmHYb-tZP \
> 8tcigmw&m=WEMl9mt9SZiq7P20DPgeZO69TFwf3d0eldQGRWlLyQg&s=FdkrkiWqHwuibT6qFqvApTkO5aTimLx7WeP74tka5XM&e=
>
> > > > > .
> > > > > Thanks for bringing it to my attention.
> > > > > Jim
> > > > >
> > > > > On Mon, Dec 21, 2020 at 10:36 AM Sunil Govindan <sunilg@apache.org>
> > > > wrote:
> > > > >
> > > > > > I had some offline talks with a few folks.
> > > > > > This issue is happening only in Mac, hence ideally it does not
> cause
> > > > much
> > > > > > of a problem in the supported OS.
> > > > > >
> > > > > > I will wait for feedback here to see whether we need another RC by
> > > > fixing
> > > > > > this. And will continue the discussion in the jira.
> > > > > >
> > > > > > Thanks
> > > > > > Sunil
> > > > > >
> > > > > > On Sat, Dec 19, 2020 at 11:07 PM Sunil Govindan <sunilg@apache.org
> >
> > > > > wrote:
> > > > > >
> > > > > > > Thanks, Xiaoqiao.
> > > > > > > All files are looking good.
> > > > > > >
> > > > > > > However, while I did the tests to verify the RC, I ran into a
> > > > serious
> > > > > NPE
> > > > > > > in YARN.
> > > > > > > I raised YARN-10540 <
> > > > > >
> > > > >
> > > >
> https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_Y \
> ARN-2D10540&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxm \
> t5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=8i-pN_j9VKNxmOzU6gYGtWm_IVyeZkBcMwVI2eyzpRk&e=
>
> > > > > > > to
> > > > > > > analyze this further. I think this issue due to YARN-10450
> > > > > > > <
> > > > > >
> > > > >
> > > >
> https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_Y \
> ARN-2D10450&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxm \
> t5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=QEHMGtEbBz5Gn7mW4UsGlc-wNZ8ugZwiFQBy2pTx-Fw&e=
>
> > > > > > > .
> > > > > > > In the trunk, I am not able to see this issue. So It could be
> > > > possible
> > > > > > > that some patches are not backported to branch-3.2.2.
> > > > > > >
> > > > > > > UI1 & UI2 nodes page is not working at this moment. I will check
> a
> > > > bit
> > > > > > > more to see about this and update here.
> > > > > > >
> > > > > > > Thanks
> > > > > > > Sunil
> > > > > > >
> > > > > > > On Sat, Dec 19, 2020 at 5:36 PM Xiaoqiao He <
> hexiaoqiao@apache.org
> > > > >
> > > > > > wrote:
> > > > > > >
> > > > > > > > Thanks Sunil, md5 files have been removed from RC4. Please have
> a
> > > > > look.
> > > > > > > > Thanks & Regards.
> > > > > > > >
> > > > > > > > - He Xiaoqiao
> > > > > > > >
> > > > > > > > On Sat, Dec 19, 2020 at 7:22 PM Sunil Govindan <
> sunilg@apache.org
> > > > >
> > > > > > wrote:
> > > > > > > >
> > > > > > > > > Hi Xiaoqiao,
> > > > > > > > >
> > > > > > > > > Please remove the md5 files from your shared RC4 repo. Thanks,
> > > > @Akira
> > > > > > > > > Ajisaka <aajisaka@apache.org> for sharing this input.
> > > > > > > > >
> > > > > > > > > Thanks
> > > > > > > > > Sunil
> > > > > > > > >
> > > > > > > > > On Sat, Dec 19, 2020 at 10:21 AM Sunil Govindan <
> > > > sunilg@apache.org>
> > > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > Reference:
> > > > > > > > > >
> > > > > >
> > > > >
> > > >
> www.apache.org_dev_release-2Ddi" rel="nofollow">https://urldefense.proofpoint.com/v2/url?u=https-3A__www.apache.org_dev_release-2Ddi> \
> stribution.html-23sigs-2Dand-2Dsums&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES \
> _g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=0qrQgqFXZzLqTDPzH_T1emam7NnHvnzXqZ6Ag0ccgIQ&e=
>
> > > > > > > > > > Also, we had a Jira to track this HADOOP-15930
> > > > > > > > > > <
> > > > > >
> > > > >
> > > >
> https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_H \
> ADOOP-2D15930&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3gb \
> xmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=afUJEs9zxobnuEnC4v0xJ6v7d0dtrUkUaX15lI6VZbM&e=
>
> > > > > > > .
> > > > > > > > > >
> > > > > > > > > > Thanks
> > > > > > > > > > Sunil
> > > > > > > > > >
> > > > > > > > > > On Sat, Dec 19, 2020 at 10:16 AM Sunil Govindan <
> > > > sunilg@apache.org>
> > > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > Hi Xiaoqiao and Wei-chiu
> > > > > > > > > > >
> > > > > > > > > > > I am a bit confused after seeing both *.sha512 and *.md5
> files
> > > > in
> > > > > the
> > > > > > > > > > > RC directory.
> > > > > > > > > > > Are we releasing both now?
> > > > > > > > > > >
> > > > > > > > > > > Thanks
> > > > > > > > > > > Sunil
> > > > > > > > > > >
> > > > > > > > > > > On Wed, Dec 9, 2020 at 10:32 PM Xiaoqiao He <
> > > > hexiaoqiao@apache.org
> > > > > >
> > > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > > Hi folks,
> > > > > > > > > > > >
> > > > > > > > > > > > The release candidate (RC4) for Hadoop-3.2.2 is available
> now.
> > > > > > > > > > > > There are 10 commits[1] differences between RC4 and RC3[2].
> > > > > > > > > > > >
> > > > > > > > > > > > The RC4 is available at:
> > > > > > > > > > > >
> > > > > >
> > > > >
> > > >
> https://urldefense.proofpoint.com/v2/url?u=http-3A__people.apache.org_-7Ehexiaoqiao_ \
> hadoop-2D3.2.2-2DRC4&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06 \
> B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=HUI5h2vNLugUtOGnApsEXpk40-hQszUQyUNbfYRQeXU&e=
>
> > > > > > > > > > > > The RC4 tag in github is here:
> > > > > > > > > > > >
> > > > > >
> > > > >
> > > >
> https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_hadoop_tree_r \
> elease-2D3.2.2-2DRC4&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06 \
> B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=Z3pv4v__QPeuKK5Ol_DOqKD-3deFnGKSfXdhi0v_K1c&e=
>
> > > > > > > > > > > > The maven artifacts are staged at:
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > >
> > > > >
> > > >
> https://urldefense.proofpoint.com/v2/url?u=https-3A__repository.apache.org_content_r \
> epositories_orgapachehadoop-2D1296&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_ \
> g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=XA6ozoshoAKllmFj5vMTlXjE-8Ee41jaKYiTxBmnWpA&e=
>
> > > > > > > > > > > >
> > > > > > > > > > > > You can find my public key at:
> > > > > > > > > > > >
> > > > > >
> > > > >
> > > >
> https://urldefense.proofpoint.com/v2/url?u=https-3A__dist.apache.org_repos_dist_rele \
> ase_hadoop_common_KEYS&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi \
> 06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=oJ2jBABd8kCf9bLKre7vOkc4T010inenJNexdbGlOdg&e=
>
> > > > > > or
> > > > > > > > > > > >
> > > > > >
> > > > >
> > > >
> https://urldefense.proofpoint.com/v2/url?u=https-3A__people.apache.org_keys_committe \
> r_hexiaoqiao.asc&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L \
> 3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=r5d-JXE1QGikxkDXlH-K9P15VaTM_kOtQz0IyBHM_Yk&e=
>
> > > > > > directly.
> > > > > > > > > > > >
> > > > > > > > > > > > Please try the release and vote.
> > > > > > > > > > > >
> > > > > > > > > > > > I have done a simple testing with my pseudo cluster.
> > > > > > > > > > > > * Verify gpg sign and md5sum.
> > > > > > > > > > > > * Setup pseudo cluster with HDFS and YARN.
> > > > > > > > > > > > * Run simple FsShell - mkdir/put/get/rename/mv.
> > > > > > > > > > > > * Submit example mr job and check the result - Pi/wordcount.
> > > > > > > > > > > > * Check the web UI of
> > > > > NameNode/DataNode/Resourcemanager/NodeManager.
> > > > > > > > > > > > My +1 to start.
> > > > > > > > > > > >
> > > > > > > > > > > > Thanks,
> > > > > > > > > > > > He Xiaoqiao
> > > > > > > > > > > >
> > > > > > > > > > > > [1]
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > >
> > > > >
> > > >
> https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_hadoop_compar \
> e_release-2D3.2.2-2DRC3...release-2D3.2.2-2DRC4&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-C \
> RbmiT9yOhqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=uUm4bp4BGiN0L04RJ1ny8G0ugpng57O_0Im8zQfMMGc&e=
>
> > > > > > > > > > > > [2]
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > >
> > > > >
> > > >
> https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.apache.org_thread.html_rf \
> b74c3a5d4f223c5804d8ee622829263740cd8701c8f3fc8b6f970af-2540-253Chdfs-2Ddev.hadoop.a \
> pache.org-253E&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=7Imi06B91L3g \
> bxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=x0gXxcI_Gd1cGJRczQYxrTznWYSJcZqCkUHuUPUjL7w&e=
>
> > > > > > > > > > > > [3]
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > >
> > > > >
> > > >
> https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_secure_D \
> ashboard.jspa-3FselectPageId-3D12335948&d=DwIBaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yO \
> hqES_g_wVY&r=7Imi06B91L3gbxmt5ChzH4cwlA2_f2tmXh3OXmV9MLw&m=nSlLXPsCxZGl0VV03dBWreCNrSH0SsNAZzmjRWO-2Zg&s=9w6gMkXXqF9gv5R3eFWF9fWH5mAJpqw7xXpGKd-XwfU&e=
>
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic