[prev in list] [next in list] [prev in thread] [next in thread]
List: lucene-dev
Subject: Re: 9.0 release
From: Mayya Sharipova <mayya.sharipova () elastic ! co ! INVALID>
Date: 2021-06-30 13:59:27
Message-ID: CAJ0Oqh18dvW+xx4=ypMj9wRRkK1_qkN4gg4FL0V3pWUS3d9aSg () mail ! gmail ! com
[Download RAW message or body]
I will be working on LUCENE-9334, I will try to finish it soon.
On Wed, Jun 30, 2021 at 12:40 AM David Smiley <dsmiley@apache.org> wrote:
> There are also deprecations to remove:
> https://issues.apache.org/jira/browse/LUCENE-8638
>
> ~ David Smiley
> Apache Lucene/Solr Search Developer
> http://www.linkedin.com/in/davidwsmiley
>
>
> On Tue, Jun 29, 2021 at 2:43 PM Mike Drob <mdrob@apache.org> wrote:
>
> > Looks like just LUCENE-9334 remains?
> >
> > On Wed, Apr 14, 2021 at 10:18 PM Julie Tibshirani <julietibs@gmail.com>
> > wrote:
> > >
> > > Hello everyone! I will pick up LUCENE-9908.
> > >
> > >
> > > I had marked LUCENE-9583 as a blocker but I'm on board with removing
> > its blocker status given we can make changes later. I hope to come back to
> > the issue soon with some ideas.
> > >
> > >
> > > Julie
> > >
> > >
> > > On Wed, Apr 14, 2021 at 12:42 PM Adrien Grand <jpountz@gmail.com>
> > wrote:
> > > >
> > > > I agree that we can remove the blocker status from LUCENE-9583 and
> > take advantage of the fact that these new APIs are experimental to improve
> > things later.
> > > >
> > > > For the renaming issue, maybe we could just make vectors plural for
> > now for consistency and revisit other options later.
> > > >
> > > > On Wed, Apr 14, 2021 at 8:21 PM Michael Sokolov <msokolov@gmail.com>
> > wrote:
> > > > >
> > > > > Thanks Adrien; I plan to tackle LUCENE-9905.
> > > > >
> > > > > I don't have ideas about how to move forward on LUCENE-9583; I spent
> > > > > significant amount of time trying various permutations on that API,
> > > > > and what we have was the best compromise I could find at the time, so
> > > > > I'm not sure I agree it's a Blocker, yet I'm open to improvements.
> > > > > Maybe Julie will propose something?
> > > > >
> > > > > There is also a vector-related renaming issue Tomoko had opened, which
> > > > > I thought was marked Blocker, but I guess no longer is. Previously I
> > > > > had hoped to get some strong consensus, but that proved challenging.
> > > > > Given that, I'm OK leaving things as-is, marking these apis
> > > > > @experimental and potentially revisiting naming issues later, eg once
> > > > > we have a second vector ANN implementation.
> > > > >
> > > > > On Wed, Apr 14, 2021 at 11:07 AM Adrien Grand <jpountz@gmail.com>
> > wrote:
> > > > > >
> > > > > > Hi Mike,
> > > > > >
> > > > > > Here's what I know about the remaining blockers:
> > > > > >
> > > > > > LUCENE-9908 - Move VectorValues#search to VectorReader and
> > LeafReader
> > > > > > This was discussed on the mailing list and it looks like there was
> > agreement on making that change. If someone has cycles and can take it,
> > please go ahead, otherwise I'll try to allocate some time to it. I'm
> > expecting this change to be rather straightforward.
> > > > > >
> > > > > > LUCENE-9905 - Revise approach to specifying NN algorithm
> > > > > > This is a change to how we've been thinking about configuring the
> > ANN algorithm. I don't know if someone plans to work on it.
> > > > > >
> > > > > > LUCENE-9583 - How should we expose VectorValues.RandomAccess
> > > > > > We'd like to get rid of this sub interface, but I'm not the best
> > person to comment on how much work this needs. Maybe Mike S or Julie can
> > give more info.
> > > > > >
> > > > > > LUCENE-9334 - Require consistency between data-structures on a
> > per-field basis
> > > > > > Mayya has been working on this one and it's very close.
> > > > > >
> > > > > > LUCENE-9047 - Directory APIs should be little endian
> > > > > > Ignacio and Julie have been working on this one and it is close as
> > well.
> > > > > >
> > > > > >
> > > > > > On Tue, Apr 13, 2021 at 10:59 PM Mike Drob <mdrob@mdrob.com> wrote:
> > > > > > >
> > > > > > > Michael, did you get a chance to mark the issues you were thinking
> > of as blockers?
> > > > > > >
> > > > > > > Adrien, I see that the remaining open blockers look mostly like
> > your open issues. Two of them have recent activity, but LUCENE-9047 would
> > need to be brought back to the lucene repo. Is this an accurate view of the
> > state of things?
> > > > > > >
> > > > > > > Now that I'm done with 8.8.2, I would love to see how we can
> > continue to make headway on 9.0!
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Mon, Mar 29, 2021 at 3:25 PM Michael Sokolov <
> > msokolov@gmail.com> wrote:
> > > > > > > >
> > > > > > > > There has been some discussion around a few code visibility and
> > naming
> > > > > > > > issues related to "VectorFormat" as it is called today. I'd like
> > to
> > > > > > > > get that sorted out before 9.0 - I'll hunt up the ticket(s) and
> > mark
> > > > > > > > as blockers
> > > > > > > >
> > > > > > > > On Sun, Mar 28, 2021 at 11:02 AM Adrien Grand <jpountz@gmail.com>
> > wrote:
> > > > > > > > >
> > > > > > > > > Hello Jan,
> > > > > > > > >
> > > > > > > > > The list of blockers should be mostly up-to-date:
> > https://issues.apache.org/jira/browse/LUCENE-9661?jql=project%3D%22Lucene%20-%20Core%22%20and%20priority%3DBlocker%20and%20fixVersion%3D%22main%20(9.0)%22
> >
> > .
> > > > > > > > >
> > > > > > > > > On Sat, Mar 27, 2021 at 7:21 PM Jan Høydahl <
> > jan.asf@cominvent.com> wrote:
> > > > > > > > > >
> > > > > > > > > > Hi,
> > > > > > > > > >
> > > > > > > > > > Where are we at with the Lucene 9.0 release planning?
> > > > > > > > > >
> > > > > > > > > > The git split is largely done. Not sure about the build.
> > > > > > > > > > Let's update the umbrella issue
> > https://issues.apache.org/jira/browse/LUCENE-9375 for known remaining
> > cleanup tasks.
> > > > > > > > > > The one on that list is releaseWizard, but as Adrien says
> > there are also other scripts that need updating.
> > > > > > > > > >
> > > > > > > > > > Jan
> > > > > > > > > >
> > > > > > > > > > 13. jan. 2021 kl. 15:10 skrev Adrien Grand <jpountz@gmail.com
> > > >
> > > > > > > > > >
> > > > > > > > > > +1 to start planning 9.0.
> > > > > > > > > >
> > > > > > > > > > Since you mentioned the Gradle build, I believe that we still
> > need to migrate some of the release tooling from Ant to Gradle, e.g.
> > dev-tools/scripts/addBackcompatIndexes.py. These scripts are not easy to
> > test without actually doing a release so the 9.0 RM might have some
> > debugging to do.
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On Mon, Dec 28, 2020 at 7:17 PM Michael Sokolov <
> > msokolov@gmail.com> wrote:
> > > > > > > > > > >
> > > > > > > > > > > Hi everyone, as we head into a new year full of optimism, is
> > it time
> > > > > > > > > > > to start discussing the next major release? We released 8.0
> > on Jun 18,
> > > > > > > > > > > 2019, over 18 months ago. Since then we've switched to a
> > gradle-based
> > > > > > > > > > > build. We have added vector-valued fields and an HNSW
> > neighbor search
> > > > > > > > > > > algorithm for them. At the same time Solr has been getting a
> > major
> > > > > > > > > > > overhaul which should justify a release, I think? IIRC there
> > was talk
> > > > > > > > > > > of making 9.0 be the first release of Solr as its own TLP. Is
> > it time
> > > > > > > > > > > to start planning for that now?
> > > > > > > > > > >
> > > > > > > > > > > -Mike
> > > > > > > > > > >
> > > > > > > > > > >
> > ---------------------------------------------------------------------
> > > > > > > > > > > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> > > > > > > > > > > For additional commands, e-mail: dev-help@lucene.apache.org
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > > Adrien
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Adrien
> > > > > > > >
> > > > > > > >
> > ---------------------------------------------------------------------
> > > > > > > > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> > > > > > > > For additional commands, e-mail: dev-help@lucene.apache.org
> > > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Adrien
> > > > >
> > > > > ---------------------------------------------------------------------
> > > > > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> > > > > For additional commands, e-mail: dev-help@lucene.apache.org
> > > > >
> > > >
> > > >
> > > > --
> > > > Adrien
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> > For additional commands, e-mail: dev-help@lucene.apache.org
> >
> >
[Attachment #3 (text/html)]
<div dir="ltr">I will be working on LUCENE-9334, I will try to finish it \
soon.</div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Jun \
30, 2021 at 12:40 AM David Smiley <<a \
href="mailto:dsmiley@apache.org">dsmiley@apache.org</a>> \
wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px \
0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div \
dir="ltr">There are also deprecations to remove: <a \
href="https://issues.apache.org/jira/browse/LUCENE-8638" \
target="_blank">https://issues.apache.org/jira/browse/LUCENE-8638</a></div><div \
dir="ltr"><br clear="all"><div><div dir="ltr"><div dir="ltr">~ David \
Smiley<div>Apache Lucene/Solr Search Developer</div><div><a \
href="http://www.linkedin.com/in/davidwsmiley" \
target="_blank">http://www.linkedin.com/in/davidwsmiley</a></div></div></div></div><br></div></div><br><div \
class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Jun 29, 2021 at 2:43 PM \
Mike Drob <<a href="mailto:mdrob@apache.org" \
target="_blank">mdrob@apache.org</a>> wrote:<br></div><blockquote \
class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid \
rgb(204,204,204);padding-left:1ex">Looks like just LUCENE-9334 remains?<br> <br>
On Wed, Apr 14, 2021 at 10:18 PM Julie Tibshirani <<a \
href="mailto:julietibs@gmail.com" target="_blank">julietibs@gmail.com</a>> \
wrote:<br> ><br>
> Hello everyone! I will pick up LUCENE-9908.<br>
><br>
><br>
> I had marked LUCENE-9583 as a blocker but I'm on board with removing its \
blocker status given we can make changes later. I hope to come back to the issue soon \
with some ideas.<br> ><br>
><br>
> Julie<br>
><br>
><br>
> On Wed, Apr 14, 2021 at 12:42 PM Adrien Grand <<a \
href="mailto:jpountz@gmail.com" target="_blank">jpountz@gmail.com</a>> wrote:<br> \
>><br> >> I agree that we can remove the blocker status from LUCENE-9583 \
and take advantage of the fact that these new APIs are experimental to improve things \
later.<br> >><br>
>> For the renaming issue, maybe we could just make vectors plural for now for \
consistency and revisit other options later.<br> >><br>
>> On Wed, Apr 14, 2021 at 8:21 PM Michael Sokolov <<a \
href="mailto:msokolov@gmail.com" target="_blank">msokolov@gmail.com</a>> \
wrote:<br> >>><br>
>>> Thanks Adrien; I plan to tackle LUCENE-9905.<br>
>>><br>
>>> I don't have ideas about how to move forward on LUCENE-9583; I \
spent<br> >>> significant amount of time trying various permutations on that \
API,<br> >>> and what we have was the best compromise I could find at the \
time, so<br> >>> I'm not sure I agree it's a Blocker, yet I'm \
open to improvements.<br> >>> Maybe Julie will propose something?<br>
>>><br>
>>> There is also a vector-related renaming issue Tomoko had opened, \
which<br> >>> I thought was marked Blocker, but I guess no longer is. \
Previously I<br> >>> had hoped to get some strong consensus, but that proved \
challenging.<br> >>> Given that, I'm OK leaving things as-is, marking \
these apis<br> >>> @experimental and potentially revisiting naming issues \
later, eg once<br> >>> we have a second vector ANN implementation.<br>
>>><br>
>>> On Wed, Apr 14, 2021 at 11:07 AM Adrien Grand <<a \
href="mailto:jpountz@gmail.com" target="_blank">jpountz@gmail.com</a>> wrote:<br> \
>>> ><br> >>> > Hi Mike,<br>
>>> ><br>
>>> > Here's what I know about the remaining blockers:<br>
>>> ><br>
>>> > LUCENE-9908 - Move VectorValues#search to VectorReader and \
LeafReader<br> >>> > This was discussed on the mailing list and it looks \
like there was agreement on making that change. If someone has cycles and can take \
it, please go ahead, otherwise I'll try to allocate some time to it. I'm \
expecting this change to be rather straightforward.<br> >>> ><br>
>>> > LUCENE-9905 - Revise approach to specifying NN algorithm<br>
>>> > This is a change to how we've been thinking about configuring \
the ANN algorithm. I don't know if someone plans to work on it.<br> >>> \
><br> >>> > LUCENE-9583 - How should we expose \
VectorValues.RandomAccess<br> >>> > We'd like to get rid of this sub \
interface, but I'm not the best person to comment on how much work this needs. \
Maybe Mike S or Julie can give more info.<br> >>> ><br>
>>> > LUCENE-9334 - Require consistency between data-structures on a \
per-field basis<br> >>> > Mayya has been working on this one and it's \
very close.<br> >>> ><br>
>>> > LUCENE-9047 - Directory APIs should be little endian<br>
>>> > Ignacio and Julie have been working on this one and it is close as \
well.<br> >>> ><br>
>>> ><br>
>>> > On Tue, Apr 13, 2021 at 10:59 PM Mike Drob <<a \
href="mailto:mdrob@mdrob.com" target="_blank">mdrob@mdrob.com</a>> wrote:<br> \
>>> >><br> >>> >> Michael, did you get a chance to mark \
the issues you were thinking of as blockers?<br> >>> >><br>
>>> >> Adrien, I see that the remaining open blockers look mostly like \
your open issues. Two of them have recent activity, but LUCENE-9047 would need to be \
brought back to the lucene repo. Is this an accurate view of the state of things?<br> \
>>> >><br> >>> >> Now that I'm done with 8.8.2, I \
would love to see how we can continue to make headway on 9.0!<br> >>> \
>><br> >>> >><br>
>>> >><br>
>>> >> On Mon, Mar 29, 2021 at 3:25 PM Michael Sokolov <<a \
href="mailto:msokolov@gmail.com" target="_blank">msokolov@gmail.com</a>> \
wrote:<br> >>> >>><br>
>>> >>> There has been some discussion around a few code visibility \
and naming<br> >>> >>> issues related to "VectorFormat" \
as it is called today. I'd like to<br> >>> >>> get that sorted \
out before 9.0 - I'll hunt up the ticket(s) and mark<br> >>> \
>>> as blockers<br> >>> >>><br>
>>> >>> On Sun, Mar 28, 2021 at 11:02 AM Adrien Grand <<a \
href="mailto:jpountz@gmail.com" target="_blank">jpountz@gmail.com</a>> wrote:<br> \
>>> >>> ><br> >>> >>> > Hello Jan,<br>
>>> >>> ><br>
>>> >>> > The list of blockers should be mostly up-to-date: <a \
href="https://issues.apache.org/jira/browse/LUCENE-9661?jql=project%3D%22Lucene%20-%20Core%22%20and%20priority%3DBlocker%20and%20fixVersion%3D%22main%20(9.0)%22" \
rel="noreferrer" target="_blank">https://issues.apache.org/jira/browse/LUCENE-9661?jql \
=project%3D%22Lucene%20-%20Core%22%20and%20priority%3DBlocker%20and%20fixVersion%3D%22main%20(9.0)%22</a>.<br>
>>> >>> ><br>
>>> >>> > On Sat, Mar 27, 2021 at 7:21 PM Jan Høydahl <<a \
href="mailto:jan.asf@cominvent.com" target="_blank">jan.asf@cominvent.com</a>> \
wrote:<br> >>> >>> >><br>
>>> >>> >> Hi,<br>
>>> >>> >><br>
>>> >>> >> Where are we at with the Lucene 9.0 release \
planning?<br> >>> >>> >><br>
>>> >>> >> The git split is largely done. Not sure about the \
build.<br> >>> >>> >> Let's update the umbrella issue <a \
href="https://issues.apache.org/jira/browse/LUCENE-9375" rel="noreferrer" \
target="_blank">https://issues.apache.org/jira/browse/LUCENE-9375</a> for known \
remaining cleanup tasks.<br> >>> >>> >> The one on that list \
is releaseWizard, but as Adrien says there are also other scripts that need \
updating.<br> >>> >>> >><br>
>>> >>> >> Jan<br>
>>> >>> >><br>
>>> >>> >> 13. jan. 2021 kl. 15:10 skrev Adrien Grand <<a \
href="mailto:jpountz@gmail.com" target="_blank">jpountz@gmail.com</a>>:<br> \
>>> >>> >><br> >>> >>> >> +1 to start \
planning 9.0.<br> >>> >>> >><br>
>>> >>> >> Since you mentioned the Gradle build, I believe \
that we still need to migrate some of the release tooling from Ant to Gradle, e.g. \
dev-tools/scripts/addBackcompatIndexes.py. These scripts are not easy to test without \
actually doing a release so the 9.0 RM might have some debugging to do.<br> \
>>> >>> >><br> >>> >>> >><br>
>>> >>> >> On Mon, Dec 28, 2020 at 7:17 PM Michael Sokolov \
<<a href="mailto:msokolov@gmail.com" target="_blank">msokolov@gmail.com</a>> \
wrote:<br> >>> >>> >>><br>
>>> >>> >>> Hi everyone, as we head into a new year full \
of optimism, is it time<br> >>> >>> >>> to start \
discussing the next major release? We released 8.0 on Jun 18,<br> >>> \
>>> >>> 2019, over 18 months ago. Since then we've switched to \
a gradle-based<br> >>> >>> >>> build. We have added \
vector-valued fields and an HNSW neighbor search<br> >>> >>> \
>>> algorithm for them. At the same time Solr has been getting a major<br> \
>>> >>> >>> overhaul which should justify a release, I \
think? IIRC there was talk<br> >>> >>> >>> of making 9.0 \
be the first release of Solr as its own TLP. Is it time<br> >>> >>> \
>>> to start planning for that now?<br> >>> >>> \
>>><br> >>> >>> >>> -Mike<br>
>>> >>> >>><br>
>>> >>> >>> \
---------------------------------------------------------------------<br> \
>>> >>> >>> To unsubscribe, e-mail: <a \
href="mailto:dev-unsubscribe@lucene.apache.org" \
target="_blank">dev-unsubscribe@lucene.apache.org</a><br> >>> >>> \
>>> For additional commands, e-mail: <a \
href="mailto:dev-help@lucene.apache.org" \
target="_blank">dev-help@lucene.apache.org</a><br> >>> >>> \
>>><br> >>> >>> >><br>
>>> >>> >><br>
>>> >>> >> --<br>
>>> >>> >> Adrien<br>
>>> >>> >><br>
>>> >>> >><br>
>>> >>> ><br>
>>> >>> ><br>
>>> >>> > --<br>
>>> >>> > Adrien<br>
>>> >>><br>
>>> >>> \
---------------------------------------------------------------------<br> \
>>> >>> To unsubscribe, e-mail: <a \
href="mailto:dev-unsubscribe@lucene.apache.org" \
target="_blank">dev-unsubscribe@lucene.apache.org</a><br> >>> >>> \
For additional commands, e-mail: <a href="mailto:dev-help@lucene.apache.org" \
target="_blank">dev-help@lucene.apache.org</a><br> >>> >>><br>
>>> ><br>
>>> ><br>
>>> > --<br>
>>> > Adrien<br>
>>><br>
>>> ---------------------------------------------------------------------<br>
>>> To unsubscribe, e-mail: <a \
href="mailto:dev-unsubscribe@lucene.apache.org" \
target="_blank">dev-unsubscribe@lucene.apache.org</a><br> >>> For additional \
commands, e-mail: <a href="mailto:dev-help@lucene.apache.org" \
target="_blank">dev-help@lucene.apache.org</a><br> >>><br>
>><br>
>><br>
>> --<br>
>> Adrien<br>
<br>
---------------------------------------------------------------------<br>
To unsubscribe, e-mail: <a href="mailto:dev-unsubscribe@lucene.apache.org" \
target="_blank">dev-unsubscribe@lucene.apache.org</a><br> For additional commands, \
e-mail: <a href="mailto:dev-help@lucene.apache.org" \
target="_blank">dev-help@lucene.apache.org</a><br> <br>
</blockquote></div>
</blockquote></div>
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic