[prev in list] [next in list] [prev in thread] [next in thread] 

List:       solr-dev
Subject:    [jira] Commented: (SOLR-1979) Create
From:       "Chris A. Mattmann (JIRA)" <jira () apache ! org>
Date:       2010-06-30 21:35:50
Message-ID: 14604535.142031277933750004.JavaMail.jira () thor
[Download RAW message or body]


    [ https://issues.apache.org/jira/browse/SOLR-1979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12884070#action_12884070 \
] 

Chris A. Mattmann commented on SOLR-1979:
-----------------------------------------

I would look at the Language Identifier in Tika (which is based on the Nutch work) as \
it is likely to be the one that is more maintained going forward IMHO...

> Create LanguageIdentifierUpdateProcessor
> ----------------------------------------
> 
> Key: SOLR-1979
> URL: https://issues.apache.org/jira/browse/SOLR-1979
> Project: Solr
> Issue Type: New Feature
> Components: update
> Reporter: Jan Høydahl
> Priority: Minor
> 
> We need the ability to detect language of some random text in order to act upon it, \
> such as indexing the content into language aware fields. Another usecase is to be \
> able to filter/facet on language on random unstructured content. To do this, we \
> should wrap the [Nutch \
> LanguageIdentifier|http://nutch.apache.org/apidocs-1.1/org/apache/nutch/analysis/lang/LanguageIdentifier.html"] \
> in an UpdateProcessor. The processor should be configured like this: {code:xml} 
> <processor class="org.apache.solr.update.processor.LanguageIdentifierUpdateProcessorFactory">
>  <str name="inputFields">title,teaser,body</str>
> <str name="isoOutputField">language</str>
> <str name="fullOutputField">language_display</str>
> </processor>  
> {code} 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[prev in list] [next in list] [prev in thread] [next in thread]