[prev in list] [next in list] [prev in thread] [next in thread] 

List:       opensolaris-opengrok-discuss
Subject:    Re: [opengrok] opengrok and subversion
From:       Knut Anders Hatlen <Knut.Hatlen () Sun ! COM>
Date:       2008-06-17 12:21:04
Message-ID: wjo8bq20ckwf.fsf () khepri41 ! norway ! sun ! com
[Download RAW message or body]

Nikolam <nimitreski@gmail.com> writes:

>> Hello to all.
>> Let me explain my problem. I'm using subversion as a code repository
>> and opengrok as search engine. I have a problem. I used cyrillic
>> alphabet for messages when commit some source code with subversion.
>
>>Hi Nikolam,
>
>> I have noticed that if I use non-ASCII characters in commit messages, I
>> need to set LC_ALL and LANG to a UTF-8 locale (for instance en_US.UTF-8)
>> to get OpenGrok to read the history from Subversion repositories. I
>> think this requirement comes from the library OpenGrok uses to access
>> the Subversion repositories.
>
> Ok, thanks for advice, but my system is already set to en_US.UTF-8. By
> the way, today I discovered another problem. If I have something in my
> files that has been written with cyrillic letters, I can't see them
> too (I'm only seeing ?????? instead of letters). So to solve this
> problem I tried to use class UnicodeReader.java. Now I don't know am I
> using that class in proper manner. I have uncomment the last part of
> source code in FileAnalyzer.java and instead the line

You're probably seeing this problem:

http://defect.opensolaris.org/bz/show_bug.cgi?id=437

> InputStreamReader inReader = new InputStreamReader(in);
>
> I put the line:
>
> UnicodeReader inReader = new UnicodeReader(in);
>
> What I'm doing wrong? Where to find solution for my problem? I found
> that Java is using Unicode as default encoding. (C or C++ is using
> ASCII). Or maybe problem is in Tomcat? I don't know really.

I think this problem is in the Xref classes (generated by JFlex from the
*.lex source files). Currently, most of them simply ignore non-ASCII
characters. I suggested a fix for a similar problem in
http://defect.opensolaris.org/bz/show_bug.cgi?id=508, but I have no idea
if that would be enough to solve it.

-- 
Knut Anders
_______________________________________________
opengrok-discuss mailing list
opengrok-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/opengrok-discuss
[prev in list] [next in list] [prev in thread] [next in thread]