[prev in list] [next in list] [prev in thread] [next in thread] 

List:       vtigercrm-developers
Subject:    [Vtigercrm-developers] UTF-8 support for Migration
From:       "Minnie A" <minnie () vtiger ! com>
Date:       2008-01-25 6:34:51
Message-ID: fc4c72e40801242222w5567a0cco2f661c41c9a2d4fc () mail ! gmail ! com
[Download RAW message or body]

[Attachment #2 (multipart/alternative)]


Dear Team,

We would like to get the help from you regarding UTF-8 related issues in
Migration.

The following steps are used to migrate from 5.0.3 to 5.0.4 latest svn
source, where as default character set is latin1 for 5.0.3 database and now
for the latest source we have to convert those data as utf8 compatible
(because default character set for 5.0.4 database is UTF-8)
So that after migration we should see the previously entered UTF-8
characters (ie., data available in 5.0.3) as it is in 5.0.4

1. Take the dump of 503 database
Eg : mysqldump -u root --port=5030 -h minnie vt503 > vt503.sql

2. Edit the dump file, find and replace the string "latin1" with "utf8" in
all places of the dump file. (Also added SET FOREIGN_KEY_CHECKS=0; at the
first line and added SET FOREIGN_KEY_CHECKS=1; at the last line in the dump
file)

3. For 504, create a database with default charset utf8.
Eg : create database vt503 default character set utf8 default collate
utf8_general_ci;

4. Apply the dump to this newly created database
 Eg : mysql -u root --port=5080 -h minnie vt503 < vt503.sql

5. Include the fix in include/database/PearDatabase.php file (Stored this
attached zip file under document root ie., parellel to config.inc.php and
unzipped). In SVN, refer the change set
http://trac.vtiger.com/cgi-bin/trac.cgi/changeset/11854

6. Run the migration (from 5.0.3 to 5.0.4)

Kindly test it and let us know the status of this fix. Also please ensure
that you have utf8 characters in 5.0.3 and are display correctly in 5.0.3.
So that after migration we have to check whether those characters are
displaying correctly in 5.0.4 migrated.

Issue : The characters which are stored in 503 db as html values(like
&#1607;&#1584;&#1575;
&#1607;&#1608;) will display as it is. Currently we are working on
converting these html values to its original chars. If we get any solution
let you know.

We expect your suggestions/solutions to handle the convertion of latin1
database to utf8 to display the utf8 characters correctly after migration.

Thanks & Regards,
Minnie.
vtiger Team.

[Attachment #5 (text/html)]

Dear Team,<br><br>We would like to get the help from you regarding UTF-8 related \
issues in Migration. <br> <br>
The following steps are used to migrate from 5.0.3 to 5.0.4 latest svn
source, where as default character set is latin1 for 5.0.3 database and
now for the latest source we have to convert those data as utf8
compatible (because default character set for 5.0.4 database is UTF-8)<br>So that \
after migration we should see the previously entered UTF-8 characters (ie., data \
available in 5.0.3) as it is in 5.0.4<span><br> <br>
1. Take the dump of 503 database<br></span>
<span style="font-weight: bold;">Eg : mysqldump -u root --port=5030 -h minnie vt503 \
&gt; vt503.sql<br><br></span>2. Edit the dump file, find and replace the string \
&quot;latin1&quot; with &quot;utf8&quot; in all places of the dump file. (Also added \
SET FOREIGN_KEY_CHECKS=0; at the first line and added SET FOREIGN_KEY_CHECKS=1; at \
the last line in the dump file)<span><br>
<br>
3. For 504, create a database with default charset utf8.  <br></span>
<span style="font-weight: bold;">Eg : create database vt503 default character set \
utf8 default collate utf8_general_ci</span><span style="font-weight: \
bold;">;<br><br></span>4. Apply the dump to this newly created database <br>
<span style="font-weight: bold;">
Eg : mysql -u root --port=5080 -h minnie vt503 &lt; vt503.sql</span><br>
<br>
5. Include the fix in include/database/PearDatabase.php file (Stored
this attached zip file under document root ie., parellel to
config.inc.php and unzipped). In SVN, refer the change set <a \
href="http://trac.vtiger.com/cgi-bin/trac.cgi/changeset/11854">http://trac.vtiger.com/cgi-bin/trac.cgi/changeset/11854</a><br>
 <div><br>6. Run the migration (from 5.0.3 to 5.0.4)<br><br>Kindly
test it and let us know the status of this fix.
Also please ensure that you have utf8 characters in 5.0.3 and are
display correctly in 5.0.3. So that after migration we have to check
whether those characters are displaying correctly in 5.0.4 migrated.<br><br><span \
style="font-weight: bold;"></span><span style="font-weight: bold;">Issue :</span> The \
characters which are stored in 503 db as html values(like  \
<span>&amp;#1607;&amp;#1584;&amp;#1575; &amp;#1607;&amp;#1608;</span>) will display \
as it is. Currently we are working on converting these html values to its original \
chars. If we get any solution let you know.<br> <br>
We expect your suggestions/solutions to handle the convertion of latin1
database to utf8 to display the utf8 characters correctly after
migration.<br><br>Thanks &amp; Regards,<br>Minnie.<br>vtiger Team.<br></div>


["migration.zip" (application/zip)]

_______________________________________________
Reach hundreds of potential candidates - http://jobs.vtiger.com 

[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic