Charset Trouble

Japanese suddenly wrong charset

hello,

I just updated to newest version of Composr and now my site that features a mix of English & Japanese is having trouble.

The English is all fine but the Japanese text in articles and wiki has all been converted / displaying not in utf-8?

Its weird as the Japanese in the RSS feeds and coded into panels etc is all OK. Only the wiki & news articles is changed.

I am hoping it is an easy fix and my original articles are all ok, my guess is they are fine.

Thanks for any help

Stevyn

example;



japanese text in RSS feed blocks on side panel are fine but article text is not


 

a test to see if Japanese text is OK here  

ウェブサイトリンク、イベント、ニュース、ブログまた、アナウンスは、北海道の人達が、こちらに送って下さるのはとても、光栄です、もちろん無料です。 ネットワークで、お互い助け合いましょう

OK update the above Japanese text is fine... and whats weird is that I posted a test article on my site the Japanese text is fine but all of old posts and wiki are all scrambled
 

It is possible your database was not saving data in Unicode, but some other default MySQL character set.

We did a fix to a problem setting the MySQL character set in the last release, but it could have this effect unfortunately (the fix is correct, but it reveals a hidden problem).

As a workaround you can try putting this in _config.php:

https://dev.mysql.com/doc/refman/5.7/en/faqs-cjk.html

I am happy to help you resolve this, send me an email if you're still struggling.

Sorry we didn't include this in the release announcement, I didn't imagine anyone would have a MySQL default character set other than Unicode or Western European.

howdy

the database should be utf-8 i think. the site is mostly english and maybe at times we post a bit of Japanese. Will try now and report back.

 

Hello,

Ok i set

$SITE_INFO['database_charset'] = 'utf-8';

in the _config.php

and good news mostly….. this fixes the news articles and wiki but now the other japanese in the templates recently saved show as just ?????????????? symbols

exploring it more now… mainly to have all the articles and wiki back is priority so that rocks

will report back