Letter combos causing a question mark to appear in GZDoom

[Kostov]

So, there are a few combinations of letters that, when typed into a string or a chat message, cause a question mark to appear in GZDoom, in place of the two letters that were just written.

An example of this is øš, which I found out after messing around with the GZDoom codepage in trying to make the Serbian Cyrillic alphabet (by changing the Doom letters to Cyrillic based on Windows-1251 and using the letter combination шљ). If you copy and paste it into GZDoom chat, it ends up as a ? instead.

I have no idea what makes this happen. Does anyone know?



(Original text: Имаш среће што те нисам ударио када си размишљао о одласку.)

[Marisa the Magician]

Wait, GZDoom isn't utf-8?

[Kostov]

Unicode? Not that I know of.

[phantombeta]

Wait, GZDoom isn't utf-8?

Nope. There was some work on UTF-8 semi-recently, but nothing came out of that.

[Graf Zahl]

That particular combination of characters gets caught in an attempt to convert UTF-8 to ISO 8859-1. GZDoom does NOT support Windows 1252 because that code page can conflict with UTF-8. Only proper ISO 8859-1 is supported.
In general I strongly advise against repurposing characters. If GZDoom ever gets a TrueType font renderer for some screens this will turn into unreadable gibberish.

[Kostov]

Aaah. Okay. I thought Windows-1252 was the main codepage. Now I know what to look out for.

[Graf Zahl]

That aside, would you mind donating the characters so that they can be placed into the proper slots for cyrillic UTF-8 text?

[Kostov]

Sure! I’ll send them in a PM.

[theleo_ua]

Sure! I’ll send them in a PM.

Russian fonts from Strife in PSD which Julian (Russian Doom author) gave me : https://drive.google.com/open?id=1sYj-q ... neaiYmwHUU