Originally posted by: PSAK

I have an input file where currency items are listed as symbols like $, €, etc. When I parse the file in WTX, it is not recognizing € symbol but all other signs are working perfectly in UTF-8 encoding.

Any solution to read € sign in WTX?

Originally posted by: paul.brett

How is this Euro symbol stored in the file?  If it is stored as hex 80 then this is not valid UTF-8 data.  This is the ANSI encoding.

The Euro symbol (€) should be stored as E2 82 AC in UTF-8.  If it is, then it will be read correctly at parsing.

Please see the enclosed example (for WTX 8.3 or higher) which will read the Euro symbol stored as UTF-8 and write it using Latin-9 (a.k.a ISO-8859-15)

Thank-you.

Paul.

Follow me on Twitter

Attachment(s)

Euro.zip   9 KB 1 version

Originally posted by: PSAK

Hi Paul,

Yes, this is indeed not a valid UTF-8 data. How can we display the same character in output too? Which encoding should we use to get the euro sign in output?

Regards,

Ashok

Originally posted by: paul.brett

If your input is not UTF-8 and your input Typetree is UTF-8, then the data is never read-in correctly (the non UTF-8 characters are discarded).

You will not be able to map this data.  No changes to the properties of output Typetree or output rules can 'recover' this data.

If you are receiving data marked as UTF-8 and it contains hex 80 to represent a Euro symbol, then you need to pre-process this data to convert all hex 80 to hex E2 82 AC.

I enclose an example pre-processing map to do just that.

Thank-you.

Paul.

Follow me on Twitter

Attachment(s)

PreProcess.zip   5 KB 1 version

Originally posted by: PSAK

I'm receiving data as hex E2 82 AC in UTF-8. Problem is when I try to load them into DB(Sql server), I could not see the sign instead its loaded as "â'¬"(as seen in UTF-8 encoding).  How can we load Euro sign into DB or print them into a file?

Originally posted by: paul.brett

E2 82 AC in UTF-8 is a Euro symbol.  Open the file Euro.txt from my zip archive Euro.zip (above) in Notepad.exe (which is UTF-8 'aware') and you will see this as €.

If your database and environment are configured correctly, then the Euro symbol should insert just fine.

Which database?  For oracle, for example, you need to set NLS_Lang - http://docs.oracle.com/cd/E12102_01/books/AnyInstAdm784/AnyInstAdmPreInstall18.html

Other configurations / DB vendors may require you to use Unicode on your output Typetree.

Thank-you.

Paul.

Follow me on Twitter

Originally posted by: Veronicadlmm

I have a problem with the symbol €, I have in the statement ml encoding="UTF-8", but to perform the transformation, the symbol € is lost. How could solve it?

I tried it with the symbol but I have not managed to fix it.