Originally posted by: ASK

Hi- I have some | delimited data which sometimes gets "|" as part of data. I dont have any specific release char before the | which is part of the data. Any ideas how I should use the release/escape char to read that data element with |.

Originally posted by: paul.brett

Unless there is a way to identify that the errant '|' is not a syntax object, then WTX will be unable to avoid seeing it as one.  Is there any way of knowing by looking at the data, which are the real delimiters, and which is data?

If for example, you have a fixed number of fields, then a pre-processor map could read the rows, and count the delimiters.  It could then flag rows that exceed the 'correct' number of delimiters for either a human to intervene or further processing to identify the real delimiters.

Thank-you.

Paul.

Follow me on Twitter

Originally posted by: ASK

Thanks Paul. There isnt any way of knowing unless one reads/looks at the file manually. I am trying to use a prep map to cleanse the data for empty spaces between delimiters and then feeding actual map. in most cases i see a leading <SP> before the errant | which i am banking to use as my release char.