SQLite Forum

Is CSV parsing too liberal?
Login
I wonder if there's a standard for all unix/iinux utilities, saying that they should, or should not, understand BOMs.

The unix/linux command <code>sed</code> always removes BOMs.  You can use sed along a pipe, or as a converter:

<code>sed <input.csv > output.csv</code>

Of course, if the BOM is there for a good reason, you're losing this functionality.