Have you tried examining the raw data (before you start any of your processing) of the affected rows to see what characters they contain? Use the SQLite shell to find out what the stored data is for those rows, so you can be sure if the problem is in the data itself or the way you're processing it.