SQLite Forum

Issue importing csv file to db
Login
If your input is in this format,<code>
   123456|names|surnames|addresses|etc|etc
</code>, why are you treating it as comma-separated-values?

You should be aware that lines which have too few columns on CSV import have the "missing" fields set to NULL.  If that result is what you mean by "one that another record is left out", you should investigate whether the file is legitimate CSV.  (For example, using "\|" to separate fields may confound the separator-quoting logic.)

I have used the SQLite shell's .import command to bring very large files into a DB, without any issues. I can also attest, from inspection of the code, that it does not do anything on the Nth line that is not done for any Mth line, where N and M are different numbers greater than 1, whether large or not.