AnsweredAssumed Answered

Problem importing into a database

Question asked by Rich Layden on Jan 13, 2020
Latest reply on Jan 13, 2020 by Robert Carroll

Hi all,


I'm tearing my hair out with this one - hopefully there is a simple fix that I'm missing.


I have a Postgres DB into which I am loading selected flat files (there is a wonderful bash script that someone shared that is doing the business).


I am experiencing a problem trying to import submission_dim.txt 


The import process was giving me the error - "extra data after last expected column".

Am I right in thinking that the schema for submission_dim has changed?
In my database table it seems to be one column short (posted_at).


I tried re-creating the Postgres table with the missing field in it (posted_at).

This time when I try to import the txt file I get the error - "missing data for column "posted_at""


So (to my feeble brain) it seems like the flat file has inconsistent column data?

Some records have the 'posted_at' data but those that don't just terminate the line (rather than have an empty field).


As i say this is seriously baking my noodle.

I'd really appreciate any advice and help.