I'm tearing my hair out with this one - hopefully there is a simple fix that I'm missing.
I have a Postgres DB into which I am loading selected flat files (there is a wonderful bash script that someone shared that is doing the business).
I am experiencing a problem trying to import submission_dim.txt
The import process was giving me the error - "extra data after last expected column".
Am I right in thinking that the schema for submission_dim has changed?
In my database table it seems to be one column short (posted_at).
I tried re-creating the Postgres table with the missing field in it (posted_at).
This time when I try to import the txt file I get the error - "missing data for column "posted_at""
So (to my feeble brain) it seems like the flat file has inconsistent column data?
Some records have the 'posted_at' data but those that don't just terminate the line (rather than have an empty field).
As i say this is seriously baking my noodle.
I'd really appreciate any advice and help.