AnsweredAssumed Answered

Problem importing into a database

Question asked by Rich Layden on Jan 13, 2020
Latest reply on Jan 13, 2020 by Robert Carroll

Hi all,

 

I'm tearing my hair out with this one - hopefully there is a simple fix that I'm missing.

 

I have a Postgres DB into which I am loading selected flat files (there is a wonderful bash script that someone shared that is doing the business).

 

I am experiencing a problem trying to import submission_dim.txt 

 

The import process was giving me the error - "extra data after last expected column".

Am I right in thinking that the schema for submission_dim has changed?
In my database table it seems to be one column short (posted_at).

 

I tried re-creating the Postgres table with the missing field in it (posted_at).

This time when I try to import the txt file I get the error - "missing data for column "posted_at""

 

So (to my feeble brain) it seems like the flat file has inconsistent column data?

Some records have the 'posted_at' data but those that don't just terminate the line (rather than have an empty field).

 

As i say this is seriously baking my noodle.

I'd really appreciate any advice and help.

 

Cheers

Rich

Outcomes