JCH
Java Community | Help. Code. Learn.•10mo ago
Ed

Database import issue

Hello, can anyone help me with a SQL importing issue. I have a table, all its fields are Text, and i want to import from csv to the table which have identical titles I used to do the import from csv to database table as in the picture, now i am going on ec2 instance and downloaded the same csv and trying to import it with command line. My command is as follows: 
\copy "en.openfoodfacts.org.products" 
  FROM '/var/lib/postgresql/data/en.openfoodfacts.org.products.csv'
  WITH (
    FORMAT csv,
    DELIMITER E'\t',
    NULL '',
    HEADER true,
    QUOTE '"',
    ESCAPE '"'
);
\copy "en.openfoodfacts.org.products" 
  FROM '/var/lib/postgresql/data/en.openfoodfacts.org.products.csv'
  WITH (
    FORMAT csv,
    DELIMITER E'\t',
    NULL '',
    HEADER true,
    QUOTE '"',
    ESCAPE '"'
);
Through intellije i get errors but much less and the importation never stops. through docker postgres container i get an error and it stops the whole process and rolls back all changes. The error as far as i can tell is because of quotes in the fields of the table, there are strings that contain ( " ' ` , ) which causes the issues i believe but i cannot understand how the intellije is working fine with small amount of errors but on docker its not and its catching errors much faster. This is an error : 
 postgres=# \copy "en.openfoodfacts.org.products" FROM '/var/lib/postgresql/data/en.openfoodfacts.org.products.csv' WITH (FORMAT csv, DELIMITER E'\t', NULL '', HEADER true, QUOTE '"', ESCAPE '"')

ERROR:  missing data for column "bicarbonate_100g"
CONTEXT:  COPY en.openfoodfacts.org.products, line 15413: "0011110198532        http://world-en.openfoodfacts.org/product/0011110198532/inter-american-products-12-new..."
 postgres=# \copy "en.openfoodfacts.org.products" FROM '/var/lib/postgresql/data/en.openfoodfacts.org.products.csv' WITH (FORMAT csv, DELIMITER E'\t', NULL '', HEADER true, QUOTE '"', ESCAPE '"')

ERROR:  missing data for column "bicarbonate_100g"
CONTEXT:  COPY en.openfoodfacts.org.products, line 15413: "0011110198532        http://world-en.openfoodfacts.org/product/0011110198532/inter-american-products-12-new..."
No description
1 Reply
JavaBot
JavaBot•10mo ago
⌛ This post has been reserved for your question.
Hey @Ed! Please use /close or the Close Post button above when your problem is solved. Please remember to follow the help guidelines. This post will be automatically closed after 300 minutes of inactivity.
TIP: Narrow down your issue to simple and precise questions to maximize the chance that others will reply in here. 💤 Post marked as dormant
This post has been inactive for over 300 minutes, thus, it has been archived. If your question was not answered yet, feel free to re-open this post or create a new one. In case your post is not getting any attention, you can try to use /help ping. Warning: abusing this will result in moderative actions taken against you.

Did you find this page helpful?