Question

0

516

Views

how to import parquet files from s3 to postgresql rds

I'm trying to load a parquet file from s3 to AWS postgresql RDS. The data import using aws_s3.table_import_from_s3 is working fine for csv file but when I tried the similar way for parquet file, I get the below error:

ERROR: invalid byte sequence for encoding "UTF8": 0x00

In AWS docs, I see option for custom delimiter or zip file. Is it possible to import parquet data?

over 4 years ago · Santiago Trujillo

1 answers

Answer question

0

Answer question

Find remote jobs

Answer 1 · 2022-05-11T20:38:55.734Z

Data import into an AWS PostgreSQL RDS supports what COPY does. Although there is a PostgreSQL binary file format it doesn't support Parquet so in order to import the data you have to convert it to a text file or the PostgreSQL binary file format first.

0

516

how to import parquet files from s3 to postgresql rds

1 answers

0

Find remote jobs

Andres GPT