In psql \copy from, send data to server in larger chunks.
authorHeikki Linnakangas <heikki.linnakangas@iki.fi>
Wed, 14 Jul 2021 10:08:28 +0000 (13:08 +0300)
committerHeikki Linnakangas <heikki.linnakangas@iki.fi>
Wed, 14 Jul 2021 10:08:28 +0000 (13:08 +0300)
commiteec57115e4c866f26bdc8bcbe3e2e7be4c6d0450
tree90b277e1b9f9f7354818d8b1e1f28ce726828e6f
parentb4deefc39b933b9808645667117f2d8208092794
In psql \copy from, send data to server in larger chunks.

Previously, we would send each line as a separate CopyData message.
That's pretty wasteful if the table is narrow, as each CopyData message
has 5 bytes of overhead. For efficiency, buffer up and pack 8 kB of
input data into each CopyData message.

The server also sends each line as a separate CopyData message in COPY TO
STDOUT, and that's similarly wasteful. But that's documented in the FE/BE
protocol description, so changing that would be a wire protocol break.

Reviewed-by: Aleksander Alekseev
Discussion: https://www.postgresql.org/message-id/40b2cec0-d0fb-3191-2ae1-9a3fe16a7e48%40iki.fi
src/bin/psql/copy.c