PGHoard: Tools for making PostgreSQL backups to cloud object storages

[waffle_ss]

How does this compare to WAL-E?

https://github.com/wal-e/wal-e

[melor]

Both do mostly the same thing with some differences. The biggest difference currently could be that WAL-E uses the PostgreSQL "archive_command" to send incremental backups (WAL files) in complete 16 megabyte chunks, whereas PGHoard uses real-time streaming with "pg_receivexlog", making the data loss window much smaller in case of a disaster.

[oskari]

PGHoard also supports Google Cloud which doesn't seem to be supported in WAL-E at the moment.

[melor]

Takes care of realtime WAL streaming, compression, encryption, restoration and backup expiration among other things. Open Source and written in Python.

[brudgers]

Curious if it backs up to other cloud storage providers in vendor neutral ways.

[anarazel]

Do you prevent segments from being removed while they're not yet received by pg_receivexlog? wal_keep_segments or replication slots?

[melor]

A replication slot can be used by defining it in the pghoard.json configuration. However, the slot needs to be created (and removed after no longer needed, important!) manually. We've been planning to add more automatic replication slot management to PGHoard.