当我尝试在我的devel数据库节点上恢复大型数据库(几乎32Go自定义格式)时,我遇到了一个小问题(该节点具有较少的RAM, CPU…
我的数据库转储是用如下命令生成的:
pg_dump -F custom -b myDB -Z 9 > /backup/myDB-`date +%y%m%d`.pg91
当我恢复它时,我使用以下命令:
pg_restore -F custom -j 5 -d myDB /backup/myDB-20130331.pg91
但是在这里,每次恢复命令失败时都会出现如下错误:
pg_restore: [archiver (db)] error returned by PQputCopyData: server closed the connection unexpectedly
This probably means the server terminated abnormally
before or while processing the request.
pg_restore: [archiver] worker process failed: exit code 1
pg_restore: [archiver (db)] error returned by PQputCopyData: server closed the connection unexpectedly
This probably means the server terminated abnormally
before or while processing the request.
pg_restore: [archiver (db)] error returned by PQputCopyData: server closed the connection unexpectedly
This probably means the server terminated abnormally
before or while processing the request.
pg_restore: [archiver (db)] error returned by PQputCopyData: server closed the connection unexpectedly
This probably means the server terminated abnormally
before or while processing the request.
当我检查我的postgresql日志时,我可以读到:
HINT: In a moment you should be able to reconnect to the database and repeat your command.
LOG: all server processes terminated; reinitializing
LOG: database system was interrupted; last known up at 2013-04-02 11:41:48 UTC
LOG: database system was not properly shut down; automatic recovery in progress
LOG: redo starts at 86/26F302B0
LOG: unexpected pageaddr 85/E3F52000 in log file 134, segment 38, offset 16064512
LOG: redo done at 86/26F51FC0
LOG: last completed transaction was at log time 2013-04-02 11:50:47.663599+00
LOG: database system is ready to accept connections
LOG: autovacuum launcher started
这是相当奇怪的,我的postgresql服务器"重启"独自只是因为我的恢复。我尽量减少工作的数量(-j 5
选项),但仍然有同样的问题。但是,在具有更好规格的节点上,恢复该数据库没有问题。我不确定,但也许我的索引更新(其中一个索引真的太大了)可以作为理解这个问题的线索?
所以我有一些问题:有没有更好的方法来恢复真正大的数据库?我是否在pg_restore命令中遗漏了一些内容?可能是我的开发服务器设置太低了?
任何线索将不胜感激。谢谢。
env: PostgreSQL 9.1(通过Debian安装)
对于这种大的工作,建议在恢复过程中禁用autovacuum
(在postgresql.conf中设置为off
)。