数据的备份与恢复问题

使用更先进的浏览器访问效果更佳。

数据的备份与恢复问题

wearmear

操作目的：内网独立模式数据库数据导出，并导入到外网

问题：操作恢复命令失败

内网备份的文件见附件

正式环境操作恢复命令如下：

[root@cms ~]# /opt/sequoiadb/bin/sdbrestore -p /opt/sequoiadb/database/standalone/bakfile -n lagoqu Init restore failed: -70 ***************************************************** Restore failed: -70 *****************************************************

[root@cms ~]#

许建辉

把执行 sdbrestore 目录下的 sdbrestore.txt 内容也贴上来：）

wearmear

2015-04-11-12.04.21.544627 Level:EVENT PID:29772 TID:29772 Function:pmdRestoreThreadMain Line:489 File:SequoiaDB/engine/pmd/sdbrestore.cpp Message: Start sdbrestore [Ver: 1.12, Release: 17824, Build: 2015-03-22-12.59.57]... 2015-04-11-12.04.21.544765 Level:WARNING PID:29772 TID:29772 Function:_readMetaHeader Line:402 File:SequoiaDB/engine/bar/barBkupLogger.cpp Message: Invalid backup name[backupName], should be: lagoqu 2015-04-11-12.04.21.544786 Level:ERROR PID:29772 TID:29772 Function:_initCheckAndPrepare Line:1760 File:SequoiaDB/engine/bar/barBkupLogger.cpp Message: Failed to read meta file[0], rc: -70 2015-04-11-12.04.21.544797 Level:WARNING PID:29772 TID:29772 Function:init Line:1724 File:SequoiaDB/engine/bar/barBkupLogger.cpp Message: Prepare check for resotre failed, rc: -70 2015-04-11-12.04.21.545153 Level:EVENT PID:29772 TID:29772 Function:pmdRestoreThreadMain Line:550 File:SequoiaDB/engine/pmd/sdbrestore.cpp Message:

Stop sdbrestore, exist code: -70

许建辉

是不是手动修改过备份文件的名字了？

wearmear

多谢许哥，找到原因了

我内网备份后，觉得名字不好就改了文件名

backupName.1 --》 lagoqu.1

backupName.bak --》 lagoqu.bak

改过来后就能正常恢复啦

wearmear

先吃饭了，是可以执行了，但是未执行成功

可能是内网我端口是11800，外网是11810的原因【未确定具体原因】。错误信息如下

QQ图片20150411121427.png

wearmear

2015-04-11-12.08.30.648052 Level:EVENT PID:30215 TID:30215 Function:pmdRestoreThreadMain Line:489 File:SequoiaDB/engine/pmd/sdbrestore.cpp Message: Start sdbrestore [Ver: 1.12, Release: 17824, Build: 2015-03-22-12.59.57]... 2015-04-11-12.08.45.066709 Level:EVENT PID:30215 TID:30215 Function:_analysis Line:226 File:SequoiaDB/engine/dps/dpsLogFileMgr.cpp Message: Analysis dps logs[begin: 0, work: 0, logicalWork: 0] 2015-04-11-12.08.46.094170 Level:WARNING PID:30215 TID:30215 Function:rtnCollectionSpaceLock Line:718 File:SequoiaDB/engine/rtn/rtn.cpp Message: Collection Space SYSTEMP does not exist in dms, load from disk 2015-04-11-12.08.46.197998 Level:ERROR PID:30215 TID:30215 Function:rtnCollectionSpaceLock Line:728 File:SequoiaDB/engine/rtn/rtn.cpp Message: Unable to load collection SYSTEMP from /opt/sequoiadb/database/standalone/11800 2015-04-11-12.08.47.387292 Level:EVENT PID:30215 TID:30215 Function:openStorage Line:182 File:SequoiaDB/engine/dms/dmsStorageBase.cpp Message: Create storage unit file[/opt/sequoiadb/database/standalone/11800/SYSTEMP.1.data] succeed, mode: e 2015-04-11-12.08.47.732974 Level:EVENT PID:30215 TID:30215 Function:openStorage Line:182 File:SequoiaDB/engine/dms/dmsStorageBase.cpp Message: Create storage unit file[/opt/sequoiadb/database/standalone/11800/SYSTEMP.1.idx] succeed, mode: e 2015-04-11-12.08.51.592825 Level:EVENT PID:30215 TID:30238 Function:pmdEDUEntryPoint Line:1034 File:SequoiaDB/engine/pmd/pmdEDU.cpp Message: Start thread[30238] for EDU[ID:1, type:LogWriter] 2015-04-11-12.08.51.592835 Level:EVENT PID:30215 TID:30240 Function:pmdEDUEntryPoint Line:1034 File:SequoiaDB/engine/pmd/pmdEDU.cpp Message: Start thread[30240] for EDU[ID:3, type:Task] 2015-04-11-12.08.51.593048 Level:EVENT PID:30215 TID:30240 Function:restore Line:1846 File:SequoiaDB/engine/bar/barBkupLogger.cpp Message: Begin to restore[backupName]... 2015-04-11-12.08.51.592923 Level:EVENT PID:30215 TID:30239 Function:pmdEDUEntryPoint Line:1034 File:SequoiaDB/engine/pmd/pmdEDU.cpp Message: Start thread[30239] for EDU[ID:2, type:DpsRollback] 2015-04-11-12.08.51.654489 Level:EVENT PID:30215 TID:30240 Function:cleanDMSData Line:1897 File:SequoiaDB/engine/bar/barBkupLogger.cpp Message: Clear dms data for restore 2015-04-11-12.08.51.917028 Level:ERROR PID:30215 TID:30240 Function:ossOpen Line:352 File:SequoiaDB/engine/oss/ossIO.cpp Message: Failed to open file: /opt/sequoiadb/conf/local/11800/sdb.conf, errno: 2 2015-04-11-12.08.51.917110 Level:ERROR PID:30215 TID:30240 Function:reflush2File Line:2084 File:SequoiaDB/engine/pmd/pmdOptionsMgr.cpp Message: Failed to write config[/opt/sequoiadb/conf/local/11800/sdb.conf], rc: -4 2015-04-11-12.08.51.917128 Level:ERROR PID:30215 TID:30240 Function:restore Line:1856 File:SequoiaDB/engine/bar/barBkupLogger.cpp Message: Failed to restore config, rc: -4 2015-04-11-12.08.51.917140 Level:EVENT PID:30215 TID:30240 Function:cleanDMSData Line:1897 File:SequoiaDB/engine/bar/barBkupLogger.cpp Message: Clear dms data for restore 2015-04-11-12.08.51.917160 Level:WARNING PID:30215 TID:30240 Function:pmdBackgroundJobEntryPoint Line:62 File:SequoiaDB/engine/pmd/pmdBackgroundJob.cpp Message: Background job[Restore] do failed, rc = -4 2015-04-11-12.08.52.034411 Level:EVENT PID:30215 TID:30240 Function:pmdEDUEntryPoint Line:1179 File:SequoiaDB/engine/pmd/pmdEDU.cpp Message: Terminating thread[30240] for EDU[ID:3, Type:Task, Name: Restore] 2015-04-11-12.08.52.593232 Level:EVENT PID:30215 TID:30239 Function:pmdDpsTransRollbackEntryPoint Line:54 File:SequoiaDB/engine/pmd/pmdDpsTransRollback.cpp Message: EDU[2] is terminated 2015-04-11-12.08.52.593373 Level:EVENT PID:30215 TID:30239 Function:pmdEDUEntryPoint Line:1179 File:SequoiaDB/engine/pmd/pmdEDU.cpp Message: Terminating thread[30239] for EDU[ID:2, Type:DpsRollback, Name: ] 2015-04-11-12.08.53.593269 Level:EVENT PID:30215 TID:30238 Function:pmdEDUEntryPoint Line:1179 File:SequoiaDB/engine/pmd/pmdEDU.cpp Message: Terminating thread[30238] for EDU[ID:1, Type:LogWriter, Name: ] 2015-04-11-12.08.53.596691 Level:EVENT PID:30215 TID:30215 Function:pmdRestoreThreadMain Line:550 File:SequoiaDB/engine/pmd/sdbrestore.cpp Message:

Stop sdbrestore, exist code: -4

wearmear

端口问题解决了

解决方法，比较笨：直接把两个备份文件用文本工具打开然后替换成正确的端口

11800 --》 11810

唉，又有新问题了，

报错

***************************************************** Restore failed: -11 *****************************************************

[root@cms bin]#

许建辉

空间不足。

许建辉

sdbrestore 在恢复数据时，是可以通过 "--dbpath", "--svcname"等参数来修改配置信息的，没必要直接去改备份的文件

用 sdbrestore --help 可以查看详细帮助；也可以在 sequoiadb的信息中心查看“备份恢复”相关的指导。

wearmear

执行结果如下

[root@cms bin]# /opt/sequoiadb/bin/sdbrestore -p /opt/sequoiadb/database/standalone/bakfile -n backupName -dbpath /opt/sequoiadb/database/standalone --confpath /opt/sequoiadb/conf/local/11810/sdb.conf --svcname 11810 Check sequoiadb(11810) is not running...OK Begin to clean dps logs... Begin to clean dms storages... Begin to init dps logs... Begin to restore... ***************************************************** Restore failed: -1 *****************************************************

[root@cms bin]#

日志

2015-04-11-13.25.48.559930 Level:EVENT PID:5248 TID:5248 Function:pmdRestoreThreadMain Line:489 File:SequoiaDB/engine/pmd/sdbrestore.cpp Message: Start sdbrestore [Ver: 1.12, Release: 17824, Build: 2015-03-22-12.59.57]... 2015-04-11-13.26.04.127367 Level:EVENT PID:5248 TID:5248 Function:_analysis Line:226 File:SequoiaDB/engine/dps/dpsLogFileMgr.cpp Message: Analysis dps logs[begin: 0, work: 0, logicalWork: 0] 2015-04-11-13.26.04.245950 Level:WARNING PID:5248 TID:5248 Function:rtnCollectionSpaceLock Line:718 File:SequoiaDB/engine/rtn/rtn.cpp Message: Collection Space SYSTEMP does not exist in dms, load from disk 2015-04-11-13.26.04.332855 Level:ERROR PID:5248 TID:5248 Function:rtnCollectionSpaceLock Line:728 File:SequoiaDB/engine/rtn/rtn.cpp Message: Unable to load collection SYSTEMP from /opt/sequoiadb/database/standalone/11810 2015-04-11-13.26.04.513512 Level:EVENT PID:5248 TID:5248 Function:openStorage Line:182 File:SequoiaDB/engine/dms/dmsStorageBase.cpp Message: Create storage unit file[/opt/sequoiadb/database/standalone/11810/SYSTEMP.1.data] succeed, mode: e 2015-04-11-13.26.04.777357 Level:EVENT PID:5248 TID:5248 Function:openStorage Line:182 File:SequoiaDB/engine/dms/dmsStorageBase.cpp Message: Create storage unit file[/opt/sequoiadb/database/standalone/11810/SYSTEMP.1.idx] succeed, mode: e 2015-04-11-13.26.10.244624 Level:EVENT PID:5248 TID:5269 Function:pmdEDUEntryPoint Line:1034 File:SequoiaDB/engine/pmd/pmdEDU.cpp Message: Start thread[5269] for EDU[ID:1, type:LogWriter] 2015-04-11-13.26.10.244655 Level:EVENT PID:5248 TID:5271 Function:pmdEDUEntryPoint Line:1034 File:SequoiaDB/engine/pmd/pmdEDU.cpp Message: Start thread[5271] for EDU[ID:3, type:Task] 2015-04-11-13.26.10.244707 Level:EVENT PID:5248 TID:5270 Function:pmdEDUEntryPoint Line:1034 File:SequoiaDB/engine/pmd/pmdEDU.cpp Message: Start thread[5270] for EDU[ID:2, type:DpsRollback] 2015-04-11-13.26.10.310341 Level:EVENT PID:5248 TID:5271 Function:restore Line:1846 File:SequoiaDB/engine/bar/barBkupLogger.cpp Message: Begin to restore[backupName]... 2015-04-11-13.26.10.342976 Level:EVENT PID:5248 TID:5271 Function:cleanDMSData Line:1897 File:SequoiaDB/engine/bar/barBkupLogger.cpp Message: Clear dms data for restore 2015-04-11-13.26.10.399146 Level:ERROR PID:5248 TID:5271 Function:ossOpen Line:352 File:SequoiaDB/engine/oss/ossIO.cpp Message: Failed to open file: /opt/sequoiadb/conf/local/11810/sdb.conf/sdb.conf, errno: 20 2015-04-11-13.26.10.399257 Level:ERROR PID:5248 TID:5271 Function:reflush2File Line:2084 File:SequoiaDB/engine/pmd/pmdOptionsMgr.cpp Message: Failed to write config[/opt/sequoiadb/conf/local/11810/sdb.conf/sdb.conf], rc: -1 2015-04-11-13.26.10.399296 Level:ERROR PID:5248 TID:5271 Function:restore Line:1856 File:SequoiaDB/engine/bar/barBkupLogger.cpp Message: Failed to restore config, rc: -1 2015-04-11-13.26.10.399346 Level:EVENT PID:5248 TID:5271 Function:cleanDMSData Line:1897 File:SequoiaDB/engine/bar/barBkupLogger.cpp Message: Clear dms data for restore 2015-04-11-13.26.10.399384 Level:WARNING PID:5248 TID:5271 Function:pmdBackgroundJobEntryPoint Line:62 File:SequoiaDB/engine/pmd/pmdBackgroundJob.cpp Message: Background job[Restore] do failed, rc = -1 2015-04-11-13.26.10.516484 Level:EVENT PID:5248 TID:5271 Function:pmdEDUEntryPoint Line:1179 File:SequoiaDB/engine/pmd/pmdEDU.cpp Message: Terminating thread[5271] for EDU[ID:3, Type:Task, Name: Restore] 2015-04-11-13.26.11.310446 Level:EVENT PID:5248 TID:5270 Function:pmdDpsTransRollbackEntryPoint Line:54 File:SequoiaDB/engine/pmd/pmdDpsTransRollback.cpp Message: EDU[2] is terminated 2015-04-11-13.26.11.310571 Level:EVENT PID:5248 TID:5270 Function:pmdEDUEntryPoint Line:1179 File:SequoiaDB/engine/pmd/pmdEDU.cpp Message: Terminating thread[5270] for EDU[ID:2, Type:DpsRollback, Name: ] 2015-04-11-13.26.12.310506 Level:EVENT PID:5248 TID:5269 Function:pmdEDUEntryPoint Line:1179 File:SequoiaDB/engine/pmd/pmdEDU.cpp Message: Terminating thread[5269] for EDU[ID:1, Type:LogWriter, Name: ] 2015-04-11-13.26.12.314360 Level:EVENT PID:5248 TID:5248 Function:pmdRestoreThreadMain Line:550 File:SequoiaDB/engine/pmd/sdbrestore.cpp Message:

Stop sdbrestore, exist code: -1

wearmear

把命令的--改成-后结果就是这样子的了

/opt/sequoiadb/bin/sdbrestore -p /opt/sequoiadb/database/standalone/bakfile -n backupName -dbpath /opt/sequoiadb/database/standalone -confpath /opt/sequoiadb/conf/local/11810/sdb.conf -svcname 11810

运行结果

Failed to reopen log file, errno = 28 Failed to write into log file, rc: 28 2015-04-11-13.32.02.721895 Level:EVENT PID:5693 TID:5693 Function:pmdRestoreThreadMain Line:550 File:SequoiaDB/engine/pmd/sdbrestore.cpp Message: Stop sdbrestore, exist code: -11 ***************************************************** Restore failed: -11 *****************************************************

[root@cms bin]#

2015-04-11-13.31.23.178931 Level:EVENT PID:5693 TID:5693 Function:pmdRestoreThreadMain Line:489 File:SequoiaDB/engine/pmd/sdbrestore.cpp Message: Start sdbrestore [Ver: 1.12, Release: 17824, Build: 2015-03-22-12.59.57]... 2015-04-11-13.31.38.678140 Level:EVENT PID:5693 TID:5693 Function:_analysis Line:226 File:SequoiaDB/engine/dps/dpsLogFileMgr.cpp Message: Analysis dps logs[begin: 0, work: 0, logicalWork: 0] 2015-04-11-13.31.38.769339 Level:WARNING PID:5693 TID:5693 Function:rtnCollectionSpaceLock Line:718 File:SequoiaDB/engine/rtn/rtn.cpp Message: Collection Space SYSTEMP does not exist in dms, load from disk 2015-04-11-13.31.38.817763 Level:ERROR PID:5693 TID:5693 Function:rtnCollectionSpaceLock Line:728 File:SequoiaDB/engine/rtn/rtn.cpp Message: Unable to load collection SYSTEMP from /opt/sequoiadb/database/standalone/11810 2015-04-11-13.31.39.182634 Level:EVENT PID:5693 TID:5693 Function:openStorage Line:182 File:SequoiaDB/engine/dms/dmsStorageBase.cpp Message: Create storage unit file[/opt/sequoiadb/database/standalone/11810/SYSTEMP.1.data] succeed, mode: e 2015-04-11-13.31.39.647146 Level:EVENT PID:5693 TID:5693 Function:openStorage Line:182 File:SequoiaDB/engine/dms/dmsStorageBase.cpp Message: Create storage unit file[/opt/sequoiadb/database/standalone/11810/SYSTEMP.1.idx] succeed, mode: e 2015-04-11-13.31.42.549680 Level:EVENT PID:5693 TID:5716 Function:pmdEDUEntryPoint Line:1034 File:SequoiaDB/engine/pmd/pmdEDU.cpp Message: Start thread[5716] for EDU[ID:3, type:Task] 2015-04-11-13.31.42.549838 Level:EVENT PID:5693 TID:5716 Function:restore Line:1846 File:SequoiaDB/engine/bar/barBkupLogger.cpp Message: Begin to restore[backupName]... 2015-04-11-13.31.42.549934 Level:EVENT PID:5693 TID:5714 Function:pmdEDUEntryPoint Line:1034 File:SequoiaDB/engine/pmd/pmdEDU.cpp Message: Start thread[5714] for EDU[ID:1, type:LogWriter] 2015-04-11-13.31.42.549985 Level:EVENT PID:5693 TID:5715 Function:pmdEDUEntryPoint Line:1034 File:SequoiaDB/engine/pmd/pmdEDU.cpp Message: Start thread[5715] for EDU[ID:2, type:DpsRollback] 2015-04-11-13.31.42.601382 Level:EVENT PID:5693 TID:5716 Function:cleanDMSData Line:1897 File:SequoiaDB/engine/bar/barBkupLogger.cpp Message: Clear dms data for restore 2015-04-11-13.31.42.601747 Level:EVENT PID:5693 TID:5716 Function:_openDataFile Line:1663 File:SequoiaDB/engine/bar/barBkupLogger.cpp Message: Begin to restore data file[/opt/sequoiadb/database/standalone/bakfile/backupName.1] 2015-04-11-13.31.42.664607 Level:EVENT PID:5693 TID:5716 Function:_openSUFile Line:2413 File:SequoiaDB/engine/bar/barBkupLogger.cpp Message: Begin to restore su[group1.1.data]... 2015-04-11-13.31.46.846846 Level:EVENT PID:5693 TID:5716 Function:_openSUFile Line:2413 File:SequoiaDB/engine/bar/barBkupLogger.cpp Message: Begin to restore su[group1.1.idx]... 2015-04-11-13.31.49.058741 Level:EVENT PID:5693 TID:5716 Function:_openSUFile Line:2413 File:SequoiaDB/engine/bar/barBkupLogger.cpp Message: Begin to restore su[lagouqu.1.data]... 2015-04-11-13.31.54.651043 Level:EVENT PID:5693 TID:5716 Function:_openSUFile Line:2413 File:SequoiaDB/engine/bar/barBkupLogger.cpp Message: Begin to restore su[lagouqu.1.idx]... 2015-04-11-13.31.57.581613 Level:EVENT PID:5693 TID:5716 Function:_openSUFile Line:2413 File:SequoiaDB/engine/bar/barBkupLogger.cpp Message: Begin to restore su[test_lagouqu.1.data]... 2015-04-11-13.32.01.013447 Level:ERROR PID:5693 TID:5716

Fu

wearmear

日志

2015-04-11-13.43.41.086448 Level:EVENT PID:6588 TID:6643 Function:_openSUFile Line:2413 File:SequoiaDB/engine/bar/barBkupLogger.cpp Message: Begin to restore su[test_lagouqu.1.data]... 2015-04-11-13.43.45.803011 Level:ERROR PID:6588 TID:6643 Function:ossWrite Line:912 File:SequoiaDB/engine/oss/ossIO.cpp Message: Failed to write() : 20, Error: 28 2015-04-11-13.43.45.803083 Level:WARNING PID:6588 TID:6643 Function:_flush Line:351 File:SequoiaDB/engine/bar/barBkupLogger.cpp Message: Failed to write data, rc: -11 2015-04-11-13.43.45.803096 Level:ERROR PID:6588 TID:6643 Function:_writeSU Line:2382 File:SequoiaDB/engine/bar/barBkupLogger.cpp Message:

Failed to write data to file[test_lagouqu.1.data], rc: -11

许建辉

--confpath /opt/sequoiadb/conf/local/11810/sdb.conf 只到目录即可，修改为：

--confpath /opt/sequoiadb/conf/local/11810

wearmear

备份成功了，两个问题：

1. 磁盘不够，删除一些东西就行了

2. 你说的--confpath 问题

但是现在11810启动报错

bash-4.1$ /opt/sequoiadb/bin/sdbstart -c /opt/sequoiadb/conf/local/11810/
Failed to open config file: /opt/sequoiadb/conf/local/11810/sdb.conf
11810: 187 bytes out==>
Failed to open config file: /opt/sequoiadb/conf/local/11810/sdb.conf
Read config file: /opt/sequoiadb/conf/local/11810/sdb.conf failed, rc: -3
Failed resolving arguments(error=-3), exit
Error: Start [/opt/sequoiadb/conf/local/11810/] failed, rc: 129(Permission Error)
Total: 1; Succeed: 0; Failed: 1
bash-4.1$

难道是我们版本的问题吗？

内网备份数据用的Version 1.10，线上用的Version 1.12

wearmear

终于搞定啦，啊啊啊啊啊啊啊啊啊啊啊啊，多谢各位大神的帮忙！！！:lol

问题：缺少权限

方法：给用户sdbadmin赋予数据库目录所有权限

chown sdbadmin:sdbadmin_group -R /opt/sequoiadb/

wearmear

命令要在root用户下操作