elasticsearch备份工具elasticsearch-dump（十）

2024-02-05 12:07:16

1.elasticsearch备份工具介绍

elasticsearch备份工具由elasticsearch-dump实现

官网：https://github.com/elasticsearch-dump/elasticsearch-dump

2.安装elasticsearch-dump

1.下载elasticsearch-dump
[root@elasticsearch ~/soft]# git clone https://github.com/taskrabbit/elasticsearch-dump

2.安装elasticsearch-dump
[root@elasticsearch ~/soft]# mv elasticsearch-dump/ /data/
[root@elasticsearch ~/soft]# cd /data/elasticsearch-dump
[root@elasticsearch /data/elasticsearch-dump]# npm install elasticdump

3.查看版本
[root@elasticsearch /data/elasticsearch-dump]# elasticdump --version
6.62.1

3.elasticsearch-dump备份实战

3.1.使用elasticsearch-dump备份xinwen索引库

命令语法：elasticdump --input es地址/索引 --output 备份到某个路径

[root@elasticsearch ~]# mkdir /data/es-backer
[root@elasticsearch ~]# elasticdump --input http://192.168.81.210:9200/xinwen --output /data/es-backer/xinwen.json
Thu, 14 Jan 2021 02:57:08 GMT | starting dump
Thu, 14 Jan 2021 02:57:09 GMT | got 4 objects from source elasticsearch (offset: 0)
Thu, 14 Jan 2021 02:57:09 GMT | sent 4 objects to destination file, wrote 4
Thu, 14 Jan 2021 02:57:09 GMT | got 0 objects from source elasticsearch (offset: 4)
Thu, 14 Jan 2021 02:57:09 GMT | Total Writes: 4
Thu, 14 Jan 2021 02:57:09 GMT | dump complete

3.2.删除xinwen索引库

在kibana中删除

Delete xinwen

删除成功

3.3.使用elasticsearch-dump还原xinwen索引库

命令语法：elasticdump --input 备份文件路径 --output es地址/索引

[root@elasticsearch ~]# elasticdump --input /data/es-backer/xinwen.json --output http://192.168.81.210:9200/xinwen
Thu, 14 Jan 2021 03:04:45 GMT | starting dump
Thu, 14 Jan 2021 03:04:45 GMT | got 4 objects from source file (offset: 0)
Thu, 14 Jan 2021 03:04:50 GMT | sent 4 objects to destination elasticsearch, wrote 4
Thu, 14 Jan 2021 03:04:50 GMT | got 0 objects from source file (offset: 4)
Thu, 14 Jan 2021 03:04:50 GMT | Total Writes: 4
Thu, 14 Jan 2021 03:04:50 GMT | dump complete

还原xinwen索引库成功

4…两个es之间进行数据迁移

elasticdump --input 要迁移es1地址/索引 --output 迁移到es2地址/索引

[root@elasticsearch ~]# elasticdump --input http://192.168.81.210:9200/xinwen --output http://192.168.81.220:9200/xinwen
Thu, 14 Jan 2021 03:08:24 GMT | starting dump
Thu, 14 Jan 2021 03:08:24 GMT | got 4 objects from source elasticsearch (offset: 0)
Thu, 14 Jan 2021 03:08:32 GMT | sent 4 objects to destination elasticsearch, wrote 4
Thu, 14 Jan 2021 03:08:32 GMT | got 0 objects from source elasticsearch (offset: 4)
Thu, 14 Jan 2021 03:08:32 GMT | Total Writes: 4
Thu, 14 Jan 2021 03:08:32 GMT | dump complete

5.安装elasticsearch-dump报错问题排查

报错内容如下

[root@elasticsearch /data/elasticsearch-dump]# npm install elasticdump
npm ERR! code ENOSELF
npm ERR! Refusing to install package with name "elasticdump" under a package
npm ERR! also called "elasticdump". Did you name your project the same
npm ERR! as the dependency you're installing?
npm ERR! 
npm ERR! For more information, see:
npm ERR!     <https://docs.npmjs.com/cli/install#limitations-of-npms-install-algorithm>

npm ERR! A complete log of this run can be found in:
npm ERR!     /root/.npm/_logs/2021-01-13T06_36_56_956Z-debug.log

报错内容翻译如下
错误的ERR！ 代码ENOSELF
错误的ERR！ 拒绝在包下安装名为“webpack”的包
错误的ERR！ 也被称为“webpack”。 你的项目名称是否相同？
错误的ERR！ 作为您正在安装的依赖项？
错误的ERR！
错误的ERR！ 有关更多信息，请参阅：
错误的ERR！<https://docs.npmjs.com/cli/install#limitations-of-npms-install-algorithm>

错误的ERR！ 可以在以下位置找到此运行的完整日志：

错误解决

根据翻译的内容提示说我们包安装名相同，elasticsearch-dump目录下有个package.json的文件，打开文件，将里面的name字段值换成和npm安装插件的名称不一致就行

[root@elasticsearch /data/elasticsearch-dump]# vim package.json 
{
  "author": "Evan Tahler <evantahler@gmail.com>",
  "name": "elasticdump1",				#随便改就行
	······
	
再次致谢npm install
[root@elasticsearch /data/elasticsearch-dump]# npm install elasticdump
npm WARN deprecated request@2.88.2: request has been deprecated, see https://github.com/request/request/issues/3142
npm WARN deprecated har-validator@5.1.5: this library is no longer supported
npm WARN deprecated s3signed@0.1.0: This module is no longer maintained. It is provided as is.
npm notice created a lockfile as package-lock.json. You should commit this file.
+ elasticdump@6.62.1
added 114 packages from 201 contributors in 37.994s

码农公寓