注:Gitlab是一个git服务程序,有web图形界面和一系列管理工具,具体详细介绍可以Google it。
这一篇可以说是上一篇《Linux Shell脚本之Atlassian confluence远程备份方法》的姊妹篇。其说明和原理是和上一篇是一样的,其核心原理都是core dump、scp、ssh和find+rm,但也有不同。
1.Gitlab本身提供了较好的备份方法,只是一个命令那么简单,并且它也支持远程备份(远程存储和云存储),例如它可以存储到aws的s3上。
2.本脚本运行在Gitlab服务器上,不在备机上,上一篇的脚本是与运行在备机上。
脚本如下:
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
|
#!/bin/bash # This shell script will execute on A Server # SHELL=/bin/bash # PATH=/sbin:/bin:/usr/sbin:/usr/bin # MAILTO=root # HOME=/ # For details see man 4 crontabs # Example of job definition: # .---------------- minute (0 - 59) # | .------------- hour (0 - 23) # | | .---------- day of month (1 - 31) # | | | .------- month (1 - 12) OR jan,feb,mar,apr ... # | | | | .---- day of week (0 - 6) (Sunday=0 or 7) OR sun,mon,tue,wed,thu,fri,sat # | | | | | # * * * * * user-name command to be executed # m h dom mon dow command # execute on 11:59 per sunday # 59 11 * * */0 $0 >/tmp/gitlab_backup_$(date -d "yesterday" +"%Y%m%d%H%M%S").log # execute on 23:59 per day # 59 23 * * * $0 >/tmp/gitlab_backup_$(date -d "yesterday" +"%Y%m%d%H%M%S").log # xxx.xxx.xxx.xxx xxx.xxx.xxx.xxx # | ssh tunnel | # xxx.xxx.xxx.xxx <==========> xxx.xxx.xxx.xxx # | | # ----------+-----------------------------+------- # | | # +-----+-----+ +------+------+ # | A | | B | # +-----------+ +-------------+ # gitlab server backups clinet # # A and B passed ssh Authentication # A-->B: ssh lan_ip # A-->B: ssh wan_ip # B-->A: ssh lan_ip # B-->A: ssh wan_ip # A-->A: ssh lan_ip # A-->A: ssh wan_ip # B-->B: ssh lan_ip # B-->B: ssh wan_ip # Run as root, of course. [ $UID - eq 0 ] || ( echo "Must be root to run this script." && exit 1 )
save_days=5 [ $? - eq 1 ] && exit 1
gitlab_internal_backup_directory= /data/var/opt/gitlab/backups
# if you have both wan ip and lan ip, you can fill it with all, if you have one ip, you can fill it just with lan ip backup_server_ipaddress_public=xxx.xxx.xxx.xxx backup_server_ipaddress_private=xxx.xxx.xxx.xxx # select lan ip first for transmission speed backup_server_hostname=${backup_server_ipaddress_private:-$backup_server_ipaddress_public} backup_server_ssh_username=root #backup_server_ssh_port=$(awk '/Port/ {print $2}' /etc/ssh/sshd_config) backup_server_ssh_port=$( netstat -anop | awk '/sshd/ && /LISTEN/ {print $4}' | awk -F ':' '{print $2}' )
backup_server_ssh_hostname=$backup_server_hostname backup_path= /data/gitlab_backup_directory
backup_path_time_uniq=$( date -d "yesterday" + "%Y%m%d" )
[ -d $backup_path/$backup_path_time_uniq ] || mkdir -p $backup_path/$backup_path_time_uniq
# sudo -u gitlab_ci -H bundle exec rake backup:create RAILS_ENV=production echo "GitLab is executing backup operation, please hold on! "
/data/opt/gitlab/bin/gitlab-rake gitlab:backup:create >$backup_path/$backup_path_time_uniq/$( date -d "yesterday" + "%Y%m%d" ).log 2>&1
[ $? - ne 0 ] && echo "Local backup failed! " && exit 1; echo "Local backup successfully! "
backuped_tar_file=` awk '/gitlab_backup.tar/ {print $4}' $backup_path /backup_path_time_uniq/ $( date -d "yesterday" + "%Y%m%d" ).log`
[ -f $gitlab_internal_backup_directory/$backuped_tar_file ] && echo "Find backuped tar file successfully! "
ssh $backup_server_ssh_username@$backup_server_ssh_hostname [ -d $backup_path/$backup_path_time_uniq ] || mkdir -p $backup_path/$backup_path_time_uniq
[ $? - ne 0 ] && echo "Remote backup directory creation failed! " && exit 1; echo "Remote backup directory creation successfully! "
scp -P$port $gitlab_internal_backup_directory/$backuped_tar_file $backup_server_ssh_username@$backup_server_ssh_hostname:$backup_path/$backup_path_time_uniq
[ $? - ne 0 ] && echo "Remote backup transmission failed! " && exit 1; echo "Remote backup transmission successfully! "
find $gitlab_internal_backup_directory -mtime +$save_days - exec rm -rf {} \;
[ $? - ne 0 ] && echo "Local expired backup remove skipped! " ; echo "Local expired backup remove successfully! "
find $backup_path -mtime +$save_days - exec rm -rf {} \;
[ $? - ne 0 ] && echo "Local expired tempdir remove skipped! " ; echo "Local expired tempdir remove successfully! "
ssh $backup_server_ssh_username@$backup_server_ssh_hostname find $backup_path -mtime +$save_days - exec rm -rf {} \;
[ $? - ne 0 ] && echo "Remote expired backup remove skipped! " ; echo "Remote expired backup remove successfully! "
|
参考:
GitLab.org / GitLab Community Edition / Backup restore https://gitlab.com/gitlab-org/gitlab-ce/blob/master/doc/raketasks/backup_restore.md
GitLab.org / GitLab CI / Backup restore https://gitlab.com/gitlab-org/gitlab-ci/blob/master/doc/raketasks/backup_restore.md
tag:Gitlab备份脚本,Gitlab备份方法,如何备份Gitlab,远程备份Gitlab,远程备份脚本
--end--
本文转自 urey_pp 51CTO博客,原文链接:http://blog.51cto.com/dgd2010/1686043,如需转载请自行联系原作者