功能介绍：
该脚本用于定期（结合crontab一起使用）将本地目录通过rsync+ssh传输到远程服务器，每次执行都生成一个带有以时间命名的目录，并且当前最新版本的数据链接到一个名字叫current的符号链接上，便于查找和恢复。在数据传输完成前，会传输到临时目录下，这个临时目录被命名为“时间-incomplete”。超过10天的备份将被删除，超过10天的日志文件也将被删除。
运行原理：
脚本运行的核心就在于ssh的互信和rsync命令。利用rsync能实现压缩传输，节省传输时间。
感谢：
脚本内容：
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
|
#!/usr/bin/env bash# Function description:# Backup filesystem using rsync# Usage:# bash backup.sh# Birth Time:# 2016-07-15 16:13:43.895515929 +0800# Author:# Open Source Software written by 'Guodong Ding <dgdenterprise@gmail.com>'# Blog: http://dgd2010.blog.51cto.com/# Github: https://github.com/DingGuodong# Others:# crontabs -- configuration and scripts for running periodical jobs# SHELL=/bin/bash# PATH=/sbin:/bin:/usr/sbin:/usr/bin# MAILTO=root# HOME=/# For details see man 4 crontabs# Example of job definition:# .---------------- minute (0 - 59)# | .------------- hour (0 - 23)# | | .---------- day of month (1 - 31)# | | | .------- month (1 - 12) OR jan,feb,mar,apr ...# | | | | .---- day of week (0 - 6) (Sunday=0 or 7) OR sun,mon,tue,wed,thu,fri,sat# | | | | |# * * * * * user-name command to be executed# m h dom mon dow command# execute on 11:59 per sunday# 59 11 * * */0 bash /path/to/backup.sh >/tmp/log_backup_fs_crontab_$(date +"\%Y\%m\%d\%H\%M\%S").log# or# execute on 23:59 per day# 59 23 * * * bash /path/to/backup.sh >/tmp/log_backup_fs_crontab_$(date +"\%Y\%m\%d\%H\%M\%S").logUSER="`id -un`"
LOGNAME="$USER"
if [ $UID -ne 0 ]; then
echo "WARNING: Running as a non-root user, \"$LOGNAME\". Functionality may be unavailable. Only root can use some commands or options"
fiold_PATH=$PATHdeclare -x PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games"
# Snapshot backup script# Refer: https://github.com/gregrs-uk/snapshot-backup/# directories to backup, separated by spacesdatadir_to_backup="/data/docker"
# backup location on remote server# This path should not contain spaces, even if they are escapedremote_destination="/data/backup/filesystem/10.6.28.135"
# ssh login to remote serverbackup_server="root@10.6.28.28"
# set ssh options for backup serverssh_option="-i /etc/ssh/ssh_host_rsa_key -p 22 -oStrictHostKeyChecking=no"
# log dir on local machine#log_directory="/tmp/backup-filesystem-10.6.28.135"log_directory="/tmp/"
# exclude file on local machineexclude=""
# ------ END OF CONFIGURATION VARIABLES ------# the following two variables should not need modificationdatetime=`date +%Y%m%d%H%M%S`
date=`date +%Y%m%d`
# set log_directory for local backup logstest -d ${log_directory} || mkdir -p ${log_directory}
# check directories exist and are accessiblessh ${ssh_option} ${backup_server} "test -e $remote_destination || mkdir -p $remote_destination"
# make directory for this snapshotssh ${ssh_option} ${backup_server} "mkdir $remote_destination/$datetime-incomplete" || { echo "Could not create snapshot directory"; exit 1; }
# Refer:#rsync -u -r -v -e ssh --progress --delete --chmod=D775 /path/to/documents/* your_server_name@your_domain:~/public_html/documents/ --exclude=.htaccess --exclude=.htaccess~#rsync -azurR -e "ssh -i /etc/ssh/ssh_host_rsa_key -p 22 -oStrictHostKeyChecking=no" --log-file=/tmp/rsync.log --delete --delete-excluded testdir 10.6.28.28:/data/backup/filesystem/10.6.28.135# do the rsync# -a, --archive archive mode; equals -rlptgoD (no -H,-A,-X)# -r, --recursive recurse into directories# -R, --relative use relative path names# -u, --update skip files that are newer on the receiver# -z, --compress compress file data during the transferrsync -azurR \
-e "ssh $ssh_option" \
--log-file=${log_directory}/backup_filesystem_rsync_${datetime}.log \
--delete --delete-excluded \
${datadir_to_backup} \
${backup_server}:${remote_destination}/${datetime}-incomplete/
# change name of directory once rsync is completessh ${ssh_option} ${backup_server} "mv $remote_destination/$datetime-incomplete $remote_destination/$datetime" || { echo "Could not rename directory after rsync"; exit 1; }
# link current to this backupssh ${ssh_option} ${backup_server} "test ! -d $remote_destination/current || rm -f $remote_destination/current" || { echo "Could not remove current backup link"; exit 1; }
ssh ${ssh_option} ${backup_server} "ln -s $remote_destination/$datetime $remote_destination/current" || { echo "Could not create current backup link"; exit 1; }
# remove backups older than 10 daysssh ${ssh_option} ${backup_server} "find $remote_destination/* -maxdepth 0 -type d -mtime +10 -exec rm -rf {} \;" || { echo "Could not remove old backups"; exit 1; }
# remove local log files older than 10 daysfind ${log_directory}/* -maxdepth 0 -type f -name *.log -mtime +10 -exec rm -rf '{}' \; || { echo "Could not remove old log files"; exit 1; }
declare -x PATH=${old_PATH}
|
tag:Linux备份,远程备份,rsync备份
--end--
本文转自 urey_pp 51CTO博客，原文链接：http://blog.51cto.com/dgd2010/1826915，如需转载请自行联系原作者