ProxySQL实现读写分离

环境说明:

IP 角色 应用 系统平台
192.168.92.131 读写分离解析主机 proxysql rhel8
192.168.92.129 master mysql rhel8
192.168.92.130 slave mysql rhel8

 

 

 

 

 

准备工作:

  • 关闭防火墙
  • 关闭SELINUX
  • 安装mysql并配置主从

安装mysql并配置主从

//授权(master)
[root@master ~]# mysql -uroot -p123456

mysql> grant replication slave on *.* to repl@192.168.92.130 identified by 123456;
Query OK, 0 rows affected, 1 warning (0.00 sec)

mysql> flush privileges;
Query OK, 0 rows affected (0.01 sec)

//连接测试(slave)
[root@slave ~]# mysql -urepl -p123456 -h192.168.92.129
mysql: [Warning] Using a password on the command line interface can be insecure.
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 7
Server version: 5.7.31 MySQL Community Server (GPL)

Copyright (c) 2000, 2020, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type help; or \h for help. Type \c to clear the current input statement.

mysql>

//更改配置文件(master)
[root@master ~]# vi /etc/my.cnf

[mysqld]
basedir=/usr/local/mysql
datadir=/opt/mydata
socket=/tmp/mysql.sock
port=3306
pid-file=/opt/mydata/mysql.pid
user=mysql
skip-name-resolve

server-id = 10
log-bin = mysql_bin

[root@master ~]# service mysqld restart
Shutting down MySQL.. SUCCESS! 
Starting MySQL. SUCCESS!

//更改配置文件(slave)
[root@slave ~]# vi /etc/my.cnf

[mysqld]
basedir=/usr/local/mysql
datadir=/opt/mydata
socket=/tmp/mysql.sock
port=3306
pid-file=/opt/mydata/mysql.pid
user=mysql
skip-name-resolve

server-id = 20
relay-log = myrelay

[root@slave ~]# service mysqld restart
Shutting down MySQL.. SUCCESS! 
Starting MySQL. SUCCESS!

//设置改变属主(slave)
mysql> change master to
    -> master_host=192.168.92.129,
    -> master_user=repl,
    -> master_password=123456,
    -> master_log_file=mysql_bin.000001,
    -> master_log_pos=154;
Query OK, 0 rows affected, 2 warnings (0.02 sec)

mysql> start slave;
Query OK, 0 rows affected (0.00 sec)

mysql> show slave status\G
。。。。。。
Slave_IO_Running: Yes
Slave_SQL_Running: Yes
。。。。。。

 

配置ProxySQL

 

mysql主库添加proxysql可以增删改查的账号

//授权(master)
mysql> grant all on *.* to proxysql@192.168.92.131 ideentified by porxysql;
Query OK, 0 rows affected, 1 warning (0.00 sec)

mysql> flush privileges;
Query OK, 0 rows affected (0.00 sec)

//连接测试(proxy SQL)
[root@proxysql ~]# mysql -uproxysql -pproxysql -h192.168.92.129
ERROR 1045 (28000): Access denied for user proxysql@192.168.92.131 (using password: YES)
[root@proxysql ~]# mysql -uproxysql -pporxysql -h192.168.92.129
Welcome to the MariaDB monitor.  Commands end with ; or \g.
Your MySQL connection id is 9
Server version: 5.7.31-log MySQL Community Server (GPL)

Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.

Type help; or \h for help. Type \c to clear the current input statement.

MySQL [(none)]> exit
Bye
[root@proxysql ~]# mysql -uproxysql -pporxysql -h192.168.92.130
Welcome to the MariaDB monitor.  Commands end with ; or \g.
Your MySQL connection id is 5
Server version: 5.7.31 MySQL Community Server (GPL)

Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.

Type help; or \h for help. Type \c to clear the current input statement.

MySQL [(none)]>

登录proxysql管理端

[root@proxysql ~]# export MYSQL_PS1="(\u@\h:\p) [\d]> "
[root@proxysql ~]# mysql -uadmin -padmin -P7777 -h127.0.0.1
Welcome to the MariaDB monitor.  Commands end with ; or \g.
Your MySQL connection id is 2
Server version: 5.5.30 (ProxySQL Admin Module)

Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.

Type help; or \h for help. Type \c to clear the current input statement.

(admin@127.0.0.1:7777) [(none)]>

proxysql管理端添加后端连接mysql主从数据库的配置

(admin@127.0.0.1:7777) [(none)]> insert into mysql_servers(hostgroup_id,hostname,port,weight,comment) values(100,192.168.92.129,3306,1,Write Group);
Query OK, 1 row affected (0.001 sec)

(admin@127.0.0.1:7777) [(none)]> insert into mysql_servers(hostgroup_id,hostname,port,weight,comment) values(200,192.168.92.130,3306,1,Read Group);
Query OK, 1 row affected (0.000 sec)

(admin@127.0.0.1:7777) [(none)]> select * from mysql_servers;
+--------------+----------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+-------------+
| hostgroup_id | hostname       | port | gtid_port | status | weight | compression | max_connections | max_replication_lag | use_ssl | max_latency_ms | comment     |
+--------------+----------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+-------------+
| 100          | 192.168.92.129 | 3306 | 0         | ONLINE | 1      | 0           | 1000            | 0                   | 0       | 0              | Write Group |
| 200          | 192.168.92.130 | 3306 | 0         | ONLINE | 1      | 0           | 1000            | 0                   | 0       | 0              | Read Group  |
+--------------+----------------+------+-----------+--------+--------+-------------+-----------------+---------------------+---------+----------------+-------------+
2 rows in set (0.000 sec)

//修改后,需要加载到RUNTIME,并保存到disk
(admin@127.0.0.1:7777) [(none)]> load mysql servers to runtime;
Query OK, 0 rows affected (0.006 sec)

(admin@127.0.0.1:7777) [(none)]> save mysql servers to disk;
Query OK, 0 rows affected (0.071 sec)

 在 proxysql 主机的 mysql_users 表中添加刚才在 master 上创建的账号 proxysql,proxysql 客户端需要使用这个账号来访问数据库
default_hostgroup 默认组设置为写组,也就是100;
当读写分离的路由规则不符合时,会访问默认组的数据库;

(admin@127.0.0.1:7777) [(none)]> insert into mysql_users(username,password,default_hostgroup,transaction_persistent) values(proxysql,proxysql,100,1);
Query OK, 1 row affected (0.000 sec)

(admin@127.0.0.1:7777) [(none)]> select * from mysql_users \G
*************************** 1. row ***************************
              username: proxysql      用户名
              password: proxysql      密码
                active: 1             是否启用账户
               use_ssl: 0             
     default_hostgroup: 100           默认主
        default_schema: NULL
         schema_locked: 0
transaction_persistent: 1
          fast_forward: 0
               backend: 1
              frontend: 1
       max_connections: 10000         最大连接数
            attributes: 
               comment: 
1 row in set (0.000 sec)

//保存到dixk
(admin@127.0.0.1:7777) [(none)]> load mysql users to runtime;
Query OK, 0 rows affected (0.001 sec)

(admin@127.0.0.1:7777) [(none)]> save mysql users to disk;
Query OK, 0 rows affected (0.010 sec)

 

添加健康检测的帐号

在mysql的 master 端添加属于proxysql的只读账号

mysql> grant select on *.* to monitor@192.168.92.% identified by monitor;
Query OK, 0 rows affected, 1 warning (0.00 sec)

mysql> flush privileges;
Query OK, 0 rows affected (0.00 sec)

在proxysql主机端修改变量设置健康检测的账号

(admin@127.0.0.1:7777) [(none)]> set mysql-monitor_username=monitor;
Query OK, 1 row affected (0.000 sec)

(admin@127.0.0.1:7777) [(none)]> set mysql-monitor_password=monitor;
Query OK, 1 row affected (0.000 sec)

(admin@127.0.0.1:7777) [(none)]> load mysql variables to runtime;
Query OK, 0 rows affected (0.002 sec)

(admin@127.0.0.1:7777) [(none)]> save mysql variables to disk;
Query OK, 140 rows affected (0.005 sec)

 

添加读写分离的路由规则

需求:

  • 将 select 查询语句全部路由至 hostgroup_id=2 的组(也就是读组)
  • 但是 select * from tb for update 这样的语句是会修改数据的,所以需要单独定义,将它路由至 hostgroup_id=1 的组(也就是写组)
  • 其他没有被规则匹配到的组将会被路由至用户默认的组(mysql_users 表中的 default_hostgroup)
(admin@127.0.0.1:7777) [(none)]> insert into mysql_query_rules(rule_id,active,match_digest,destination_hostgroup,apply) values(100,1,^SELECT.*FOR UPDATE$,100,1);
Query OK, 1 row affected (0.001 sec)

(admin@127.0.0.1:7777) [(none)]> insert into mysql_query_rules(rule_id,active,match_digest,destination_hostgroup,apply) values(200,1,^SELECT,200,1);
Query OK, 1 row affected (0.000 sec)

(admin@127.0.0.1:7777) [(none)]> select rule_id,active,match_digest,destination_hostgroup,apply from mysql_query_rules;
+---------+--------+----------------------+-----------------------+-------+
| rule_id | active | match_digest         | destination_hostgroup | apply |
+---------+--------+----------------------+-----------------------+-------+
| 100     | 1      | ^SELECT.*FOR UPDATE$ | 100                   | 1     |
| 200     | 1      | ^SELECT              | 200                   | 1     |
+---------+--------+----------------------+-----------------------+-------+
2 rows in set (0.000 sec)

(admin@127.0.0.1:7777) [(none)]> load mysql query rules to runtime;
Query OK, 0 rows affected (0.001 sec)

(admin@127.0.0.1:7777) [(none)]> save mysql query rules to disk;
Query OK, 0 rows affected (0.034 sec)

 

验证读写分离

登录 proxysql 客户端

登录用户是刚才我们在 mysql_user 表中创建的用户,端口为6033

[root@proxysql ~]# mysql -uproxysql -pproxysql -h127.0.0.1 -P6033
Welcome to the MariaDB monitor.  Commands end with ; or \g.
Your MySQL connection id is 5
Server version: 5.5.30 (ProxySQL)

Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.

Type help; or \h for help. Type \c to clear the current input statement.

(proxysql@127.0.0.1:6033) [(none)]> show databases;
+--------------------+
| Database           |
+--------------------+
| information_schema |
| mysql              |
| performance_schema |
| school             |
| sys                |
+--------------------+
5 rows in set (0.006 sec)

 

尝试修改数据库和查询

创建2个数据库并查询一下表

(proxysql@127.0.0.1:6033) [(none)]> create database jinxinruntian;
Query OK, 1 row affected (0.007 sec)

(proxysql@127.0.0.1:6033) [(none)]> create database wangqing;
Query OK, 1 row affected (0.004 sec)

(proxysql@127.0.0.1:6033) [(none)]> select user,host from mysql.user;
+---------------+----------------+
| user          | host           |
+---------------+----------------+
| monitor       | 192.168.92.%   |
| repl          | 192.168.92.130 |
| proxysql      | 192.168.92.131 |
| mysql.session | localhost      |
| mysql.sys     | localhost      |
| root          | localhost      |
+---------------+----------------+
6 rows in set (0.003 sec)

 

验证读写分离是否成功

proxysql有个类似审计的功能,可以查看各类SQL的执行情况,其需要在proxysql管理端执行

(admin@127.0.0.1:7777) [(none)]> select * from stats_mysql_query_digest\G
*************************** 1. row ***************************
        hostgroup: 200
       schemaname: information_schema
         username: proxysql
   client_address: 
           digest: 0x0F02B330C823D739
      digest_text: select user,host from mysql.user
       count_star: 1
       first_seen: 1623022307
        last_seen: 1623022307
         sum_time: 2953
         min_time: 2953
         max_time: 2953
sum_rows_affected: 0
    sum_rows_sent: 6
*************************** 2. row ***************************
        hostgroup: 100
       schemaname: information_schema
         username: proxysql
   client_address: 
           digest: 0xCE6BB7764BA98E04
      digest_text: create database jinxinruntian
       count_star: 1
       first_seen: 1623022295
        last_seen: 1623022295
         sum_time: 6590
         min_time: 6590
         max_time: 6590
sum_rows_affected: 1
    sum_rows_sent: 0
*************************** 3. row ***************************
        hostgroup: 100
       schemaname: none
         username: proxysql
   client_address: 
           digest: 0x99531AEFF718C501
      digest_text: show tables
       count_star: 1
       first_seen: 1623022281
        last_seen: 1623022281
         sum_time: 28595
         min_time: 28595
         max_time: 28595
sum_rows_affected: 0
    sum_rows_sent: 0
*************************** 4. row ***************************
        hostgroup: 200
       schemaname: school
         username: proxysql
   client_address: 
           digest: 0x620B328FE9D6D71A
      digest_text: SELECT DATABASE()
       count_star: 1
       first_seen: 1623022281
        last_seen: 1623022281
         sum_time: 2763
         min_time: 2763
         max_time: 2763
sum_rows_affected: 0
    sum_rows_sent: 1

从上面的 hostgroup 和 digest_text 值来看,所有的写操作都被路由至100组,读操作都被路由至200组,其中100组为写组,200组为读组!

 

ProxySQL实现读写分离

上一篇:SQLServer中char、varchar、nchar、nvarchar的区别(搬运):


下一篇:Centos 下操作Mysql入门级指令