[Warning] InnoDB: Difficult to Find Free Blocks in the Buffer Pool

MySQL错误日志给出警告信息:

[Warning] InnoDB: Difficult to find free blocks in the buffer pool (336 search iterations)! 0 failed attempts to flush a page! Consider increasing the buffer pool size. It is also possible that in your Unix version fsync is very slow, or completely frozen inside the OS kernel. Then upgrading to a newer version of your operating system may help. Look at the number of fsyncs in diagnostic info below. Pending flushes (fsync) log: 0; buffer pool: 0. 1621989850 OS file reads, 1914021664 OS file writes, 110701569 OS fsyncs. Starting InnoDB Monitor to print further diagnostics to the standard output.

2019-10-26T15:02:03.962059Z 4520929 [Warning] InnoDB: Difficult to find free blocks in the buffer pool (337 search iterations)! 0 failed attempts to flush a page! Consider increasing the buffer pool size. It is also possible that in your Unix version fsync is very slow, or completely frozen inside the OS kernel. Then upgrading to a newer version of your operating system may help. Look at the number of fsyncs in diagnostic info below. Pending flushes (fsync) log: 0; buffer pool: 0. 1621989850 OS file reads, 1914021664 OS file writes, 110701569 OS fsyncs. Starting InnoDB Monitor to print further diagnostics to the standard output.

当InnoDB中的线程不断地请求空闲块,但无法从buffer pool中获得空闲块的时候,就会出现上面的警告消息。实际中,并不是这么简单,可能还有其他事情发生,懂得如何构建buffer pool中的块,就可以轻松的明白。

 

buffer pool主要由三个列表组成:

1.free list:空闲列表,线程可以从磁盘读入数据到列表中的页

2.lru list:最近最少使用列表

3.flush list:脏的或被修改的页的列表

 

正如我们所知,每个请求都是有InnoDB中的线程来处理。如果所需的页在buffer pool中不可用,则必须从磁盘中读取它并将其放入其中,为此需要从空闲列表(free list)中分配一个空闲块。空闲块只能从空闲列表中获取,所以需要空闲块的线程会经历以下的迭代过程:

·从free list中寻找一个空闲的块,如果有可用就分配它。如果不是,继续。

·扫描lru列表,如果找到干净(clean)的块,就将块移动到free list中,并分配。如果没有,继续。

·从lru列表的尾部刷新脏页,将其移动到free list,并分配。

这里是简化的步骤,只是为了便于理解,实际并不是这么简单,但类似。在任何时刻,如果块被移动到free list,就可以被任何线程使用,就可能使得当前的线程无法获取到块。当前线程就会每间隔10ms执行一次请求。

 

那什么时候会将警告信息写入日志呢?

 当一个线程执行超过20迭代,就会将警告信息写入日志。下面是对应的源码块:

if (n_iterations > 20 & & srv_buf_pool_old_size == srv_buf_pool_size) {< strong > <= == == == Here it is < / strong >
ib::
    warn(ER_IB_MSG_134)     << "Difficult to find free blocks in the buffer pool"        " ("     << n_iterations << " search iterations)! " << flush_failures     << " failed attempts to"        " flush a page! Consider increasing the buffer pool"        " size. It is also possible that in your Unix version"        " fsync is very slow, or completely frozen inside"        " the OS kernel. Then upgrading to a newer version"        " of your operating system may help. Look at the"        " number of fsyncs in diagnostic info below."        " Pending flushes (fsync) log: "

  

遇到这种警告,可能是由很多原因造成的,以下的一些清单可以用来确认原因。尽管它已经多次使IO子系统饱和,但它不可能对每个实例和工作负载都相同的。

·IO子系统慢,不能满足需要及时将页刷新到磁盘

·page cleaner线程数量不够

·buffer pool本身太小,从而导致free list和lru list都小

 

常用的解决方法有:

1.增加buffer pool

2.调优、升级IO子系统

3.优化sql,避免全表/全索引扫描

[Warning] InnoDB: Difficult to Find Free Blocks in the Buffer Pool

上一篇:Spark SQL | 目前Spark社区最活跃的组件之一


下一篇:java连接mysql数据库的五种方式