作者:雷霞

爱可生测试团队负责人,专注于 MySQL 相关的测试工作。

本文来源:原创投稿

*爱可生开源社区出品,原创内容未经授权不得随意使用,转载请联系小编并注明来源。

什么是 MySQL Test?

MySQL Test 是 MySQL 发行版本中集成 all-in-one 测试框架,用于做 mysql 服务的单元,回归和一致性测试,并提供了运行单元测试和创建新单元测试的工具。
框架包括一组测试用例和用于运行它们的程序:perl 脚本(mysql-test-run.pl)和 c++ 二进制(mysqltest)。
  • perl 脚本:负责控制流程,包括启停、识别执行哪些用例、创建文件夹、收集结果等操作。

  • mysqltest:负责执行测试用例,包括读文件,解析特定语法,执行用例。

安装环境

OS:Ubuntu 18.04.1 LTS

1. 下载 MySQL 源码包

本文采用的 MySQL 版本是 5.7.26,可根据需要自行选择版本。
  1. wget https://dev.mysql.com/get/Downloads/MySQL-5.7/mysql-5.7.26.tar.gz

2. 安装编译 MySQL 源码所需依赖包

  1. apt install make cmake gcc g++ perl \

  2. bison libaio-dev libncurses5 \

  3. libncurses5-dev libnuma-dev

如上步操作失败或速度过慢,可修改 /etc/apt/sources.list 换成国内的源。
  1. deb https://mirrors.ustc.edu.cn/ubuntu/ bionic main restricted universe multiverse

  2. deb-src https://mirrors.ustc.edu.cn/ubuntu/ bionic main restricted universe multiverse

  3. deb https://mirrors.ustc.edu.cn/ubuntu/ bionic-updates main restricted universe multiverse

  4. deb-src https://mirrors.ustc.edu.cn/ubuntu/ bionic-updates main restricted universe multiverse

  5. deb https://mirrors.ustc.edu.cn/ubuntu/ bionic-backports main restricted universe multiverse

  6. deb-src https://mirrors.ustc.edu.cn/ubuntu/ bionic-backports main restricted universe multiverse

  7. deb https://mirrors.ustc.edu.cn/ubuntu/ bionic-security main restricted universe multiverse

  8. deb-src https://mirrors.ustc.edu.cn/ubuntu/ bionic-security main restricted universe multiverse

  9. deb https://mirrors.ustc.edu.cn/ubuntu/ bionic-proposed main restricted universe multiverse

  10. deb-src https://mirrors.ustc.edu.cn/ubuntu/ bionic-proposed main restricted universe multiverse

3. 安装 boost 1.59

需要安装 boost 1.59 版本,系统默认的 1.65 版本不可用。
  1. wget https://sourceforge.net/projects/boost/files/boost/1.59.0/boost_1_59_0.tar.gz

  2. ./bootstrap.sh

  3. ./b2 install

4. 配置编译安装

  1. cmake . -DBUILD_CONFIG=mysql_release -DCPACK_MONOLITHIC_INSTALL=ON -DCMAKE_INSTALL_PREFIX=/usr/local/mysql -DDEFAULT_CHARSET=utf8 -DDEFAULT_COLLATION=utf8_general_ci -DMYSQLX_TCP_PORT=33060 -DMYSQL_UNIX_ADDR=/usr/local/mysql/mysql.sock -DMYSQL_TCP_PORT=3306 -DMYSQLX_UNIX_ADDR=/usr/local/mysql/mysqlx.sock -DMYSQL_DATADIR=/usr/local/mysql/data -DSYSCONFDIR=/usr/local/mysql/etc -DENABLE_DOWNLOADS=ON -DWITH_BOOST=system


  2. make -j4

  3. make install

编译完成后,在 MySQL 安装目录生成如下目录结构。
  1. drwxr-xr-x 2 root root 4096 Feb 12 04:24 collections/

  2. drwxr-xr-x 4 root root 4096 Feb 12 04:24 extra/

  3. drwxr-xr-x 2 root root 40960 Feb 12 04:24 include/

  4. drwxr-xr-x 4 root root 4096 Feb 12 04:24 lib/

  5. -rw-r--r-- 1 root root 836 Apr 13 2019 lsan.supp

  6. lrwxrwxrwx 1 root root 19 Feb 12 04:24 mtr -> ./mysql-test-run.pl*

  7. -rwxr-xr-x 1 root root 36862 Apr 13 2019 mysql-stress-test.pl*

  8. lrwxrwxrwx 1 root root 19 Feb 12 04:24 mysql-test-run -> ./mysql-test-run.pl*

  9. -rwxr-xr-x 1 root root 220158 Apr 13 2019 mysql-test-run.pl*

  10. drwxr-xr-x 2 root root 65536 Feb 16 10:22 r/

  11. drwxr-xr-x 7 root root 12288 Feb 12 04:24 std_data/

  12. drwxr-xr-x 46 root root 4096 Feb 12 04:24 suite/

  13. drwxr-xr-x 2 root root 77824 Feb 16 10:22 t/

  14. -rw-r--r-- 1 root root 29730 Apr 13 2019 valgrind.supp

  15. drwxr-xr-x 9 root root 4096 Mar 5 08:40 var/

测试示例

我们通过一个最简单的例子来说明这个框架是怎么使用的。

1. 创建测试用例

mysql-test/t 目录下创建一个文件名为 action_1st.test 的文件,
  1. root@ubuntu:/usr/local/mysql/mysql-test# vim t/action_1st.test

  2. --disable_warnings

  3. DROP TABLE IF EXISTS t1;

  4. SET @@sql_mode='NO_ENGINE_SUBSTITUTION';

  5. --enable_warnings


  6. SET SQL_WARNINGS=1;


  7. CREATE TABLE t1 (a INT);

  8. INSERT INTO t1 VALUES (1);

  9. INSERT INTO t1 VALUES (2);


  10. DROP TABLE t1;

/mysql-test/r 目录下创建一个 action_1st.resul 的文件,
  1. root@ubuntu:/usr/local/mysql/mysql-test# vim r/action_1st.result

  2. DROP TABLE IF EXISTS t1;

  3. SET @@sql_mode='NO_ENGINE_SUBSTITUTION';

  4. SET SQL_WARNINGS=1;

  5. CREATE TABLE t1 (a INT);

  6. INSERT INTO t1 VALUES (1);

  7. INSERT INTO t1 VALUES (2);

  8. DROP TABLE t1;

2. 执行并查看运行效果

执行测试用例,
  1. root@ubuntu:/usr/local/mysql/mysql-test# ./mtr action_1st.test

  2. Logging: ./mtr action_1st.test

  3. MySQL Version 5.7.26

  4. Checking supported features...

  5. - SSL connections supported

  6. Collecting tests...

  7. Checking leftover processes...

  8. Removing old var directory...

  9. Creating var directory '/usr/local/mysql/mysql-test/var'...

  10. Installing system database...

  11. Using parallel: 1


  12. ==============================================================================


  13. TEST RESULT TIME (ms) or COMMENT

  14. --------------------------------------------------------------------------


  15. worker[1] Using MTR_BUILD_THREAD 300, with reserved ports 13000..13009

  16. worker[1] mysql-test-run: WARNING: running this script as _root_ will cause some tests to be skipped

  17. [100%] main.action_1st [ pass ] 12

  18. --------------------------------------------------------------------------

  19. The servers were restarted 0 times

  20. Spent 0.012 of 4 seconds executing testcases


  21. Completed: All 1 tests were successful.

测试用例运行时,mysqltest 会将 mysql-test/t/action_1st.test 的执行结果与 mysql-test/r/action_1st.result 作差异对比 diff。如果预期结果与实际结果不同,测试用例失败,如上图所示,测试用例的执行结果与预期结果一致。