PostgreSQL 回归测试

回归测试是Postgresql的测试方法之一。

回归测试，需要事先定义好测试脚本（通常是sql脚本，放在sql目录中），同时定义好调用执行测试脚本的预期正确输出文件（通常放在expected目录中)。

测试使用make check或make installcheck进行，它会通过pg_regress程序调用 sql目录中的sql，并收集输出结果（通常放到results目录中），最后pg_regress会对expected目录和results目录中的文件使用diff进行一一比较。

如果比较发现文件内容不一致，会将不一致的结果输出到regression.diffs文件中，并返回这个TEST CASE Failed。

但是这种测试方法实际上有一些需要注意的地方，例如我们使用不同的本地化设置，时区可能得到的结果和期望的结果就不一样。另外有些不可预知的结果，例如随机值，数据的顺序，执行计划和优化器相关参数有关。这些因素都可能导致测试结果和预期不一致，那么我们就需要人为去修复这种Failed。

Postgresql的主代码测试文件在src/test/regress目录中。

这个目录的结构如下：

postgres@digoal-> ll -rt

total 1.2M

rwr-- 1 postgres postgres 579 Jun1003:29 standby_schedule 测试standby的调度配置, 其实就是调度sql里的文件名

2.3K serial_schedule 串行测试的调度配置

937 resultmap 不同的测试平台的结果映射文件，因为不同平台某些测试结果可能不相同，所以一个expected文件不能支持所有的平台。例如浮点数测试。

rwxrxrx 4.4K regressplans.sh

20K regressc

159 README

2.7K pg_regress_main1.6K pg_regressh

69K3.6K parallel_schedule 并行测试的调度配置

624Makefile

5.6KGNUmakefile

drwxrwxrwx24.0K38 output

drwxrwxrwx input

data 一些测试数据

Sep71451 sql 测试用到的sql

drwxrwxr52 results 通过pg_regress调用目录中的脚本，得到的结果

expected 执行目录中的文件对应的正确返回结果

上层目录结构如下，其中包含了一些其他的测试目标，例如隔离级别的测试，本地化测试，性能测试，线程安全测试。等。

cd /optsoft_bakpostgresql-9.4.4srctest

36K

examples

441 isolation

6 locale

389Makefile

performance

perl

1917 regress

thread

接下来我们看看Postgresql的回归测试程序pg_regress的用法，它不会安装到PGHOME/bin中，只在src/test/regress中存在。

$ cd srctestregress

$ srcregresspg_regress help

Postgresql regression test driver

Usage:

pg_regress [OPTION]...EXTRATEST]...

Optionsconfigauth=DATADIR update authentication settings for DATADIR

createroleROLE create the specified role before testing

dbnameDB use database DB (default "regression")

debug turn on debug mode in programs that are run

dlpathDIR look dynamic libraries DIR

encodingENCODING ENCODING as the encoding

inputdirDIR take input files from DIR "."launcherCMD CMD launcher of psql

loadextensionEXT load the named extension before running the

tests; can appear multiple times

languageLANG load the named language before running the

maxconnectionsN maximum number of concurrent connections

is0,0)"> meaning unlimitedoutputdirDIR place output files scheduleFILE test ordering schedule FILE

(can be used multiple times to concatenatetempinstallDIR create a temporary installation --useexisting an existing installation

Options"temp-install" modeextraDIR additional directory to install eg.,0)"> contribnolocale C locale

portPORT start postmaster on PORT

FILE append contents of FILE to temporary config

topbuilddirDIR relative) path to top level build directory

using an existing installationhostHOST postmaster running on HOST

PORT postmaster running at PORT

userUSER connect USER

psqldirDIR psql default: configured bindir)

Theexit status 0if all tests passed some tests Failedand2

if the tests Could not be run some reason.

Report bugs to <pgsqlbugs@postgresqlorg>.

# ----------

# src/test/regress/parallel_schedule

# By convention,we put no more than twenty tests in any one parallel group;

# this limits the number of connections needed to run the tests.

# ----------

# run tablespace by itself,and first,because it forces a checkpoint;

# we'd prefer not to have checkpoints later in the tests because that

# interferes with crash-recovery testing.

test: tablespace

# The first group of parallel tests

test: boolean char name varchar text int2 int4 int8 oid float4 float8 bit numeric txid uuid enum money rangetypes pg_lsn regproc

# contrib/ltree/Makefile

MODULE_big ltree

OBJS o ltree_opo lquery_opo _ltree_opo crc32o \

ltxtquery_ioo ltxtquery_opo ltree_gisto _ltree_gisto

PG_CPPFLAGS DLOWER_NODE

EXTENSION DATA sql ltreesql

REGRESS ltree

ifdef USE_PGXS

PG_CONfig pg_config

PGXS := $shell $PG_CONfigpgxs)

include $PGXSelse

subdir ltree

top_builddir ../..

top_builddir)//Makefileglobal

top_srcdircontrib-globalmk

endif

ifdef REGRESS

# Select database to use for running the tests

ifneq ($(USE_MODULE_DB),)

REGRESS_OPTS += --dbname=$(CONTRIB_TESTDB_MODULE)

else

REGRESS_OPTS += --dbname=$(CONTRIB_TESTDB)

endif

# where to find psql for running the tests

PsqlDIR = $(bindir)

# When doing a VPATH build,must copy over the data files so that the

# driver script can find them. We have to use an absolute path for

# the targets,because otherwise make will try to locate the missing

# files using VPATH,and will find them in $(srcdir),but the point

# here is that we want to copy them from $(srcdir) to the build

# directory.

ifdef VPATH

abs_builddirshell pwdtest_files_src wildcard $srcdirdata/*.data)

test_files_build := $(patsubst $(srcdir)/%,$(abs_builddir)/%,$(test_files_src))

all: $(test_files_build)

$(test_files_build): $(abs_builddir)/%: $(srcdir)/%

$(MKDIR_P) $(dir $@)

ln -s $< $@

endif # VPATH

.PHONY: submake

submake:

ifndef PGXS

$(MAKE) -C $(top_builddir)/src/test/regress pg_regress$(X)

# against installed postmaster

installcheck: submake $(REGRESS_PREP)

$(pg_regress_installcheck) $(REGRESS_OPTS) $(REGRESS)

ifdef PGXS

check:

@echo '"$(MAKE) check" is not supported.'

@echo 'Do "$(MAKE) install",then "$(MAKE) installcheck" instead.'

check: all submake $(REGRESS_PREP)

$(pg_regress_check) --extra-install=$(subdir) $(REGRESS_OPTS) $(REGRESS)

endif

endif # REGRESS

PostgreSQL 回归测试

相关推荐