Meta-test suite Donovan Kolbly (09 Mar 2005 17:54 UTC)
Re: Meta-test suite Per Bothner (09 Mar 2005 19:19 UTC)
Re: Meta-test suite Donovan Kolbly (09 Mar 2005 20:19 UTC)
Re: Meta-test suite Per Bothner (09 Mar 2005 20:39 UTC)
Re: Meta-test suite Donovan Kolbly (09 Mar 2005 21:21 UTC)
Re: Meta-test suite Per Bothner (09 Mar 2005 21:39 UTC)
Counting [was Re: Meta-test suite] Donovan Kolbly (10 Mar 2005 15:02 UTC)
Re: Meta-test suite Per Bothner (09 Mar 2005 20:41 UTC)
Re: Meta-test suite Donovan Kolbly (09 Mar 2005 20:54 UTC)

Re: Meta-test suite Per Bothner 09 Mar 2005 20:39 UTC

Donovan Kolbly wrote:

> More crucially, there does not seem to be any way for a portable runner to
> keep track of the nesting of test suites.

The API should probably have a way to get the value of (test-runner-group-path).
One detail: the latter has the suite-names in reverse order, since the
implementation uses a stack; a public function should probably return the
names in top-to-botton order.  That's a minor tweak.

> I'm not sure yet what to
> suggest for SRFI-64 to track suite nesting, but something along the lines
> of a `test-runner-on-suite-begin!' and `test-runner-on-suite-end!' would
> probably do it (*).

That might be useful for some things, though I don't think it should be needed
to keep track of the "group-path", which the framework should do.

> [*] do you want to call these things "suites" or "groups"?  The
>     terminology seems to vary from place to place, or am I still missing
>     something....

Hm.  I think a "test suite" is a collection of tests, which consists of
individualt "test cases", which are usually grouped into "test groups".
A test-begin/test-end-pair together with whatever's between them is an
implicit/informal test group, while a test-group is an explicit test group.

A test suite is whatever gets run user a test runner.

Does that sound reasonable?  If so, "suite-name" should be "group-name".
--
	--Per Bothner
xxxxxx@bothner.com   http://per.bothner.com/