[rt-devel] bug in regression tests?

[Jesse Vincent]

On Wed, Jun 18, 2003 at 02:30:29PM +1000, Jamie Wilkinson wrote:
> This one time, at band camp, Jesse Vincent wrote:
> >
> >
> >On Wed, Jun 18, 2003 at 02:02:48PM +1000, Jamie Wilkinson wrote:
> >> This one time, at band camp, Jesse Vincent wrote:
> >> >That does indeed look like a bug in the test suite or your setup. there
> >> >are about 900 tests ;)
> >> 
> >> I'm now getting up to 154 with no errors, and now no log messages indicating
> >> a failure either:
> >> 
> >> ...
> >> ok 154 - Has three attachments, presumably a text-plain, a text-html and a
> >> multipart alternative
> >> 1..154
> >> 
> >> So it seems to be getting to all the tests up to and through
> >> 04send_email.pl.
> >> 
> >> Are there any more that should be run, or are there some 750 tests that
> >> *don't* get run because of my configuration?
> 
> "my conifiguration" == "--with-postgres and --with-fastcgi", not the
> self-contained regression area.
> 
> >Can you try the vanilla regression test suite the way I've described it,
> >please?
> 
> The problems I have with the vanilla regression test suite is that it does
> not just work out of the box, which is why I'm trying to get to a point
> where I *can* automate the entire set up and clean up of the regression.

That's fine, but to fix _anything_, I need you to start with the very
basic step of attempting to run the test suite as it's designed to be
run, not through a self-designed harness.


> So, you say there are 900 tests.  I am only seeing 154 of them.  Is it
> possible that some tests only get run with mysql and mod_perl1, for example,
> or should I be expecting to see 900 tests get run regardless of how it's set
> up?

The tests are not conditional. You should see all of them.


-- 
http://www.bestpractical.com/rt  -- Trouble Ticketing. Free.