https://fastapi.metacpan.org/source/BDFOY/Test-Output-1.033/Changes

The problem is here:

This was noticed by Tina Müller in os-autoinst/os-autoinst#1622

While I am aware that I'm teaching my grandmother to suck eggs, it's most likely that you read in a file as bytes (no :encoding(utf8)) then wrote it out again as :encoding(utf8) so that byte data was upgraded into characters accidentally.

We're using Test::Output and often have the situation that we print debugging statements when working on a test.
To see the actual output, we have to change stderr_like to stderr_from, save it into a variable, add a like statement and diag the output.
It would be helpful if Test::Output could use Capture::Tiny's tee function on request, for example via an environment variable.
If you think this could be useful as well, I would try to make a PR.

This old chestnut again.

The 'LICENSE' file says that the module is licensed "under the same terms as perl itself, under the Artistic License 2.0", which is self-contradicting because perl is licensed under either GPL or Artistic 1 licenses, not Artistic 2. The text in the module file itself says "same as perl", without mentioning Artistic 2.0. I suspect you mean to license the module as Artistic 2.0, in which case it would be better to get rid of the "same as perl" text everywhere and just say "Artistic 2.0" instead.

I'm struggling to figure out why in some test cases, this (great!) module captures stderr and in others it does not. I am probably doing something dumb but maybe there is an actual problem.

I have a perl program that I need to test main() for. An example test is below.

output_like( sub { main( '-z' ) },
             qr/./,
             qr/Unexpected option -z, ignoring/ms,
             'Unexpected options are ignored'
           );                                                                   

The code that generates the stderr output is

sub main {
...
    if ( $ARGV[0] =~ /^-/ ) {
        warn "Unexpected option $ARGV[0], ignoring.\n";
        shift @ARGV;
        next;
    }

The issue I am seeing is when I get partway through a battery of tests I get failures because output from warn() is ending up on the screen and not being captured by output_like().

I tried to write a reproducer but can't find a simple case.
The failing calling chain is: main()->message()->warn()
Here's the attempted reproducer:

$ cat z.pl
#!/usr/bin/env perl

use strict;
use warnings;
use File::Path qw(remove_tree);
use File::Spec;
use Sys::Hostname;

use FindBin qw($Bin); 
use lib ("$Bin", "$Bin/..", "$Bin/lib", "$Bin/../lib");
unless( caller() ) {
    main( @ARGV );
    exit;
}

sub main {
   message("abc123");
};

sub message {
   warn "Warning from inside message()\n";
}

1;

$ cat t/z.t
use strict;
use warnings;

use FindBin qw($Bin);
use lib ("$Bin", "$Bin/..", "$Bin/lib", "$Bin/../lib");

use Test::More tests => 1;
use Test::Output;

require 'z.pl';

chdir('./t') if ( -d './t' );

my $startdir = `pwd`;
chomp($startdir);

output_like( sub { main() },
             qr/.*/,
             qr/Warning from/,
             'Detects warning from inside subroutine'
           );

This passes fine.

$ perl t/z.t 
1..1
ok 1 - Detects warning from inside subroutine

The test I am having trouble with is in the midst of about 70-odd tests in one file.
Some of them do a bit of set up and tear down along the way, but I don't see why that would be a problem. When I run the set of tests, what happens is I get the warning printed on stderr

$ perl t/10_main.t 1>/dev/null
#   Failed test 'Empty directories are detected and no message is sent.'
#   at t/10_dirmanager.t line 375.
# STDERR:
# 
# doesn't match:
# (?^:.*Directory\s+sempty,\s+message.*)
# as expected
Directory empty, message not sent

instead of captured by output_like.

I've tested this against the latest git version (in lib/Test/Output.pm).
Any feedback would be greatly welcomed.

It seems combined_from is not exported by default anymore. Importing all functions works:

use Test::More tests => 1;
use Test::Output qw(:functions);
say Test::Output->VERSION;
my $out = combined_from { say "hello" };
like $out, qr{hello};
__END__
1..1
1.032
ok 1

But not by default:

use Test::More tests => 1;
use Test::Output;         
say Test::Output->VERSION;
my $out = combined_from { say "hello" };
like $out, qr{hello};
__END__
1..1
1.032
hello
Can't locate object method "combined_from" via package "1" (perhaps you forgot to load "1"?) at -e line 5.
# Looks like your test exited with 255 before it could output anything.

It worked in 1.031:

use Test::More tests => 1;
use Test::Output;
say Test::Output->VERSION;
my $out = combined_from { say "hello" };
like $out, qr{hello};
__END__
1..1
1.031
ok 1

Other functions are still working:

use Test::More tests => 1;
use Test::Output;
say Test::Output->VERSION;
my $out = combined_like { say "hello" } qr{hello}, "label"
__END__
1..1
1.032
ok 1 - label

Hi, in the code examples for section TESTS subsection OUTPUT, subsubsection output_is, output_isnt, there are two code blocks (following

is functionally equivalent to
.

One for output_is

 stdout_is(sub {print "foo";},'foo')
    && stderr_is(sub {print STDERR "bar";'bar');

which should be

 stdout_is(sub {print "foo";},'foo')
    && stderr_is(sub {print STDERR "bar";},'bar');

(adds the missing curly closing brace and comma before the last argument of stderr_is)

and another one for output_isnt

  stdout_is(sub {print "foo";},'bar')
    && stderr_is(sub {print STDERR "bar";'foo');

which should be

  stdout_isnt(sub {print "foo";},'bar')
    && stderr_isnt(sub {print STDERR "bar";},'foo');

(changes std*_is -> std*_isnt and adds the missing curly brace and comma)