Loading DB routines from perl5db.pl version 1.49_04
Editor support available.

Enter h or 'h h' for help, or 'man perldebug' for more help.

main::(-e:1):    42
Cannot do `initialize' in Term::ReadLine::Gnu at
/usr/local/Cellar/perl/5.24.0_1/lib/perl5/5.24.0/perl5db.pl line 6861.
 at /usr/local/Cellar/perl/5.24.0_1/lib/perl5/site_perl/5.24.0/
darwin-thread-multi-2level/Term/ReadLine/Gnu.pm line 844.
    Term::ReadLine::Gnu::AU::AUTOLOAD(Term::ReadLine=HASH(0x7f9363267290))
called at /usr/local/Cellar/perl/5.24.0_1/lib/perl5/site_perl/5.24.0/
darwin-thread-multi-2level/Term/ReadLine/Gnu.pm line 287
    Term::ReadLine::Gnu::new("Term::ReadLine", "perldb",
GLOB(0x7f936218ad68), GLOB(0x7f936216fa78)) called at
/usr/local/Cellar/perl/5.24.0_1/lib/perl5/5.24.0/perl5db.pl line 6861
    DB::setterm() called at /usr/local/Cellar/perl/5.24.0_
1/lib/perl5/5.24.0/perl5db.pl line 1845
    DB::_DB__read_next_cmd(undef) called at /usr/local/Cellar/perl/5.24.0_
1/lib/perl5/5.24.0/perl5db.pl line 2779
    DB::DB called at -e line 1
Cannot do `initialize' in Term::ReadLine::Gnu at
/usr/local/Cellar/perl/5.24.0_1/lib/perl5/5.24.0/perl5db.pl line 6861.
END failed--call queue aborted.
 at -e line 0.

Summary of my perl5 (revision 5 version 24 subversion 0) configuration:

  Platform:
    osname=darwin, osvers=14.5.0, archname=darwin-thread-multi-2level
    uname='darwin yosemitevm.local 14.5.0 darwin kernel version 14.5.0: thu
apr 21 20:40:54 pdt 2016; root:xnu-2782.50.3~1release_x86_64 x86_64 '
    config_args='-des -Dprefix=/usr/local/Cellar/perl/5.24.0_1
-Dprivlib=/usr/local/Cellar/perl/5.24.0_1/lib/perl5/5.24.0
-Dsitelib=/usr/local/Cellar/perl/5.24.0_1/lib/perl5/site_perl/5.24.0
-Dotherlibdirs=/usr/local/lib/perl5/site_perl/5.24.0
-Dperlpath=/usr/local/opt/perl/bin/perl
-Dstartperl=#!/usr/local/opt/perl/bin/perl
-Dman1dir=/usr/local/Cellar/perl/5.24.0_1/share/man/man1
-Dman3dir=/usr/local/Cellar/perl/5.24.0_1/share/man/man3 -Duseshrplib
-Duselargefiles -Dusethreads'
    hint=recommended, useposix=true, d_sigaction=define
    useithreads=define, usemultiplicity=define
    use64bitint=define, use64bitall=define, uselongdouble=undef
    usemymalloc=n, bincompat5005=undef
  Compiler:
    cc='cc', ccflags ='-fno-common -DPERL_DARWIN -mmacosx-version-min=10.10
-fno-strict-aliasing -pipe -fstack-protector-strong -I/usr/local/include
-DPERL_USE_SAFE_PUTENV',
    optimize='-O3',
    cppflags='-fno-common -DPERL_DARWIN -mmacosx-version-min=10.10
-fno-strict-aliasing -pipe -fstack-protector-strong -I/usr/local/include'
    ccversion='', gccversion='4.2.1 Compatible Apple LLVM 7.0.2
(clang-700.1.81)', gccosandvers=''
    intsize=4, longsize=8, ptrsize=8, doublesize=8, byteorder=12345678,
doublekind=3
    d_longlong=define, longlongsize=8, d_longdbl=define, longdblsize=16,
longdblkind=3
    ivtype='long', ivsize=8, nvtype='double', nvsize=8, Off_t='off_t',
lseeksize=8
    alignbytes=8, prototype=define
  Linker and Libraries:
    ld='cc', ldflags =' -mmacosx-version-min=10.10 -fstack-protector-strong
-L/usr/local/lib'
    libpth=/usr/local/lib /usr/include/libxml2 /Applications/Xcode.app/
Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/../lib/clang/7.0.2/lib
/Applications/Xcode.app/Contents/Developer/Toolchains/
XcodeDefault.xctoolchain/usr/lib /Applications/Xcode.app/
Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.11.sdk/usr/lib
/usr/lib
    libs=-lpthread -ldbm -ldl -lm -lutil -lc
    perllibs=-lpthread -ldl -lm -lutil -lc
    libc=, so=dylib, useshrplib=true, libperl=libperl.dylib
    gnulibc_version=''
  Dynamic Linking:
    dlsrc=dl_dlopen.xs, dlext=bundle, d_dlsymun=undef, ccdlflags=' '
    cccdlflags=' ', lddlflags=' -mmacosx-version-min=10.10 -bundle
-undefined dynamic_lookup -L/usr/local/lib -fstack-protector-strong'


Characteristics of this binary (from libperl):
  Compile-time options: HAS_TIMES MULTIPLICITY PERLIO_LAYERS
                        PERL_COPY_ON_WRITE PERL_DONT_CREATE_GVSV
                        PERL_HASH_FUNC_ONE_AT_A_TIME_HARD
                        PERL_IMPLICIT_CONTEXT PERL_MALLOC_WRAP
                        PERL_PRESERVE_IVUV PERL_USE_SAFE_PUTENV
                        USE_64_BIT_ALL USE_64_BIT_INT USE_ITHREADS
                        USE_LARGE_FILES USE_LOCALE USE_LOCALE_COLLATE
                        USE_LOCALE_CTYPE USE_LOCALE_NUMERIC USE_LOCALE_TIME
                        USE_PERLIO USE_PERL_ATOF USE_REENTRANT_API
  Built under darwin
  Compiled at Jun  4 2016 11:01:07
  @INC:
    /usr/local/Cellar/perl/5.24.0_1/lib/perl5/site_perl/5.24.0/
darwin-thread-multi-2level
    /usr/local/Cellar/perl/5.24.0_1/lib/perl5/site_perl/5.24.0
    /usr/local/Cellar/perl/5.24.0_1/lib/perl5/5.24.0/darwin-
thread-multi-2level
    /usr/local/Cellar/perl/5.24.0_1/lib/perl5/5.24.0
    /usr/local/lib/perl5/site_perl/5.24.0

xterm-256color

Greetings Karen,

Thank you for the list of modules at https://metacpan.org/pod/Task::Kensho.
The list is very informative.

I searched the page for "parallel" and nothing came up. May I suggest MCE
as a possible candidate. MCE was written to tackle parallelism on a box.
MCE *does not* compete with other modules, but instead complements in the
wild. By itself, MCE provides out of the box parallelism for map and grep.

use MCE::Map;
my @a = mce_map { "Please add MCE $_\n" } 0 .. 1_000_000;

use MCE::Grep;
my @b = mce_grep { $_ % 7 == 0 } 0 .. 100;

One line enables parallelism in Test-Perl-Critic.
https://github.com/Perl-Critic/Test-Perl-Critic/blob/master/lib/Test/Perl/Critic.pm#L104

David Farrell did a nice write up on MCE some time back.
http://perltricks.com/article/61/2014/1/21/Make-your-code-run-faster-with-Perl-s-secret-turbo-module

MCE is a chunking engine. It eats big files for breakfast :). Well,
chunking has the effect of reducing IPC behind the scene.

http://api.metacpan.org/source/MARIOROY/MCE-1.521/images/02_Bank_Model_Chunking.gif

Every chunk comes with an ID. So easy to have ordered output while running.
http://api.metacpan.org/source/MARIOROY/MCE-1.521/images/03_Bank_Model_Chunk_ID.gif

MCE allows natural cross-over function calling. Serialization is done
automatically.
http://api.metacpan.org/source/MARIOROY/MCE-1.521/images/08_Natural_Callback.gif

There is even bin/mce_grep to enable scientists to parse massive genome
files using the binary agrep or tre-agrep commands.
https://metacpan.org/source/MARIOROY/MCE-1.521/bin/mce_grep

The presentation by Gavin Carr takes MCE for a spin.
http://www.openfusion.net/talks/pwp/
http://www.openfusion.net/talks/pwp/#22   mce_grep
http://www.openfusion.net/talks/pwp/#20   mce_loop

For folks who like prime numbers, compare the 2 examples. MCE runs with
Perl not compiled with threads support.

https://metacpan.org/source/DANAJ/Math-Prime-Util-0.49/examples/fibprime-threads.pl
https://metacpan.org/source/DANAJ/Math-Prime-Util-0.49/examples/fibprime-mce.pl

MCE supports an input iterator (complement to Jeffrey Thalhammer). Notice
how the MCE code is much smaller. To use threads (not fork, one simply adds
use threads; at the top).

Well, am hoping to see MCE listed for parallelism. Please... Thank you.

Kind regards,
Mario

----

Hi again,

In other words, may MCE be added to the list of modules at
https://metacpan.org/pod/Task::Kensho for enabling parallelism? I
understand that this request may be rejected. Oh gosh, will feel bad if
that were to happen. Will feel like all the hours was worth it if it were
to be added.

It was no small feat to have MCE run on all environments including
Windows/Cygwin. I am embarrassed to say, but that was hard.

Scientists out in QATAR (are using MCE -- mainly benefiting from workers
persisting between row data.
http://qatar-weill.cornell.edu

Of all things, MCE is helping with parallelism hacking molecules.
https://metacpan.org/source/DEMIAN/HackaMol-0.00_21/examples/MCE/heavy_mvr.pl#L11

I even received a report from Greece stating MCE is used in a Windows
production environment only possible with MCE 1.516 and later releases.

Well, MCE is my humble 2 cents in helping folks enable parallelism in Perl.

Thank you.
Mario

----

Just realized that I need to monitor the perlmonks site and help out answer questions.

Splitting large array for threads.
http://www.perlmonks.org/?node_id=1089915

Look at MCE go, better yet enabling chunking, and furthermore direct processing of the input file.
http://www.perlmonks.org/?node_id=1110247

Several folks have asked for Ruby-MCE, Python-MCE, even Go-MCE. Perl is first to receive MCE.

Work done thus far in Ruby-MCE has helped me solved a rare bug in Perl-MCE on Windows. The bug existed for the longest time and spent countless hours on many occasions trying to reproduce it. The bug presented itself in Greece and finally able to reproduce it.

If I had the time, would love to re-write MCE. Add more features. The next item for Perl-MCE is mce_start sub { ... } based on MCE::Flow and to run in the background. Several mce_start may run, each with various workers, each massively parallel with full chunking support. Also have mce_await, mce_status, etc. I can do this. Will be awesome.

I'm not totally sure about Perl6 and whether it will have chunking abilities. So may need to write Perl6-MCE one day.

Thank you in advance for considering MCE as a parallel module for the list. I would do a pull request, but not sure under what section to place MCE under. Thus the reason for not sending. Will wait for a go before sending a pull request otherwise.

Do I add it after Module Development?

MCE: Parallel Processing

Many-Core Engine for Perl providing parallel processing capabilities

Cheer,
Mario

----

Hi all,

I am ok if MCE is not listed on https://metacpan.org/pod/Task::Kensho. I
have found peace and no longer think about it.

There was one thing remaining with MCE. That is, a massive update on the
documentation itself. MCE 1.522 was released today.

1.522 Thu Dec 25 16:00:00 EST 2014

[BUG FIXES]

* Applied fix to MCE->shutdown so that MCE Models do not err when
  receiving signal to terminate.

* Optimization for MCE->print, MCE->printf, MCE->say and MCE->sendto.
  This was calling fileno unnecessarily. MCE->print('STDERR', ...)
  is not supported. Do this instead; MCE->print(\*STDERR, ...)

[ENHANCEMENTS]

* Inserts the actual lib-path at the head of @INC in example files.
* Massive documentation updates throughout the entire distribution.
* Renamed barrier_sync.pl to sync.pl; scaling_pings.pl to ping.pl.
* Updated requires in META.yml, Makefile.PL and perl-MCE.spec.
* Updated comment in MCE::Queue test scripts.
* Updated the README file.

[NEW FEATURES]

* Added sampledb examples demonstrating DBI and SQLite with MCE.
* Added step_demo.pl to examples.


All 6 models are powerful in MCE. Look at MCE::Grep go below.
https://metacpan.org/pod/distribution/MCE/lib/MCE.pod#MCE-MODELS

A common scenario is grepping for pattern(s) inside a massive log file.
Notice how parallelism increases as complexity increases for the pattern.
Testing was done against a 300 MB file containing 250k lines.

use MCE::Grep <https://metacpan.org/pod/MCE::Grep>;

my @m; open my $LOG, "<", "/path/to/log/file" or die "$!\n";

@m = grep { /pattern/ } <$LOG>;                      ##  0.756 secs
@m = grep { /foobar|[2357][1468][9]/ } <$LOG>;       ## 24.681 secs

## Parallelism with mce_grep. This involves the manager process
## due to processing a file handle.

@m = mce_grep { /pattern/ } <$LOG>;                  ##  0.997 secs
@m = mce_grep { /foobar|[2357][1468][9]/ } <$LOG>;   ##  7.439 secs

## Even faster with mce_grep_f. Workers access the file directly
## with zero interaction from the manager process.

my $LOG = "/path/to/file";
@m = mce_grep_f { /pattern/ } $LOG;                  ##  0.112 secs
@m = mce_grep_f { /foobar|[2357][1468][9]/ } $LOG;   ##  6.840 secs


Merry Christmas !!!

Kind regards,
Mario

perl -MDateTime::Moonpig -E 'DateTime::Moonpig->new( year => 2016, month => 1, day => 1 )->plus( months => 1 )' 
# Argument "months" isn't numeric in addition
perl -MDateTime::Moonpig -E 'DateTime::Moonpig->new( year => 2016, month => 1, day => 1 )->add( months => 1 )' 
# Do not mutate DateTime objects! (http://rjbs.manxome.org/rubric/entry/1929) at /home/kent/perl5/perlbrew/perls/5.24.0-RC5/lib/site_perl/5.24.0/DateTime/Moonpig.pm line 85.
    DateTime::Moonpig::__ANON__(DateTime::Moonpig=HASH(0x2844e58), DateTime::Duration=HASH(0x21c0800)) called at /home/kent/perl5/perlbrew/perls/5.24.0-RC5/lib/site_perl/5.24.0/x86_64-linux/DateTime.pm line 1688
    DateTime::add(DateTime::Moonpig=HASH(0x2844e58), "months", 1) called at -e line 1