turinglife / mapreduce-lite Goto Github PK

Since MapReduce Lite uses a class registering mechanism to support creating 
mapper/reducer according to their class names, and this mechanism breaks 
symbolic dependency between users' program and the MapReduce Lite library, we 
will need to force linking the library when we write MapReduce Lite programs.  
In cmake, this can be done using CMake scripts as follow:

 whole_link_flags = ["-Wl,--whole-archive"]
 for i in link_all_symbols_lib_list:
   whole_link_flags.append(i[0])
 whole_link_flags.append('-Wl,--no-whole-archive')

What steps will reproduce the problem?
1. install deps
2. mkdir build & cd build & cmake ..
3. make

What is the expected output? What do you see instead?


What version of the product are you using? On what operating system?
mac os x 10.8

Please provide any additional information below.

[  7%] Built target base
[ 11%] Built target class_register_test
[ 13%] Built target cvector_test
[ 15%] Built target stl-util_test
[ 16%] Built target varint32_test
[ 22%] Built target strutil
[ 24%] Built target join_strings_test
[ 26%] Built target split_string_test
[ 28%] Built target strcodec_test
[ 30%] Built target stringprintf_test
[ 33%] Built target hash
[ 35%] Built target md5_hash_test
[ 39%] Built target system
[ 41%] Built target condition_variable_test
[ 43%] Built target filepattern_test
[ 45%] Built target mutex_test
[ 52%] Built target sorted_buffer
[ 54%] Built target memory_allocator_test
[ 56%] Built target memory_piece_io_test
[ 58%] Built target memory_piece_less_than_test
[ 60%] Built target memory_piece_test
[ 62%] Built target sorted_buffer_iterator_test
[ 64%] Built target sorted_buffer_regression_test
[ 66%] Built target sorted_buffer_test
[ 67%] Building CXX object 
src/mapreduce_lite/CMakeFiles/mapreduce_lite.dir/socket_communicator.cc.o
/Users/fandywang/project/mapreduce-lite/src/mapreduce_lite/socket_communicator.c
c:338:19: error: comparison of unsigned expression < 0 is always false
      [-Werror,-Wtautological-compare]
    if (this_send < 0) {
        ~~~~~~~~~ ^ ~
/Users/fandywang/project/mapreduce-lite/src/mapreduce_lite/socket_communicator.c
c:372:17: error: comparison of unsigned expression < 0 is always false
      [-Werror,-Wtautological-compare]
  if (this_send < 0) {
      ~~~~~~~~~ ^ ~
/Users/fandywang/project/mapreduce-lite/src/mapreduce_lite/socket_communicator.c
c:397:20: error: comparison of unsigned expression < 0 is always false
      [-Werror,-Wtautological-compare]
  if (this_receive < 0) {
      ~~~~~~~~~~~~ ^ ~
3 errors generated.
make[2]: *** 
[src/mapreduce_lite/CMakeFiles/mapreduce_lite.dir/socket_communicator.cc.o] 
Error 1
make[1]: *** [src/mapreduce_lite/CMakeFiles/mapreduce_lite.dir/all] Error 2
make: *** [all] Error 2

Currently, sock_communicator uses epoll, which is specific to Linux, thus makes 
MapReduce Lite not portable to FreeBSD, MacOS X and Cygwin.  A solution is to 
use libevent, which encapsulate epoll (Linux), kqueue (FreeBSD, MacOS X), and 
i/o completion (Windows).


libevent is not available in the Cygwin package repositories. You can get the 
most recent libevent by going to

http://monkey.org/~provos/libevent/

downloading the most recent code, and applying the patch here:

http://monkeymail.org/archives/libevent-users/2007-June/000685.html

and then following the README directions to compile. ( ./configure && make ) 

What steps will reproduce the problem?
1.
2.
3.

What is the expected output? What do you see instead?

cmake works, but make outputs the following error:
mapreduce-lite/src/base/logging.cc:4:fatal error: paralgo/base/logging.h：no 
such file or directory.

What steps will reproduce the problem?
1. mkdir build
2. cmake .. and make on build directory
3. show error with boost library.

What is the expected output? What do you see instead?
-Make builds programs success. Error in Boost library version 1.52

What version of the product are you using? On what operating system?
-Linux OS x64.

Please provide any additional information below.
What steps will reproduce the problem?
1. mkdir build
2. cmake .. and make on build directory
3. show error with boost library.

What is the expected output? What do you see instead?
-Make builds programs success. Error in Boost library version 1.52

What version of the product are you using? On what operating system?
-Linux OS x64.

Please provide any additional information below.
Programs not show error in "cmake .." step. You can see below.

-- The C compiler identification is GNU
-- The CXX compiler identification is GNU
-- Check for working C compiler: /usr/bin/gcc
-- Check for working C compiler: /usr/bin/gcc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Found PROTOBUF: /usr/lib/libprotobuf.so 
-- Configuring done
-- Generating done
-- Build files have been written to: 
/home/chatsiri/workspacecpp/mic/mapreduce-lite-read-only/build

What steps will reproduce the problem?
1. install deps
2. mkdir build & cd build & cmake ..
3. make

What is the expected output? What do you see instead?


What version of the product are you using? On what operating system?
mac os x 10.8

Please provide any additional information below.

[100%] Building CXX object 
src/mapreduce_lite/demo/CMakeFiles/mrl-wordcount.dir/wordcount.cc.o
Linking CXX executable mrl-wordcount
ld: library not found for -lrt
clang: error: linker command failed with exit code 1 (use -v to see invocation)
make[2]: *** [src/mapreduce_lite/demo/mrl-wordcount] Error 1
make[1]: *** [src/mapreduce_lite/demo/CMakeFiles/mrl-wordcount.dir/all] Error 2
make: *** [all] Error 2