xiaom / hadoop-book Goto Github PK
View Code? Open in Web Editor NEWThis project forked from tomwhite/hadoop-book
Example source code accompanying O'Reilly's "Hadoop: The Definitive Guide" by Tom White
Home Page: http://www.hadoopbook.com/
This project forked from tomwhite/hadoop-book
Example source code accompanying O'Reilly's "Hadoop: The Definitive Guide" by Tom White
Home Page: http://www.hadoopbook.com/
Example code for "Hadoop: The Definitive Guide, Third Edition" by Tom White. Copyright (C) 2011 Tom White, 978-1-449-31152-0 http://www.hadoopbook.com/ http://oreilly.com/catalog/9781449311520/ The code is hosted at http://github.com/tomwhite/hadoop-book/. You can find code for the first edition at http://github.com/tomwhite/hadoop-book/tree/1e, and for the second edition at http://github.com/tomwhite/hadoop-book/tree/2e. This version of the code has been tested with: * Hadoop 1.2.1/0.22.0/0.23.x/2.2.0 * Avro 1.5.4 * Pig 0.9.1 * Hive 0.8.0 * HBase 0.90.4/0.94.15 * ZooKeeper 3.4.2 * Sqoop 1.4.0-incubating * MRUnit 0.8.0-incubating Before running the examples you need to install Hadoop, Pig, Hive, HBase, ZooKeeper, and Sqoop (as appropriate) as explained in the book. You also need to install Maven. Then you can build the code with: % mvn package -DskipTests By default Hadoop 1.2.1 is used. This can be changed by specifying the hadoop.version property, e.g. % mvn package -DskipTests -Dhadoop.version=1.2.0 There are profiles for different Hadoop major versions and distributions, specified in hadoop-meta/pom.xml, and they are specified using the hadoop.distro property. For example, to use the default version of Hadoop 2: % mvn package -DskipTests -Dhadoop.distro=apache-2 Again, you can specify hadoop.version to use a particular Hadoop 2 version: % mvn package -DskipTests -Dhadoop.distro=apache-2 -Dhadoop.version=2.1.1-beta You should then be able to run the examples from the book. Chapter names for "Hadoop: The Definitive Guide", Third Edition ch01 - Meet Hadoop ch02 - MapReduce ch03 - The Hadoop Distributed Filesystem ch04 - Hadoop I/O ch05 - Developing a MapReduce Application ch06 - How MapReduce Works ch07 - MapReduce Types and Formats ch08 - MapReduce Features ch09 - Setting Up a Hadoop Cluster ch10 - Administering Hadoop ch11 - Pig ch12 - Hive ch13 - HBase ch14 - ZooKeeper ch15 - Sqoop ch16 - Case Studies app1 - Installing Apache Hadoop app2 - Cloudera's Distribution for Hadoop app3 - Preparing the NCDC Weather Data
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.