Este es un repositorio para los diferentes ejercicios que efectuaremos en Spark / Impala y Solr
- Instalar git
$ sudo yum install git
- Clonar este repo
$ git clone [email protected]:joaosal/ulabs.git
- Magic
You also need to:
- Install maven
$ wget http://mirror.olnevhost.net/pub/apache/maven/maven-3/3.0.5/binaries/apache-maven-3.0.5-bin.tar.gz
Afterwards the process is easy
Run the wget command from the dir you want to extract maven too. run the following to extract the tar,
tar xvf apache-maven-3.0.5-bin.tar.gz
move maven to /usr/local/apache-maven
mv apache-maven-3.0.5 /usr/local/apache-maven
Next add the env variables to your ~/.bashrc file
export M2_HOME=/usr/local/apache-maven
export M2=$M2_HOME/bin
export PATH=$M2:$PATH
Execute these commands
source ~/.bashrc
Verify everything is working with the following command
mvn -version
$ spark-shell
$ pyspark
- Hive
$ beeline -u jdbc:hive2://localhost:10000
- Impala
$ impala-shell
- Install MYSQL
$ sudo yum install mysql-server
- Then to start MYSQL server
$sudo service mysqld start
- To log in to MySQL as the Root User
$ mysql -u root
- Set the root user password for all local domains
SET PASSWORD FOR 'root'@'localhost' = PASSWORD('new-password');
SET PASSWORD FOR 'root'@'localhost.localdomain' = PASSWORD('new-password');
SET PASSWORD FOR 'root'@'127.0.0.1' = PASSWORD('new-password');
Populate DB with script
mysql> source dbsetup.sql
- Verify
mysql> use dualcore
Database changed
mysql> show tables;
+--------------------+
| Tables_in_dualcore |
+--------------------+
| customers |
| employees |
| order_details |
| orders |
| products |
| suppliers |
+--------------------+
- Write Tests
- Rethink Github Save
- Add Code Comments
MIT
Free Software, Hell Yeah!