ulabs's Introduction

LABORATORIOS UNIVERSITARIOS

Este es un repositorio para los diferentes ejercicios que efectuaremos en Spark / Impala y Solr

Instalar git

$ sudo yum install git

Clonar este repo

$ git clone [email protected]:joaosal/ulabs.git

Magic

You also need to:

Install maven

$ wget http://mirror.olnevhost.net/pub/apache/maven/maven-3/3.0.5/binaries/apache-maven-3.0.5-bin.tar.gz

Afterwards the process is easy

Run the wget command from the dir you want to extract maven too. run the following to extract the tar,

tar xvf apache-maven-3.0.5-bin.tar.gz

move maven to /usr/local/apache-maven

mv apache-maven-3.0.5  /usr/local/apache-maven

Next add the env variables to your ~/.bashrc file

export M2_HOME=/usr/local/apache-maven
export M2=$M2_HOME/bin 
export PATH=$M2:$PATH

Execute these commands

source ~/.bashrc

Verify everything is working with the following command

mvn -version

Spark

$ spark-shell

$ pyspark

Impala / Hive

Hive

$ beeline -u jdbc:hive2://localhost:10000

Impala

$ impala-shell

Install MYSQL

$ sudo yum install mysql-server

Then to start MYSQL server

$sudo service mysqld start

To log in to MySQL as the Root User

$ mysql -u root

Set the root user password for all local domains

SET PASSWORD FOR 'root'@'localhost' = PASSWORD('new-password');
SET PASSWORD FOR 'root'@'localhost.localdomain' = PASSWORD('new-password');
SET PASSWORD FOR 'root'@'127.0.0.1' = PASSWORD('new-password');

Populate DB with script

mysql> source dbsetup.sql

Verify

mysql> use dualcore
Database changed
mysql> show tables;
+--------------------+
| Tables_in_dualcore |
+--------------------+
| customers          |
| employees          |
| order_details      |
| orders             |
| products           |
| suppliers          |
+--------------------+