rstudio / sparkapi Goto Github PK

View Code? Open in Web Editor NEW

31.0 31.0 13.0 298 KB

Sparklyr Extensions API

Home Page: http://spark.rstudio.com/extensions.html

License: Apache License 2.0

R 64.24% Scala 35.76%

sparkapi's Introduction

RStudio

RStudio is an integrated development environment (IDE) for the R programming language. Some of its features include:

Customizable workbench with all of the tools required to work with R in one place (console, source, plots, workspace, help, history, etc.).
Syntax highlighting editor with code completion.
Execute code directly from the source editor (line, selection, or file).
Full support for authoring Sweave and TeX documents.
Runs on Windows, Mac, and Linux, and has a community-maintained FreeBSD port.
Can also be run as a server, enabling multiple users to access the RStudio IDE using a web browser.

For more information on RStudio please visit the project website.

Getting the Code

RStudio is licensed under the AGPLv3, the terms of which are included in the file COPYING. You can find our source code repository on GitHub at https://github.com/rstudio/rstudio.

Documentation

For information on how to use RStudio check out our online documentation.

For documentation on running your own RStudio Server see the server getting started guide.

See also the following files included with the distribution:

COPYING - RStudio license (AGPLv3)
NOTICE - Additional open source software included with RStudio
SOURCE - How to obtain the source code for RStudio
INSTALL - How to build and install RStudio from source

If you have problems or want to share feedback with us please visit our community forum. For other inquiries you can also email us at [email protected].

sparkapi's People

Contributors

Stargazers

Watchers

Forkers

akzaidi clarkfitzg javierluraschi dselivanov harryprince nikolayvoronchikhin dvasilen superdupershant kashenfelter isabella232

sparkapi's Issues

add 'spark_session' as alias for 'hive_context' (Spark 2.0.0)

With Spark 2.0.0, the Spark session / SQL context / hive context have all been amalgamated into a single object. Right now, hive_context() returns that:

> hive_context(sc)
<jobj[8]>
  class org.apache.spark.sql.SparkSession
  org.apache.spark.sql.SparkSession@65b602ec

But we should be able to access this with a plain spark_session(sc) call.

Example Extension Package needed

Hi,

I am trying to understand the concepts behind the extensions for sparklyr.

An example extension would be very helpful for me.

Thanks!

RPC protocol

This is not a issue, but a quick note from my experience.
IMHO SparkR RPC is the most terrible part of SparkR project. It incredibly slow and memory inefficient. R <-> jvm data transfer is so painful with sparkr RPC... (here I made some timings for transfer of small data.frame)
Of course I don't have full information about goal of this package (but I think, main goal is to create foundation for dplyr backend ), but I'm not sure it is good idea to use it. Mb something that relies on rJava will be much better choice. Hope this may be useful.
Also I will be happy to contribute when project will have roadmap.

spark_invoke errors not reported from log

E.g.

> iris_tbl <- copy_to(sc, iris, "iris", overwrite = TRUE)
Error: Error: <unknown error>

However, I see in the logs (from spark_log()):

16/06/21 13:29:17 ERROR RBackendHandler: dropTempTable on 7 failed

Is this intended, or a regression caused during the refactor?

improve 'sparkapi_jobj' error display

E.g.

iris_tbl <- copy_to(sc, iris, "iris", overwrite = TRUE)
sparkapi:::sparkapi_jobj(iris_tbl)

prints

Error: Unable to retreive a sparkapi_jobj from object of class tbl_sparktbl_sqltbl_lazytbl

Note that the S3 class names are just concatenated together.

On AWS EMR cluster, spark_connect fails

Using sparklyr version 0.2.29, and sparkapi 0.3.18

On an AWS EM cluster, running the following to connect fails:

Sys.setenv(SPARK_HOME="/usr/lib/spark")
sc <- spark_connect(master = "yarn-client")
Error in releaseContents[[1]] : subscript out of bounds

/usr/lib/spark/RELEASE file has no content.

Here is the recursive directory listing of /usr/lib/spark:

/usr/lib/spark/:
total 80
drwxr-xr-x 2 root root  4096 Jul 22 16:33 bin
lrwxrwxrwx 1 root root    15 Jul 22 16:33 conf -> /etc/spark/conf
drwxr-xr-x 3 root root  4096 Jul 22 16:33 data
lrwxrwxrwx 1 root root    35 Jul 22 16:33 examples -> /usr/share/doc/spark-1.6.1/examples
drwxr-xr-x 3 root root  4096 Jul 22 16:33 extras
drwxr-xr-x 2 root root  4096 Jul 22 16:33 lib
-rw-r--r-- 1 root root 17352 Jun 10 01:56 LICENSE
-rw-r--r-- 1 root root 23529 Jun 10 01:56 NOTICE
drwxr-xr-x 6 root root  4096 Jul 22 16:33 python
drwxr-xr-x 3 root root  4096 Jul 22 16:33 R
-rw-r--r-- 1 root root   120 Jul 22 18:08 RELEASE
drwxr-xr-x 2 root root  4096 Jul 22 16:33 sbin
lrwxrwxrwx 1 root root    19 Jul 22 16:33 work -> /var/run/spark/work
drwxr-xr-x 3 root root  4096 Jul 22 16:30 yarn

/usr/lib/spark/bin:
total 36
-rwxr-xr-x 1 root root 1099 Jun 10 01:35 beeline
-rwxr-xr-x 1 root root 2143 Jun 10 01:35 load-spark-env.sh
-rwxr-xr-x 1 root root 3459 Jun 10 01:35 pyspark
-rwxr-xr-x 1 root root 2384 Jun 10 01:35 run-example
-rwxr-xr-x 1 root root 2858 Jun 10 01:35 spark-class
-rwxr-xr-x 1 root root 1049 Jun 10 01:35 sparkR
-rwxr-xr-x 1 root root 3026 Jun 10 01:35 spark-shell
-rwxr-xr-x 1 root root 1075 Jun 10 01:35 spark-sql
-rwxr-xr-x 1 root root 1050 Jun 10 01:35 spark-submit

/usr/lib/spark/data:
total 4
drwxr-xr-x 5 root root 4096 Jul 22 16:33 mllib

/usr/lib/spark/data/mllib:
total 808
drwxr-xr-x 2 root root   4096 Jul 22 16:33 als
-rw-r--r-- 1 root root  63973 Jun 10 01:35 gmm_data.txt
-rw-r--r-- 1 root root     72 Jun 10 01:35 kmeans_data.txt
drwxr-xr-x 2 root root   4096 Jul 22 16:33 lr-data
-rw-r--r-- 1 root root 197105 Jun 10 01:35 lr_data.txt
-rw-r--r-- 1 root root     24 Jun 10 01:35 pagerank_data.txt
-rw-r--r-- 1 root root    164 Jun 10 01:35 pic_data.txt
drwxr-xr-x 2 root root   4096 Jul 22 16:33 ridge-data
-rw-r--r-- 1 root root 104736 Jun 10 01:35 sample_binary_classification_data.txt
-rw-r--r-- 1 root root     68 Jun 10 01:35 sample_fpgrowth.txt
-rw-r--r-- 1 root root   1598 Jun 10 01:35 sample_isotonic_regression_data.txt
-rw-r--r-- 1 root root    264 Jun 10 01:35 sample_lda_data.txt
-rw-r--r-- 1 root root 104736 Jun 10 01:35 sample_libsvm_data.txt
-rwxr-xr-x 1 root root 119069 Jun 10 01:35 sample_linear_regression_data.txt
-rw-r--r-- 1 root root  14351 Jun 10 01:35 sample_movielens_data.txt
-rw-r--r-- 1 root root   6953 Jun 10 01:35 sample_multiclass_classification_data.txt
-rw-r--r-- 1 root root     95 Jun 10 01:35 sample_naive_bayes_data.txt
-rw-r--r-- 1 root root  39474 Jun 10 01:35 sample_svm_data.txt
-rw-r--r-- 1 root root 115476 Jun 10 01:35 sample_tree_data.csv

/usr/lib/spark/data/mllib/als:
total 40
-rw-r--r-- 1 root root  2854 Jun 10 01:35 sample_movielens_movies.txt
-rw-r--r-- 1 root root 32363 Jun 10 01:35 sample_movielens_ratings.txt
-rw-r--r-- 1 root root   128 Jun 10 01:35 test.data

/usr/lib/spark/data/mllib/lr-data:
total 44
-rwxr-xr-x 1 root root 42060 Jun 10 01:35 random.data

/usr/lib/spark/data/mllib/ridge-data:
total 12
-rw-r--r-- 1 root root 10395 Jun 10 01:35 lpsa.data

/usr/lib/spark/extras:
total 4
drwxr-xr-x 2 root root 4096 Jul 22 16:33 lib

/usr/lib/spark/extras/lib:
total 780
-rw-r--r-- 1 root root  26092 Jun 10 01:56 spark-ganglia-lgpl_2.10-1.6.1.jar
lrwxrwxrwx 1 root root     33 Jul 22 16:33 spark-ganglia-lgpl.jar -> spark-ganglia-lgpl_2.10-1.6.1.jar
-rw-r--r-- 1 root root 103380 Jun 10 01:56 spark-streaming-flume_2.10-1.6.1.jar
lrwxrwxrwx 1 root root     36 Jul 22 16:33 spark-streaming-flume.jar -> spark-streaming-flume_2.10-1.6.1.jar
-rw-r--r-- 1 root root  86041 Jun 10 01:56 spark-streaming-flume-sink_2.10-1.6.1.jar
lrwxrwxrwx 1 root root     41 Jul 22 16:33 spark-streaming-flume-sink.jar -> spark-streaming-flume-sink_2.10-1.6.1.jar
-rw-r--r-- 1 root root 284927 Jun 10 01:56 spark-streaming-kafka_2.10-1.6.1.jar
lrwxrwxrwx 1 root root     36 Jul 22 16:33 spark-streaming-kafka.jar -> spark-streaming-kafka_2.10-1.6.1.jar
-rw-r--r-- 1 root root 205367 Jun 10 01:56 spark-streaming-kinesis-asl_2.10-1.6.1.jar
lrwxrwxrwx 1 root root     42 Jul 22 16:33 spark-streaming-kinesis-asl.jar -> spark-streaming-kinesis-asl_2.10-1.6.1.jar
-rw-r--r-- 1 root root  19349 Jun 10 01:56 spark-streaming-mqtt_2.10-1.6.1.jar
lrwxrwxrwx 1 root root     35 Jul 22 16:33 spark-streaming-mqtt.jar -> spark-streaming-mqtt_2.10-1.6.1.jar
-rw-r--r-- 1 root root  23147 Jun 10 01:56 spark-streaming-twitter_2.10-1.6.1.jar
lrwxrwxrwx 1 root root     38 Jul 22 16:33 spark-streaming-twitter.jar -> spark-streaming-twitter_2.10-1.6.1.jar
-rw-r--r-- 1 root root  31971 Jun 10 01:56 spark-streaming-zeromq_2.10-1.6.1.jar
lrwxrwxrwx 1 root root     37 Jul 22 16:33 spark-streaming-zeromq.jar -> spark-streaming-zeromq_2.10-1.6.1.jar

/usr/lib/spark/lib:
total 193680
-rw-r--r-- 1 root root    339666 May 26 22:22 datanucleus-api-jdo-3.2.6.jar
-rw-r--r-- 1 root root   1890075 May 26 22:22 datanucleus-core-3.2.10.jar
-rw-r--r-- 1 root root   1809447 May 26 22:22 datanucleus-rdbms-3.2.9.jar
-rw-r--r-- 1 root root 190168742 Jun 10 01:53 spark-assembly-1.6.1-hadoop2.7.2-amzn-2.jar
lrwxrwxrwx 1 root root        43 Jul 22 16:33 spark-assembly.jar -> spark-assembly-1.6.1-hadoop2.7.2-amzn-2.jar
-rw-r--r-- 1 root root   4113055 Jun 10 01:56 spark-examples-1.6.1-hadoop2.7.2-amzn-2.jar
lrwxrwxrwx 1 root root        43 Jul 22 16:33 spark-examples.jar -> spark-examples-1.6.1-hadoop2.7.2-amzn-2.jar

/usr/lib/spark/python:
total 28
drwxr-xr-x 4 root root 4096 Jul 22 16:33 docs
drwxr-xr-x 2 root root 4096 Jul 22 16:33 lib
drwxr-xr-x 6 root root 4096 Jul 22 16:33 pyspark
-rwxr-xr-x 1 root root  899 Jun 10 01:56 run-tests
-rwxr-xr-x 1 root root 7629 Jun 10 01:56 run-tests.py
drwxr-xr-x 3 root root 4096 Jul 22 16:33 test_support

/usr/lib/spark/python/docs:
total 68
-rw-r--r-- 1 root root 10462 Jun 10 01:56 conf.py
-rw-r--r-- 1 root root   679 Jun 10 01:56 epytext.py
-rw-r--r-- 1 root root  1105 Jun 10 01:56 index.rst
-rw-r--r-- 1 root root  6462 Jun 10 01:56 make2.bat
-rw-r--r-- 1 root root   193 Jun 10 01:56 make.bat
-rw-r--r-- 1 root root  6836 Jun 10 01:56 Makefile
-rw-r--r-- 1 root root  1965 Jun 10 01:56 pyspark.mllib.rst
-rw-r--r-- 1 root root  1395 Jun 10 01:56 pyspark.ml.rst
-rw-r--r-- 1 root root   242 Jun 10 01:56 pyspark.rst
-rw-r--r-- 1 root root   384 Jun 10 01:56 pyspark.sql.rst
-rw-r--r-- 1 root root   818 Jun 10 01:56 pyspark.streaming.rst
drwxr-xr-x 2 root root  4096 Jul 22 16:33 _static
drwxr-xr-x 2 root root  4096 Jul 22 16:33 _templates

/usr/lib/spark/python/docs/_static:
total 8
-rw-r--r-- 1 root root 2097 Jun 10 01:56 pyspark.css
-rw-r--r-- 1 root root 3467 Jun 10 01:56 pyspark.js

/usr/lib/spark/python/docs/_templates:
total 4
-rw-r--r-- 1 root root 207 Jun 10 01:56 layout.html

/usr/lib/spark/python/lib:
total 400
-rw-r--r-- 1 root root  44846 Jun 10 01:56 py4j-0.9-src.zip
-rw-r--r-- 1 root root   1445 Jun 10 01:56 PY4J_LICENSE.txt
-rw-r--r-- 1 root root 357051 Jun 10 01:56 pyspark.zip

/usr/lib/spark/python/pyspark:
total 448
-rw-r--r-- 1 root root  8142 Jun 10 01:56 accumulators.py
-rw-r--r-- 1 root root  3695 Jun 10 01:56 broadcast.py
-rw-r--r-- 1 root root 26442 Jun 10 01:56 cloudpickle.py
-rw-r--r-- 1 root root  6325 Jun 10 01:56 conf.py
-rw-r--r-- 1 root root 41493 Jun 10 01:56 context.py
-rw-r--r-- 1 root root  6127 Jun 10 01:56 daemon.py
-rw-r--r-- 1 root root  1924 Jun 10 01:56 files.py
-rw-r--r-- 1 root root 37579 Jun 10 01:56 heapq3.py
-rw-r--r-- 1 root root  2626 Jun 10 01:56 __init__.py
-rw-r--r-- 1 root root  5739 Jun 10 01:56 java_gateway.py
-rw-r--r-- 1 root root  3994 Jun 10 01:56 join.py
drwxr-xr-x 3 root root  4096 Jul 22 16:33 ml
drwxr-xr-x 4 root root  4096 Jul 22 16:33 mllib
-rw-r--r-- 1 root root  5678 Jun 10 01:56 profiler.py
-rw-r--r-- 1 root root 92465 Jun 10 01:56 rdd.py
-rw-r--r-- 1 root root  4250 Jun 10 01:56 rddsampler.py
-rw-r--r-- 1 root root  1217 Jun 10 01:56 resultiterable.py
-rw-r--r-- 1 root root 16261 Jun 10 01:56 serializers.py
-rw-r--r-- 1 root root  2737 Jun 10 01:56 shell.py
-rw-r--r-- 1 root root 27712 Jun 10 01:56 shuffle.py
drwxr-xr-x 2 root root  4096 Jul 22 16:33 sql
-rw-r--r-- 1 root root  5115 Jun 10 01:56 statcounter.py
-rw-r--r-- 1 root root  3756 Jun 10 01:56 status.py
-rw-r--r-- 1 root root  2822 Jun 10 01:56 storagelevel.py
drwxr-xr-x 2 root root  4096 Jul 22 16:33 streaming
-rw-r--r-- 1 root root 83052 Jun 10 01:56 tests.py
-rw-r--r-- 1 root root  2679 Jun 10 01:56 traceback_utils.py
-rw-r--r-- 1 root root  5665 Jun 10 01:56 worker.py

/usr/lib/spark/python/pyspark/ml:
total 244
-rw-r--r-- 1 root root 35165 Jun 10 01:56 classification.py
-rw-r--r-- 1 root root  6561 Jun 10 01:56 clustering.py
-rw-r--r-- 1 root root 12048 Jun 10 01:56 evaluation.py
-rw-r--r-- 1 root root 75488 Jun 10 01:56 feature.py
-rw-r--r-- 1 root root   950 Jun 10 01:56 __init__.py
drwxr-xr-x 2 root root  4096 Jul 22 16:33 param
-rw-r--r-- 1 root root  8435 Jun 10 01:56 pipeline.py
-rw-r--r-- 1 root root 12372 Jun 10 01:56 recommendation.py
-rw-r--r-- 1 root root 33384 Jun 10 01:56 regression.py
-rw-r--r-- 1 root root 13886 Jun 10 01:56 tests.py
-rw-r--r-- 1 root root 11134 Jun 10 01:56 tuning.py
-rw-r--r-- 1 root root  1744 Jun 10 01:56 util.py
-rw-r--r-- 1 root root  6446 Jun 10 01:56 wrapper.py

/usr/lib/spark/python/pyspark/ml/param:
total 56
-rw-r--r-- 1 root root  8891 Jun 10 01:56 __init__.py
-rw-r--r-- 1 root root  8704 Jun 10 01:56 _shared_params_code_gen.py
-rw-r--r-- 1 root root 28742 Jun 10 01:56 shared.py

/usr/lib/spark/python/pyspark/mllib:
total 300
-rw-r--r-- 1 root root 27459 Jun 10 01:56 classification.py
-rw-r--r-- 1 root root 29266 Jun 10 01:56 clustering.py
-rw-r--r-- 1 root root  4956 Jun 10 01:56 common.py
-rw-r--r-- 1 root root 16457 Jun 10 01:56 evaluation.py
-rw-r--r-- 1 root root 21016 Jun 10 01:56 feature.py
-rw-r--r-- 1 root root  5674 Jun 10 01:56 fpm.py
-rw-r--r-- 1 root root  1208 Jun 10 01:56 __init__.py
drwxr-xr-x 2 root root  4096 Jul 22 16:33 linalg
-rw-r--r-- 1 root root 16527 Jun 10 01:56 random.py
-rw-r--r-- 1 root root  9881 Jun 10 01:56 recommendation.py
-rw-r--r-- 1 root root 31504 Jun 10 01:56 regression.py
drwxr-xr-x 2 root root  4096 Jul 22 16:33 stat
-rw-r--r-- 1 root root 62759 Jun 10 01:56 tests.py
-rw-r--r-- 1 root root 23651 Jun 10 01:56 tree.py
-rw-r--r-- 1 root root 13091 Jun 10 01:56 util.py

/usr/lib/spark/python/pyspark/mllib/linalg:
total 80
-rw-r--r-- 1 root root 35769 Jun 10 01:56 distributed.py
-rw-r--r-- 1 root root 41644 Jun 10 01:56 __init__.py

/usr/lib/spark/python/pyspark/mllib/stat:
total 32
-rw-r--r-- 1 root root  1263 Jun 10 01:56 distribution.py
-rw-r--r-- 1 root root  1197 Jun 10 01:56 __init__.py
-rw-r--r-- 1 root root  2024 Jun 10 01:56 KernelDensity.py
-rw-r--r-- 1 root root 13344 Jun 10 01:56 _statistics.py
-rw-r--r-- 1 root root  2301 Jun 10 01:56 test.py

/usr/lib/spark/python/pyspark/sql:
total 308
-rw-r--r-- 1 root root 15506 Jun 10 01:56 column.py
-rw-r--r-- 1 root root 28633 Jun 10 01:56 context.py
-rw-r--r-- 1 root root 54657 Jun 10 01:56 dataframe.py
-rw-r--r-- 1 root root 56958 Jun 10 01:56 functions.py
-rw-r--r-- 1 root root  8260 Jun 10 01:56 group.py
-rw-r--r-- 1 root root  2510 Jun 10 01:56 __init__.py
-rw-r--r-- 1 root root 22582 Jun 10 01:56 readwriter.py
-rw-r--r-- 1 root root 56452 Jun 10 01:56 tests.py
-rw-r--r-- 1 root root 42904 Jun 10 01:56 types.py
-rw-r--r-- 1 root root  3052 Jun 10 01:56 utils.py
-rw-r--r-- 1 root root  5165 Jun 10 01:56 window.py

/usr/lib/spark/python/pyspark/streaming:
total 168
-rw-r--r-- 1 root root 19620 Jun 10 01:56 context.py
-rw-r--r-- 1 root root 27238 Jun 10 01:56 dstream.py
-rw-r--r-- 1 root root  6372 Jun 10 01:56 flume.py
-rw-r--r-- 1 root root  1007 Jun 10 01:56 __init__.py
-rw-r--r-- 1 root root 18285 Jun 10 01:56 kafka.py
-rw-r--r-- 1 root root  5673 Jun 10 01:56 kinesis.py
-rw-r--r-- 1 root root  2191 Jun 10 01:56 listener.py
-rw-r--r-- 1 root root  2950 Jun 10 01:56 mqtt.py
-rw-r--r-- 1 root root 64505 Jun 10 01:56 tests.py
-rw-r--r-- 1 root root  4952 Jun 10 01:56 util.py

/usr/lib/spark/python/test_support:
total 20
-rwxr-xr-x 1 root root   13 Jun 10 01:56 hello.txt
-rw-r--r-- 1 root root  873 Jun 10 01:56 SimpleHTTPServer.py
drwxr-xr-x 4 root root 4096 Jul 22 16:33 sql
-rw-r--r-- 1 root root  668 Jun 10 01:56 userlib-0.1.zip
-rwxr-xr-x 1 root root  945 Jun 10 01:56 userlibrary.py

/usr/lib/spark/python/test_support/sql:
total 20
drwxr-xr-x 4 root root 4096 Jul 22 16:33 orc_partitioned
drwxr-xr-x 4 root root 4096 Jul 22 16:33 parquet_partitioned
-rw-r--r-- 1 root root   36 Jun 10 01:56 people1.json
-rw-r--r-- 1 root root   73 Jun 10 01:56 people.json
-rw-r--r-- 1 root root   10 Jun 10 01:56 text-test.txt

/usr/lib/spark/python/test_support/sql/orc_partitioned:
total 8
drwxr-xr-x 3 root root 4096 Jul 22 16:33 b=0
drwxr-xr-x 3 root root 4096 Jul 22 16:33 b=1
-rwxr-xr-x 1 root root    0 Jun 10 01:56 _SUCCESS

/usr/lib/spark/python/test_support/sql/orc_partitioned/b=0:
total 4
drwxr-xr-x 2 root root 4096 Jul 22 16:33 c=0

/usr/lib/spark/python/test_support/sql/orc_partitioned/b=0/c=0:
total 4
-rwxr-xr-x 1 root root 168 Jun 10 01:56 part-r-00000-829af031-b970-49d6-ad39-30460a0be2c8.orc

/usr/lib/spark/python/test_support/sql/orc_partitioned/b=1:
total 4
drwxr-xr-x 2 root root 4096 Jul 22 16:33 c=1

/usr/lib/spark/python/test_support/sql/orc_partitioned/b=1/c=1:
total 4
-rwxr-xr-x 1 root root 168 Jun 10 01:56 part-r-00000-829af031-b970-49d6-ad39-30460a0be2c8.orc

/usr/lib/spark/python/test_support/sql/parquet_partitioned:
total 16
-rw-r--r-- 1 root root  210 Jun 10 01:56 _common_metadata
-rw-r--r-- 1 root root  743 Jun 10 01:56 _metadata
-rw-r--r-- 1 root root    0 Jun 10 01:56 _SUCCESS
drwxr-xr-x 3 root root 4096 Jul 22 16:33 year=2014
drwxr-xr-x 4 root root 4096 Jul 22 16:33 year=2015

/usr/lib/spark/python/test_support/sql/parquet_partitioned/year=2014:
total 4
drwxr-xr-x 3 root root 4096 Jul 22 16:33 month=9

/usr/lib/spark/python/test_support/sql/parquet_partitioned/year=2014/month=9:
total 4
drwxr-xr-x 2 root root 4096 Jul 22 16:33 day=1

/usr/lib/spark/python/test_support/sql/parquet_partitioned/year=2014/month=9/day=1:
total 4
-rw-r--r-- 1 root root 322 Jun 10 01:56 part-r-00008.gz.parquet

/usr/lib/spark/python/test_support/sql/parquet_partitioned/year=2015:
total 8
drwxr-xr-x 4 root root 4096 Jul 22 16:33 month=10
drwxr-xr-x 3 root root 4096 Jul 22 16:33 month=9

/usr/lib/spark/python/test_support/sql/parquet_partitioned/year=2015/month=10:
total 8
drwxr-xr-x 2 root root 4096 Jul 22 16:33 day=25
drwxr-xr-x 2 root root 4096 Jul 22 16:33 day=26

/usr/lib/spark/python/test_support/sql/parquet_partitioned/year=2015/month=10/day=25:
total 8
-rw-r--r-- 1 root root 343 Jun 10 01:56 part-r-00002.gz.parquet
-rw-r--r-- 1 root root 343 Jun 10 01:56 part-r-00004.gz.parquet

/usr/lib/spark/python/test_support/sql/parquet_partitioned/year=2015/month=10/day=26:
total 4
-rw-r--r-- 1 root root 333 Jun 10 01:56 part-r-00005.gz.parquet

/usr/lib/spark/python/test_support/sql/parquet_partitioned/year=2015/month=9:
total 4
drwxr-xr-x 2 root root 4096 Jul 22 16:33 day=1

/usr/lib/spark/python/test_support/sql/parquet_partitioned/year=2015/month=9/day=1:
total 4
-rw-r--r-- 1 root root 343 Jun 10 01:56 part-r-00007.gz.parquet

/usr/lib/spark/R:
total 4
drwxrwxrwx 3 root root 4096 Jul 22 16:33 lib

/usr/lib/spark/R/lib:
total 548
drwxrwxrwx 10 root root   4096 Jul 22 16:33 SparkR
-rwxrwxrwx  1 root root 555270 Jun 10 01:38 sparkr.zip

/usr/lib/spark/R/lib/SparkR:
total 44
-rwxrwxrwx 1 root root  659 Jun 10 01:38 DESCRIPTION
drwxrwxrwx 2 root root 4096 Jul 22 16:33 help
drwxrwxrwx 2 root root 4096 Jul 22 16:33 html
drwxrwxrwx 2 root root 4096 Jul 22 16:33 Meta
-rwxrwxrwx 1 root root 7018 Jun 10 01:38 NAMESPACE
drwxrwxrwx 2 root root 4096 Jul 22 16:33 profile
drwxrwxrwx 2 root root 4096 Jul 22 16:33 R
drwxrwxrwx 3 root root 4096 Jul 22 16:33 tests
drwxrwxrwx 2 root root 4096 Jul 22 16:33 test_support
drwxrwxrwx 2 root root 4096 Jul 22 16:33 worker

/usr/lib/spark/R/lib/SparkR/help:
total 12
-rwxrwxrwx 1 root root  60 Jun 10 01:38 aliases.rds
-rwxrwxrwx 1 root root   0 Jun 10 01:38 AnIndex
-rwxrwxrwx 1 root root  64 Jun 10 01:38 paths.rds
-rwxrwxrwx 1 root root   0 Jun 10 01:38 SparkR.rdb
-rwxrwxrwx 1 root root 113 Jun 10 01:38 SparkR.rdx

/usr/lib/spark/R/lib/SparkR/html:
total 8
-rwxrwxrwx 1 root root  923 Jun 10 01:38 00Index.html
-rwxrwxrwx 1 root root 1319 Jun 10 01:38 R.css

/usr/lib/spark/R/lib/SparkR/Meta:
total 20
-rwxrwxrwx 1 root root  188 Jun 10 01:38 hsearch.rds
-rwxrwxrwx 1 root root   38 Jun 10 01:38 links.rds
-rwxrwxrwx 1 root root 1717 Jun 10 01:38 nsInfo.rds
-rwxrwxrwx 1 root root  732 Jun 10 01:38 package.rds
-rwxrwxrwx 1 root root  164 Jun 10 01:38 Rd.rds

/usr/lib/spark/R/lib/SparkR/profile:
total 8
-rwxrwxrwx 1 root root  956 Jun 10 01:38 general.R
-rwxrwxrwx 1 root root 1696 Jun 10 01:38 shell.R

/usr/lib/spark/R/lib/SparkR/R:
total 828
-rwxrwxrwx 1 root root   1056 Jun 10 01:38 SparkR
-rwxrwxrwx 1 root root 820273 Jun 10 01:38 SparkR.rdb
-rwxrwxrwx 1 root root  19193 Jun 10 01:38 SparkR.rdx

/usr/lib/spark/R/lib/SparkR/tests:
total 4
drwxrwxrwx 2 root root 4096 Jul 22 16:33 testthat

/usr/lib/spark/R/lib/SparkR/tests/testthat:
total 184
-rwxrwxrwx 1 root root  1241 Jun 10 01:38 jarTest.R
-rwxrwxrwx 1 root root   994 Jun 10 01:38 packageInAJarTest.R
-rwxrwxrwx 1 root root  3036 Jun 10 01:38 test_binaryFile.R
-rwxrwxrwx 1 root root  3677 Jun 10 01:38 test_binary_function.R
-rwxrwxrwx 1 root root  1599 Jun 10 01:38 test_broadcast.R
-rwxrwxrwx 1 root root  1972 Jun 10 01:38 test_client.R
-rwxrwxrwx 1 root root  3996 Jun 10 01:38 test_context.R
-rwxrwxrwx 1 root root  1542 Jun 10 01:38 test_includeJAR.R
-rwxrwxrwx 1 root root  1810 Jun 10 01:38 test_includePackage.R
-rwxrwxrwx 1 root root  4856 Jun 10 01:38 test_mllib.R
-rwxrwxrwx 1 root root  4380 Jun 10 01:38 test_parallelize_collect.R
-rwxrwxrwx 1 root root 27403 Jun 10 01:38 test_rdd.R
-rwxrwxrwx 1 root root  2327 Jun 10 01:38 test_Serde.R
-rwxrwxrwx 1 root root  7922 Jun 10 01:38 test_shuffle.R
-rwxrwxrwx 1 root root 70044 Jun 10 01:38 test_sparkSQL.R
-rwxrwxrwx 1 root root  3171 Jun 10 01:38 test_take.R
-rwxrwxrwx 1 root root  5089 Jun 10 01:38 test_textFile.R
-rwxrwxrwx 1 root root  5189 Jun 10 01:38 test_utils.R

/usr/lib/spark/R/lib/SparkR/test_support:
total 4
-rwxrwxrwx 1 root root 2886 Jun 10 01:38 sparktestjar_2.10-1.0.jar

/usr/lib/spark/R/lib/SparkR/worker:
total 12
-rwxrwxrwx 1 root root 1863 Jun 10 01:38 daemon.R
-rwxrwxrwx 1 root root 5882 Jun 10 01:38 worker.R

/usr/lib/spark/sbin:
total 92
-rwxr-xr-x 1 root root 2803 Jun 10 01:35 slaves.sh
-rwxr-xr-x 1 root root 1341 Jun 10 01:35 spark-config.sh
-rwxr-xr-x 1 root root 5243 Jun 10 01:35 spark-daemon.sh
-rwxr-xr-x 1 root root 1262 Jun 10 01:35 spark-daemons.sh
-rwxr-xr-x 1 root root 1347 Jun 10 01:35 start-all.sh
-rwxr-xr-x 1 root root 1272 Jun 10 01:35 start-history-server.sh
-rwxr-xr-x 1 root root 2403 Jun 10 01:35 start-master.sh
-rwxr-xr-x 1 root root 1622 Jun 10 01:35 start-mesos-dispatcher.sh
-rwxr-xr-x 1 root root 1423 Jun 10 01:35 start-mesos-shuffle-service.sh
-rwxr-xr-x 1 root root 1279 Jun 10 01:35 start-shuffle-service.sh
-rwxr-xr-x 1 root root 3151 Jun 10 01:35 start-slave.sh
-rwxr-xr-x 1 root root 2061 Jun 10 01:35 start-slaves.sh
-rwxr-xr-x 1 root root 1824 Jun 10 01:35 start-thriftserver.sh
-rwxr-xr-x 1 root root 1478 Jun 10 01:35 stop-all.sh
-rwxr-xr-x 1 root root 1056 Jun 10 01:35 stop-history-server.sh
-rwxr-xr-x 1 root root 1220 Jun 10 01:35 stop-master.sh
-rwxr-xr-x 1 root root 1112 Jun 10 01:35 stop-mesos-dispatcher.sh
-rwxr-xr-x 1 root root 1084 Jun 10 01:35 stop-mesos-shuffle-service.sh
-rwxr-xr-x 1 root root 1067 Jun 10 01:35 stop-shuffle-service.sh
-rwxr-xr-x 1 root root 1557 Jun 10 01:35 stop-slave.sh
-rwxr-xr-x 1 root root 1298 Jun 10 01:35 stop-slaves.sh
-rwxr-xr-x 1 root root 1066 Jun 10 01:35 stop-thriftserver.sh

/usr/lib/spark/yarn:
total 4
drwxr-xr-x 2 root root 4096 Jul 22 16:30 lib

/usr/lib/spark/yarn/lib:
total 0
lrwxrwxrwx 1 root root 39 Jul 22 16:30 datanucleus-api-jdo.jar -> ../../lib/datanucleus-api-jdo-3.2.6.jar
lrwxrwxrwx 1 root root 37 Jul 22 16:30 datanucleus-core.jar -> ../../lib/datanucleus-core-3.2.10.jar
lrwxrwxrwx 1 root root 37 Jul 22 16:30 datanucleus-rdbms.jar -> ../../lib/datanucleus-rdbms-3.2.9.jar

and contents of /usr/lib/spark/NOTICE file:

Apache Spark
Copyright 2014 The Apache Software Foundation.

This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).


========================================================================
Common Development and Distribution License 1.0
========================================================================

The following components are provided under the Common Development and Distribution License 1.0. See project link for details.

     (CDDL 1.0) Glassfish Jasper (org.mortbay.jetty:jsp-2.1:6.1.14 - http://jetty.mortbay.org/project/modules/jsp-2.1)
     (CDDL 1.0) Servlet Specification 2.5 API (org.mortbay.jetty:servlet-api-2.5:6.1.14 - http://jetty.mortbay.org/project/modules/servlet-api-2.5)
     (COMMON DEVELOPMENT AND DISTRIBUTION LICENSE (CDDL) Version 1.0) (GNU General Public Library) Streaming API for XML (javax.xml.stream:stax-api:1.0-2 - no url defined)
     (Common Development and Distribution License (CDDL) v1.0) JavaBeans Activation Framework (JAF) (javax.activation:activation:1.1 - http://java.sun.com/products/javabeans/jaf/index.jsp)

========================================================================
Common Development and Distribution License 1.1
========================================================================

The following components are provided under the Common Development and Distribution License 1.1. See project link for details.

     (CDDL 1.1) (GPL2 w/ CPE) JAXB API bundle for GlassFish V3 (javax.xml.bind:jaxb-api:2.2.2 - https://jaxb.dev.java.net/)
     (CDDL 1.1) (GPL2 w/ CPE) JAXB RI (com.sun.xml.bind:jaxb-impl:2.2.3-1 - http://jaxb.java.net/)
     (CDDL 1.1) (GPL2 w/ CPE) jersey-core (com.sun.jersey:jersey-core:1.8 - https://jersey.dev.java.net/jersey-core/)
     (CDDL 1.1) (GPL2 w/ CPE) jersey-core (com.sun.jersey:jersey-core:1.9 - https://jersey.java.net/jersey-core/)
     (CDDL 1.1) (GPL2 w/ CPE) jersey-guice (com.sun.jersey.contribs:jersey-guice:1.9 - https://jersey.java.net/jersey-contribs/jersey-guice/)
     (CDDL 1.1) (GPL2 w/ CPE) jersey-json (com.sun.jersey:jersey-json:1.8 - https://jersey.dev.java.net/jersey-json/)
     (CDDL 1.1) (GPL2 w/ CPE) jersey-json (com.sun.jersey:jersey-json:1.9 - https://jersey.java.net/jersey-json/)
     (CDDL 1.1) (GPL2 w/ CPE) jersey-server (com.sun.jersey:jersey-server:1.8 - https://jersey.dev.java.net/jersey-server/)
     (CDDL 1.1) (GPL2 w/ CPE) jersey-server (com.sun.jersey:jersey-server:1.9 - https://jersey.java.net/jersey-server/)

========================================================================
Common Public License 1.0
========================================================================

The following components are provided under the Common Public 1.0 License. See project link for details.

     (Common Public License Version 1.0) JUnit (junit:junit-dep:4.10 - http://junit.org)
     (Common Public License Version 1.0) JUnit (junit:junit:3.8.1 - http://junit.org)
     (Common Public License Version 1.0) JUnit (junit:junit:4.8.2 - http://junit.org)

========================================================================
Eclipse Public License 1.0
========================================================================

The following components are provided under the Eclipse Public License 1.0. See project link for details.

     (Eclipse Public License - Version 1.0) mqtt-client (org.eclipse.paho:mqtt-client:0.4.0 - http://www.eclipse.org/paho/mqtt-client)
     (Eclipse Public License v1.0) Eclipse JDT Core (org.eclipse.jdt:core:3.1.1 - http://www.eclipse.org/jdt/)

========================================================================
Mozilla Public License 1.0
========================================================================

The following components are provided under the Mozilla Public License 1.0. See project link for details.

     (GPL) (LGPL) (MPL) JTransforms (com.github.rwl:jtransforms:2.4.0 - http://sourceforge.net/projects/jtransforms/)
     (Mozilla Public License Version 1.1) jamon-runtime (org.jamon:jamon-runtime:2.3.1 - http://www.jamon.org/jamon-runtime/)



========================================================================
NOTICE files
========================================================================

The following NOTICEs are pertain to software distributed with this project.


// ------------------------------------------------------------------
// NOTICE file corresponding to the section 4d of The Apache License,
// Version 2.0, in this case for
// ------------------------------------------------------------------

Apache Avro
Copyright 2009-2013 The Apache Software Foundation

This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).

Apache Commons Codec
Copyright 2002-2009 The Apache Software Foundation

This product includes software developed by
The Apache Software Foundation (http://www.apache.org/).

--------------------------------------------------------------------------------
src/test/org/apache/commons/codec/language/DoubleMetaphoneTest.java contains
test data from http://aspell.sourceforge.net/test/batch0.tab.

Copyright (C) 2002 Kevin Atkinson ([email protected]). Verbatim copying
and distribution of this entire article is permitted in any medium,
provided this notice is preserved.
--------------------------------------------------------------------------------

Apache HttpComponents HttpClient
Copyright 1999-2011 The Apache Software Foundation

This project contains annotations derived from JCIP-ANNOTATIONS
Copyright (c) 2005 Brian Goetz and Tim Peierls. See http://www.jcip.net

Apache HttpComponents HttpCore
Copyright 2005-2011 The Apache Software Foundation

Curator Recipes
Copyright 2011-2014 The Apache Software Foundation

Curator Framework
Copyright 2011-2014 The Apache Software Foundation

Curator Client
Copyright 2011-2014 The Apache Software Foundation

Apache Geronimo
Copyright 2003-2008 The Apache Software Foundation

Activation 1.1
Copyright 2003-2007 The Apache Software Foundation

Apache Commons Lang
Copyright 2001-2014 The Apache Software Foundation

This product includes software from the Spring Framework,
under the Apache License 2.0 (see: StringUtils.containsWhitespace())

Apache log4j
Copyright 2007 The Apache Software Foundation

# Compress LZF

This library contains efficient implementation of LZF compression format,
as well as additional helper classes that build on JDK-provided gzip (deflat)
codec.

## Licensing

Library is licensed under Apache License 2.0, as per accompanying LICENSE file.

## Credit

Library has been written by Tatu Saloranta ([email protected]).
It was started at Ning, inc., as an official Open Source process used by
platform backend, but after initial versions has been developed outside of
Ning by supporting community.

Other contributors include:

* Jon Hartlaub (first versions of streaming reader/writer; unit tests)
* Cedrik Lime: parallel LZF implementation

Various community members have contributed bug reports, and suggested minor
fixes; these can be found from file "VERSION.txt" in SCM.

Objenesis
Copyright 2006-2009 Joe Walnes, Henri Tremblay, Leonardo Mesquita

Apache Commons Net
Copyright 2001-2010 The Apache Software Foundation

                            The Netty Project
                            =================

Please visit the Netty web site for more information:

  * http://netty.io/

Copyright 2011 The Netty Project

The Netty Project licenses this file to you under the Apache License,
version 2.0 (the "License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at:

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
License for the specific language governing permissions and limitations
under the License.

Also, please refer to each LICENSE.<component>.txt file, which is located in
the 'license' directory of the distribution file, for the license terms of the
components that this product depends on.

-------------------------------------------------------------------------------
This product contains the extensions to Java Collections Framework which has
been derived from the works by JSR-166 EG, Doug Lea, and Jason T. Greene:

  * LICENSE:
    * license/LICENSE.jsr166y.txt (Public Domain)
  * HOMEPAGE:
    * http://gee.cs.oswego.edu/cgi-bin/viewcvs.cgi/jsr166/
    * http://viewvc.jboss.org/cgi-bin/viewvc.cgi/jbosscache/experimental/jsr166/

This product contains a modified version of Robert Harder's Public Domain
Base64 Encoder and Decoder, which can be obtained at:

  * LICENSE:
    * license/LICENSE.base64.txt (Public Domain)
  * HOMEPAGE:
    * http://iharder.sourceforge.net/current/java/base64/

This product contains a modified version of 'JZlib', a re-implementation of
zlib in pure Java, which can be obtained at:

  * LICENSE:
    * license/LICENSE.jzlib.txt (BSD Style License)
  * HOMEPAGE:
    * http://www.jcraft.com/jzlib/

This product optionally depends on 'Protocol Buffers', Google's data
interchange format, which can be obtained at:

  * LICENSE:
    * license/LICENSE.protobuf.txt (New BSD License)
  * HOMEPAGE:
    * http://code.google.com/p/protobuf/

This product optionally depends on 'SLF4J', a simple logging facade for Java,
which can be obtained at:

  * LICENSE:
    * license/LICENSE.slf4j.txt (MIT License)
  * HOMEPAGE:
    * http://www.slf4j.org/

This product optionally depends on 'Apache Commons Logging', a logging
framework, which can be obtained at:

  * LICENSE:
    * license/LICENSE.commons-logging.txt (Apache License 2.0)
  * HOMEPAGE:
    * http://commons.apache.org/logging/

This product optionally depends on 'Apache Log4J', a logging framework,
which can be obtained at:

  * LICENSE:
    * license/LICENSE.log4j.txt (Apache License 2.0)
  * HOMEPAGE:
    * http://logging.apache.org/log4j/

This product optionally depends on 'JBoss Logging', a logging framework,
which can be obtained at:

  * LICENSE:
    * license/LICENSE.jboss-logging.txt (GNU LGPL 2.1)
  * HOMEPAGE:
    * http://anonsvn.jboss.org/repos/common/common-logging-spi/

This product optionally depends on 'Apache Felix', an open source OSGi
framework implementation, which can be obtained at:

  * LICENSE:
    * license/LICENSE.felix.txt (Apache License 2.0)
  * HOMEPAGE:
    * http://felix.apache.org/

This product optionally depends on 'Webbit', a Java event based
WebSocket and HTTP server:

  * LICENSE:
    * license/LICENSE.webbit.txt (BSD License)
  * HOMEPAGE:
    * https://github.com/joewalnes/webbit

# Jackson JSON processor

Jackson is a high-performance, Free/Open Source JSON processing library.
It was originally written by Tatu Saloranta ([email protected]), and has
been in development since 2007.
It is currently developed by a community of developers, as well as supported
commercially by FasterXML.com.

Jackson core and extension components may be licensed under different licenses.
To find the details that apply to this artifact see the accompanying LICENSE file.
For more information, including possible other licensing options, contact
FasterXML.com (http://fasterxml.com).

## Credits

A list of contributors may be found from CREDITS file, which is included
in some artifacts (usually source distributions); but is always available
from the source code management (SCM) system project uses.

Jackson core and extension components may licensed under different licenses.
To find the details that apply to this artifact see the accompanying LICENSE file.
For more information, including possible other licensing options, contact
FasterXML.com (http://fasterxml.com).

mesos
Copyright 2014 The Apache Software Foundation

Apache Thrift
Copyright 2006-2010 The Apache Software Foundation.

   Apache Ant
   Copyright 1999-2013 The Apache Software Foundation

   The <sync> task is based on code Copyright (c) 2002, Landmark
   Graphics Corp that has been kindly donated to the Apache Software
   Foundation.

Apache Commons IO
Copyright 2002-2012 The Apache Software Foundation

Apache Commons Math
Copyright 2001-2013 The Apache Software Foundation

===============================================================================

The inverse error function implementation in the Erf class is based on CUDA
code developed by Mike Giles, Oxford-Man Institute of Quantitative Finance,
and published in GPU Computing Gems, volume 2, 2010.
===============================================================================

The BracketFinder (package org.apache.commons.math3.optimization.univariate)
and PowellOptimizer (package org.apache.commons.math3.optimization.general)
classes are based on the Python code in module "optimize.py" (version 0.5)
developed by Travis E. Oliphant for the SciPy library (http://www.scipy.org/)
Copyright © 2003-2009 SciPy Developers.
===============================================================================

The LinearConstraint, LinearObjectiveFunction, LinearOptimizer,
RelationShip, SimplexSolver and SimplexTableau classes in package
org.apache.commons.math3.optimization.linear include software developed by
Benjamin McCann (http://www.benmccann.com) and distributed with
the following copyright: Copyright 2009 Google Inc.
===============================================================================

This product includes software developed by the
University of Chicago, as Operator of Argonne National
Laboratory.
The LevenbergMarquardtOptimizer class in package
org.apache.commons.math3.optimization.general includes software
translated from the lmder, lmpar and qrsolv Fortran routines
from the Minpack package
Minpack Copyright Notice (1999) University of Chicago.  All rights reserved
===============================================================================

The GraggBulirschStoerIntegrator class in package
org.apache.commons.math3.ode.nonstiff includes software translated
from the odex Fortran routine developed by E. Hairer and G. Wanner.
Original source copyright:
Copyright (c) 2004, Ernst Hairer
===============================================================================

The EigenDecompositionImpl class in package
org.apache.commons.math3.linear includes software translated
from some LAPACK Fortran routines.  Original source copyright:
Copyright (c) 1992-2008 The University of Tennessee.  All rights reserved.
===============================================================================

The MersenneTwister class in package org.apache.commons.math3.random
includes software translated from the 2002-01-26 version of
the Mersenne-Twister generator written in C by Makoto Matsumoto and Takuji
Nishimura. Original source copyright:
Copyright (C) 1997 - 2002, Makoto Matsumoto and Takuji Nishimura,
All rights reserved
===============================================================================

The LocalizedFormatsTest class in the unit tests is an adapted version of
the OrekitMessagesTest class from the orekit library distributed under the
terms of the Apache 2 licence. Original source copyright:
Copyright 2010 CS Systèmes d'Information
===============================================================================

The HermiteInterpolator class and its corresponding test have been imported from
the orekit library distributed under the terms of the Apache 2 licence. Original
source copyright:
Copyright 2010-2012 CS Systèmes d'Information
===============================================================================

The creation of the package "o.a.c.m.analysis.integration.gauss" was inspired
by an original code donated by Sébastien Brisard.
===============================================================================

The complete text of licenses and disclaimers associated with the the original
sources enumerated above at the time of code translation are in the LICENSE.txt
file.

This product currently only contains code developed by authors
of specific components, as identified by the source code files;
if such notes are missing files have been created by
Tatu Saloranta.

For additional credits (generally to people who reported problems)
see CREDITS file.

Apache Commons Lang
Copyright 2001-2011 The Apache Software Foundation

Apache Commons Compress
Copyright 2002-2012 The Apache Software Foundation

Apache Commons CLI
Copyright 2001-2009 The Apache Software Foundation

Google Guice - Extensions - Servlet
Copyright 2006-2011 Google, Inc.

Google Guice - Core Library
Copyright 2006-2011 Google, Inc.

Apache Jakarta HttpClient
Copyright 1999-2007 The Apache Software Foundation

Apache Hive
Copyright 2008-2013 The Apache Software Foundation

This product includes software developed by The Apache Software
Foundation (http://www.apache.org/).

This product includes software developed by The JDBM Project
(http://jdbm.sourceforge.net/).

This product includes/uses ANTLR (http://www.antlr.org/),
Copyright (c) 2003-2011, Terrence Parr.

This product includes/uses StringTemplate (http://www.stringtemplate.org/),
Copyright (c) 2011, Terrence Parr.

This product includes/uses ASM (http://asm.ow2.org/),
Copyright (c) 2000-2007 INRIA, France Telecom.

This product includes/uses org.json (http://www.json.org/java/index.html),
Copyright (c) 2002 JSON.org

This product includes/uses JLine (http://jline.sourceforge.net/),
Copyright (c) 2002-2006, Marc Prud'hommeaux <[email protected]>.

This product includes/uses SQLLine (http://sqlline.sourceforge.net),
Copyright (c) 2002, 2003, 2004, 2005 Marc Prud'hommeaux <[email protected]>.

This product includes/uses SLF4J (http://www.slf4j.org/),
Copyright (c) 2004-2010 QOS.ch

This product includes/uses Bootstrap (http://twitter.github.com/bootstrap/),
Copyright (c) 2012 Twitter, Inc.

This product includes/uses Glyphicons (http://glyphicons.com/),
Copyright (c) 2010 - 2012 Jan Kovarík

This product includes DataNucleus (http://www.datanucleus.org/)
Copyright 2008-2008 DataNucleus

This product includes Guava (http://code.google.com/p/guava-libraries/)
Copyright (C) 2006 Google Inc.

This product includes JavaEWAH (http://code.google.com/p/javaewah/)
Copyright (C) 2011 Google Inc.

Apache Commons Pool
Copyright 1999-2009 The Apache Software Foundation

=========================================================================
==  NOTICE file corresponding to section 4(d) of the Apache License,   ==
==  Version 2.0, in this case for the DataNucleus distribution.        ==
=========================================================================

===================================================================
This product includes software developed by many individuals,
including the following:
===================================================================
Erik Bengtson
Andy Jefferson

===================================================================
This product has included contributions from some individuals,
including the following:
===================================================================

===================================================================
This product has included contributions from some individuals,
including the following:
===================================================================
Joerg von Frantzius
Thomas Marti
Barry Haddow
Marco Schulze
Ralph Ullrich
David Ezzio
Brendan de Beer
David Eaves
Martin Taal
Tony Lai
Roland Szabo
Marcus Mennemeier
Xuan Baldauf
Eric Sultan

===================================================================
This product also includes software developed by the TJDO project
(http://tjdo.sourceforge.net/).
===================================================================

===================================================================
This product includes software developed by many individuals,
including the following:
===================================================================
Andy Jefferson
Erik Bengtson
Joerg von Frantzius
Marco Schulze

===================================================================
This product has included contributions from some individuals,
including the following:
===================================================================
Barry Haddow
Ralph Ullrich
David Ezzio
Brendan de Beer
David Eaves
Martin Taal
Tony Lai
Roland Szabo
Anton Troshin (Timesten)

===================================================================
This product also includes software developed by the Apache Commons project
(http://commons.apache.org/).
===================================================================

Apache Java Data Objects (JDO)
Copyright 2005-2006 The Apache Software Foundation

=========================================================================
==  NOTICE file corresponding to section 4(d) of the Apache License,   ==
==  Version 2.0, in this case for the Apache Derby distribution.       ==
=========================================================================

Apache Derby
Copyright 2004-2008 The Apache Software Foundation

Portions of Derby were originally developed by
International Business Machines Corporation and are
licensed to the Apache Software Foundation under the
"Software Grant and Corporate Contribution License Agreement",
informally known as the "Derby CLA".
The following copyright notice(s) were affixed to portions of the code
with which this file is now or was at one time distributed
and are placed here unaltered.

(C) Copyright 1997,2004 International Business Machines Corporation.  All rights reserved.

(C) Copyright IBM Corp. 2003.

The portion of the functionTests under 'nist' was originally
developed by the National Institute of Standards and Technology (NIST),
an agency of the United States Department of Commerce, and adapted by
International Business Machines Corporation in accordance with the NIST
Software Acknowledgment and Redistribution document at
http://www.itl.nist.gov/div897/ctg/sql_form.htm

Apache Commons Collections
Copyright 2001-2008 The Apache Software Foundation

Apache Commons Configuration
Copyright 2001-2008 The Apache Software Foundation

Apache Jakarta Commons Digester
Copyright 2001-2006 The Apache Software Foundation

Apache Commons BeanUtils
Copyright 2000-2008 The Apache Software Foundation

Apache Avro Mapred API
Copyright 2009-2013 The Apache Software Foundation

Apache Avro IPC
Copyright 2009-2013 The Apache Software Foundation


Vis.js
Copyright 2010-2015 Almende B.V.

Vis.js is dual licensed under both

  * The Apache 2.0 License
    http://www.apache.org/licenses/LICENSE-2.0

    and

  * The MIT License
    http://opensource.org/licenses/MIT

Vis.js may be distributed under either license.


Vis.js uses and redistributes the following third-party libraries:

- component-emitter
  https://github.com/component/emitter
  The MIT License

- hammer.js
  http://hammerjs.github.io/
  The MIT License

- moment.js
  http://momentjs.com/
  The MIT License

- keycharm
  https://github.com/AlexDM0/keycharm
  The MIT License

===============================================================================

The CSS style for the navigation sidebar of the documentation was originally 
submitted by Óscar Nájera for the scikit-learn project. The scikit-learn project
is distributed under the 3-Clause BSD license.
===============================================================================

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.