Git Product home page Git Product logo

hiveudf's Introduction

HiveUDF

This Hive UDF sample code contains 2 functions: MyUpper() and MyContains()

They are tested in Hive 0.12, 0.13 and 1.0.

To make Hive UDF work in Drill, please follow this blog:

http://www.openkb.info/2015/08/how-to-run-hive-udf-in-drill.html

a. How to build the jar

mvn package

##b. Prepare a Hive table with sample data

In Hive CLI, create a test table:

CREATE TABLE testarray(col1 string, col2 string) ROW FORMAT DELIMITED FIELDS TERMINATED BY "|";
CREATE TABLE testarray2(col1 array<string>, col2 string) ;

Put below data for testarray:

echo "abc|xyz" > test.data

Insert into testarray2:

insert into table testarray2 select array(col1,col2),col2 from testarray;

hive> select * from testarray2 ;
OK
["abc","xyz"]	xyz
Time taken: 0.06 seconds, Fetched: 1 row(s)

##c. Test UDF

ADD JAR ~/target/MyUDF-1.0.0.jar;
CREATE TEMPORARY FUNCTION MyUpper AS 'openkb.hive.udf.MyUpper'; 
CREATE TEMPORARY FUNCTION MyContains AS 'openkb.hive.udf.MyContains'; 

SELECT MyUpper(col2) FROM testarray2;
XYZ

SELECT MyContains(col1,col2) FROM testarray2;
true

hiveudf's People

Contributors

viadea avatar

Watchers

James Cloos avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.