Git Product home page Git Product logo

Comments (6)

choochootrain avatar choochootrain commented on July 20, 2024

until https://issues.apache.org/jira/browse/SPARK-6363 is resolved i don't think we will support scala 2.11. but you can open a pr for when that change is made in spark

from singlestore-spark-connector.

tsindot avatar tsindot commented on July 20, 2024

I see. Which artifact are not currently published under 2.11 by the Spark project that the memsql connector is dependent on? The majority of the modules are now crossed built, including the spark-core, spark-streaming, spark-streaming-kafka, and spark-sql. The one thing I do see missing is spark-jdbc, and the thrift sever, but I don't believe that this project is dependent on those. I will put together a PR with the cross build and submit. Hopefully, you will be able to publish the 2.11 artifacts, if not I will fall back to publishing them to our local artifactory until resolved. TIA for the feedback.

-Todd

from singlestore-spark-connector.

choochootrain avatar choochootrain commented on July 20, 2024

correct, it supports 2.11 for everything we need but until we've tested it extensively we won't publish the artifacts. please feel free to put together that pr - once 1.2.1 is shipped i'll test and publish artifacts for the next release

from singlestore-spark-connector.

tsindot avatar tsindot commented on July 20, 2024

@choochootrain
Sorry, messed up the PR, closed it and created a new one.

-Todd

from singlestore-spark-connector.

btrofimov avatar btrofimov commented on July 20, 2024

@choochootrain - that https://issues.apache.org/jira/browse/SPARK-6363 is already resolved. Are there any plans to publish memsql-spark-connector with 2.11 support?

from singlestore-spark-connector.

choochootrain avatar choochootrain commented on July 20, 2024

memsql-spark-connector runs on Spark 1.5.1 at the moment because it uses some of the internal API for SQL pushdown support. publishing with 2.11 support is blocked until memsql-spark-connector is ported to Spark 2.0 - at that point, publishing with 2.11 should be straightforward

from singlestore-spark-connector.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.