Git Product home page Git Product logo

Comments (5)

markgrover avatar markgrover commented on August 21, 2024

Thanks, Derek. That's an issue I have run into as well - the validator seems to only think of 1st party services (e.g. HDFS, YARN, HIVE, etc.) to be the only valid ones. I think it allows for additional valid service names to be provided by command line, but they aren't being used as far as I can tell.

from cm_ext.

dereklwood avatar dereklwood commented on August 21, 2024

Ah thanks, I didn't realize you could pass in additional service types. The following does appear to work for me:

$ java -jar validator.jar -s src/descriptor/service.sdl -l SPARK_ON_YARN
Validating: src/descriptor/service.sdl
Validation succeeded.

So I'll go ahead and close this. It would be nice to include these common components by default but i'm guessing they are keeping it compatible with CM4.

from cm_ext.

jackson-chris avatar jackson-chris commented on August 21, 2024

I am experiencing this same issue when trying to use the schema-validator-maven-plugin. I have the plugin configured as follows:

      <plugin>
        <groupId>com.cloudera.enterprise</groupId>
        <artifactId>schema-validator-maven-plugin</artifactId>
        <version>5.8.0</version>
        <executions>
          <execution>
            <id>validate-schema</id>
            <phase>test</phase>
            <goals>
              <goal>validate</goal>
            </goals>
            <configuration>
              <sourceDirectory>src</sourceDirectory>
              <strictMode>true</strictMode>
            </configuration>
          </execution>
        </executions>
      </plugin>

And I receive the following error:

[INFO] --- schema-validator-maven-plugin:5.8.0:validate (validate-schema) @ foo-cloudera-csd ---
[ERROR] Validating: /some/path/code/foo/foo-cloudera-csd/src/main/resources/descriptor/service.sdl
==> SPARK_ON_YARN must be a valid service type
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2.149 s
[INFO] Finished at: 2016-07-28T14:32:47-04:00
[INFO] Final Memory: 18M/303M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.cloudera.enterprise:schema-validator-maven-plugin:5.8.0:validate (validate-schema) on project foo-cloudera-csd: Encountered 1 errors -> [Help 1]
[ERROR]

I used the mvn help function to describe the configuration available for the plugin but it doesn't seem there are any options to list additional service types. Is there a way to do this that I simply missed or is this something that can be added?

from cm_ext.

mcapitanio avatar mcapitanio commented on August 21, 2024

@blindenvy You have to specify:

<configuration>
    <addValidServiceTypes>SPARK_ON_YARN</addValidServiceTypes>
</configuration>

from cm_ext.

chufucun avatar chufucun commented on August 21, 2024

This configuration works:

     <plugin>
        <groupId>com.cloudera.enterprise</groupId>
        <artifactId>schema-validator-maven-plugin</artifactId>
        <version>6.3.0</version>
        <executions>
          <execution>
            <id>validate-schema</id>
          </execution>
        </executions>
        <!-- The list containing additional valid service types separated by space. For example, "FOO BAR" -->
        <configuration>
          <addValidServiceTypes>SPARK_ON_YARN</addValidServiceTypes>
        </configuration>
      </plugin>

from cm_ext.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.