Comments (5)
Thanks, Derek. That's an issue I have run into as well - the validator seems to only think of 1st party services (e.g. HDFS, YARN, HIVE, etc.) to be the only valid ones. I think it allows for additional valid service names to be provided by command line, but they aren't being used as far as I can tell.
from cm_ext.
Ah thanks, I didn't realize you could pass in additional service types. The following does appear to work for me:
$ java -jar validator.jar -s src/descriptor/service.sdl -l SPARK_ON_YARN
Validating: src/descriptor/service.sdl
Validation succeeded.
So I'll go ahead and close this. It would be nice to include these common components by default but i'm guessing they are keeping it compatible with CM4.
from cm_ext.
I am experiencing this same issue when trying to use the schema-validator-maven-plugin. I have the plugin configured as follows:
<plugin>
<groupId>com.cloudera.enterprise</groupId>
<artifactId>schema-validator-maven-plugin</artifactId>
<version>5.8.0</version>
<executions>
<execution>
<id>validate-schema</id>
<phase>test</phase>
<goals>
<goal>validate</goal>
</goals>
<configuration>
<sourceDirectory>src</sourceDirectory>
<strictMode>true</strictMode>
</configuration>
</execution>
</executions>
</plugin>
And I receive the following error:
[INFO] --- schema-validator-maven-plugin:5.8.0:validate (validate-schema) @ foo-cloudera-csd ---
[ERROR] Validating: /some/path/code/foo/foo-cloudera-csd/src/main/resources/descriptor/service.sdl
==> SPARK_ON_YARN must be a valid service type
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2.149 s
[INFO] Finished at: 2016-07-28T14:32:47-04:00
[INFO] Final Memory: 18M/303M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.cloudera.enterprise:schema-validator-maven-plugin:5.8.0:validate (validate-schema) on project foo-cloudera-csd: Encountered 1 errors -> [Help 1]
[ERROR]
I used the mvn help function to describe the configuration available for the plugin but it doesn't seem there are any options to list additional service types. Is there a way to do this that I simply missed or is this something that can be added?
from cm_ext.
@blindenvy You have to specify:
<configuration>
<addValidServiceTypes>SPARK_ON_YARN</addValidServiceTypes>
</configuration>
from cm_ext.
This configuration works:
<plugin>
<groupId>com.cloudera.enterprise</groupId>
<artifactId>schema-validator-maven-plugin</artifactId>
<version>6.3.0</version>
<executions>
<execution>
<id>validate-schema</id>
</execution>
</executions>
<!-- The list containing additional valid service types separated by space. For example, "FOO BAR" -->
<configuration>
<addValidServiceTypes>SPARK_ON_YARN</addValidServiceTypes>
</configuration>
</plugin>
from cm_ext.
Related Issues (20)
- loggingType "glog" is not visible on role log view
- CSD role description HOT 1
- CSD requiredRoleState optional?
- Validation of alternatives key in scripts object of parcel.json fails
- Alternatives.json destination requires common value between versions
- Validator fails with "Unexpected character"
- Host selection for multiple roles HOT 2
- Track Role Actions from command line
- Stop individual Role
- Text parameter type HOT 1
- How to report custom metric in CSD?
- parameter of type localDataDir doesn't get created HOT 2
- Ubuntu xenial should be a supported OS
- Can I support ElasticSearch now?
- Does this work with CDH 6 ?
- Cloudera Manager vs. validator.jar: gzip or no gzip
- HTTP error
- When will version 6.0 be supported HOT 2
- instroduction for alternatives.json HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cm_ext.