MacOS build keeps failing because of permissions with "npm"

Do you have additional instructions when this occurs.

Values not displaying in Security Analysis and Functional Tests sections in the Quality Widget. This has been an issue for months with no timeline of when it's going to be resolved. When Hygieia was introduced to the world this issue was present. At one time when the product was called Dash it worked.

Business Need

As a DevOps engineer, I want to be able to interact with the Feature widget on the Hygieia Dashboard in a meaningful way, so that I can get more detail into my agile content going through my pipeline.

Acceptance Criteria

GIVEN a configured Hygieia Feature Widget
WHEN certain progress values for an Agile team and sprint are unfavorable
THEN the Hygieia Feature Widget flags "Yellow" and/or "Red" depending on severity

GIVEN a configured Hygieia Feature Widget
WHEN the Widget is clicked
THEN the user is sent to a DevOps-configured web page (e.g., the content management source system or another tool that aggregates/analyzes Agile data)

Gradle was introduced by committers of Hygieia , but it was later found that API layer was not running correctly in IDE's like Eclipse , we need more time fixing it,
Gradle has been pulled out for now and maven based build pom's are put back.

The issue is open to get Gradle based build working. A seperate branch gradle has been created for this purpose

When running mvn --settings [Path to your settings.xml] clean compile install package I receive a build failure on com.github.eirslett:frontend-maven-plugin

The documentation says the following configuration:

sonar.metrics=ncloc,coverage,violations,critical_violations,major_violations,blocker_violations

However, this results in the following:

(So, 0% coverage data).

This is because the sonar metrics displayed in the UI is not the coverage, but the line coverage (line_coverage). It's confusing.

Then, updating the configuration doesn't do anything. I add the metric line_coverage, and no line_coverage is added. The non-obvious fix for that is to run the following Mongo query:

db.code_quality.drop()

What are you ideas on that?

The code repo widget is pulling in the same commit message multiple times (i.e. when clicking on the code repo graph). The longer you keep your dashboard active in your browser, the more messages appear.

Add the ability to track the team members, either just the number of members or names too as they change over time. Also track when team members are on vacation / off the project (temporarily).

This will provide a way for the dashboard to plot the number of team members for a given sprint / release as another metric to feed into the project health.

@tabladrum think this is of value to anyone?

Business Need

As a DevOps engineer, I need to see the Build widget on Hygieia display as a block "Yellow" warning on Yellow statuses in Jenkins and Hudson, not just "Red," so that I can more clearly understand what the true status is of my builds

Acceptance Criteria

GIVEN the Hygieia Build Widget
WHEN a Jenkins OR Hudson job is Yellow
THEN the Hygieia Build Widget displays as block "Yellow" status warning (not "Red")

Narrative:

The current Jira collector only considers "teams" to be the Jira Project ; likewise, Jira only considers the out-of-the-box "Remaining Estimate" field for estimates. Although this may be the case for most flat organizations, larger organizations may require a custom field option for setting Teams; respectively, the out of the box estimates field does not work for everyone. I would suggest allowing a user to configure custom to their own process a field that sets where "Team" data exists~~; likewise, this should also exist for estimates.~~

Acceptance Criteria:

• Teams are configurable at runtime for the Jira Feature Collector, and thus configurable for the end-user on the widget display from drop-down filters
• Estimate fields are configurable at runtime for the Jira Feature Collector, and thus display on the widget for the end-user

Use Case:

# Teams
GIVEN the Hygieia Feature Widget
WHEN a user configures the widget for his/her team
THEN the "teams" available are from the custom organization configured by the specific implementation of Jira and the Hygieia Dashboard for his/her org needs

# Estimates
GIVEN: A Jira Board configured with custom Estimate fields
WHEN: An issue type story is created using a customized Estimate field
THEN: The issue type story's Estimate value is applied to a running implementation of Hygieia's Feature Widget IF the custom Estimate field is mentioned at runtime.

Several of the collectors have copy & pasted code for the http clients & processing code. I'd like to see them share a common set of utils & clients. I would suggest something like https://github.com/Netflix/feign with okhttp, such that the code would be more readable.

• Create shared client code / utils
• Simplify http client code across collectors
• Ability to record server responses - so that we can replay them for unit tests

Create Dockerfile's for each individual service and docker-compose.yml for the entire app to spin the whole application with a single command: docker-compose up.

as its hard coded the segmentApi path which is only for github enterprise.

PR on its way to move this path into the settings (and default to github enterprise)

a trivial PR on its way...

UI should have a configuration ability to allow you to point it to a URL for the API
localhost references definitely need to get removed.

find . -type f |xargs grep /api
./app/dashboard/core/data-factories/build-data.js:        var buildDetailRoute = '/api/build/';
./app/dashboard/core/data-factories/code-analysis-data.js:        var caDetailRoute = '/api/quality/';
./app/dashboard/core/data-factories/code-repo-data.js:        var caDetailRoute = '/api/commit';
./app/dashboard/core/data-factories/collector-data.js:        var itemRoute = '/api/collector/item';
./app/dashboard/core/data-factories/collector-data.js:        var itemsByTypeRoute = '/api/collector/item/type/';
./app/dashboard/core/data-factories/collector-data.js:        var collectorsByTypeRoute = '/api/collector/type/';
./app/dashboard/core/data-factories/dashboard-data.js:        var dashboardRoute = '/api/dashboard';
./app/dashboard/core/data-factories/dashboard-data.js:        var mydashboardRoute = "/api/dashboard/mydashboard";
./app/dashboard/core/data-factories/dashboard-data.js:        var myownerRoute = "/api/dashboard/myowner";
./app/dashboard/core/data-factories/deploy-data.js:        var deployDetailRoute = '/api/deploy/status/';
./app/dashboard/core/data-factories/feature-data.js:        var testTotal = 'http://localhost:8080/api/feature/estimates/total/Team:9933916?component=552e7b21c44a49be6261d54a';
./app/dashboard/core/data-factories/feature-data.js:        var buildTotal = '/api/feature/estimates/total/';
./app/dashboard/core/data-factories/feature-data.js:        var testWip = 'http://localhost:8080/api/feature/estimates/wip/Team:9933916?component=552e7b21c44a49be6261d54a';
./app/dashboard/core/data-factories/feature-data.js:        var buildWip = '/api/feature/estimates/wip/';
./app/dashboard/core/data-factories/feature-data.js:        var testDone = 'http://localhost:8080/api/feature/estimates/done/Team:9933916?component=552e7b21c44a49be6261d54a';
./app/dashboard/core/data-factories/feature-data.js:        var buildDone = '/api/feature/estimates/done/';
./app/dashboard/core/data-factories/feature-data.js:        var testFeatureWip = 'http://localhost:8080/api/feature/estimates/super/Team:9933916?component=552e7b21c44a49be6261d54a';
./app/dashboard/core/data-factories/feature-data.js:        var buildFeatureWip = '/api/feature/estimates/super/';
./app/dashboard/core/data-factories/feature-data.js:        var testSprint = 'http://localhost:8080/api/iteration/Team:9933916?component=552e7b21c44a49be6261d54a';
./app/dashboard/core/data-factories/feature-data.js:        var buildSprint = '/api/iteration/';
./app/dashboard/core/data-factories/feature-data.js:        var testTeams = 'http://localhost:8080/api/collector/item/type/ScopeOwner';
./app/dashboard/core/data-factories/feature-data.js:        var buildTeams = '/api/collector/item/type/ScopeOwner';
./app/dashboard/core/data-factories/feature-data.js:        var testTeamByCollectorItemId = 'http://localhost:8080/api/collector/item/552ecefac44af4d37f321a6e';
./app/dashboard/core/data-factories/feature-data.js:        var buildTeamByCollectorItemId = '/api/collector/item/';
./app/dashboard/core/data-factories/login-data.js:        var LoginDetailRoute = '/api/authenticateUser/';
./app/dashboard/core/data-factories/monitor-data.js:        var monitorRoute = '/api/dashboard/';
./app/dashboard/core/data-factories/monitor-data.js:        var serviceRoute = '/api/service/';
./app/dashboard/core/data-factories/signup-data.js:        var SignupDetailRoute = '/api/registerUser/';
./app/dashboard/core/data-factories/test-suite-data.js:        var caDetailRoute = '/api/test/';
./test-data/commit_detail.json:            "scmCommitLog": "Add /api/canadianflag url to entitlements exclusion list - since its invoked from footer present on /cvv page. ",

Hi,

According to the Readme in the UI it is possible to start the client without building and deploying the API, right ?

"All data is currently coming from the test-data folder so you shouldn't need an api, but also means no settings will be saved.."

I can start the UI, but then you need to login to enter the dashboard. Is there a default user available to login ?

Jira collector not showing any data. Where would this error be occurring from? It can see all Scopes on Jira but Sprint Information not showing up

The current quality UI widget has a 'rules compliance' metric. However, since version 4.0, this metric has been removed from Sonar: https://jira.sonarsource.com/browse/SONAR-4755

What do we want to do with this? Remove it from the UI also?

Hi all,

Right now, the Hygieia code is using two build tools, Maven and Gradle, and I find it a bit confusing to know which one to use. The current documentation is just as confusing, since some of the documentation (for example, the main documentation) talks about Gradle, but the documentation of the sub projects talk about Maven.

I can do a pull request, that's fine, but I'd like to know the general sentiment about getting rid of the Maven code.

When running the GitHubSourceCodeCollector, the API calls specify a time that is ten minutes in the past to get the most recent commits. The timezone is not specified and Github.com's api.github.com assumes they are in Pacific time. If your server's date is in Pacific time and you run the collector everything is ok. Api.github.com allows you to specify a timezone on the end of your date BTW.

I can't seem to find where to specify the subversion url. The documentation mentions username, password, but nothing about the repo url.

I banged my head a bit getting all the parts built and running.

To make my life easier at least - and hopefully others giving the project a try - I've hacked up

• a little root maven pom.xml so you can build the common java stuff from the root directory
• made it easy to run things via the maven command line to avoid folks having to do much spring boot configuration on startup etc
• added a little bit more logging on startup so you can see what the effective configuration is for mongo / jenkins / github etc so you can be sure that the spring boot configuration magic is properly working ;)
• polished the README.md's a little here or there

A PR on its way shortly...

Not showing the correct number of commits/contributors from Github.

As explained by tabladrum:
When the collector runs continuously, the numbers will be correct over 14 days. Each time (based on the cron setting) the collector runs, it fetches commits from lastupdated - 10 mins (randomly set) and discards the duplications while saving it.

Enhancement needed: For the first run, go back 14 days.

Can you explain more about the jira collector configuration, especially the following part?

#In-built folder housing prepared REST queries (required)
feature.queryFolder=jiraapi-queries

#Jira API Query file names (String template requires the files to have .st extension) (required)
feature.storyQuery=story
feature.epicQuery=epic
feature.projectQuery=projectinfo
feature.memberQuery=memberinfo
feature.sprintQuery=sprintinfo
feature.teamQuery=teaminfo
feature.trendingQuery=trendinginfo

Installed Mongo
Downloaded Hygieia V1.2.0
Successfully ran mvn clean compile install package
Created application.properties in corresponding config folders for Hudson Collector and Subversion Collector
Run both hudson and subversion collector with java -jar
Run gulp serve in the UI folder

Everything appears to come up ok
I see data has been created in mongo
I can add a dashboard in the UI

But, I can not succesffuly add any widgets via the UI.

For subversion the dialog box comes up and and can select subversion and provide a url, but it will not save.
Debugging the JS I see

    function submitForm(valid, url, repoType) {
        ctrl.submitted = true;
        if (valid && ctrl.collectors.length) {

ctrl.collectors.length is 0

For the build widget, it comes up but there are no options avaible in the "Select a build job" drop down.

I've reviewed the documentation several time, but I feel like I'm missing some simple step.

Thanks,

Tony Perkins
Fidelity Investments

i am having issue to bring up the github collector. (btw, my password has some special character like *.) Not sure this caused the issue.

One more thing, does it support git/stash?

Working on Docker Build. Everything worked except for UI

I am working on the NodeJS, Gulp dependencies.

Publish images to docker hub

Is it possible to do a TFS collector? I know that there is a Java SDK for TFS found here http://blogs.msdn.com/b/bharry/archive/2011/05/16/announcing-a-java-sdk-for-tfs.aspx

Not sure if anyone has done this before?
Is it something that can be added to this repo?

Thanks.

Need unit tests for github collector.

Trying to spin it up and I'm only running the NodeJS backend. I wanted to see how it would fail if I didn't have the backend running so I could better understand what port the backend runs on and such. But the error is not so helpful:

[Proxy] { [Error: connect ECONNREFUSED]
  code: 'ECONNREFUSED',
  errno: 'ECONNREFUSED',
  syscall: 'connect' }

I would love it if it would say what code is failing and what it's trying to connect to.

If you let me know where this might be happening, I could take a stab at a PR....

The version of rest api dependents on core 0.3.1-SNAPTSHOT, but the core has 0.3.1 in the master branch, need to be consistent.

Please help, stood up Hygieia, can't signup.

• maven "Reactor Summary" all are a SUCCESS
• mongodb "show dbs" has admin, local & test
• mongodb "show collections" indicates the following:

> show collections
system.indexes
system.users
system.version
> db.getCollection("system.users").find()
{ "_id" : "dashboarddb.dashboarduser", "user" : "dashboarduser", "db" : "dashboarddb", "credentials" : { "SCRAM-SHA-1" : { "iterationCount" : 10000, "salt" : "REDACTED==", "storedKey" : "REDACTED", "serverKey" : "REDACTED" } }, "roles" : [ ] }

• After a while there is more information that could be helpful

GET http://REDACTED:3000/browser-sync/browser-sync-client.1.7.3.js net::ERR_INCOMPLETE_CHUNKED_ENCODING
Error: [$compile:tpload] Failed to load template: app/dashboard/views/signup.html
http://errors.angularjs.org/1.3.17/$compile/tpload?p0=app%2Fdashboard%2Fviews%2Fsignup.html
    at REGEX_STRING_REGEXP (angular.js:63)
    at handleError (angular.js:16233)
    at processQueue (angular.js:13300)
    at angular.js:13316
    at Scope.$get.Scope.$eval (angular.js:14555)
    at Scope.$get.Scope.$digest (angular.js:14371)
    at Scope.$get.Scope.$apply (angular.js:14660)
    at done (angular.js:9734)
    at completeRequest (angular.js:9924)
    at XMLHttpRequest.requestError (angular.js:9875)

When typing in the login form, the username/password are automatically populated in any other browsers that are currently viewing the login page, as you type.

When building the lira collector:
com.capitalone.versionone:jira-client:jar:01.01.00.01-SNAPSHOT is missing, no dependency information available

the latest change to the pom.xml in UI is breaking the mvn install.

it now hangs on the gulp serve that has been added and won't continue/finish the installation.

https://crackstation.net/hashing-security.htm

What permissions are needed for the jira user.

I am trying to use a read-only kind of user but getting '403 Forbidden' error in the collector logs.

Thanks.

Our jenkins is being set up with no readonly if there is no login. I didn't see any usename and password to configure in the application.properties file.

Can it be added?

After syncing with the latest version of Hygieia, whenever I run gulp serve, the initial login page shows, but after that, I get an error:

_http_outgoing.js:335
    throw new Error('Can\'t set headers after they are sent.');
          ^
Error: Can't set headers after they are sent.
    at ServerResponse.OutgoingMessage.setHeader (_http_outgoing.js:335:11)
    at ServerResponse.writeHead (_http_server.js:195:21)
    at ProxyServer.<anonymous> (/Users/erikp/Userfiles/Klanten/Rabobank/Projects/cqc-dashboard/UI/gulp/proxy.js:32:7)
    at ProxyServer.emit (/Users/erikp/Userfiles/Klanten/Rabobank/Projects/cqc-dashboard/UI/node_modules/http-proxy/node_modules/eventemitter3/index.js:100:27)
    at ClientRequest.proxyError (/Users/erikp/Userfiles/Klanten/Rabobank/Projects/cqc-dashboard/UI/node_modules/http-proxy/lib/http-proxy/passes/web-incoming.js:139:16)
    at ClientRequest.emit (events.js:129:20)
    at Socket.socketErrorListener (_http_client.js:271:9)
    at Socket.emit (events.js:107:17)
    at net.js:459:14
    at process._tickCallback (node.js:355:11)

After gulp serve. I got the the page "Cannot GET /".

when I use gulp serve to bring up UI, after i sign in, i cannot create a new dashboard, and found the following exception. Actually, my api is installed in tomcat with port 8080.

I didn't see any documentation for this portion in the github, did I miss anything?

http://localhost:3000/api/dashboard/mydashboard/kyosong Failed to load resource: the server responded with a status of 404 (Not Found)

Rather than generic names like "CodeQuality" we should rename the directories to meaning ones that represent what they are, like "SonarCollector" or something along those lines.

Hi,

I build the api with mvn install.

The tests fail with:
java.lang.IllegalStateException: Failed to load ApplicationContext ...

Caused by: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'encryptionController' defined in file [path/to/api/target/classes/com/capitalone/dashboard/rest/EncryptionController.class]: Unsatisfied dependency expressed through constructor argument with index 0 of type [com.capitalone.dashboard.service.EncryptionService]: : No qualifying bean of type [com.capitalone.dashboard.service.EncryptionService] found for dependency: expected at least 1 bean which qualifies as autowire candidate for this dependency. Dependency annotations: {}; nested exception is org.springframework.beans.factory.NoSuchBeanDefinitionException: No qualifying bean of type [com.capitalone.dashboard.service.EncryptionService] found for dependency: expected at least 1 bean which qualifies as autowire candidate for this dependency. Dependency annotations: {}

mvn compile works, and the class is located at ./target/classes/com/capitalone/dashboard/rest/EncryptionController.class.

Also the core module is build with success.

Any idea ?

Thanks,
Martijn

Based on the feedback from #52 need to create a simplified and straightforward step by step getting started guide.

How Can I create a Custom Widget that will render a URL?

Do I need to start with cloning and existing collector?

Hi!

Are there any guidelines for contributing? I've submitted the form for the license agreement and I'd like to implement Collectors for CircleCI and Pivotal. I'm not sure if you'd like them to contributed back to this repo or just kept in my fork.

[13:47:34] Warning: gulp version mismatch:
[13:47:34] Global gulp is 3.9.0
[13:47:34] Local gulp is 3.8.11
[13:47:35] Using gulpfile ~/projects/Hygieia/Hygieia/UI/gulpfile.js
[13:47:35] Starting 'consolidate:jade:app'...
[13:47:35] Starting 'consolidate:jade:components'...
[13:47:35] Starting 'wiredep'...
[13:47:35] Starting 'injector:css:preprocessor'...
[13:47:36] Starting 'themes-watcher'...
[13:47:36] Starting 'scripts'...
[13:47:36] Starting 'fonts'...
[13:47:36] Finished 'consolidate:jade:app' after 837 ms
[13:47:36] Finished 'consolidate:jade:components' after 683 ms
[13:47:36] Starting 'consolidate:jade'...
[13:47:36] Finished 'consolidate:jade' after 11 μs
[13:47:36] Starting 'consolidate'...
[13:47:36] Finished 'consolidate' after 6.16 μs
[13:47:36] gulp-inject 7 files into index.less.
[13:47:36] Finished 'wiredep' after 700 ms
[13:47:36] Finished 'injector:css:preprocessor' after 786 ms
[13:47:36] Starting 'styles'...

/Users/benp/projects/Hygieia/Hygieia/UI/src/app/chartist/plugins/pointHalo.js
line 13 col 17 Confusing use of '!'.

⚠ 1 warning

/Users/benp/projects/Hygieia/Hygieia/UI/src/app/chartist/plugins/tooltip.js
line 19 col 17 Confusing use of '!'.
line 19 col 52 Confusing use of '!'.
line 91 col 22 Don't make functions within a loop.
line 97 col 22 Don't make functions within a loop.

⚠ 4 warnings

[13:47:38] Finished 'styles' after 1.92 s
[13:47:38] Starting 'injector:css'...

/Users/benp/projects/Hygieia/Hygieia/UI/src/app/dashboard/controllers/site.js
line 121 col 10 Unnecessary semicolon.

⚠ 1 warning

[13:47:38] gulp-inject 1 files into index.html.
[13:47:38] Finished 'injector:css' after 128 ms

/Users/benp/projects/Hygieia/Hygieia/UI/src/app/dashboard/directives/widget-container.js
line 87 col 33 Use '===' to compare with 'null'.

⚠ 1 warning

/Users/benp/projects/Hygieia/Hygieia/UI/src/components/widgets/codeanalysis/view.js
line 80 col 14 Missing semicolon.
line 88 col 30 Missing semicolon.

⚠ 2 warnings

[13:47:40] Finished 'themes-watcher' after 3.99 s
[13:47:40] Finished 'fonts' after 4.03 s

/Users/benp/projects/Hygieia/Hygieia/UI/src/app/dashboard/core/extensions/ng-fitText.js
line 68 col 26 Don't make functions within a loop.
line 73 col 99 Expected an assignment or function call and instead saw an expression.

⚠ 2 warnings

[13:47:40] Finished 'scripts' after 4.41 s
[13:47:40] Starting 'injector:js'...
[13:47:40] gulp-inject 62 files into index.html.
[13:47:40] Finished 'injector:js' after 293 ms
[13:47:40] Starting 'watch'...
[13:47:40] Finished 'watch' after 58 ms
[13:47:40] Starting 'serve'...
[13:47:40] Finished 'serve' after 40 ms
[BS] Local URL: http://localhost:3000/
[BS] External URL: http://192.168.1.177:3000/
[BS] Serving files from: .tmp
[BS] Serving files from: src
[BS] Watching files...
[Proxy] { [Error: connect ECONNREFUSED]
code: 'ECONNREFUSED',
errno: 'ECONNREFUSED',
syscall: 'connect' }
[Proxy] { [Error: connect ECONNREFUSED]
code: 'ECONNREFUSED',
errno: 'ECONNREFUSED',
syscall: 'connect' }
[Proxy] { [Error: connect ECONNREFUSED]
code: 'ECONNREFUSED',
errno: 'ECONNREFUSED',
syscall: 'connect' }
[Proxy] { [Error: connect ECONNREFUSED]
code: 'ECONNREFUSED',
errno: 'ECONNREFUSED',
syscall: 'connect' }
[Proxy] { [Error: connect ECONNREFUSED]
code: 'ECONNREFUSED',
errno: 'ECONNREFUSED',
syscall: 'connect' }
[Proxy] { [Error: connect ECONNREFUSED]
code: 'ECONNREFUSED',
errno: 'ECONNREFUSED',
syscall: 'connect' }

once I've run gulp serve the site appears however any attempt to register a new user with the API ends with a Proxy ECONNREFUSED. Do I need to to build the API component as well?

EDIT:

environment Mac OSX yosemite

Hi,

I am getting java.lang.NullPointerException errors on trying to start the hudson collector. Other collectors are working fine. But I am not able to get the jenkins collector to work.

2015-07-31 09:28:27,591 ERROR o.s.boot.SpringApplication - Application startup failed
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'hudsonCollectorTask': Invocation of init method failed; nested exception is java.lang.NullPointerException
    at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:136) ~[spring-beans-4.1.4.RELEASE.jar!/:4.1.4.RELEASE]
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:408) ~[spring-beans-4.1.4.RELEASE.jar!/:4.1.4.RELEASE]

Full stacktrace of the error is here: https://gist.github.com/bimlendu/82a5be5606464fd17743

Thanks.