Comments (4)
Congrats on being first :)
We don’t currently have plans to open-source the server.
Our goal is to enable Google-engaged open source projects to leverage Mako to enable/accelerate sustainable performance automation. We believe that this goal can be achieved with a hosted server and a set of open source client libraries which can be used in open source tests. This will allow us to scope our support of customers with the resources that we have available for this project.
That being said, we want community feedback regarding whether this scoping and prioritization will work. If not, we are eager to hear what workflows have friction and what we can do to make engineers/teams successful.
from mako.
As a Knative contributor I'd like to run these performance tests against a development branch/different cluster configurations but not spam the hosted mako dashboard.
I think the hosted dashboard would get unwieldy if each contributor has N variations of similar perf tests.
from mako.
Also using knative - can I publish results for tests run on AKS (for instance) to mako?
from mako.
I think the hosted dashboard would get unwieldy if each contributor has N variations of similar perf tests.
Great observation. This is the reason Mako supports tags (see TAGS.md). You can use tags to group all your personal runs together. And the Label Official Runs best practice should ensure such runs don’t clutter the canonical/official charts.
For example, you might want your runs to have the tag type=private
(to distinguish it from type=official
), and/or user=dprotaso
.
Note that to enable this the test should be written in a way that makes it easy for the caller to pass in custom tags to be applied to the run. e.g.
run_perf_test.sh --additional_tags=”type=private,user=dprotaso”
In that example, to chart all your runs your URL could look something like: https://mako.dev/b/XXXXXXXX&tag=type%3Dprivate&tag=user%3Ddprotaso (replace ‘XXXXXXXX’ with the correct benchmark key).
With the Mako command-line, you could query for your runs like:
mako list_runs --benchmark_key=”XXXXXXXX” --tag_list=”type=private,user=dprotaso”
And in analyzers that can make use of run history, you could populate the analyzer configuration’s RunInfoQuery (see mako.proto) with those tags in order to make sure you’re comparing apples to apples.
Also using knative - can I publish results for tests run on AKS (for instance) to mako?
Sure. You can publish results from anywhere as long as:
- It has access to https://mako.dev
- Google authentication is established. See AUTHENTICATION.md. Note this section of the Google Cloud documentation about developing code locally, deploying your application on-premises, or deploying to another public cloud.
To connect to the tags question, this is where you might add a tag like environment=AKS
.
from mako.
Related Issues (13)
- CLI build (and probably others) is broken on mac HOT 1
- Interested in using Mako for an open source project HOT 1
- Use google.golang.org/protobuf instead of github.com/golang/protobuf HOT 2
- Please allowlist exposure-notifications-verification-server project to use mako.dev HOT 1
- Errors when using Microservice Docker image
- Whitelist Request HOT 1
- Determine how to accept data from non-Google users HOT 7
- Compiled proto and gRPC files in the repo HOT 1
- Use klog instead of glog HOT 2
- Make bazel build compatible with Bazel 1.x
- Please whitelist Asylo project to use Mako HOT 2
- Please whitelist agones.dev project to use mako.dev HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mako.