Comments (4)
It mostly works, but there are a few patches and configuration steps needed:
- We are still in the process of splitting file vs directory artifacts, which is a requirement for the Bazel RE API.
- We use SHA1, which only BuildBarn supports.
- There is some configuration in the RE settings that needs passing which we currently hardcode to our internal API.
So we have done a small build using BuildBarn, and expect to have instructions on how to do real builds in the next month or so, but for the moment, it's probably infeasible to do so.
from buck2.
This should be mostly working, you can see some of the support for it here: https://github.com/facebookincubator/buck2/tree/main/remote_execution/oss
This is using the remote execution apis described here: https://github.com/bazelbuild/remote-apis/blob/main/build/bazel/remote/execution/v2/remote_execution.proto. AIUI, there are several open source implementations of the server components of that api (e.g. https://github.com/buildbarn/bb-remote-execution).
It doesn't look like there's an example or documentation yet about how to set that up in the open source release, but I think you can expect that that will be coming soon.
from buck2.
I can see an example here now https://github.com/facebook/buck2/tree/main/examples/remote_execution/engflow so I think the issue can be closed.
One thing I haven't figured out is how to just use a shared action cache without a remote executor. Running without engine_address
throws an error.
Jobs: In progress: 78. Finished: 42. Cache hits: 0%. Time elapsed: 2.2s
^ the Cache hits is always zero - I assume that's because there is no local cache?
from buck2.
Yep, the shared action cache currently requires the remote executor. We are looking at whether a local shared executor might be a good idea, e.g. #105
from buck2.
Related Issues (20)
- Conflicting inputs on erlang build of Opentelemetry HOT 1
- error: Variable `typing` not found HOT 2
- Excluding rules from certain platforms HOT 6
- Unable to `buck2 clean` a repo which uses `git_fetch()` on Windows
- `configured_alias` and configuration modifiers HOT 2
- review Go analysis.Pass.Module proposal
- Creating symbolic links to toolchains HOT 10
- Early-building some parts of graph HOT 7
- How to use "buck2 clean" or other commands to delete only the generated files (cache) without killing the daemon? HOT 2
- Question: how to pass dependencies that change state forward across a non-output-changing rule HOT 4
- buck2 : Is java supported as a part of buck2 HOT 2
- Share work across configurations by setting working directory for actions then canonicalizing that working directory in RE HOT 5
- How to use multiple execution platforms HOT 1
- Distributed project.ignore
- How to use c/aquery to find the dependents of an anon_target HOT 3
- Trouble linking Apple Frameworks HOT 1
- documentation mentions `frecli` which doesn't seem to be available publicly HOT 1
- Adding support for new languages HOT 5
- Java rules don't appear to be usable in OSS edition of buck2 HOT 2
- Builtin prelude support for running python in a venv?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from buck2.