Comments (5)
Pipelines tools like make are difficult to use in R since these tools are language agnostic. Therefore, these tools add extra friction and obstruct the workflow if applied into particular language like R.
In the meantime, using a package like drake that is designed for R would work well within the language. The user can write functions instead of script files. Moreover, the functions return objects which will be saved automatically instead of output that need to be saved manually. In addition, R-focus interface to define the skippable steps of the workflow instead of MakeFiles.
from ds-pipelines-1.
I find it interesting how eight simple steps can make the workflow easy for collaborators and make reproducibility possible. The first step is file organization and naming, it is a simple and valuable tool. A good file organizing and proper naming will be useful for collaborators including myself. Also, adopting one organization method that includes file separation is also a useful tool. For example, separating code scripts from data files is an easy and good workflow. The final step to organize files is creating the Readme files and continuously updating it with any project/file changes.
The second step for reproducibility is to perform all tasks using a script. Itβs a simple step that allows all project collaborators to keep a record of all the changes made to a project or a data file. In the meantime, this step will allow collaborators to reproduce the change to any file/data. The third step is automating the process which also a simple step that can save the collaborator time for past and future work.
from ds-pipelines-1.
Your text look great. I am going to close this even though it is assigned to Alison so you can move on.
from ds-pipelines-1.
Great comments @RAtshan! β¨
You could consider GNU make to be a great grandparent of the packages we asked you to install early in this lesson (drake
, remake
, and scipiper
). The lead of drake
has added a lot of useful features to dependency management systems in R, and has a great way of summarizing why we put energy into using these tools. "Skip the work you don't need"
We'd like you to next check out a short part of Will's video on drake
πΊ Activity: watch video on drake from at least 3:33 to 7:42 (you are welcome to watch the whole thing)
Use a github comment on this issue to let us know what contrasts you identified between solutions in make
and what is offered in R-specific tools, like drake
. Please use less than 300 words. Then assign your onboarding cohort team member this issue to read what you wrote. When they are done, welcome them to comment with any questions or comments.
When you are satisfied with the discussion, you can close this issue and I'll direct you to the next one.
from ds-pipelines-1.
When you are done poking around, check out the next issue.
from ds-pipelines-1.
Related Issues (6)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
π Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. πππ
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google β€οΈ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ds-pipelines-1.