Compact view about gwf-graph HOT 5 OPEN

I'm considering adding a Group feature to gwf in version 2.0, so you can write something like:

with gwf.group("map_reads") as g:
    for sample_id in samples:
        g.target("sample_{}".format(i}, inputs=[], outputs=[], ...) <<< "..."

This would prefix all target names with "map_reads", but also save the group(s) (they could be nested) associated with each target. With that you can compact each all groups (or just large groups) as you describe.

from gwf-graph.

That would be really useful when naming targets and especially afterwards for doing this specific task.
Right now I have come up with a solution where I run BFS on the graph and identify parallel paths, but then I will have to use some heuristics, for making a sanity check, where I look at the targets names to see if the naming is similar, for example by seeing that all parallel targets starts with "map_reads". With the group feature the heuristics would be unnecessary, because it would be fair to expect that the user use groups if they want a compact graph.

from gwf-graph.

Sounds like a sensible solution for now! :-)

from gwf-graph.

I'm considering adding a Group feature to gwf in version 2.0, so you can write something like:

with gwf.group("map_reads") as g:
    for sample_id in samples:
        g.target("sample_{}".format(i}, inputs=[], outputs=[], ...) <<< "..."

You probably already have this in mind, but it would be really nice to summarize related jobs into one line for gwf status.

from gwf-graph.

@jbethune That is one of the main reasons for introducing a group feature, yes 🙂

from gwf-graph.