Persistent test settings about cms-bot HOT 8 CLOSED

A new Issue was created by @kpedro88 Kevin Pedro.

@davidlange6, @Dr15Jones, @smuzaffar, @fabiocos, @kpedro88 can you please review it and eventually sign/assign? Thanks.

cms-bot commands are listed here

from cms-bot.

Thanks @kpedro88 for opening the issue. This is on our to do list. @mrodozov is looking in to it. We are thinking of a special comment e.g.

test parameters/settings
pull_requests=#PR1,#PR2,cms-sw/cmsdist#PRn
workflows=534.0,540.0
release=CMSSW_11_0_DEVEL_X
architecture=slc7_amd64_gcc900
full_build=true|false

bot then can use the settings from the last such comment made by a user, who has rights to start tests. One can still override part of settinsg via please test .... comment

Is this sound reasonable?

from cms-bot.

@smuzaffar is the syntax of these extra settings flexible or rigid? I mean are all the fields always needed, or the default will be used unless specified otherwise? I guess the latter is what we want.
What about possible changes of settings during the PR review? They will be always possible I guess...

from cms-bot.

@smuzaffar this looks reasonable to me, thanks

Maybe worthwhile to have separate items for CMSSW PRs vs external PRs?

It would also be nice to have an option for the bot to print all the specified test settings, in case they get updated piecemeal over the course of a long PR review.

from cms-bot.

@kpedro88 pls see #1234 and maybe close this.

from cms-bot.

@mrodozov can you provide some description of how the new functionality works (preferably in the cms-bot command documentation so it's clear to everyone)?

from cms-bot.

@kpedro88 , there are still few issues with this thatis why I did not advertise or updates here. Basic documentation is available cms-bot commands page http://cms-sw.github.io/cms-bot-cmssw-cmds.html but we are still testing this feature.

from cms-bot.

Okay, since this is nominally in place, the issue can be closed. Thanks!

from cms-bot.