Apply CBF on discrete action space about cbf HOT 2 OPEN

Hi Lalu,

Thank you for raising this issue and glad that you are interested in our work. You are right that we apply CLF and CBF in continuous action space. For potential implementation of CBF on discrete action space, I wouldn't say it's out of possibility but it would be definitely challenging as both DDP and lie derivative thing won't be able to work for discrete action space.

I'm glad to follow up more in email, please reach out to [email protected] if you are interested in a further discussion or we can directly hop on a call.

from cbf.

Thanks for your reply @junzengx14

I hope you meant differential dynamic programming by DDP. It makes sense that differential dynamic programming and lie derivatives wouldn't work for discrete action space. Probably that's why CBF and CLF are mostly applied to continuous action space in literature.

I would like to learn more about these limitations of CBF and find some way of addressing them. Happy to connect 😄. I will send you a mail.

from cbf.