feature request: batched get_optimistic_exploration_action

[samuelstanton]

Would it be straighforward to implement a batched version of get_optimistic_exploration_action?

[quanvuong]

Hi Samuel,

It is doable (a few hours effort), but not straightforward (< 20 minutes).

This is because:

1. the function get_optimistic_exploration_action requires computing one backward pass and per-sample gradient (and not sum of gradients over a batch of input).
2. AFAIK, pytorch doesn't support computing per-sample gradient.