Log uniform learning rates about unreal HOT 2 OPEN

Hi, @tomelliot!

Noticed your comment, when was looking at log-uniform function of unreal algorithm.
Actually, I think that code, you suggest, isn't right implementation of log-uniform distribution sampling? and even stackoverflow answer is not correct. parameters low and high are expected to be inside logarithm function, and uniform distribution should sample value between log(low) and log(high).
I reference to the similar, but not the same question and the answer https://math.stackexchange.com/a/1411802

Second question is about training process. Was the problem because of wrong predefined hit reward or not enough training time?

from unreal.

I couldn't find a decisive source defining "log uniform", just comments on SO and the like. I just went with the answer from SO, but you're correct that the code snippet isn't correct. It should be:

def loguniform(low=0, high=1, size=None): return np.exp(np.random.uniform(np.log(low), np.log(high), size))

Second question is about training process. Was the problem because of wrong predefined hit reward or not enough training time?

IIRC training time wasn't the problem - I ran it for sufficient epochs for the complexity of the problem.

from unreal.