Question : about "gym.vector.SyncVectorEnv"
Hello,
I have question regarding "gym.vector.SyncVectorEnv", in the documentation there are this explanation : "where the different copies of the environment are executed sequentially".
My question is what do you mean by sequentially?, do you mean with every episode we excecute one env?
Maybe to clarifiy my question, I explain what Iam trying to do:
Iam trying to use DDPG (stable baseline3) to solve a problem.
I would like to know, how can we change the env sampled values with every episode "and it should be reproducible"
for example, assume we have an env where we harvest energy, we assume that the harvested energy is normally distributed, and then in every episode, I will sample DIFFERENT Values of my harvested energy.I would just like to emphasize again, that I would like that the different values of my harvested energy to be reproducible, so I can compare the RL method to other methods.
PS: the customer env is already created where can I change the sampled value with every episode (using seed which gets as input the episode "i"), now my problem how can I fit it to the code using gym and stable baseline.
I think "gym.vector.SyncVectorEnv" is my solution but Iam not sure.
Thank you Best regards
Source: openai/gym