vecbuf#


class VectorReplayBuffer(total_size: int, buffer_num: int, **kwargs: Any)[source]#

Bases: ReplayBufferManager

VectorReplayBuffer contains n ReplayBuffer with the same size.

It is used for storing transition from different environments yet keeping the order of time.

Parameters:
  • total_size – the total size of VectorReplayBuffer.

  • buffer_num – the number of ReplayBuffer it uses, which are under the same configuration.

Other input arguments (stack_num/ignore_obs_next/save_only_last_obs/sample_avail) are the same as ReplayBuffer.

See also

Please refer to ReplayBuffer for other APIs’ usage.

class PrioritizedVectorReplayBuffer(total_size: int, buffer_num: int, **kwargs: Any)[source]#

Bases: PrioritizedReplayBufferManager

PrioritizedVectorReplayBuffer contains n PrioritizedReplayBuffer with same size.

It is used for storing transition from different environments yet keeping the order of time.

Parameters:
  • total_size – the total size of PrioritizedVectorReplayBuffer.

  • buffer_num – the number of PrioritizedReplayBuffer it uses, which are under the same configuration.

Other input arguments (alpha/beta/stack_num/ignore_obs_next/save_only_last_obs/ sample_avail) are the same as PrioritizedReplayBuffer.

See also

Please refer to ReplayBuffer for other APIs’ usage.

set_beta(beta: float) None[source]#
class HERVectorReplayBuffer(total_size: int, buffer_num: int, **kwargs: Any)[source]#

Bases: HERReplayBufferManager

HERVectorReplayBuffer contains n HERReplayBuffer with same size.

It is used for storing transition from different environments yet keeping the order of time.

Parameters:
  • total_size – the total size of HERVectorReplayBuffer.

  • buffer_num – the number of HERReplayBuffer it uses, which are under the same configuration.

Other input arguments are the same as HERReplayBuffer.

See also

Please refer to ReplayBuffer for other APIs’ usage.