vecbuf#
Source code: tianshou/data/buffer/vecbuf.py
- class VectorReplayBuffer(total_size: int, buffer_num: int, **kwargs: Any)[source]#
Bases:
ReplayBufferManager
VectorReplayBuffer contains n ReplayBuffer with the same size.
It is used for storing transition from different environments yet keeping the order of time.
- Parameters:
total_size – the total size of VectorReplayBuffer.
buffer_num – the number of ReplayBuffer it uses, which are under the same configuration.
Other input arguments (stack_num/ignore_obs_next/save_only_last_obs/sample_avail) are the same as
ReplayBuffer
.See also
Please refer to
ReplayBuffer
for other APIs’ usage.
- class PrioritizedVectorReplayBuffer(total_size: int, buffer_num: int, **kwargs: Any)[source]#
Bases:
PrioritizedReplayBufferManager
PrioritizedVectorReplayBuffer contains n PrioritizedReplayBuffer with same size.
It is used for storing transition from different environments yet keeping the order of time.
- Parameters:
total_size – the total size of PrioritizedVectorReplayBuffer.
buffer_num – the number of PrioritizedReplayBuffer it uses, which are under the same configuration.
Other input arguments (alpha/beta/stack_num/ignore_obs_next/save_only_last_obs/ sample_avail) are the same as
PrioritizedReplayBuffer
.See also
Please refer to
ReplayBuffer
for other APIs’ usage.
- class HERVectorReplayBuffer(total_size: int, buffer_num: int, **kwargs: Any)[source]#
Bases:
HERReplayBufferManager
HERVectorReplayBuffer contains n HERReplayBuffer with same size.
It is used for storing transition from different environments yet keeping the order of time.
- Parameters:
total_size – the total size of HERVectorReplayBuffer.
buffer_num – the number of HERReplayBuffer it uses, which are under the same configuration.
Other input arguments are the same as
HERReplayBuffer
.See also
Please refer to
ReplayBuffer
for other APIs’ usage.