Skip to content

Tensorboard Logging Issue after multiple consecutive calls to self.learn(..., reset_num_timesteps=False) #1007

@krishpop

Description

@krishpop

Screen Shot 2020-09-19 at 1 53 06 AM

Describe the bug
step used to log self.summary when training SAC resets to 0 when self.learn(reset_num_timesteps=False) is run. This results in some tensorboard logs to become disconnected and have logging begin at step=0 again.

Additional context
This can be resolved by logging to tensorboard with self.num_timesteps instead of step passed into self._train_step.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions