It doesn’t re-run on new code pushes and does not run on old PRs after enabling it.
Also, even though comments are good ones, it does not create tasks.
Perhaps it will be nice to add a setting somewhere to enable the automatic creation of tasks according to comments, and an action somewhere to run manually on old PRs