I'm open to changing this behavior. The reason it refreshes is cause you can add a whole bunch of new pages (by creatinga Link to a New Page) and it won't be reflected on the chapter page unless the chapter page is refreshed.
Would you guys prefer to manually refresh it? Or, like in the old adv editor, there was a little box that said that the pages may have changed, and gives u opportunity to click link to refresh.