When edit reply, it throws you to the first page

I replied to the comment in my forum. I saw a mistake in my reply. I edited the reply, clicked "Publish" and it threw me to the first page of that post (thread). Why do you need to do that? I want to stay in the same page.