[Trent Adams]

Ironically, there is a post with the “notification” tag for a plugin that does what you want. Read through this thread on the notification plugin as this plugin will notify you of a reply and there is even a thread for an alteration of the plugin that makes it send out a reply for every single post that is replied to!

Trent