iAnnotate isn't bad with PDFs but I've only used it for books under 150 pages in length.
I'm not certain that there's an app yet that will take RTF and let you annotate. Documents to Go will read RTF,  but not comment, plus it's ugly as sin as interfaces go.

I'm using PlainText mostly, and waiting for Scrivener 2, but that doesn't solve your commenting challenge.