It's just that #; working at the read-level is what makes it useful to me.
If it works at the lexical level it would be strange. For example,
parenthesis are typically individual lexemes, so this:

  (a #;(a) b)

would go to:

  (a a) b)

rather than:

  (a b)

Robby