Funny how tastes differ! I don't like the fact that less is the default pager. I would much rather use a trivial version of more, which just immediately exists if there is less than a page, and only need space bar or "q" to get out. And I really don't want to press the final space bar at the end; more can just exit. And restoring the screen content is evil: If I say "man foo", it is because I want to see the man page of foo. Hiding it again at the end is dumb ... it prevents me from keeping the information on the screen and referring back to it later.
In a nutshell, today's less has a huge amount of functionality that I don't need. In and of itself that's not a bad thing, but it gets in the hair when it gives me a complex prompt, refuses to exit when it is no longer needed, and messes with my screen.
If this bothered me a lot, I would find some third-party version of more and install it, but it is not a huge deal. For now I make do by hand-setting PAGER=more, MORE=-Er and LESS_IS_MORE.