While I don't really have a strong opinion on tests being installed when installing a package, I do mind when they get installed as a top-level package in my site-packages! pip install tests actually will install something.

Might I also recommend a rename of the top-level confluence package? I know it's an ideal name right now but the deprecated xmlrpc library currently has the same name so after a pip install, they'll be stepping on each others' toes on the filesystem.