Received a telework agreement that says employer is allowed to visit my telework site (home) anytime

We are required to sign an agreement stating that our primary residence is open to on-site visits by my employer. This seems like a crazy invasion of privacy or am I wrong? I love teleworking but this seems to be going too far.