As far as I know since the new GnuPG release 2.3.0 the connection exclusiveness should be removed, and instead shared by reusing the one made from OpenSC (which provides the PIV and pkcs11 access).
Fill in the blank.