Define the public-key authentication as the only allowed authentications method under the Authentication - Default-Authentication page, on the Parameters tab.

Figure 5.4. Enable only public-key authentication