How to change the default lookup entity when adding a connection

Hello all

I have a custom entity that makes use of connections to establish relationships between the entity and some system entities such as contacts and users. When I try to add, for example, a contact as a connection, the lookup is showing a list of accounts. How do I change the lookup so that it shows a list of contacts and/or users instead of accounts?