Hi Piotr!
Thank you for the question. Using display groups in person field on activity is possible. But at the moment we don't show the display groups in search window for this field.
This is a valid wish and I ask you to report it as wish through partner portal.
Thank you in advance!