Is it possible to disable opening of paperclip?

We have some notes and files attached to the paperclip and would like to disable accessing them.
I have found out it works with notes, but doesn't with attached files, the user is able to download the attached file.
version 8.5 2019-09-15 (build 85321026)