Just wondering if we can only restrict XL files permission on specific pages in confluence?
Attachments follow the restrictions of their containing page, so no, you can't do this directly.
What you might do is use the attachments macro to show your files on one page (unrestricted), but point it to pull the attachment list from another page which is more limited, so they can't change them.
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.