I have a very large attachments folder (several Terabytes) that I would like to export. Since space is a a premium, I have written a custom export plugin that only counts the bytes written to the various output streams (it actually does more than that, but that is irrelevant to this question).
I am currently running the count against our server and it is going to take a few days. I would like to shorten this window if possible. A find command with +1G show that a significant chunk of the space is files > 1 Gb.
The question I have is, can I safely omit these files from the export, while writing their location to a script file that will tar them manually, allowing them to be copied after the import? Or will I need to create a custom import to handle the other direction? By “safely” I mean “if I put an ‘if’ test in my plugin”, because I can fairly easily omit them.