<div dir="auto">I do something where I make sure all my files are in my backup server...<div dir="auto"><br></div><div dir="auto">So I will pull the full index from the backup server...</div><div dir="auto"><br></div><div dir="auto">And I will use a generated list of files on the file system... Using a GPFS policy...</div><div dir="auto"><br></div><div dir="auto">And pulling indexes and comparing about 1.3 million files on both sides of the diff takes about 3 minutes. The sorts takes a bit of time but the whole thing runs in 6 minutes as I run both sorts and pulls in parallel.</div><div dir="auto"><br></div><div dir="auto">So I would recommend just generating the file listing using a mmfind or an apply policy at time of snapshot and doing it again at a different time and just running a diff command to find missing entries.</div><div dir="auto"><br></div><div dir="auto">Depending on the amount of data you could probably combine the date and inode into a single field and only sort those and compare then join the filename using the inode.. depends on how big your filesystem index would be.</div><div dir="auto"><br></div><div dir="auto">Good luck on this one. But it is very nice to know every morning which 16 files out of millions aren't in the backup because their filenames are too crazy.. lol</div><div dir="auto"><br></div><div dir="auto">Alec</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, May 30, 2023, 9:57 AM Talamo Ivano Giuseppe <<a href="mailto:ivano.talamo@psi.ch">ivano.talamo@psi.ch</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
Hello everyone,</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
I am currently looking for the most efficient way to get a list of all deleted files since time T.</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
So far the best I could come to is to create a snapshot at time T, generate two lists via policies, one for the files inside the .snapshots dir, one for the current filesystem, and compare the two with standard diff command.</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
But I was wondering if is there any smarter way with policies only.</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
Thanks,<br>
Ivano</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div>
<div id="m_1603543543260175421Signature">
<div>
<div id="m_1603543543260175421divtagdefaultwrapper" dir="ltr" style="font-size:12pt;font-family:Calibri,Helvetica,sans-serif;color:rgb(0,0,0)">
</div>
<div dir="ltr" style="font-size:12pt;font-family:Calibri,Helvetica,sans-serif;color:rgb(0,0,0)">
<p><span id="m_1603543543260175421ms-rterangepaste-start"></span></p>
<div>__________________________________________</div>
<div>Paul Scherrer Institut</div>
<div>Ivano Talamo</div>
<div>WHGA/038</div>
<div>Forschungsstrasse 111</div>
<div>5232 Villigen PSI</div>
<div>Schweiz</div>
<div><br>
</div>
<div>Phone: +41 56 310 47 11</div>
<div>E-Mail: <a href="mailto:ivano.talamo@psi.ch" target="_blank" rel="noreferrer">ivano.talamo@psi.ch</a></div>
<span id="m_1603543543260175421ms-rterangepaste-end"></span><br>
<p></p>
</div>
</div>
</div>
</div>
</div>
_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at <a href="http://gpfsug.org" rel="noreferrer noreferrer" target="_blank">gpfsug.org</a><br>
<a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org" rel="noreferrer noreferrer" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org</a><br>
</blockquote></div>