From kraemerf at de.ibm.com Mon Dec 22 08:09:44 2025 From: kraemerf at de.ibm.com (Frank Kramer) Date: Mon, 22 Dec 2025 08:09:44 +0000 Subject: [gpfsug-discuss] =?utf-8?q?Save_the_date_-_Invitation=3A_IBM_Stora?= =?utf-8?q?ge_Scale_New_User_Day_=E2=80=93_March_9=2C_2026?= Message-ID: Save the date! You are invited to the IBM Storage Scale New User Day, taking place on March 9, 2026, at the brandnew IBM Campus in Ehningen, Germany. This free, in-person technical workshop is part of the IBM Storage Scale User Days 2026 and is designed for new users and GPFS refreshers from Germany, Austria, and Switzerland. What to expect: * Practical introduction starting from the basics * Sessions led by IBM technical experts working with customers every day * Focus on real-world usage and best practices Event details: * Date: March 9, 2026 * Time: 11:00–17:30 (local time) * Location: IBM Campus 1, 71139 Ehningen, Germany * Language: German only (no translation provided) * Format: Face-to-face workshop Recommended background Basic understanding of Linux, networking, and raw devices. We look forward to welcoming you to our new, spacious IBM facility for a full day of learning and exchange. If you like to join, feel free to ask Markus Merz (mailto:MMERZ at de.ibm.com) for the registration link. -frank- Frank Kraemer IBM Senior Technical Specialist Tower One, Bruesseler Street 1-3, 60327 Frankfurt mailto:kraemerf at de.ibm.com Mobile +491713043699 IBM Germany -------------- next part -------------- An HTML attachment was scrubbed... URL: From kraemerf at de.ibm.com Mon Dec 22 08:36:52 2025 From: kraemerf at de.ibm.com (Frank Kramer) Date: Mon, 22 Dec 2025 08:36:52 +0000 Subject: [gpfsug-discuss] =?utf-8?q?Save_the_date_-_Invitation=3A_IBM_Stora?= =?utf-8?q?ge_Scale_User_Days_=E2=80=93_March_10=E2=80=9311=2C_2026?= Message-ID: Save the date! You are invited to the IBM Storage Scale User Days 2026, taking place on March 10–11, 2026, at the IBM Campus in Ehningen, Germany. This free, in-person expert-level workshop brings together customers, IBM Storage Scale development, and IBM partner technical experts to share insights and experiences. Key topics: * What’s new in IBM Storage Scale 6.0.0 * IBM Storage Scale System 7.0.0.0 * Data for AI use cases and architectures Event details: * Start: March 10, 2026, at 10:00 AM (local time) * Location: IBM Campus 1, 71139 Ehningen, Germany * Language: Mixed German and English (no translation provided) * Format: Face-to-face workshop The event will be hosted at our new, spacious IBM facility. More details: https://www.schuessler-plan.de/en/projects/ibm-technologycampus-ehningen.html Registration: If you would like to join, please contact Markus Merz for the registration link: MMERZ at de.ibm.com We look forward to welcoming you in Ehningen. Appendix: Storage Scale 6.0.0 IBM Storage Scale 6.0.0 is a major evolution in IBM’s global data platform, purpose-built to meet the demands of AI-driven enterprises. At the heart of this release is the Storage Scale System Data Acceleration Tier (DAT) a high-performance NVMeoF-based storage layer designed to deliver extreme IOPS and ultra-low latency for real-time AI inferencing workloads. https://www.ibm.com/docs/en/announcements/storage-scale-60 Appendix: Storage Scale System 7.0.0.0 IBM Storage Scale RAID is a software implementation of storage RAID technologies within IBM Storage Scale. Using conventional dual-ported disks in a JBOD configuration, IBM Storage Scale RAID implements sophisticated data placement and error-correction algorithms to deliver high levels of storage reliability, availability, and performance. Standard GPFS file systems are created from the NSDs defined through IBM Storage Scale RAID. https://www.ibm.com/docs/en/storage-scale-system/storage-scale-software/7.0.0 Appendix: Accelerating AI inference with IBM Storage Scale Large language model (LLM) based inference is a dominant workload for modern AI applications, and it has become so taxing on all three infrastructure resources (compute, network, and storage) that entirely new software capabilities are emerging to support resource management and optimization for inference. https://research.ibm.com/blog/accelerating-ai-inference-with-ibm-storage-scale -frank- Frank Kraemer IBM Senior Technical Specialist Tower One, Bruesseler Street 1-3, 60327 Frankfurt mailto:kraemerf at de.ibm.com Mobile +491713043699 IBM Germany -------------- next part -------------- An HTML attachment was scrubbed... URL: From p.ward at nhm.ac.uk Tue Dec 23 10:18:30 2025 From: p.ward at nhm.ac.uk (Paul Ward) Date: Tue, 23 Dec 2025 10:18:30 +0000 Subject: [gpfsug-discuss] help/ advice with external helper apps for ILM policy engine In-Reply-To: References: Message-ID: Hi, has anyone written external helper apps for the ILM policy engine. we are running TCT, planning to move files from on-premise COS to AWS, but I need to detect which cloudpool the files are currently in. The policy engine doesn't appear to be able to access the extended file attributes indicating which cloudpool a migrated file is in. So I am trying to use an external helper script, but execution of the policy seems to stall at the point it should use the helper script. I will also need to use a help app to move the files from COS to AWS as the mmcloudgateway CLI will recall then migrate, but the policy engine detects the files are already migrated so refuses to 'migrate' them again. I plan to call the CLI version Any advice? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [cid:image001.png at 01DC73F5.7BBDCB90] -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 12974 bytes Desc: image001.png URL: From janfrode at tanso.net Tue Dec 23 21:50:19 2025 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Tue, 23 Dec 2025 22:50:19 +0100 Subject: [gpfsug-discuss] help/ advice with external helper apps for ILM policy engine In-Reply-To: References: Message-ID: Policy engine can use xattrs using something like "WHERE xattr('user.xattrname') LIKE 'value'". I don't currently have any TCT systems available to check, but are there no xattrs you could use a xattr like above to figure out which pool it's in? Use f.ex. "mmlsattr -L -d filename" to check which xattrs are set for a given file. -jf On Tue, Dec 23, 2025 at 11:19 AM Paul Ward wrote: > Hi, > > has anyone written external helper apps for the ILM policy engine. > > we are running TCT, planning to move files from on-premise COS to AWS, but > I need to detect which cloudpool the files are currently in. > The policy engine doesn’t appear to be able to access the extended file > attributes indicating which cloudpool a migrated file is in. > So I am trying to use an external helper script, but execution of the > policy seems to stall at the point it should use the helper script. > > I will also need to use a help app to move the files from COS to AWS as > the mmcloudgateway CLI will recall then migrate, but the policy engine > detects the files are already migrated so refuses to ‘migrate’ them again. > I plan to call the CLI version > > Any advice? > > > > Kindest regards, > > Paul > > > > Paul Ward > > TS Infrastructure Architect > > Natural History Museum > > T: 02079426450 > > E: p.ward at nhm.ac.uk > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org > -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 12974 bytes Desc: not available URL: From p.ward at nhm.ac.uk Wed Dec 24 11:31:29 2025 From: p.ward at nhm.ac.uk (Paul Ward) Date: Wed, 24 Dec 2025 11:31:29 +0000 Subject: [gpfsug-discuss] help/ advice with external helper apps for ILM policy engine In-Reply-To: References: Message-ID: Yes I tried that first, but it seems from the testing I’ve done, the attributes I want are not accessible from the policy engine in 5.1.9. Co-pilot suggests they maybe in 5.2.x Which we cant go to until we’ve converted from TCT to AFM, which is what I need this for. Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [cid:image001.png at 01DC74C8.9DAA57E0] From: gpfsug-discuss On Behalf Of Jan-Frode Myklebust Sent: 23 December 2025 21:50 To: gpfsug main discussion list Subject: Re: [gpfsug-discuss] help/ advice with external helper apps for ILM policy engine Policy engine can use xattrs using something like "WHERE xattr('user.xattrname') LIKE 'value'". I don't currently have any TCT systems available to check, but are there no xattrs you could use a xattr like above to figure out which pool it's in? Use f.ex. "mmlsattr -L -d filename" to check which xattrs are set for a given file. -jf On Tue, Dec 23, 2025 at 11:19 AM Paul Ward > wrote: Hi, has anyone written external helper apps for the ILM policy engine. we are running TCT, planning to move files from on-premise COS to AWS, but I need to detect which cloudpool the files are currently in. The policy engine doesn’t appear to be able to access the extended file attributes indicating which cloudpool a migrated file is in. So I am trying to use an external helper script, but execution of the policy seems to stall at the point it should use the helper script. I will also need to use a help app to move the files from COS to AWS as the mmcloudgateway CLI will recall then migrate, but the policy engine detects the files are already migrated so refuses to ‘migrate’ them again. I plan to call the CLI version Any advice? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [cid:image001.png at 01DC74C8.9DAA57E0] _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at gpfsug.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 12974 bytes Desc: image001.png URL: From janfrode at tanso.net Thu Dec 25 19:16:23 2025 From: janfrode at tanso.net (Jan-Frode Myklebust) Date: Thu, 25 Dec 2025 20:16:23 +0100 Subject: [gpfsug-discuss] help/ advice with external helper apps for ILM policy engine In-Reply-To: References: Message-ID: > policy engine doesn’t appear to be able to access the extended file attributes indicating which cloudpool a migrated file is in I'm struggling to accept this -- but I no longer have any TCT systems to check on. You seem to say there is an xattr that tells which cloudpool a file is migrated to. Which xattr is this ? Could you give an example? Looking into an old policy partition dump I have in my notes (tslspolict gpfs0 --ptn gpfs0TctPartition -L), I see no relevant xattrs pointing at any pools -- so maybe it's just being kept in some TCT database elsewhere? But, for converting from TCT to AFM you could maybe just look for files that are premigrated or migrated looking at MISC_ATTRIBUTES V for fully migrated files: define( is_migrated, (MISC_ATTRIBUTES LIKE '%V%') ) and: /* TCT needs timestamp comparison to decide if cloud version is same as local version: */ define( is_premigrated_different, ((XATTR('dmapi.MCEA', 5, 1) == 'C') AND (MTIME_FILE != MTIME_XATTR))) define( is_premigrated_same, ((XATTR('dmapi.MCEA', 5, 1) == 'C') AND (MTIME_FILE == MTIME_XATTR))) I don't think these are set for AFM evicted files, as that's a very different mechanism. -jf On Wed, Dec 24, 2025 at 12:32 PM Paul Ward wrote: > Yes I tried that first, but it seems from the testing I’ve done, the > attributes I want are not accessible from the policy engine in 5.1.9. > Co-pilot suggests they maybe in 5.2.x > Which we cant go to until we’ve converted from TCT to AFM, which is what I > need this for. > > > > Kindest regards, > > Paul > > > > Paul Ward > > TS Infrastructure Architect > > Natural History Museum > > T: 02079426450 > > E: p.ward at nhm.ac.uk > > > > *From:* gpfsug-discuss *On Behalf Of *Jan-Frode > Myklebust > *Sent:* 23 December 2025 21:50 > *To:* gpfsug main discussion list > *Subject:* Re: [gpfsug-discuss] help/ advice with external helper apps > for ILM policy engine > > > > Policy engine can use xattrs using something like "WHERE > xattr('user.xattrname') LIKE 'value'". > > > > I don't currently have any TCT systems available to check, but are there > no xattrs you could use a xattr like above to figure out which pool it's > in? Use f.ex. "mmlsattr -L -d filename" to check which xattrs are set for a > given file. > > > > > > > > -jf > > On Tue, Dec 23, 2025 at 11:19 AM Paul Ward wrote: > > Hi, > > has anyone written external helper apps for the ILM policy engine. > > we are running TCT, planning to move files from on-premise COS to AWS, but > I need to detect which cloudpool the files are currently in. > The policy engine doesn’t appear to be able to access the extended file > attributes indicating which cloudpool a migrated file is in. > So I am trying to use an external helper script, but execution of the > policy seems to stall at the point it should use the helper script. > > I will also need to use a help app to move the files from COS to AWS as > the mmcloudgateway CLI will recall then migrate, but the policy engine > detects the files are already migrated so refuses to ‘migrate’ them again. > I plan to call the CLI version > > Any advice? > > > > Kindest regards, > > Paul > > > > Paul Ward > > TS Infrastructure Architect > > Natural History Museum > > T: 02079426450 > > E: p.ward at nhm.ac.uk > > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at gpfsug.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org > -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 12974 bytes Desc: not available URL: