Improve performance when writing a large number of message files to disk

Problem:

A channel that is writing a large number of files to disk will get progressively slower (as the number of files in the target directory gets large). This is because your computer’s operating system must keep track of all of the files in a directory. Moving or deleting files from the target directory on a regular basis will ensure that the performance of this channel is not adversely affected.

This one can sneak up on you, initially channel performance will be fine, but it gradually degrades as the number of files in the target directory increases.

This usually occurs when using a To File or To Translator (with net file functions) and writing individual messages to separate files. However it can occur whenever you are writing a large number of files to disk.

 Solution:

Use a purge script to regularly delete or move old files from the target directory. This will reduce the operating system overhead and maintain consistent performance.

 

Leave A Comment?

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.