FAQ: File Systems
- What is the /home file system?
- What are the Project file systems?
- How do I transfer files to and from RDHPCS Boulder?
- I am running the WRF model and generating NETCDF output but my output isn't any faster. What's wrong?
- In the past we were told not to write to the same file from multiple processes, is this ok now?
- How do I figure out how much disk I am using on each file system?
Q: What is the /home file system?
A: The /home file system provides 0.5 GBytes storage per user for source code and other critical files. It is BACKED UP nightly. You may request for additional space if it is needed, however, we cannot guarantee that this request will be answered. This space is primarily for source code and not for data files. The storing of data files could lead to the suspension of your account/
Q: What are the Project file systems?
A: The project file systems are spaces that should be used for storing data used or generated by model runs. The space is granted per project and is shared across all users of the project. The names of the file systems typically start with /p or /tg, (eg. /p10, /p21, or /tg0). The real time file systems (/rt0, /rt1, /rt2, and /rt3) are also project file systems.
THESE FILE SYSTEMS ARE NOT BACKED UP!!!!!!!
It is the responsibility of the user to back up their files to the MSS. Please see the FAQ Entry "Information on using the Mass Store System" for information.
Q: How do I transfer files to and from RDHPCS Boulder?
A: The only approved method is via scp. Please contact us at hpcshelp.fsl@noaa.gov for approval.
Q: I am running the WRF model and generating NETCDF output but my output isn't any faster. What's wrong?
A: WRF output isn't very efficient, or at least it is not to designed to write output in a way that takes advantage of the PVFS file system. You can modify the quilting options so your code uses multiple IO nodes to improve your IO speed. There is a parallel version of NETCDF available. Please let us know if you are interested in testing it and we can investigate the possibility.
Q: In the past we were told not to write to the same file from multiple processes, is this ok now?
A: Yes it is. You can write from all of your compute processes simultaneously to the same file. Then copy it off of the file system to more permanent storage.
Q: How do I figure out how much disk I am using on each file system?
A: For the home file system, run "du -sh". For your project directories, click on the box with the file system(s) associated with your project. HPCS Monitor
Last Updated 22Jul08