This article is applicable for the DGX nodes where Docker has been set up without using NVIDIA Bright Cluster Manager.
At the time of setting up Docker using Bright, a few Docker files and directories are added to different exclude lists to avoid syncing undesired files between software image and compute node. It is recommended to add relevant Docker files or directories to the exclude lists for a DGX node in case the node is running Docker which wasn’t set up by running the cli tool cm-docker-setup on the head node or from the Bright View web interface.
The files and directories which should be added to the different exclude lists of a DGX node are as follows (if Docker is running on a category of nodes, then the category exclude lists can be updated instead of updating the exclude lists on individual nodes):
Entries to add to excludelistsyncinstall, excludelistgrab and excludelistgrabnew:
- /var/lib/docker - /etc/docker/key.json
Entries to add to excludelistupdate:
- /var/lib/docker - /etc/docker/key.json - /etc/systemd/system/multi-user.target.wants/docker.service
Upon adding the entries above, the relevant files or directories are not going to be synced between node(s) and software image(s) during provisioning or runtime updating node(s) or grabbing files from a node to an image.