storage
Storage operations
neuro storage [OPTIONS] COMMAND [ARGS]...
Storage operations.
Commands:
Copy files and directories
neuro storage cp [OPTIONS] [SOURCES]... [DESTINATION]
Copy files and directories.
Either
SOURCES
or DESTINATION
should have storage:// scheme. If scheme is omitted, file:// scheme is assumed.Use /dev/stdin and /dev/stdout file names to copy a file from terminal and print the content of file on the storage to console.
Any number of --exclude and --include options can be passed. The filters that appear later in the command take precedence over filters that appear earlier in the command. If neither --exclude nor --include options are specified the default can be changed using the storage.cp-exclude configuration variable documented in "neuro help user- config".
# copy local files into remote storage root
$ neuro cp foo.txt bar/baz.dat storage:
$ neuro cp foo.txt bar/baz.dat -t storage:
# copy local directory `foo` into existing remote directory `bar`
$ neuro cp -r foo -t storage:bar
# copy the content of local directory `foo` into existing remote
# directory `bar`
$ neuro cp -r -T storage:foo storage:bar
# download remote file `foo.txt` into local file `/tmp/foo.txt` with
# explicit file:// scheme set
$ neuro cp storage:foo.txt file:///tmp/foo.txt
$ neuro cp -T storage:foo.txt file:///tmp/foo.txt
$ neuro cp storage:foo.txt file:///tmp
$ neuro cp storage:foo.txt -t file:///tmp
# download other project's remote file into the current directory
$ neuro cp storage:/{project}/foo.txt .
# download only files with extension `.out` into the current directory
$ neuro cp storage:results/*.out .
Name | Description |
---|---|
--help | Show this message and exit. |
--continue | Continue copying partially-copied files. |
--exclude-from-files FILES | A list of file names that contain patterns for exclusion files and directories. Used only for uploading. The default can be changed using the storage.cp-exclude-from-files configuration variable documented in "neuro help user-config" |
--exclude TEXT | Exclude files and directories that match the specified pattern. |
--include TEXT | Don't exclude files and directories that match the specified pattern. |
--glob / --no-glob | Expand glob patterns in SOURCES with explicit scheme. [default: glob] |
-T, --no-target-directory | Treat DESTINATION as a normal file. |
-p, --progress / -P, --no-progress | Show progress, on by default in TTY mode, off otherwise. |
-r, --recursive | Recursive copy, off by default |
-t, --target-directory DIRECTORY | Copy all SOURCES into DIRECTORY. |
-u, --update | Copy only when the SOURCE file is newer than the destination file or when the destination file is missing. |
Show current storage usage
neuro storage df [OPTIONS] [PATH]
Show current storage usage.
If
PATH
is specified, show storage usage of which path is a part.Name | Description |
---|---|
--help | Show this message and exit. |
List resources that match PATTERNS
neuro storage glob [OPTIONS] [PATTERNS]...
List resources that match
PATTERNS
.Name | Description |
---|---|
--help | Show this message and exit. |
List directory contents
neuro storage ls [OPTIONS] [PATHS]...
List directory contents.
By default
PATH
is equal project's dir (storage:)Name | Description |
---|---|
--help | Show this message and exit. |
-d, --directory | list directories themselves, not their contents. |
-l | use a long listing format. |
-h, --human-readable | with -l print human readable sizes (e.g., 2K, 540M). |
-a, --all | do not ignore entries starting with . |
--sort [name | size | time] | sort by given field, default is name. |
Make directories
neuro storage mkdir [OPTIONS] PATHS...
Make directories.
Name | Description |
---|---|
--help | Show this message and exit. |
-p, --parents | No error if existing, make parent directories as needed |
Move or rename files and directories
neuro storage mv [OPTIONS] [SOURCES]... [DESTINATION]
Move or rename files and directories.
SOURCE
must contain path to the file or directory existing on the storage, and DESTINATION
must contain the full path to the target file or directory.
# move and rename remote file
$ neuro mv storage:foo.txt storage:bar/baz.dat
$ neuro mv -T storage:foo.txt storage:bar/baz.dat
# move remote files into existing remote directory
$ neuro mv storage:foo.txt storage:bar/baz.dat storage:dst
$ neuro mv storage:foo.txt storage:bar/baz.dat -t storage:dst
# move the content of remote directory into other existing
# remote directory
$ neuro mv -T storage:foo storage:bar
# move remote file into other project's directory
$ neuro mv storage:foo.txt storage:/{project}/bar.dat
# move remote file from other project's directory
$ neuro mv storage:/{project}/foo.txt storage:bar.dat
Name | Description |
---|---|
--help | Show this message and exit. |
--glob / --no-glob | Expand glob patterns in SOURCES [default: glob] |
-T, --no-target-directory | Treat DESTINATION as a normal file |
-t, --target-directory DIRECTORY | Copy all SOURCES into DIRECTORY |
Remove files or directories
neuro storage rm [OPTIONS] PATHS...
Remove files or directories.
$ neuro rm storage:foo/bar
$ neuro rm storage:/{project}/foo/bar
$ neuro rm storage://{cluster}/{project}/foo/bar
$ neuro rm --recursive storage:/{project}/foo/
$ neuro rm storage:foo/**/*.tmp
Name | Description |
---|---|
--help | Show this message and exit. |
--glob / --no-glob | Expand glob patterns in PATHS [default: glob] |
-p, --progress / -P, --no-progress | Show progress, on by default in TTY mode, off otherwise. |
-r, --recursive | remove directories and their contents recursively |
List storage in a tree-like format
neuro storage tree [OPTIONS] [PATH]
List storage in a tree-like format
Tree is a recursive directory listing program that produces a depth indented listing of files, which is colorized ala dircolors if the LS_
COLORS
environment variable is set and output is to tty. With no arguments, tree lists the files in the storage: directory. When directory arguments are given, tree lists all the files and/or directories found in the given directories each in turn. Upon completion of listing all files/directories found, tree returns the total number of files and/or directories listed.By default
PATH
is equal project's dir (storage:)Name | Description |
---|---|
--help | Show this message and exit. |
-h, --human-readable | Print the size in a more human readable way. |
-a, --all | do not ignore entries starting with . |
-s, --size | Print the size in bytes of each file. |
--sort [name | size | time] | sort by given field, default is name |
Last modified 7mo ago