gfptar

Name

gfptar — archive files in parallel

Synopsis

gfptar [OPTIONS] -c outdir [-C basedir] member...

gfptar [OPTIONS] -x outdir indir [member...]

gfptar [OPTIONS] -t indir

gfptar [OPTIONS] -r outdir [-C basedir] member...

gfptar [OPTIONS] -u outdir [-C basedir] member...

DESCRIPTION

gfptar creates archive files to Gfarm or local file system, or extracts the archive files. The archive files consist of multiple tar files and database files in a directory. Creation or extraction is performed in parallel for each tar file.

OPERATION MODE

-c(--create) outdir [-C(--basedir) basedir] member...

Create outdir directory, and create archive files in the new directory.

member... (files or directories) in basedir are archived.

-x(--extract) outdir indir [member...]

Create outdir directory, and extract files from archive files of indir to the new directory.

When members are specified, only the specified members will be extracted.

-t(--list) indir

List the contents of archive files in indir.

-r(--append) outdir [-C(--basedir) basedir] member...

Append archive files in outdir directory.

-u(--update) outdir [-C(--basedir) basedir] member...

Append archive files with newer files in existing outdir directory.

PATH STYLE

outdir, indir and basedir must be one of the following formats.

path-name: is a relative path or an absolute path of a local file system. When the path is a mount point on gfarm2fs, tar files are operated without passing through the gfarm2fs. (Non-tar files are operated via gfarm2fs.)
gfarm:...: is a Gfarm URL of a Gfarm file system.

OPTIONS

The primary options are listed below. For additional options, please refer to gfptar --help.

-j, --jobs=NUM

Specifies the maximum number of jobs to create archive files or extract from archive files simultaneously.

The default value is 4.

-s, --size=BYTES

Specifies assumed size in bytes per output tar file for --create. Since compression ratios vary depending on the content of the file and the compression type, Archive files will be created for each group of files divided by the assumed size calculated considering the assumed compression ratio (--ratio option).

The default value is 200Mi (200 * 1024^2 = 209715200) (200 mebibytes).

--ratio=RATIO

Specifies the assumed compression ratio in percentage for --create.

The default value is 50 (50 %).

-T, --type=TYPE

Specifies a compression type for --create. "gz" means gzip type (suffix is .tar.gz). "bz2" means bzip2 type (suffix is .tar.bz2). "xz" means xz type (suffix is .tar.xz). "no" means no compression.

The default value is gz.

-I, --use-compress-program=COMMAND

Specifies a command of compression program. Suffix for creating tar files must be specified by --type option. The command must accept -d option for decompression.

-q, --quiet

Suppresses non-error messages.

-v, --verbose

Displays verbose output.

-d, --debug

Displays debug output.

-?, --help

Displays a list of command options.

EXAMPLES

Creates archive files from local directories to a Gfarm directory. The archived files of this example include dir1 and dir2 as relative path.

$ gfptar -c gfarm:/home/user1/out.gfptar -C /home/user1 ./dir1 ./dir2

Extract files from a Gfarm directory to a local directory. The extracted files of this example are dir1 and dir2.

$ gfptar -x /home/user1/outdir gfarm:/home/user1/out.gfptar

Creates archive files from Gfarm directories to a Gfarm directory. NOTE: If there are many small size files, it may perform better to specify a path on gfarm2fs for -C option.

$ gfptar -c gfarm:/home/user1/out.gfptar -C gfarm:/home/user1 ./dir

Extract files from a Gfarm directory to a Gfarm directory. NOTE: If there are many small size files, it may perform better to specify a path on gfarm2fs for -x option.

$ gfptar -x gfarm:/home/user1/dir2 gfarm:/home/user1/out.gfptar

Extract a specified file from a Gfarm directory to a local directory. The extracted file of this example is dir1/path/to/file only.

$ gfptar -x /home/user1/outdir gfarm:/home/user1/out.gfptar dir1/path/to/file1