Author Archives: Osamu Tatebe

Gfarm 2.7.1 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.7.1
* Gfarm file system version 2.6.16
* Gfarm Zabbix plugin version 4.0.0

http://sourceforge.net/projects/gfarm/

This Gfarm release includes destination schedule update of gfpcopy to
exclude busy hosts, and other useful updates and bug fixes.

Gfarm Zabbix plugin fixes issues with Template OS Linux, and enhances
the silent data corruption support to alert every checksum mismatch
error without any summarization.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.1 and 2.6.16
=======================================

[2017.1.14]

Updated feature
* gfpcopy, gfprep – do not copy to busy hosts by default. This will
be disabled by -B option
* gfpcopy, gfprep – -I option to specify interval to collect host
information. Default is 300 seconds.
* gfsd – adjust log level for non-critical replication failure

Bug fix
* incorrect metadb_server_list causes assertion failure

Release note for Gfarm Zabbix plugin 4.0.0
==========================================

[2016.12.28]

Updated feature
* restructure the templates.
Template_Gfarm_linux, which enables detection of some critical problems,
can coexist with “Template OS Linux” with this change.
The definitions which cannot coexist with “Template OS Linux” are
moved to the Template_gfarm*_alt templates. (e.g. Template_Gfarm_linux_alt)
[sf.net ticket #966]
* make Template_Gfarm_linux treat “I/O error” message from kernel
as “high” priority problem instead of an “average” problem.
[sf.net ticket #930]
* make Template_Gfarm_linux detect “bio too big device” message from kernel.
which shows a critical problem about the stroage. [sf.net ticket #931]
* make Template_Gfarm_linux detect “XFS: Internal error” message from kernel.
[sf.net ticket #976]
* report all critical “checksum mismatch” errors from gfmd,
all critical write_verify related errors from gfsd, and
all “Input/output error” / “Stale file handle” errors from gfsd
without any summarization. [sf.net ticket #977]

Documentation Update
* improve installation procedure [sf.net ticket #932]
* clarify macro settings [sf.net ticket #945]

Gfarm 2.7.0 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.7.0
* Gfarm2fs version 1.2.10

http://sourceforge.net/projects/gfarm/

Gfarm 2.7.0 is a major update that includes the following new
features;

– InfiniBand RDMA support
– Directory Quota

InfiniBand RDMA improves the access performance in InfiniBand network
environment. To enable the InfiniBand RDMA support, specify
–with-infiniband option at configure. See INSTALL.en and
doc/Gfarm-FAQ.en for details.

Directory quota limits file usage including number of inodes and total
file size, under a set of directories. See
doc/html/en/user/dirquota.html for details.

To update from Gfarm 2.6.X or earlier to Gfarm 2.7.0,
config-gfarm-update is required to update a Postgresql database
schema;

% service gfarm-pgsql start
% config-gfarm-update –update
% service gfmd start

Release note for Gfarm 2.7.0
============================

[2016.12.8]

New feature
* InfiniBand RDMA support
* Directory quota (see doc/html/en/user/dirquota.html for details)

New command
* gfdirquota – manage directory set for directory quota

New configuration directive
* ib_rdma – enables or disables InfiniBand RDMA data transfer. When
configuring –with-infiniband, default is enable.
* rdma_device_name, rdma_port – optional directive to specify device
name and port number, respectively, for RDMA data transfer
* rdma_min_size – minimum size for RDMA data transfer. Default is
65536 bytes
* rdma_mr_reg_mode – specifies memory registration mode. Default is
static.
* rdma_mr_reg_static_min_size, rdma_mr_reg_static_max_size – minimum
and maximum size for static RDMA buffer for each gfsd connection.
Default is 1MiB and 16MiB, respectively
* directory_quota_count_per_user_limit – maximum number of directory
sets for each user. Default is 100

Updated feature
* gfedquota, gfquota – -D and -d options for directory quota

Release note for Gfarm2fs 1.2.10
================================

[2016.12.8]

Updated feature
* -o directory_quota_rename_error_exdev option – enables client-side
directory move between different directory sets by copying and
removing

Gfarm 2.6.15 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.6.15

http://sourceforge.net/projects/gfarm/

This release includes OpenSSL 1.1.0 support, a new option of gfprep,
and other useful updates and bug fixes.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.6.15
=============================

[2016.12.3]

Updated feature
* OpenSSL 1.1.0 support
* gfprep – -mm option to keep an original copy in migration mode
* gfsd – log message of write_verify process includes the hostname

Bug fix
* gfprep -m may fail due to file busy even though all operations succeed

Gfarm 2.6.14 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.6.14

http://sourceforge.net/projects/gfarm/

This release includes a new command gflsof to list current opened
Gfarm files. It also includes useful updates.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.6.14
=============================

[2016.10.26]

New command
* gflsof – list current opened Gfarm files

Updated feature
* increase default timeout to connect to gfmd to 35 seconds to cope
with fault of primary and secondary DNS servers

Gfarm 2.6.13 released

We are pleased to announce the release of

* Gfarm file system version 2.6.13

This release supports a new configuration directive to specify the
maximum number of open files. It also includes useful updates.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.6.13
=============================

[2016.9.27]

New configuration directive
* max_open_files – specify the maximum number of open files. Default
is 1024.

Updated feature
* gfmd – keep minimum disk space to reduce no space risk

Gfarm 2.6.12 released

We are pleased to announce the release of

* Gfarm file system version 2.6.12

http://sourceforge.net/projects/gfarm/

This release supports failover of symbolic link in Gfarm URL format.
That is, a symbolic link gfarm://serverA:port/path/name can be
accessed even though the serverA is failed over to serverB. To
support this, metadata_server_list directive can be used multiple
times to specify several metadata server groups.

It changes Ganglia plugin format to avoid false sharing of cache
line, which requires to update the plugin as follows;

service gmond stop
config-gfmd-iostat -f …
config-gfsd-iostat -f …
service gmond start

It also includes several bug fixes.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.6.12
=============================

[2016.8.16]

New feature
* symbolic link support for master-slave redundant metadata servers –
metadb_server_list directive can be used several times to specify
several metadata server groups

Updated feature
* iostat – new data format that aligns the cache line to avoid
unnecessary false sharing. This requires ganglia plugin update by
config-{gfsd,gfmd}-iostat -f

Bug fix
* fix compilation error on Linux/alpha. This patch is contributed by
Michael Cree via Dmitry Smirnov [https://bugs.debian.org/827021]
* gfpcopy – plug memory leak, which was introduced in Gfarm 2.6.6
* gfmd – quota is not effective just after gfmd start-up or failover
* gfmd – incorrect grace period for soft quota after gfmd restart or
failover
* gfsd – may give up to reconnect to gfmd
* gfsd – incorrect period for write_verify is reported at gfsd crash
on Linux 2.6.22 or before

Gfarm 2.6.10 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.6.10

http://sourceforge.net/projects/gfarm/

This release includes new configuration directive for performance
improvement of gfmd to disable nfs root squash support if not
necessary, and several bug fixes.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.6.10
=============================

[2016.4.25]

New configuration directive
* metadb_server_nfs_root_squash_support – disables nfs root squash
support to improve the metadata performance if it is not necessary
* write_verify_log_interval – specifies the interval to record
statistics of write verify

Updated feature
* profile and progress logging support for write verify

Bug fix
* when gfmd is down, gfsd may not log failed close operation at exit
* multiple spool directories may cause inconsistent file creation. If
this happens, alert and move it to the spool top directory.

Gfarm 2.6.9 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.6.9
* Gfarm2fs version 1.2.9.9

http://sourceforge.net/projects/gfarm/

This release includes multiple spool directory support and improvement
of file scheduling for file creation, and several bug fixes.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.6.9
============================

[2016.4.3]

New configuration directive
* spool_server_back_channel_rcvbuf_limit and
metadb_server_back_channel_sndbuf_limit – limits outstanding
requests between gfsd and gfmd to reduce risk of the disconnection.
Default is 4096 bytes.

Updated feature
* gfsd – support multiple spool directories
* most available disk space is selected when creating files
* gfwhere – -m option to select files having the specified number or
less number of replicas
* gfwhere – -h option to select files that stored on the specified
host
* gfstatus – -m option to change the configuration parameter in gfmd
with -M option. Currently, ‘digest’, ‘write_verify’,
‘write_verify_interval’, ‘write_verify_retry_interval’ can be
changed. Note that write_verify is enabled only after gfsd is
restarted.
* write_verify process of gfsd terminates and dumps file information
to be verified by TERM signal
* gfspoolpath – -I option to specify inode number and generation
number instead of a filename

Bug fix
* updated files during the connection between gfsd and gfmd is
disconnected cannot be accessed
* master gfmd may crash when connecting from an expired slave gfmd
[sf.net ticket #947]
* delete metadata when a copy cannot be created due to no space error
* mtime of gfs_pio_stat() and gfs_stat() is inconsistent, which may
cause failure to extract symbolic links from tar files

Release note for Gfarm2fs 1.2.9.9
=================================

[2016.4.3]

Updated feature
* readlink – cache previous result to improve ‘ls -l’ performance