Author Archives: Osamu Tatebe

Gfarm 2.7.9 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.7.9
* Gfarm file system version 2.6.24

http://sourceforge.net/projects/gfarm/

This release includes useful updates and bug fixes.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.9
============================

[2018.1.16]

Updated feature
* gfmd – improve response time during replica check when enabling
replica info. By default, use a ticket lock for FIFO thread
scheduling instead of a stock mutex lock.

Bug fix
* replica check does not honor directory quota
* fix deadlock or segfault when reading files using InfiniBand RDMA if
reconnection happens

Release note for Gfarm 2.6.24
=============================

[2018.1.16]

Updated feature
* gfmd – improve response time during replica check when enabling
replica info. By default, use a ticket lock for FIFO thread
scheduling instead of a stock mutex lock.

Gfarm 2.7.8 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.7.8
* Gfarm file system version 2.6.23

http://sourceforge.net/projects/gfarm/

This release includes useful updates and bug fixes.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.8
============================

[2017.12.03]

Updated feature
* show the number of ongoing replications by SIGUSR2

Bug fix
* spool_check_level disable makes gfsd unstable, which has been
introduced since the version 2.7.6
* fix data race when switching gfsd or gfmd connections, that may make
segfault
* fix data race about gfsd status

Release note for Gfarm 2.6.23
=============================

[2017.12.03]

New configuration directive
* metadb_server_remover_queue_length – queue length for remove
requests to make it a low priority not to prevent from replication
requests

Updated feature
* show the number of ongoing replications by SIGUSR2

Bug fix
* spool_check_level disable makes gfsd unstable, which has been
introduced since the version 2.6.22
* fix data race when switching gfsd or gfmd connections, that may make
segfault
* fix data race about gfsd status

Gfarm 2.7.7 released

We are pleased to announce the release of

* Gfarm file system version 2.7.7
* Gfarm file system version 2.6.22

http://sourceforge.net/projects/gfarm/

This release includes useful updates to improve resonse time under
heavy loads that include too many gfmd-initiated replications, file
removals and file updates.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.7
============================

[2017.11.26]

New configuration directive
* metadb_server_remove_scan_log_interval – interval to log statistical
information about removed file scan
* metadb_server_remove_scan_interval_factor – interval between removed
file scans

Documentation
* manual pages – gfsrepcheck(1)

Updated feature
* gfmd – improve response time even under too many gfmd-initiated
replications, file removals and updates
* gfdf – -i option to print number of inodes
* gfrepcheck – status command to obtain the current status

Release note for Gfarm 2.6.22
=============================

[2017.11.26]

New configuration directive
* metadb_server_remove_scan_log_interval – interval to log statistical
information about removed file scan
* metadb_server_remove_scan_interval_factor – interval between removed
file scans
* spool_check_parallel, spool_check_parallel_max,
spool_check_parallel_per_capacity, spool_check_parallel_step –
specifies the number of parallelism and granularity of spool check

Documentation
* manual pages – gfsrepcheck(1)

Updated feature
* gfsd – parallel spool check for faster spool check processing
* gfmd – improve response time even under too many gfmd-initiated
replications, file removals and updates
* gfrepcheck – status command to obtain the current status

Gfarm 2.7.6 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.7.6
* Gfarm file system version 2.6.21

http://sourceforge.net/projects/gfarm/

This release includes useful updates and bug fixes.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.6
============================

[2017.10.1]

New configuration directive
* replication_busy_host – specify whether destinations of
gfmd-initiated replication include busy hosts or not. Default is
enable. Note that file replica creation to busy file system nodes
is disabled since 2.7.2. To keep this behavior, specify
replication_busy_host disable
* replica_check_remove_grace_used_space_ratio,
replica_check_remove_grace_time – specify grace space ratio and
grace time for replica check remove
* spool_check_parallel, spool_check_parallel_max,
spool_check_parallel_per_capacity, spool_check_parallel_step –
specifies the number of parallelism and granularity of spool check

Updated feature
* gfsd – parallel spool check for faster spool check processing
* gfmd – gfmd-initiated replication selects a file replica to be
replicated randomly to avoid concentration
* gfmd – more rigit disk available check to avoid no space error
* gfrepcheck – gfrepcheck stop stops replica check processing
soon.

Release note for Gfarm 2.6.21
=============================

[2017.10.1]

New configuration directive
* replication_busy_host – specify whether destinations of
gfmd-initiated replication include busy hosts or not. Default is
enable. Note that file replica creation to busy file system nodes
is disabled since 2.6.17. To keep this behavior, specify
replication_busy_host disable
* replica_check_remove_grace_used_space_ratio,
replica_check_remove_grace_time – specify grace space ratio and
grace time for replica check remove

Updated feature
* gfmd – gfmd-initiated replication selects a file replica to be
replicated randomly to avoid concentration
* gfmd – more rigit disk available check to avoid no space error
* gfrepcheck – gfrepcheck stop stops replica check processing
soon.

Gfarm 2.7.5 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.7.5
* Gfarm file system version 2.6.20

http://sourceforge.net/projects/gfarm/

This release includes useful updates and bug fixes.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.5
============================

[2017.8.9]

New configuration directive
* max_directory_depth – maximum directory depth. Default is 100.

Release note for Gfarm 2.6.20
=============================

[2017.8.9]

New configuration directive
* max_directory_depth – maximum directory depth. Default is 100.

Gfarm 2.7.2 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.7.2
* Gfarm file system version 2.6.17

http://sourceforge.net/projects/gfarm/

This Gfarm release includes a feature to disable file system node
group based replica location control, and an update to exclude busy
nodes for file replica creation, and other useful updates and bug
fixes.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.2
============================

[2017.2.4]

New configuration directive
* replicainfo – disables file system group based replica location
control feature. Only number of file replicas is maintained. This
directive is available for gfmd

Updated feature
* gfmd – support none backend database for temporal Gfarm file system
without any backend database. Journaling keeps metadata change log
up to the journal file size
* gfmd – do not create file replicas in busy file system nodes

Release note for Gfarm 2.6.17
=============================

[2017.2.4]

New configuration directive
* replicainfo – disables file system group based replica location
control feature. Only number of file replicas is maintained. This
directive is available for gfmd

Updated feature
* gfmd – do not create file replicas in busy file system nodes

Gfarm 2.7.1 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.7.1
* Gfarm file system version 2.6.16
* Gfarm Zabbix plugin version 4.0.0

http://sourceforge.net/projects/gfarm/

This Gfarm release includes destination schedule update of gfpcopy to
exclude busy hosts, and other useful updates and bug fixes.

Gfarm Zabbix plugin fixes issues with Template OS Linux, and enhances
the silent data corruption support to alert every checksum mismatch
error without any summarization.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.1 and 2.6.16
=======================================

[2017.1.14]

Updated feature
* gfpcopy, gfprep – do not copy to busy hosts by default. This will
be disabled by -B option
* gfpcopy, gfprep – -I option to specify interval to collect host
information. Default is 300 seconds.
* gfsd – adjust log level for non-critical replication failure

Bug fix
* incorrect metadb_server_list causes assertion failure

Release note for Gfarm Zabbix plugin 4.0.0
==========================================

[2016.12.28]

Updated feature
* restructure the templates.
Template_Gfarm_linux, which enables detection of some critical problems,
can coexist with “Template OS Linux” with this change.
The definitions which cannot coexist with “Template OS Linux” are
moved to the Template_gfarm*_alt templates. (e.g. Template_Gfarm_linux_alt)
[sf.net ticket #966]
* make Template_Gfarm_linux treat “I/O error” message from kernel
as “high” priority problem instead of an “average” problem.
[sf.net ticket #930]
* make Template_Gfarm_linux detect “bio too big device” message from kernel.
which shows a critical problem about the stroage. [sf.net ticket #931]
* make Template_Gfarm_linux detect “XFS: Internal error” message from kernel.
[sf.net ticket #976]
* report all critical “checksum mismatch” errors from gfmd,
all critical write_verify related errors from gfsd, and
all “Input/output error” / “Stale file handle” errors from gfsd
without any summarization. [sf.net ticket #977]

Documentation Update
* improve installation procedure [sf.net ticket #932]
* clarify macro settings [sf.net ticket #945]

Gfarm 2.7.0 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.7.0
* Gfarm2fs version 1.2.10

http://sourceforge.net/projects/gfarm/

Gfarm 2.7.0 is a major update that includes the following new
features;

– InfiniBand RDMA support
– Directory Quota

InfiniBand RDMA improves the access performance in InfiniBand network
environment. To enable the InfiniBand RDMA support, specify
–with-infiniband option at configure. See INSTALL.en and
doc/Gfarm-FAQ.en for details.

Directory quota limits file usage including number of inodes and total
file size, under a set of directories. See
doc/html/en/user/dirquota.html for details.

To update from Gfarm 2.6.X or earlier to Gfarm 2.7.0,
config-gfarm-update is required to update a Postgresql database
schema;

% service gfarm-pgsql start
% config-gfarm-update –update
% service gfmd start

Release note for Gfarm 2.7.0
============================

[2016.12.8]

New feature
* InfiniBand RDMA support
* Directory quota (see doc/html/en/user/dirquota.html for details)

New command
* gfdirquota – manage directory set for directory quota

New configuration directive
* ib_rdma – enables or disables InfiniBand RDMA data transfer. When
configuring –with-infiniband, default is enable.
* rdma_device_name, rdma_port – optional directive to specify device
name and port number, respectively, for RDMA data transfer
* rdma_min_size – minimum size for RDMA data transfer. Default is
65536 bytes
* rdma_mr_reg_mode – specifies memory registration mode. Default is
static.
* rdma_mr_reg_static_min_size, rdma_mr_reg_static_max_size – minimum
and maximum size for static RDMA buffer for each gfsd connection.
Default is 1MiB and 16MiB, respectively
* directory_quota_count_per_user_limit – maximum number of directory
sets for each user. Default is 100

Updated feature
* gfedquota, gfquota – -D and -d options for directory quota

Release note for Gfarm2fs 1.2.10
================================

[2016.12.8]

Updated feature
* -o directory_quota_rename_error_exdev option – enables client-side
directory move between different directory sets by copying and
removing

Gfarm 2.6.15 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.6.15

http://sourceforge.net/projects/gfarm/

This release includes OpenSSL 1.1.0 support, a new option of gfprep,
and other useful updates and bug fixes.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.6.15
=============================

[2016.12.3]

Updated feature
* OpenSSL 1.1.0 support
* gfprep – -mm option to keep an original copy in migration mode
* gfsd – log message of write_verify process includes the hostname

Bug fix
* gfprep -m may fail due to file busy even though all operations succeed

Gfarm 2.6.14 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.6.14

http://sourceforge.net/projects/gfarm/

This release includes a new command gflsof to list current opened
Gfarm files. It also includes useful updates.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.6.14
=============================

[2016.10.26]

New command
* gflsof – list current opened Gfarm files

Updated feature
* increase default timeout to connect to gfmd to 35 seconds to cope
with fault of primary and secondary DNS servers