Author Archives: Osamu Tatebe

Gfarm 2.7.17 released

We are pleased to announce the release of

* Gfarm file system version 2.7.17,
* Gfarm2fs version 1.2.14, and
* Gfarm Zabbix plugin version 4.2.

https://github.com/oss-tsukuba/gfarm/releases/tag/2.7.17
https://github.com/oss-tsukuba/gfarm2fs/releases/tag/1.2.14
https://github.com/oss-tsukuba/gfarm-zabbix/releases/tag/4.2

This release includes useful updates including read only file system
and bug fixes.

We recommend for all users to upgrade to this version. Note that this
release requires to update the Gfarm configuration by

# config-gfarm-update –update

before executing gfmd metadata servers.

Release note for Gfarm 2.7.17
=============================

[2020.9.17]

Update note
* this release requires config-gfarm-update –update

New feature
* libgfarm – Multithread safe. For details, see lib/libgfarm/README.MT-safe
* Gfarm read only file system – gfstatus -Mm ‘read_only enable’
* pkg-config support

New configuration file
* gfmd.failover.conf – this configuration file will be read at
failover, which is mainly used by Gfarm-zabbix failover mechanism to
make Gfarm read only when gfmd is failed over but it may be stale.
This file is created by config-gfarm or config-gfarm-update –update.

New configuration directive
* read_only – read only file system
* spool_server_read_only_interval – if there are files still opened
and modified when Gfarm is changed to a read only file system, these
files cannot be closed until Gfarm is changed to a read-write file
system. This directive specifies the interval in second for gfsd to
check the status change.
* include – includes a configuration file
* include_nesting_limit – limits the nesting level of include files
* failover_notify_delay – delay to notify failover to gfsd servers

Documentation
* document for Gfarm encrypted file system using EncFS

Updated feature
* gfarmbb – -mpi and -conf options to set up Gfarm/BB using mpirun
* gfmv – allow gfmv between different directory quota setting [#1081]
* gfkey – -V option to display version information
* gfstatus – auth directive can be dynamically updated
* config-gfarm-update – error check
* gfsd – display gfsd type in command line field of ps(1) [#1100]
* gfmd – record gfmd config changes in log [#1097]
* gfmd – -u option to specify file name of gfmd.failover.conf
* gfmd – automatic quota check again, which makes gfquotacheck unnecessary
* libgfarm – support GFARM_FILE_UNBUFFERED in open flag
* FTBFS on GNU Hurd [#805]

Bug fix
* removing user may crash gfmd at restart when using directory quota
[#1102]
* fix segfault when calling gfarm_initialize after gfarm_terminate if
log_file directive is used
* when gfmd is failovered, quota is not correct [#1101]

Release note for Gfarm2fs 1.2.14
================================

[2020.9.17]

Updated feature
* gfarm2fs – multithread safe. For backward compatibility use -s
option
* mount.hpci – accept sharedsecret authentication
* mount.hpci – mount in /tmp when /gfarm mount directory is not
available

Release note for Gfarm Zabbix plugin 4.2
========================================

[2020.9.17]

New feature
* add new setting ‘POSTGRES_PID_FILE’ in install.conf,
pathname of PID file for the PostgreSQL daemon.
[GitHub oss-tsukuba/gfarm-zabbix#1]
* make failover script utilize the gfmd read_only feature since gfarm-2.7.17.
this adds the following configuration directives to gfarm_gfmd_failover.conf:
– ‘read_only_failover_config’ specifies the setting which will be written
to gfmd.failover.agent.conf when split brain may happen.
– ‘read_write_failover_config’ specifies the setting which will be written
to gfmd.failover.agent.conf when split brain must not happen.
– ‘allow_inconsistency’ – if this is ‘true’ and failover_type is
‘availability, failover is allowed even if there is newer metadata in
some metadata servers which are down. the read_only_failover_config
setting will be written to gfmd.failover.config before the failover.
– ‘gfmd_failover_agent_conf_file’ – pathname of gfmd.failover.agent.conf
[GitHub oss-tsukuba/gfarm-zabbix#2]

github and Gfarm 2.7.16 released

Hi all,

We are moved to github.com from sourceforge.net;

https://github.com/oss-tsukuba/gfarm/
https://github.com/oss-tsukuba/gfarm2fs/

Use new repositories in github.com.

Also, we are pleased to announce the release of Gfarm file
system version 2.7.16

https://github.com/oss-tsukuba/gfarm/releases/tag/2.7.16

This release includes useful updates and bug fixes.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.16
=============================

[2019.11.30]

Updated feature
* reduce logs when files on a readonly gfsd are removed

Gfarm 2.7.15 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.7.15

http://sourceforge.net/projects/gfarm/

This release includes useful updates and bug fixes.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.15
=============================

[2019.10.24]

New configuration directive
* rdma_gid_index – specify the gid index to use GRH

Updated feature
* gfarmbb – status command to check process, network and directory
status for Gfarm/BB

Bug fix
* Remote write may fail due to completion error when using InfiniBand

Gfarm 2.7.14 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.7.14
* Gfarm file system version 2.6.29
* Gfarm2fs version 1.2 13
* Gfarm zabbix plugin version 4.1

http://sourceforge.net/projects/gfarm/

This release includes useful updates and bug fixes. Gfarm 2.7.14 has
a new feature of Gfarm/BB on-demand file system for a burst buffer
exploiting node-local storages.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.14
=============================

[2019.9.10]

New command
* gfarmbb – start and stop scripts for Gfarm/BB node-local on-demand
file system

New configuration directive
* log_file – specify a log file
* quota_check_retry_interval, directory_quota_check_retry_interval –
specifies the interval to re-calculate the quota. This is
introduced to make replica check progress. Default is 60 seconds.
* schedule_rpc_timeout – specifies the timeout for RPC.

Updated feature
* gfmd, gfsd – -F option to specify a log file

Bug fix
* gfquotacheck – may fail due to timeout
* libgfarm – too high CPU load may cause gfsd protocol mismatch
* gfsd – fix race condition to terminate that may fail to record the
write verify information

Release note for Gfarm 2.6.29
=============================

[2019.9.10]

New configuration directive
* quota_check_retry_interval – specifies the interval to re-calculate
the quota. This is introduced to make replica check progress.
Default is 60 seconds.
* schedule_rpc_timeout – specifies the timeout for RPC.

Bug fix
* gfquotacheck – may fail due to timeout
* libgfarm – too high CPU load may cause gfsd protocol mismatch
* gfsd – fix race condition to terminate that may fail to record the
write verify information

Release note for Gfarm2fs 1.2.13
================================

[2019.9.10]

Updated feature
* mount.hpci – more moderate error message

Bug fix
* umount.gfarm2fs – a mount point not mounted by gfarm2fs may be
unmounted

Release note for Gfarm Zabbix plugin 4.1
========================================

[2019.9.10]

New feature
* rename existing “PostgreSQL server is not running” trigger to
“PostgreSQL server access is timed out”, because this may be triggerd
by slow response of the PostgreSQL daemon.
add new “PostgreSQL server is not running” trigger which checks
existence of the PostgreSQL daemon process.
NOTE: this requires update of /etc/sudoers and new configuration
parameters in install.conf. [SF.net #999]
* add new directive ‘failover_type’. if this value is ‘availability’,
failover script performs promotion even if a sequence number of
gfmd journal file on a metadata server cannot be acquired.
see zabbix_install_manual for detail.
default failover_type is consistency. [SF.net #1071]

Bug fix
* if sshd on a metadata server is down (but the host itself is up),
failover script incorrectly performs promotion [SF.net #1070]
* the meaning of ‘log_to_syslog’ setting in failover script
had been incorrectly reversed since gfarm_zabbix-2.2.0 [SF.net #1077]
* permissible time difference in Template Gfarm linux is changed
from 5 minutes to 30 seconds [SF.net #1078]

Regards,
Osamu

Gfarm 2.7.13 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.7.13
* Gfarm file system version 2.6.28

http://sourceforge.net/projects/gfarm/

This release includes useful updates and bug fixes. Gfarm 2.7.13 has
a new feature to make a filesystem node readonly.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.13
=============================

[2019.3.22]

New configuration directive
* replication_at_write_open – if this directive is enabled, even when
all file replicas of a file are stored at read-only filesystem
nodes, it can be updated by replicating it to a read-write
filesystem node before opening in the write mode. Default is
enable.

Updated feature
* read-only mode – filesystem node can be changed to read only by
gfhost -m -f 1 hostname
* gfdf – -R option to know real disk usage

Bug fix
* gfmd failover does not work, which was introduced by the version
2.7.12
* compilation error with InfiniBand, which was introduced by the
version 2.7.12
* gfquota -d does not work against a writable directory

Release note for Gfarm 2.6.28
=============================

[2019.3.22]

Bug fix
* gfmd failover does not work, which was introduced by the version
2.6.27

Gfarm version 2.7.12 withdrawn

Hi all,

We regret to withdraw the release of Gfarm 2.7.12 and
Gfarm 2.6.27 due to a serious bug included.

The metadata server cannot be failed over.

** Please do not use this release **

We apologize for this inconvenience sincerely, and will
release the new version soon. Please use Gfarm 2.7.11
or Gfarm 2.6.26 until then.

Gfarm 2.7.12 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.7.12
* Gfarm file system version 2.6.27
* Gfarm2fs version 1.2.12

http://sourceforge.net/projects/gfarm/

This release includes useful updates and bug fixes, especially
‘gfdf -a’.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.12
=============================

[2019.2.20]

Documentation
* failover and disaster recovery documents

Updated feature
* gfmd – improve replica check process especially using replicainfo
that means file system group based replica location control feature
* gfstatus – -l and -L options to list configuration names
* support 8 Exbibyte file system node

Bug fix
* gfdf – fix output with -a option

Release note for Gfarm 2.6.27
=============================

[2019.2.20]

Documentation
* failover and disaster recovery documents

Updated feature
* gfmd – improve replica check process especially using replicainfo
that means file system group based replica location control feature
* gfstatus – -l and -L options to list configuration names

Bug fix
* gfdf – fix output with -a option

Release note for Gfarm2fs 1.2.12
================================

[2019.2.20]

Updated feature
* gfarm2fs.profile.xxx local extended attribute to show the profile
value when it is enabled, which requires Gfarm 2.7.12 or later

Gfarm 2.7.10 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.7.10
* Gfarm file system version 2.6.25

http://sourceforge.net/projects/gfarm/

This release includes useful updates and bug fixes.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.10
=============================

[2018.2.22]

Updated feature
* gfmd – improve ticket lock performance, which is introduced since
the version 2.7.9

Bug fix
* directory quota may be incorrect when moving a file during the
replica check
* slave gfmd may crash when it is stopped during busy metadata updates
* gfmd crashes when it is stopped at early boot stage

Release note for Gfarm 2.6.25
=============================

[2018.2.22]

Updated feature
* gfdf – -i option to print number of inodes
* gfmd – improve ticket lock performance, which is introduced since
the version 2.6.24

Bug fix
* slave gfmd may crash when it is stopped during busy metadata updates
* gfmd crashes when it is stopped at early boot stage

Gfarm 2.7.9 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.7.9
* Gfarm file system version 2.6.24

http://sourceforge.net/projects/gfarm/

This release includes useful updates and bug fixes.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.9
============================

[2018.1.16]

Updated feature
* gfmd – improve response time during replica check when enabling
replica info. By default, use a ticket lock for FIFO thread
scheduling instead of a stock mutex lock.

Bug fix
* replica check does not honor directory quota
* fix deadlock or segfault when reading files using InfiniBand RDMA if
reconnection happens

Release note for Gfarm 2.6.24
=============================

[2018.1.16]

Updated feature
* gfmd – improve response time during replica check when enabling
replica info. By default, use a ticket lock for FIFO thread
scheduling instead of a stock mutex lock.