Author Archives: Osamu Tatebe

Gfarm GridFTP DSI 1.0.5 released

Release note for Gfarm GridFTP DSI 1.0.5

[2021.6.21]

Updated feature

  • support Grid Community Toolkit (GCT) 6.2.
  • blocksize can be specified by client_file_bufsize in Gfarm configuration file

https://github.com/oss-tsukuba/gfarm-gridftp-dsi/releases/tag/1.0.5

Gfarm version 2.7.18 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.7.18,
* Gfarm2fs version 1.2.15.

https://github.com/oss-tsukuba/gfarm/releases/tag/2.7.18
https://github.com/oss-tsukuba/gfarm2fs/releases/tag/1.2.15

This release includes useful updates and bug fixes.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.18
=============================

[2021.4.23]

New configuration directive
* network_send_timeout – timeout to send data. Default is 0 that
means no timeout

Updated feature
* gfprep – -m option works even when the destination already stores
the file replica [#1111]
* gfsetfacl and gfgetfacl – -R option to recursively change ACLs
[#1107]
* gfmd – improves startup time

Bug fix
* gfarm2fs fails due to race condition to connect gfmd, introduced by
the version 2.7.17
* gfprep – -M option may exit before the limit [#1112]
* gfmd may crash when a parent directory has default ACL [#1108]

Release note for Gfarm2fs 1.2.15
================================

[2021.4.23]

Updated feature
* suppress too much logs of gfs_lremovexattr
* mount.hpci – accept mount options

Bug fix
* unexpected file size after write close when mounting in multithread
mode [#9]
* mount.gfarm2fs – fix proxy update in automount case

Gfarm 2.7.17 released

We are pleased to announce the release of

* Gfarm file system version 2.7.17,
* Gfarm2fs version 1.2.14, and
* Gfarm Zabbix plugin version 4.2.

https://github.com/oss-tsukuba/gfarm/releases/tag/2.7.17
https://github.com/oss-tsukuba/gfarm2fs/releases/tag/1.2.14
https://github.com/oss-tsukuba/gfarm-zabbix/releases/tag/4.2

This release includes useful updates including read only file system
and bug fixes.

We recommend for all users to upgrade to this version. Note that this
release requires to update the Gfarm configuration by

# config-gfarm-update –update

before executing gfmd metadata servers.

Release note for Gfarm 2.7.17
=============================

[2020.9.17]

Update note
* this release requires config-gfarm-update –update

New feature
* libgfarm – Multithread safe. For details, see lib/libgfarm/README.MT-safe
* Gfarm read only file system – gfstatus -Mm ‘read_only enable’
* pkg-config support

New configuration file
* gfmd.failover.conf – this configuration file will be read at
failover, which is mainly used by Gfarm-zabbix failover mechanism to
make Gfarm read only when gfmd is failed over but it may be stale.
This file is created by config-gfarm or config-gfarm-update –update.

New configuration directive
* read_only – read only file system
* spool_server_read_only_interval – if there are files still opened
and modified when Gfarm is changed to a read only file system, these
files cannot be closed until Gfarm is changed to a read-write file
system. This directive specifies the interval in second for gfsd to
check the status change.
* include – includes a configuration file
* include_nesting_limit – limits the nesting level of include files
* failover_notify_delay – delay to notify failover to gfsd servers

Documentation
* document for Gfarm encrypted file system using EncFS

Updated feature
* gfarmbb – -mpi and -conf options to set up Gfarm/BB using mpirun
* gfmv – allow gfmv between different directory quota setting [#1081]
* gfkey – -V option to display version information
* gfstatus – auth directive can be dynamically updated
* config-gfarm-update – error check
* gfsd – display gfsd type in command line field of ps(1) [#1100]
* gfmd – record gfmd config changes in log [#1097]
* gfmd – -u option to specify file name of gfmd.failover.conf
* gfmd – automatic quota check again, which makes gfquotacheck unnecessary
* libgfarm – support GFARM_FILE_UNBUFFERED in open flag
* FTBFS on GNU Hurd [#805]

Bug fix
* removing user may crash gfmd at restart when using directory quota
[#1102]
* fix segfault when calling gfarm_initialize after gfarm_terminate if
log_file directive is used
* when gfmd is failovered, quota is not correct [#1101]

Release note for Gfarm2fs 1.2.14
================================

[2020.9.17]

Updated feature
* gfarm2fs – multithread safe. For backward compatibility use -s
option
* mount.hpci – accept sharedsecret authentication
* mount.hpci – mount in /tmp when /gfarm mount directory is not
available

Release note for Gfarm Zabbix plugin 4.2
========================================

[2020.9.17]

New feature
* add new setting ‘POSTGRES_PID_FILE’ in install.conf,
pathname of PID file for the PostgreSQL daemon.
[GitHub oss-tsukuba/gfarm-zabbix#1]
* make failover script utilize the gfmd read_only feature since gfarm-2.7.17.
this adds the following configuration directives to gfarm_gfmd_failover.conf:
– ‘read_only_failover_config’ specifies the setting which will be written
to gfmd.failover.agent.conf when split brain may happen.
– ‘read_write_failover_config’ specifies the setting which will be written
to gfmd.failover.agent.conf when split brain must not happen.
– ‘allow_inconsistency’ – if this is ‘true’ and failover_type is
‘availability, failover is allowed even if there is newer metadata in
some metadata servers which are down. the read_only_failover_config
setting will be written to gfmd.failover.config before the failover.
– ‘gfmd_failover_agent_conf_file’ – pathname of gfmd.failover.agent.conf
[GitHub oss-tsukuba/gfarm-zabbix#2]

github and Gfarm 2.7.16 released

Hi all,

We are moved to github.com from sourceforge.net;

https://github.com/oss-tsukuba/gfarm/
https://github.com/oss-tsukuba/gfarm2fs/

Use new repositories in github.com.

Also, we are pleased to announce the release of Gfarm file
system version 2.7.16

https://github.com/oss-tsukuba/gfarm/releases/tag/2.7.16

This release includes useful updates and bug fixes.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.16
=============================

[2019.11.30]

Updated feature
* reduce logs when files on a readonly gfsd are removed

Gfarm 2.7.15 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.7.15

http://sourceforge.net/projects/gfarm/

This release includes useful updates and bug fixes.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.15
=============================

[2019.10.24]

New configuration directive
* rdma_gid_index – specify the gid index to use GRH

Updated feature
* gfarmbb – status command to check process, network and directory
status for Gfarm/BB

Bug fix
* Remote write may fail due to completion error when using InfiniBand

Gfarm 2.7.14 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.7.14
* Gfarm file system version 2.6.29
* Gfarm2fs version 1.2 13
* Gfarm zabbix plugin version 4.1

http://sourceforge.net/projects/gfarm/

This release includes useful updates and bug fixes. Gfarm 2.7.14 has
a new feature of Gfarm/BB on-demand file system for a burst buffer
exploiting node-local storages.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.14
=============================

[2019.9.10]

New command
* gfarmbb – start and stop scripts for Gfarm/BB node-local on-demand
file system

New configuration directive
* log_file – specify a log file
* quota_check_retry_interval, directory_quota_check_retry_interval –
specifies the interval to re-calculate the quota. This is
introduced to make replica check progress. Default is 60 seconds.
* schedule_rpc_timeout – specifies the timeout for RPC.

Updated feature
* gfmd, gfsd – -F option to specify a log file

Bug fix
* gfquotacheck – may fail due to timeout
* libgfarm – too high CPU load may cause gfsd protocol mismatch
* gfsd – fix race condition to terminate that may fail to record the
write verify information

Release note for Gfarm 2.6.29
=============================

[2019.9.10]

New configuration directive
* quota_check_retry_interval – specifies the interval to re-calculate
the quota. This is introduced to make replica check progress.
Default is 60 seconds.
* schedule_rpc_timeout – specifies the timeout for RPC.

Bug fix
* gfquotacheck – may fail due to timeout
* libgfarm – too high CPU load may cause gfsd protocol mismatch
* gfsd – fix race condition to terminate that may fail to record the
write verify information

Release note for Gfarm2fs 1.2.13
================================

[2019.9.10]

Updated feature
* mount.hpci – more moderate error message

Bug fix
* umount.gfarm2fs – a mount point not mounted by gfarm2fs may be
unmounted

Release note for Gfarm Zabbix plugin 4.1
========================================

[2019.9.10]

New feature
* rename existing “PostgreSQL server is not running” trigger to
“PostgreSQL server access is timed out”, because this may be triggerd
by slow response of the PostgreSQL daemon.
add new “PostgreSQL server is not running” trigger which checks
existence of the PostgreSQL daemon process.
NOTE: this requires update of /etc/sudoers and new configuration
parameters in install.conf. [SF.net #999]
* add new directive ‘failover_type’. if this value is ‘availability’,
failover script performs promotion even if a sequence number of
gfmd journal file on a metadata server cannot be acquired.
see zabbix_install_manual for detail.
default failover_type is consistency. [SF.net #1071]

Bug fix
* if sshd on a metadata server is down (but the host itself is up),
failover script incorrectly performs promotion [SF.net #1070]
* the meaning of ‘log_to_syslog’ setting in failover script
had been incorrectly reversed since gfarm_zabbix-2.2.0 [SF.net #1077]
* permissible time difference in Template Gfarm linux is changed
from 5 minutes to 30 seconds [SF.net #1078]

Regards,
Osamu

Gfarm 2.7.13 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.7.13
* Gfarm file system version 2.6.28

http://sourceforge.net/projects/gfarm/

This release includes useful updates and bug fixes. Gfarm 2.7.13 has
a new feature to make a filesystem node readonly.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.13
=============================

[2019.3.22]

New configuration directive
* replication_at_write_open – if this directive is enabled, even when
all file replicas of a file are stored at read-only filesystem
nodes, it can be updated by replicating it to a read-write
filesystem node before opening in the write mode. Default is
enable.

Updated feature
* read-only mode – filesystem node can be changed to read only by
gfhost -m -f 1 hostname
* gfdf – -R option to know real disk usage

Bug fix
* gfmd failover does not work, which was introduced by the version
2.7.12
* compilation error with InfiniBand, which was introduced by the
version 2.7.12
* gfquota -d does not work against a writable directory

Release note for Gfarm 2.6.28
=============================

[2019.3.22]

Bug fix
* gfmd failover does not work, which was introduced by the version
2.6.27

Gfarm version 2.7.12 withdrawn

Hi all,

We regret to withdraw the release of Gfarm 2.7.12 and
Gfarm 2.6.27 due to a serious bug included.

The metadata server cannot be failed over.

** Please do not use this release **

We apologize for this inconvenience sincerely, and will
release the new version soon. Please use Gfarm 2.7.11
or Gfarm 2.6.26 until then.