Category Archives: ニュース

Gfarm version 2.8.7 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.8.7

Gfarm 2.8 is a major update including
– Transport Layer Security (TLS) for secure communication
– New authentication methods – SASL (XOAUTH2, PLAIN, ANONYMOUS) and Kerberos
– Multitenant support
– gfcp and gfconcat commands – copy a file and concatinate files in parallel
– jwt-parse command – display a JSON Web Token and check expiration

and other new features. To upgrade to this release, “config-gfarm-update –update” is required.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.8.7
============================

[2025.4.11]

Bug fix
* gfs_pio_sendfile(), gfs_pio_recvfile() – fix an issue that prevented transfer of files larger than 2,147,479,552 bytes to/from local storage

Release note for Gfarm 2.8.6
============================

[2024.12.16]

New environment variable
* GFARM_SASL_USER, GFARM_SASL_PASSWORD, GFARM_SASL_MECHANISMS, GFARM_SASL_REAML

Updated feature
* gfptar – –update and –append options and many other enhancements, see the manual page of gfptar(1) or gfptar –help.
* gfptar – reduce memory consumption
* adjust log level

Bug fix
* gfptar – fix issues of file names containing sharps and semicolons, and long multi-bytes file names
* gfptar – fix possible stall when I/O error occurs
* gfjournal – fix assersion failure with -l option, introduced in the version 2.8.0
* gfsd – fix noisy error log if inter-gfsd connection is encrypted [#1164]

Release note for Gfarm 2.8.5
============================

[2024.9.4]

New configuration directive
* log_tls_verbose to display verbose messages in TLS
* metadb_backend_sync_commit_at_initialization to disable asynchronous commit at initialization.

Updated feature
* gfrm – -v option to print file names to be deleted
* gfmd – improve the startup time by asynchronous commits to flush uncommitted journals
* improve log messages in TLS and SASL authentication
* log related directives, log_level, log_message_verbose_level, log_auth_verbose, log_tls_verbose, can be modified by gfstatus in runtime

Bug fix
* gfpcopy – preserve times when the file size is larger than 1 GiB by default, introduced in the version 2.8.0

Release note for Gfarm 2.8.4
============================

[2024.3.26]

Updated feature
* gfmd – adjust log level

Bug fix
* gfmd – fix possible segfault, introduced in the version 2.8.1

Release note for Gfarm 2.8.3
============================

[2024.2.20]

Updated feature
* gfperf – allow new authentication methods. support PHP7 or later

Bug fix
* When SASL authentication fails, do not proceed to the next authentication method

Release note for Gfarm 2.8.2
============================

[2023.12.30]

Bug fix
* gfmd – synchronous slaves may be recognized as asyncronous slaves, introduced by the version 2.7.21

Release note for Gfarm 2.8.1
============================

[2023.12.14]

New configuration directive
* protocol_compat – use older version of protocols. specify 2.7.13 to access older servers in shared secret authentication [#1153]

New utility
* jwt-parse – display a JSON Web Token and check expiration

Documentation
* SETUP and Gfarm-FAQ – update for Gfarm 2.8
* user/auth – SASL (OAuth2) authentication in TLS

Updated feature
* gfptar – ignore errors as the original tar behavior [#1162]
* gfmd – create file replicas first for files that fail to create file replicas on file close [#1160]
* libgfarm – recover backward compatibility in GSI

Bug fix
* gfptar – fix runtime error “release unlocked lock”
* gfarmbb – fix gfarmbb start stops
* gfhost – may fail with segmentation fault [#1158]
* libgfarm – SASL client-side authentication is not thread-safe [#1157]
* libgfarm – gfarm_humanize_number_to_int64() may fail
* build directory feature in Make is broken
* unconfig-gfarm.sh, unconfig-gfsd.sh – fix -t option
* gfarm-gridftp-dsi does not work since Gfarm 2.8.0 [#1155]

Release note for Gfarm 2.8.0
============================

[2023.9.3]

Update note
* this release requires config-gfarm-update –update

New feature
* Transport Layer Security (TLS) for secure communication
* New authentication methods – SASL (XOAUTH2, PLAIN, ANONYMOUS) and Kerberos
* Multitenant support

New command
* gfcp – copy a file in parallel
* gfpconcat – concatinate files in parallel

New authentication method
* sasl_auth, sasl – SASL (XOAUTH2, PLAIN, ANONYMOUS) authentication in TLS. After the authentication, sasl_auth uses a plain socket, while sasl uses TLS secure connection.
* tls_sharedsecret, tls_client_certificate – shared secret and client certificate authentications in TLS. Afther the authentication, both uses TLS secure connection.
* kerberos_auth, kerberos – Kerberos authentication. After the authentication, kerberos_auth uses a plain socket, while kerberos uses Kerberos encrypted connection.

New configuration directive
* auth_trial_order – specify authentication order
* sasl_mechanisms, sasl_user, sasl_password – for SASL authentication
* tls_cipher_suite, tls_ca_certificate_path, tls_ca_revocation_path, tls_ca_peer_verify_chain_path, tls_certificate_file, tls_certificate_chain_file, tls_key_file, tls_allow_no_crl, tls_key_update, tls_build_chain_local, tls_proxy_certificate, tls_security_level – for TLS secure communication

Documentation
* SASL authentication and secure communication with TLS

Updated feature
* gfpcopy – -t option for parallel copy of large files. Default is 2.
* gfpcopy – -T option to specify the threshold for large files. Default is 1G.
* gfuser – -A option to specify a global name for each authentication method
* gfuser – -L option to display more user information
* gfstatus – -S option to display static settings

Bug fix
* race condition about GFM_PROTO_CLOSE_WRITE_V2_4 [#1126]

Gfarm version 2.7.21 and Nextcloud-Gfarm 1.0.2 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.7.21,
* Gfarm2fs version 1.2.17,
* Nextcloud-Gfarm version 1.0.2

https://github.com/oss-tsukuba/gfarm/releases/tag/2.7.21
https://github.com/oss-tsukuba/gfarm2fs/releases/tag/1.2.17
https://github.com/oss-tsukuba/nextcloud-gfarm/releases/tag/1.0.2

Nextcloud-Gfarm is a Nextcloud container with Gfarm backend storage,
which extends the official Nextcloud container image. It includes an
external storage app for Gfarm that enables access to Gfarm file
system.

Gfarm introduces a new gfptar parallel archive command, which
efficiently copies many small files to/from a Gfarm file system.

This release includes useful updates and bug fixes.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.21
=============================

[2023.3.14]

New command
* gfptar – parallel tar command

Updated feature
* gfpcopy – select from all available hosts if all hosts in
write_target_domain are readonly
* config-gfarm – support PostgreSQL 14 or later
* config-gfarm – sanity check for metadata admin user

Bug fix
* gfhost – fix segfault when executing gfhost -H host
* config-gfarm, config-gfsd – fix DEBUG=true does not work
* gfmd – fix race condition in metadata server management
* gfmd – fix error message in replication [#1137]

Release note for Gfarm2fs 1.2.17
================================

[2023.3.20]

Updated feature
* support subuid/subgid in default setting

Bug fix
* fix segafault in case of long subdir name

Release note for Nextcloud-Gfarm 1.0.2
======================================

[2023.3.20]

Updated feature
* update README.md
* make Gfarm access robust

Release note for Nextcloud-Gfarm 1.0.1
======================================

[2023.3.16]

Updated feature
* support Gfarm 2.7.21 or later

Release note for Nextcloud-Gfarm 1.0.0
======================================

[2023.3.9]

This is a Nextcloud container with Gfarm backend storage, which
extends the official Nextcloud container image. It includes an
external storage app for Gfarm that enables access to Gfarm file
system.

Gfarm version 2.7.20 released

We are pleased to announce the release of

* Gfarm file system version 2.7.20,
* Gfarm2fs version 1.2.16,
* Gfarm Zabbix plugin version 4.3

https://github.com/oss-tsukuba/gfarm/releases/tag/2.7.20
https://github.com/oss-tsukuba/gfarm2fs/releases/tag/1.2.16
https://github.com/oss-tsukuba/gfarm-zabbix/releases/tag/4.3

This release includes useful updates and bug fixes.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.20
=============================

[2022.3.24]

Updated feature
* support ARM platform
* gfpcopy – select from all available hosts if no host available in write_target_domain

Release note for Gfarm2fs 1.2.16
================================

[2022.3.24]

Updated feature
* improve access performance
* umount.hpci – default directory is changed to /tmp

Release note for Gfarm Zabbix plugin 4.3
========================================

[2022.3.24]

New feature
* support Zabbix 5.0 LTS on CentOS 7

Updated feature
* default value of read_write_failover_config is changed from ”
to ‘read_only disable’. As the result, if newest metadata is availabe
in a slave gfmd, the filesystem will become writable by default
after failover.

Gfarm GridFTP DSI 1.0.5 released

Release note for Gfarm GridFTP DSI 1.0.5

[2021.6.21]

Updated feature

  • support Grid Community Toolkit (GCT) 6.2.
  • blocksize can be specified by client_file_bufsize in Gfarm configuration file

https://github.com/oss-tsukuba/gfarm-gridftp-dsi/releases/tag/1.0.5

Gfarm version 2.7.18 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.7.18,
* Gfarm2fs version 1.2.15.

https://github.com/oss-tsukuba/gfarm/releases/tag/2.7.18
https://github.com/oss-tsukuba/gfarm2fs/releases/tag/1.2.15

This release includes useful updates and bug fixes.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.18
=============================

[2021.4.23]

New configuration directive
* network_send_timeout – timeout to send data. Default is 0 that
means no timeout

Updated feature
* gfprep – -m option works even when the destination already stores
the file replica [#1111]
* gfsetfacl and gfgetfacl – -R option to recursively change ACLs
[#1107]
* gfmd – improves startup time

Bug fix
* gfarm2fs fails due to race condition to connect gfmd, introduced by
the version 2.7.17
* gfprep – -M option may exit before the limit [#1112]
* gfmd may crash when a parent directory has default ACL [#1108]

Release note for Gfarm2fs 1.2.15
================================

[2021.4.23]

Updated feature
* suppress too much logs of gfs_lremovexattr
* mount.hpci – accept mount options

Bug fix
* unexpected file size after write close when mounting in multithread
mode [#9]
* mount.gfarm2fs – fix proxy update in automount case

Gfarm 2.7.17 released

We are pleased to announce the release of

* Gfarm file system version 2.7.17,
* Gfarm2fs version 1.2.14, and
* Gfarm Zabbix plugin version 4.2.

https://github.com/oss-tsukuba/gfarm/releases/tag/2.7.17
https://github.com/oss-tsukuba/gfarm2fs/releases/tag/1.2.14
https://github.com/oss-tsukuba/gfarm-zabbix/releases/tag/4.2

This release includes useful updates including read only file system
and bug fixes.

We recommend for all users to upgrade to this version. Note that this
release requires to update the Gfarm configuration by

# config-gfarm-update –update

before executing gfmd metadata servers.

Release note for Gfarm 2.7.17
=============================

[2020.9.17]

Update note
* this release requires config-gfarm-update –update

New feature
* libgfarm – Multithread safe. For details, see lib/libgfarm/README.MT-safe
* Gfarm read only file system – gfstatus -Mm ‘read_only enable’
* pkg-config support

New configuration file
* gfmd.failover.conf – this configuration file will be read at
failover, which is mainly used by Gfarm-zabbix failover mechanism to
make Gfarm read only when gfmd is failed over but it may be stale.
This file is created by config-gfarm or config-gfarm-update –update.

New configuration directive
* read_only – read only file system
* spool_server_read_only_interval – if there are files still opened
and modified when Gfarm is changed to a read only file system, these
files cannot be closed until Gfarm is changed to a read-write file
system. This directive specifies the interval in second for gfsd to
check the status change.
* include – includes a configuration file
* include_nesting_limit – limits the nesting level of include files
* failover_notify_delay – delay to notify failover to gfsd servers

Documentation
* document for Gfarm encrypted file system using EncFS

Updated feature
* gfarmbb – -mpi and -conf options to set up Gfarm/BB using mpirun
* gfmv – allow gfmv between different directory quota setting [#1081]
* gfkey – -V option to display version information
* gfstatus – auth directive can be dynamically updated
* config-gfarm-update – error check
* gfsd – display gfsd type in command line field of ps(1) [#1100]
* gfmd – record gfmd config changes in log [#1097]
* gfmd – -u option to specify file name of gfmd.failover.conf
* gfmd – automatic quota check again, which makes gfquotacheck unnecessary
* libgfarm – support GFARM_FILE_UNBUFFERED in open flag
* FTBFS on GNU Hurd [#805]

Bug fix
* removing user may crash gfmd at restart when using directory quota
[#1102]
* fix segfault when calling gfarm_initialize after gfarm_terminate if
log_file directive is used
* when gfmd is failovered, quota is not correct [#1101]

Release note for Gfarm2fs 1.2.14
================================

[2020.9.17]

Updated feature
* gfarm2fs – multithread safe. For backward compatibility use -s
option
* mount.hpci – accept sharedsecret authentication
* mount.hpci – mount in /tmp when /gfarm mount directory is not
available

Release note for Gfarm Zabbix plugin 4.2
========================================

[2020.9.17]

New feature
* add new setting ‘POSTGRES_PID_FILE’ in install.conf,
pathname of PID file for the PostgreSQL daemon.
[GitHub oss-tsukuba/gfarm-zabbix#1]
* make failover script utilize the gfmd read_only feature since gfarm-2.7.17.
this adds the following configuration directives to gfarm_gfmd_failover.conf:
– ‘read_only_failover_config’ specifies the setting which will be written
to gfmd.failover.agent.conf when split brain may happen.
– ‘read_write_failover_config’ specifies the setting which will be written
to gfmd.failover.agent.conf when split brain must not happen.
– ‘allow_inconsistency’ – if this is ‘true’ and failover_type is
‘availability, failover is allowed even if there is newer metadata in
some metadata servers which are down. the read_only_failover_config
setting will be written to gfmd.failover.config before the failover.
– ‘gfmd_failover_agent_conf_file’ – pathname of gfmd.failover.agent.conf
[GitHub oss-tsukuba/gfarm-zabbix#2]

github and Gfarm 2.7.16 released

Hi all,

We are moved to github.com from sourceforge.net;

https://github.com/oss-tsukuba/gfarm/
https://github.com/oss-tsukuba/gfarm2fs/

Use new repositories in github.com.

Also, we are pleased to announce the release of Gfarm file
system version 2.7.16

https://github.com/oss-tsukuba/gfarm/releases/tag/2.7.16

This release includes useful updates and bug fixes.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.16
=============================

[2019.11.30]

Updated feature
* reduce logs when files on a readonly gfsd are removed

Gfarm 2.7.15 released

Hi all,

We are pleased to announce the release of

* Gfarm file system version 2.7.15

http://sourceforge.net/projects/gfarm/

This release includes useful updates and bug fixes.

We recommend for all users to upgrade to this version.

Release note for Gfarm 2.7.15
=============================

[2019.10.24]

New configuration directive
* rdma_gid_index – specify the gid index to use GRH

Updated feature
* gfarmbb – status command to check process, network and directory
status for Gfarm/BB

Bug fix
* Remote write may fail due to completion error when using InfiniBand