カテゴリー別アーカイブ: ニュース

Gfarm 2.6.9をリリース

みなさま

* Gfarmファイルシステム version 2.6.9
* Gfarm2fs version 1.2.9.9

を公開致しました。

http://sourceforge.net/projects/gfarm/

複数のパーティションのサポート、ファイル生成のストレージスケジューリン
グの改善などの他、不具合修正が含まれています。

このバージョンに更新していただくことをお勧めします。

Release note for Gfarm 2.6.9
============================

[2016.4.3]

New configuration directive
* spool_server_back_channel_rcvbuf_limit and
metadb_server_back_channel_sndbuf_limit – limits outstanding
requests between gfsd and gfmd to reduce risk of the disconnection.
Default is 4096 bytes.

Updated feature
* gfsd – support multiple spool directories
* most available disk space is selected when creating files
* gfwhere – -m option to select files having the specified number or
less number of replicas
* gfwhere – -h option to select files that stored on the specified
host
* gfstatus – -m option to change the configuration parameter in gfmd
with -M option. Currently, ‘digest’, ‘write_verify’,
‘write_verify_interval’, ‘write_verify_retry_interval’ can be
changed. Note that write_verify is enabled only after gfsd is
restarted.
* write_verify process of gfsd terminates and dumps file information
to be verified by TERM signal
* gfspoolpath – -I option to specify inode number and generation
number instead of a filename

Bug fix
* updated files during the connection between gfsd and gfmd is
disconnected cannot be accessed
* master gfmd may crash when connecting from an expired slave gfmd
[sf.net ticket #947]
* delete metadata when a copy cannot be created due to no space error
* mtime of gfs_pio_stat() and gfs_stat() is inconsistent, which may
cause failure to extract symbolic links from tar files

Release note for Gfarm2fs 1.2.9.9
=================================

[2016.4.3]

Updated feature
* readlink – cache previous result to improve ‘ls -l’ performance

Gfarm 2.6.8をリリース

みなさま

* Gfarmファイルシステム version 2.6.8

を公開致しました。

http://sourceforge.net/projects/gfarm/

このバージョンは、サイレントデータ損傷(silent data corruption)を検知
するため、書込後に読み込んで digest を確認する書込検証(write verify)
機能をサポートしました。その他、重要な不具合修正が含まれています。

このバージョンに更新していただくことをお勧めします。

Release note for Gfarm 2.6.8
============================

[2016.1.16]

New feature
* write verify – detect silent data corruption by re-reading files

New configuration directive
* write_verify – enables the write verify feature
* write_verify_interval – specifies the wait time in seconds of the
write verify after the file creation. Default is 21600 seconds (6
hours).
* write_verify_retry_interval – specifies the wait time in seconds to
retry write verify when the file is opened for writing at the write
verify time. Default is 600 seconds (10 minutes).

Updated feature
* gfstatus – -M option to ask configuration, e.g. write_verify or
digest, in gfmd
* gfmd reports file names opened for writing when gfsd exits without
closing them
* quota check for file replication, chown, and chgrp

Bug fix
* gfmd crashes when quota prevents file creation [sf.net ticket #936]
* gfsd – plug memory leak at gfmd-initiated replication, which was
introduced by Gfarm 2.6.0

Gfarm 2.6.7, Zabbix plugin 3.0.0, Samba plugin 1.0.1, GridFTP DSI 1.0.4をリリース

みなさま

* Gfarmファイルシステム version 2.6.7
* Gfarm Zabbixプラグイン version 3.0.0
* Gfarm Sambaプラグイン version 1.0.1
* Gfarm GridFTP DSI version 1.0.4

を公開致しました。

http://sourceforge.net/projects/gfarm/

このバージョンは、重要な不具合修正が含まれています。

このバージョンに更新していただくことをお勧めします。

Release note for Gfarm 2.6.7
============================

[2015.11.28]

Updated feature
* make gfarm2fs return EIO instead of EINVAL, when no replica is
available [sf.net ticket #924]

Bug fix
* gfrep and gfprep may create incomplete replica when network error
happens, which is introduced by Gfarm 2.6.0 [sf.net ticket #926]
* local host is not selected when reading a file at first operation,
which was introduced by Gfarm 2.6.0
* When a file system node crashes during receiving a file replica, the
metadata remains [sf.net ticket #913]
* client_digest_check does not return an error even when checksum
mismatch happens [sf.net ticket #915, #916]
* gfarm clients may access uninitialized data, and may dump core, if
$HOME/.gfarm2rc does not exist [sf.net ticket #912]
* changing gfmd port number by “gfmdhost -m -p” makes gfmd crash
[sf.net ticket #918]
* When trying to modify a file stored at a file server with no space
or in read-only mode, return no space immediately instead of
retrying for a while

Release note for Gfarm Zabbix plugin 3.0.0
==========================================

[2015.9.30]

Updated feature
* restructure the templates
– the templates of this version has no conflict with “Template OS Linux”
so that a host can be linked with both “Template OS Linux” and Gfarm
Zabbix templates [sf.net ticket #911]
– Template_Gfarm_zabbix are no longer provided

Release note for Gfarm Samba plugin 1.0.1
=========================================

[2015.11.28]

Bug fix
* configure –with-samba does not set samba source path

Release note for Gfarm GridFTP DSI 1.0.4
========================================

[2015.11.28]

Bug fix
* fix segfault when using Gfarm 2.6
* check error in gfs_pio_close()

Gfarm 2.6.6, Gfarm2fs 1.2.9.8, Gfarm zabbix plugin 2.2.0をリリース

みなさま

* Gfarmファイルシステム version 2.6.6
* Gfarm2fs version 1.2.9.8
* Gfarm zabbixプラグイン version 2.2.0

を公開致しました。

http://sourceforge.net/projects/gfarm/

このバージョンは、不具合修正の他、以下の機能更新が含
まれています。

・複製作成時における破損ファイルの /lost+found への移動
・自動クオータチェック

このバージョンに更新していただくことをお勧めします。

Release note for Gfarm 2.6.6
============================

[2015.8.29]

New configuration directive
* client_parallel_max – the maximum number of parallel operations that
can be specified by gfpcopy and gfprep

Documentation
* manual pages – gfs_pio_sendfile(3), gfs_pio_recvfile(3)
* manual pages – gfarm_environ(7) that describes environment variables
for Gfarm including ciphers in GSI communication
* user manual – cipher-comparison.html that describes the performance
of each cipher in typical architectures

Updated feature
* gfpcopy, gfprep – -k option not to copy symlinks [sf.net ticket
#904]
* gfpcopy, gfprep – -X option to exclude files or directories [sf.net
ticket #901]
* gfpcopy, gfprep – retry if copy or replication fails [sf.net ticket
#903]
* gfmv – more like mv(1) not just calling gfs_rename(2) [sf.net ticket
#897]
* automatic quota check – gfquotacheck is not needed to be called
explicitly [sf.net ticket #902]
* gfcksum – -l option to show a long path for each file [sf.net ticket
#879]
* adjust log level [sf.net ticket #876, #877]
* gfjournal – performance improvement [sf.net ticket #872]
* automatic repair at replication when the file is corrupted [sf.net
ticket #836]
* gfjournaldump – support ruby 1.9 or later

Bug fix
* gfjournal – fix incorrect output for offset [sf.net ticket #878]
* gfjournaldump – fix incorrect output [sf.net ticket #870]
* gfmd may crash when gfedquota is executed after gfmd failover
[sf.net ticket #906]

Release note for Gfarm 2.6.5.1
==============================

[2015.7.5]

Bug fix
* initialization for thread-safe OpenSSL is not called at the
beginning
* when specifying the same entry for rename, the entry is unlinked
[sf.net ticket #450]
* gfrmdir / returns ‘is a directory’ [sf.net ticket #451]
* file system node is not removed in the backend database when it has
no file replica, which was introduced by Gfarm 2.6.5 [sf.net ticket
#868]
* replica check does not start when the file system node group is
changed [sf.net ticket #866]
* replica check does not start when gfarm.replicainfo is removed
[sf.net ticket #867]

Release note for Gfarm2fs 1.2.9.8
=================================

[2015.8.29]

Updated feature
* umount.hpci – display umount error message
* -o hard_remove to prevent device or resource busy error
* gfarm2fs.cksum local extended attribute to show the digest

Bug fix
* mount.gfarm2fs – temporary proxy cert is referenced when mounting
two or more Gfarm file systems

Release note for Gfarm Zabbix plugin 2.2.0
==========================================

[2015.7.24]

Updated feature
* improve the failover script
– it gets status of gfmd servers in parallel [sf.net ticket #858]
– the configuration parameter ‘inspection_timeout’ is added
[sf.net ticket #858]

* improve “Low free memory on server {HOSTNAME}” trigger.
it uses vm.memory.size[available] instead of vm.memory.size[free],
vm.memory.size[cached] and vm.memory.size[buffers] to detect the status
more accurately [sf.net ticket #899]

Gfarm 2.6.5をリリース

みなさま

* Gfarmファイルシステム version 2.6.5

を公開致しました。

http://sourceforge.net/projects/gfarm/

このバージョンは、不具合修正の他、以下の新機能が含
まれています。

・自動余剰複製削除
・HPSS への並列コピー機能

このバージョンに更新していただくことをお勧めします。

Release note for Gfarm 2.6.5
============================

[2015.6.25]

New feature
* automatic removal of excessive number of file replicas
* gfrepcheck – remove and reduce_log commands to control automatic
replica removal and log summary output features
* gfpcopy – HPSS support
* gfprep, gfpcopy – -z and -Z options to specify the minimum and
maximum file size to copy, respectively

New configuration directive
* replica_check_remove – disables automatic replica removal feature
* replica_check_reduced_log – disables log summary output feature in
replica check
* metadb_replica_remover_by_host_sleep_time
* metadb_replica_remover_by_host_inode_step

Updated feature
* file replicas can be removed only when available number of replicas
is greater than required [sf.net ticket #857]
* gfexport – accept multiple input files [sf.net ticket #853]
* gfspooldigest – show statistics at the end
* libgfarm – do not connect to servers when client certificate is
expired
* gfhost -d removes file replicas stored on the deleted host [sf.net
ticket #860]
* gfjournal -m – performance improvement
* gfmd – SIGHUP is not needed to reload CA certificate and CRL
* slave gfmd – do not exit when journal receive queue overflows

Bug fix
* gfmd may crash in GSI [sf.net ticket #854]
* gfmd – replica check does not create required replicas when gfsd is
up [sf.net ticket #856]
* client may block when GSI authentication fails
* client may crash when connection problem happens [sf.net ticket
#852]
* slave gfmd may exit when connection problem happens [sf.net ticket
#851]
* gfmkdir – fix invalid memory reference in error case

Release note for Gfarm 2.6.4.1
==============================

[2015.4.30]

Updated feature
* gfspooldigest – -M option to select files modified older than the
specified days ago
* make progress of replica check

Bug fix
* gfspooldigest – segfault when gfmd failover happens [sf.net ticket
#848]

Gfarm 2.6.4をリリース

みなさま

* Gfarmファイルシステム version 2.6.4

を公開致しました。

http://sourceforge.net/projects/gfarm/

このバージョンは、不具合修正が含まれています。
このバージョンに更新していただくことをお勧めします。

Release note for Gfarm 2.6.4
============================

[2015.4.26]

Updated feature
* gfpcopy – overwrite files when having no file replica
* gfspooldigest (aka gfspoolmd5) – -G option to read files in a spool
directory in Gfarm API, which is useful to move corrupted files to
lost+found
* gffilepath – -l and -P options to specify the metadata directory and
the backend database path, respectively
* master gfmd stops after all journal transfer for safe failover to an
asynchronous slave server [sf.net ticket #845]
* adjust log level

Bug fix
* cannot build on Mac OS X and NetBSD since Gfarm 2.6.1 [sf.net ticket
#846]
* gffilepath – it does not support hardlinked files

Gfarm 2.6.3をリリース

みなさま

* Gfarmファイルシステム version 2.6.3

を公開致しました。

http://sourceforge.net/projects/gfarm/

このバージョンは、不具合修正が含まれています。
このバージョンに更新していただくことをお勧めします。

Release note for Gfarm 2.6.3
============================

[2015.4.13]

Bug fix
* gfs_pio_sendfile/recvfile may generate incorrect digest
* when a slave gfmd is changed from asynchronous to synchronous, it
stops to work [sf.net ticket #829]

Gfarm 2.6.2をリリース

みなさま

* Gfarmファイルシステム version 2.6.2
* Gfarm zabbixプラグイン version 2.1.0

を公開致しました。

http://sourceforge.net/projects/gfarm/

このバージョンは、有用な更新および不具合修正が含まれています。
このバージョンに更新していただくことをお勧めします。

なお、gfarm-announce-ja MLは移動することになりました。
日本語の扱いに問題なければ sourceforge.net となる予定です。

Release note for Gfarm 2.6.2
============================

[2015.3.27]

Updated feature
* unconfig scripts are generated by config-gfarm and config-gfsd to
undo the configuration process [sf.net ticket #819]

Bug fix
* mtime becomes Jan 1, 1970 when client_digest_check is enabled, which
was introduced by Gfarm 2.6.1 [sf.net ticket #832]
* missing checksum check during automatic replication when a file is
created [sf.net ticket #835]
* fix lost update problem that happens concurrent read and write cases
* gfreg – leaves an empty file incorrectly when a diskfull host is
specified by -h option [sf.net ticket #842]
* config-gfarm, config-gfsd – fix permission of configuration file of
systemd [sf.net ticket #830]
* fix infinite loop of replica check due to file size or checksum
mismatch

Release note for Gfarm Zabbix plugin 2.1.0
==========================================

[2015.3.25]

Updated feature
* improve the failover script
– it gives up promotion of a slave metadata server when it may
cause inconsistency of metadata among the servers
[sf.net ticket #825], [sf.net ticket #837]
– it retries to execute ‘gfjournal -m’ on a metadata server via SSH
[sf.net ticket #834]
* the failover script supports CentOS 7 [sf.net ticket #826]
* add a trigger to the template ‘Templete_Gfarm represent_client_nodep’,
which alerts administrators to multiple master metadata servers
running [sf.net ticket #778]
* do not alert administrators to successive triggers
[sf.net ticket #781], [sf.net ticket #823], [sf.net ticket #825],

Documentation
* explain firewall setting of gfarm-zabbix
[sf.net ticket #840]
* explain how to install gfarm-zabbix on CentOS 7
[sf.net ticket #791]
* explain how the failover script chooses new master metadata server

Bug fix
* whitespaces in ‘gfarm_gfmd_failover.conf’ are not preserved correctly
[sf.net ticket #833]

Gfarm 2.6.1をリリース

みなさま

* Gfarmファイルシステム version 2.6.1
* Gfarmファイルシステム version 2.5.8.14

を公開致しました。

http://sourceforge.net/projects/gfarm/

このバージョンは、有用な更新が含まれています。このバージョンに
更新していただくことをお勧めします。

Release note for Gfarm 2.6.1
============================

[2015.3.2]

New feature
* move corrupted replica to lost+found when checksum error happens
[sf.net ticket #802]

Documentation
* SETUP – update firewall setting [sf.net ticket #816]
* SETUP – user registration setting required on metadata servers and
file system nodes [sf.net ticket #803]
* manual pages – gfrm(1), config-gfarm(8), config-gfarm-update(8),
config-gfsd(8) and gfdump.postgresql(8) [sf.net ticket #799]
* Gfarm-FAQ – gfsd -dv may help to find a reason of authentication
error

Updated feature
* gfprep, gfpcopy – keep minimum disk space to reduce no space risk
* config-gfarm, config-gfarm-update – -d digest_type option to enable
digest check
* config-gfarm – -E option to enable data checksum support in a
backend database. PostgreSQL 9.3 or later is required to use this
option [sf.net ticket #804]
* gfmd – performance improvement of initialization process [sf.net
ticket #808]
* gfmd – multi-master check at the startup process [sf.net ticket
#807]
* configure – support GNU hurd for host_os_name [sf.net ticket #806]

Bug fix
* gfpcopy – count skipped files correctly [sf.net ticket #810]
* gfs_pio_sendfile() may set incorrect check sum when it is opened in
GFARM_FILE_APPEND [sf.net ticket #812]
* gfsd – failover notification may delay [sf.net ticket #792]

Release note for Gfarm 2.5.8.14
===============================

[2015.3.2]

Documentation
* SETUP – update firewall setting [sf.net ticket #816]
* SETUP – user registration setting required on metadata servers and
file system nodes [sf.net ticket #803]
* manual pages – gfrm(1), config-gfarm(8), config-gfarm-update(8),
config-gfsd(8) and gfdump.postgresql(8) [sf.net ticket #799]
* Gfarm-FAQ – gfsd -dv may help to find a reason of authentication
error

Updated feature
* gfprep, gfpcopy – keep minimum disk space to reduce no space risk
* config-gfarm, config-gfarm-update – -d digest_type option to enable
digest check
* config-gfarm – -E option to enable data checksum support in a
backend database. PostgreSQL 9.3 or later is required to use this
option [sf.net ticket #804]
* gfmd – performance improvement of initialization process [sf.net
ticket #808]
* gfmd – multi-master check at the startup process [sf.net ticket
#807]
* configure – support GNU hurd for host_os_name [sf.net ticket #806]

Bug fix
* gfpcopy – count skipped files correctly [sf.net ticket #810]

Gfarm 2.6.0をリリース

みなさま

* Gfarmファイルシステム version 2.6.0
* Gfarmファイルシステム version 2.5.8.13

を公開致しました。

http://sourceforge.net/projects/gfarm/

Gfarm 2.6.0 はメジャーバージョンアップで以下の新機能が含まれています。

  • エンドツーエンドのデータ完全性
  • 運用中のGfmdのフェイルオーバ機能
  • ファイルシステムノードのグループ化とファイル複製配置の指定
  • CentOS 7のサポート

Gfarm 2.5.8.X あるいはその前のバージョンから Gfarm 2.6.0への更新は config-gfarm-update を実行して Postgresql のスキーマを更新する必要があります。

% service gfarm-pgsql start
% config-gfarm-update –update
% service gfmd start

エンドツーエンドのデータ完全性のチェックを有効にするためには、gfmd.confでdigestを指定しチェックサム計算を有効にしてgfarm2.confで以下を指定します。

client_digest_check enable

これにより、サイレントデータ破壊の検知が可能となります。複製配置の指定はgfhostgroupでファイルシステムノードをグループ分けし、gfncopy -S で指定します。詳細はマニュアルページを参照してください。

Release note for Gfarm 2.6.0
============================

[2014.12.17]

New feature
* end-to-end data integrity for silent data corruption [sf.net ticket #774]
* checksum during replication [sf.net tickets #769 and #771]
* replica locations specified by file system node groups [sf.net tickets #494 and #711]
* gfhostgroup – manage file system node group
* fast failover by notifying to gfsd [sf.net ticket #721]
* client transparent failover [sf.net ticket #527]
* support sticky bit of directories [sf.net ticket #762]

New configuration directive
* client_digest_check – enables end-to-end data integrity

New API
* gfs_pio_sendfile, gfs_pio_recvfile – bulk data transfer

Updated feature
* gfncopy – -S option to specify replica locations by node groups [sf.net ticket #712]
* gfpcopy, gfexport, gfreg – performance improvement [sf.net ticket #728]
* support sha256 digest type [sf.net ticket #757]
* gfmdhost – introduce a new state under synchronization [sf.net ticket #752]

Bug fix
* fix race condition when updating files during a failover [sf.net ticket #341]
* file metadata may not be updated when using direct access feature on a file system node [sf.net ticket #461]

Release note for Gfarm 2.5.8.13
===============================

[2014.12.16]

Updated feature
* config-gfarm – CentOS 7 support [sf.net ticket #787]
* gfprep – suppress insufficient number of replicas error since it is norm when -x option is specified
* gfmdhost – -N and -1 options for health check purpose [sf.net ticket #779]

Bug fix
* GFARM_FILE_APPEND does not work on Mac OS X [sf.net ticket #789]