カテゴリー別アーカイブ: ニュース

Gfarm 2.6.12をリリース

みなさま

* Gfarmファイルシステム version 2.6.12

を公開致しました。

http://sourceforge.net/projects/gfarm/

このバージョンでは、Gfarm URL形式のシンボリックリンク
において、フェイルオーバをサポートしました。つまり、
gfarm://serverA:port/path/name というシンボリックリン
クにおいて、serverA から serverB にフェイルオーバして
もリンクがたどれるようになりました。そのために、
metadata_server_list を複数指定することを許し、以下の
ように指定します。

metadata_server_list serverA:port serverB:port

また、Ganglia plugin のフォーマットをキャッシュライン
の偽共有が発生しないよう更新しました。これに伴い、バー
ジョンアップする場合は以下のように plugin を更新する必
要があります。

service gmond stop
config-gfmd-iostat -f …
config-gfsd-iostat -f …
service gmond start

そのほか、いくつかの不具合修正が含まれています。

このバージョンに更新していただくことをお勧めします。

Release note for Gfarm 2.6.12
=============================

[2016.8.16]

New feature
* symbolic link support for master-slave redundant metadata servers –
metadb_server_list directive can be used several times to specify
several metadata server groups

Updated feature
* iostat – new data format that aligns the cache line to avoid
unnecessary false sharing. This requires ganglia plugin update by
config-{gfsd,gfmd}-iostat -f

Bug fix
* fix compilation error on Linux/alpha. This patch is contributed by
Michael Cree via Dmitry Smirnov [https://bugs.debian.org/827021]
* gfpcopy – plug memory leak, which was introduced in Gfarm 2.6.6
* gfmd – quota is not effective just after gfmd start-up or failover
* gfmd – incorrect grace period for soft quota after gfmd restart or
failover
* gfsd – may give up to reconnect to gfmd
* gfsd – incorrect period for write_verify is reported at gfsd crash
on Linux 2.6.22 or before

Gfarm 2.6.11をリリース

みなさま

* Gfarmファイルシステム version 2.6.11

を公開致しました。

http://sourceforge.net/projects/gfarm/

このバージョンは、重要な不具合修正が含まれています。GSI認証を用いる場
合に gfmd が deadlock する問題を解消するためには、/etc/init.d/gfmd に

export GLOBUS_THREAD_MODEL=pthread

を追加する必要があります。

このバージョンに更新していただくことをお勧めします。

Release note for Gfarm 2.6.11
=============================

[2016.6.2]

Bug fix
* gfpcopy does not tolerate file migration or file replica removal
* gfs_pio_close() returns GFARM_ERR_BAD_FILE_DESCRIPTOR when it is
called against a never accessed 0-byte file
* gfmd may deadlock in GSI when using Globus Toolkit 6.0 or later
* multi spool directories – directories having the same prefix cannot
be specified

Gfarm 2.6.10をリリース

みなさま

* Gfarmファイルシステム version 2.6.10

を公開致しました。

http://sourceforge.net/projects/gfarm/

gfmd が共有鍵をNFSで共有しないとき、性能を向上させる
オプションの追加、不具合修正が含まれています。

このバージョンに更新していただくことをお勧めします。

Release note for Gfarm 2.6.10
=============================

[2016.4.25]

New configuration directive
* metadb_server_nfs_root_squash_support – disables nfs root squash
support to improve the metadata performance if it is not necessary
* write_verify_log_interval – specifies the interval to record
statistics of write verify

Updated feature
* profile and progress logging support for write verify

Bug fix
* when gfmd is down, gfsd may not log failed close operation at exit
* multiple spool directories may cause inconsistent file creation. If
this happens, alert and move it to the spool top directory.


Osamu Tatebe
Center for Computational Sciences, University of Tsukuba

Gfarm 2.6.9をリリース

みなさま

* Gfarmファイルシステム version 2.6.9
* Gfarm2fs version 1.2.9.9

を公開致しました。

http://sourceforge.net/projects/gfarm/

複数のパーティションのサポート、ファイル生成のストレージスケジューリン
グの改善などの他、不具合修正が含まれています。

このバージョンに更新していただくことをお勧めします。

Release note for Gfarm 2.6.9
============================

[2016.4.3]

New configuration directive
* spool_server_back_channel_rcvbuf_limit and
metadb_server_back_channel_sndbuf_limit – limits outstanding
requests between gfsd and gfmd to reduce risk of the disconnection.
Default is 4096 bytes.

Updated feature
* gfsd – support multiple spool directories
* most available disk space is selected when creating files
* gfwhere – -m option to select files having the specified number or
less number of replicas
* gfwhere – -h option to select files that stored on the specified
host
* gfstatus – -m option to change the configuration parameter in gfmd
with -M option. Currently, ‘digest’, ‘write_verify’,
‘write_verify_interval’, ‘write_verify_retry_interval’ can be
changed. Note that write_verify is enabled only after gfsd is
restarted.
* write_verify process of gfsd terminates and dumps file information
to be verified by TERM signal
* gfspoolpath – -I option to specify inode number and generation
number instead of a filename

Bug fix
* updated files during the connection between gfsd and gfmd is
disconnected cannot be accessed
* master gfmd may crash when connecting from an expired slave gfmd
[sf.net ticket #947]
* delete metadata when a copy cannot be created due to no space error
* mtime of gfs_pio_stat() and gfs_stat() is inconsistent, which may
cause failure to extract symbolic links from tar files

Release note for Gfarm2fs 1.2.9.9
=================================

[2016.4.3]

Updated feature
* readlink – cache previous result to improve ‘ls -l’ performance

Gfarm 2.6.8をリリース

みなさま

* Gfarmファイルシステム version 2.6.8

を公開致しました。

http://sourceforge.net/projects/gfarm/

このバージョンは、サイレントデータ損傷(silent data corruption)を検知
するため、書込後に読み込んで digest を確認する書込検証(write verify)
機能をサポートしました。その他、重要な不具合修正が含まれています。

このバージョンに更新していただくことをお勧めします。

Release note for Gfarm 2.6.8
============================

[2016.1.16]

New feature
* write verify – detect silent data corruption by re-reading files

New configuration directive
* write_verify – enables the write verify feature
* write_verify_interval – specifies the wait time in seconds of the
write verify after the file creation. Default is 21600 seconds (6
hours).
* write_verify_retry_interval – specifies the wait time in seconds to
retry write verify when the file is opened for writing at the write
verify time. Default is 600 seconds (10 minutes).

Updated feature
* gfstatus – -M option to ask configuration, e.g. write_verify or
digest, in gfmd
* gfmd reports file names opened for writing when gfsd exits without
closing them
* quota check for file replication, chown, and chgrp

Bug fix
* gfmd crashes when quota prevents file creation [sf.net ticket #936]
* gfsd – plug memory leak at gfmd-initiated replication, which was
introduced by Gfarm 2.6.0

Gfarm 2.6.7, Zabbix plugin 3.0.0, Samba plugin 1.0.1, GridFTP DSI 1.0.4をリリース

みなさま

* Gfarmファイルシステム version 2.6.7
* Gfarm Zabbixプラグイン version 3.0.0
* Gfarm Sambaプラグイン version 1.0.1
* Gfarm GridFTP DSI version 1.0.4

を公開致しました。

http://sourceforge.net/projects/gfarm/

このバージョンは、重要な不具合修正が含まれています。

このバージョンに更新していただくことをお勧めします。

Release note for Gfarm 2.6.7
============================

[2015.11.28]

Updated feature
* make gfarm2fs return EIO instead of EINVAL, when no replica is
available [sf.net ticket #924]

Bug fix
* gfrep and gfprep may create incomplete replica when network error
happens, which is introduced by Gfarm 2.6.0 [sf.net ticket #926]
* local host is not selected when reading a file at first operation,
which was introduced by Gfarm 2.6.0
* When a file system node crashes during receiving a file replica, the
metadata remains [sf.net ticket #913]
* client_digest_check does not return an error even when checksum
mismatch happens [sf.net ticket #915, #916]
* gfarm clients may access uninitialized data, and may dump core, if
$HOME/.gfarm2rc does not exist [sf.net ticket #912]
* changing gfmd port number by “gfmdhost -m -p” makes gfmd crash
[sf.net ticket #918]
* When trying to modify a file stored at a file server with no space
or in read-only mode, return no space immediately instead of
retrying for a while

Release note for Gfarm Zabbix plugin 3.0.0
==========================================

[2015.9.30]

Updated feature
* restructure the templates
– the templates of this version has no conflict with “Template OS Linux”
so that a host can be linked with both “Template OS Linux” and Gfarm
Zabbix templates [sf.net ticket #911]
– Template_Gfarm_zabbix are no longer provided

Release note for Gfarm Samba plugin 1.0.1
=========================================

[2015.11.28]

Bug fix
* configure –with-samba does not set samba source path

Release note for Gfarm GridFTP DSI 1.0.4
========================================

[2015.11.28]

Bug fix
* fix segfault when using Gfarm 2.6
* check error in gfs_pio_close()

Gfarm 2.6.6, Gfarm2fs 1.2.9.8, Gfarm zabbix plugin 2.2.0をリリース

みなさま

* Gfarmファイルシステム version 2.6.6
* Gfarm2fs version 1.2.9.8
* Gfarm zabbixプラグイン version 2.2.0

を公開致しました。

http://sourceforge.net/projects/gfarm/

このバージョンは、不具合修正の他、以下の機能更新が含
まれています。

・複製作成時における破損ファイルの /lost+found への移動
・自動クオータチェック

このバージョンに更新していただくことをお勧めします。

Release note for Gfarm 2.6.6
============================

[2015.8.29]

New configuration directive
* client_parallel_max – the maximum number of parallel operations that
can be specified by gfpcopy and gfprep

Documentation
* manual pages – gfs_pio_sendfile(3), gfs_pio_recvfile(3)
* manual pages – gfarm_environ(7) that describes environment variables
for Gfarm including ciphers in GSI communication
* user manual – cipher-comparison.html that describes the performance
of each cipher in typical architectures

Updated feature
* gfpcopy, gfprep – -k option not to copy symlinks [sf.net ticket
#904]
* gfpcopy, gfprep – -X option to exclude files or directories [sf.net
ticket #901]
* gfpcopy, gfprep – retry if copy or replication fails [sf.net ticket
#903]
* gfmv – more like mv(1) not just calling gfs_rename(2) [sf.net ticket
#897]
* automatic quota check – gfquotacheck is not needed to be called
explicitly [sf.net ticket #902]
* gfcksum – -l option to show a long path for each file [sf.net ticket
#879]
* adjust log level [sf.net ticket #876, #877]
* gfjournal – performance improvement [sf.net ticket #872]
* automatic repair at replication when the file is corrupted [sf.net
ticket #836]
* gfjournaldump – support ruby 1.9 or later

Bug fix
* gfjournal – fix incorrect output for offset [sf.net ticket #878]
* gfjournaldump – fix incorrect output [sf.net ticket #870]
* gfmd may crash when gfedquota is executed after gfmd failover
[sf.net ticket #906]

Release note for Gfarm 2.6.5.1
==============================

[2015.7.5]

Bug fix
* initialization for thread-safe OpenSSL is not called at the
beginning
* when specifying the same entry for rename, the entry is unlinked
[sf.net ticket #450]
* gfrmdir / returns ‘is a directory’ [sf.net ticket #451]
* file system node is not removed in the backend database when it has
no file replica, which was introduced by Gfarm 2.6.5 [sf.net ticket
#868]
* replica check does not start when the file system node group is
changed [sf.net ticket #866]
* replica check does not start when gfarm.replicainfo is removed
[sf.net ticket #867]

Release note for Gfarm2fs 1.2.9.8
=================================

[2015.8.29]

Updated feature
* umount.hpci – display umount error message
* -o hard_remove to prevent device or resource busy error
* gfarm2fs.cksum local extended attribute to show the digest

Bug fix
* mount.gfarm2fs – temporary proxy cert is referenced when mounting
two or more Gfarm file systems

Release note for Gfarm Zabbix plugin 2.2.0
==========================================

[2015.7.24]

Updated feature
* improve the failover script
– it gets status of gfmd servers in parallel [sf.net ticket #858]
– the configuration parameter ‘inspection_timeout’ is added
[sf.net ticket #858]

* improve “Low free memory on server {HOSTNAME}” trigger.
it uses vm.memory.size[available] instead of vm.memory.size[free],
vm.memory.size[cached] and vm.memory.size[buffers] to detect the status
more accurately [sf.net ticket #899]

Gfarm 2.6.5をリリース

みなさま

* Gfarmファイルシステム version 2.6.5

を公開致しました。

http://sourceforge.net/projects/gfarm/

このバージョンは、不具合修正の他、以下の新機能が含
まれています。

・自動余剰複製削除
・HPSS への並列コピー機能

このバージョンに更新していただくことをお勧めします。

Release note for Gfarm 2.6.5
============================

[2015.6.25]

New feature
* automatic removal of excessive number of file replicas
* gfrepcheck – remove and reduce_log commands to control automatic
replica removal and log summary output features
* gfpcopy – HPSS support
* gfprep, gfpcopy – -z and -Z options to specify the minimum and
maximum file size to copy, respectively

New configuration directive
* replica_check_remove – disables automatic replica removal feature
* replica_check_reduced_log – disables log summary output feature in
replica check
* metadb_replica_remover_by_host_sleep_time
* metadb_replica_remover_by_host_inode_step

Updated feature
* file replicas can be removed only when available number of replicas
is greater than required [sf.net ticket #857]
* gfexport – accept multiple input files [sf.net ticket #853]
* gfspooldigest – show statistics at the end
* libgfarm – do not connect to servers when client certificate is
expired
* gfhost -d removes file replicas stored on the deleted host [sf.net
ticket #860]
* gfjournal -m – performance improvement
* gfmd – SIGHUP is not needed to reload CA certificate and CRL
* slave gfmd – do not exit when journal receive queue overflows

Bug fix
* gfmd may crash in GSI [sf.net ticket #854]
* gfmd – replica check does not create required replicas when gfsd is
up [sf.net ticket #856]
* client may block when GSI authentication fails
* client may crash when connection problem happens [sf.net ticket
#852]
* slave gfmd may exit when connection problem happens [sf.net ticket
#851]
* gfmkdir – fix invalid memory reference in error case

Release note for Gfarm 2.6.4.1
==============================

[2015.4.30]

Updated feature
* gfspooldigest – -M option to select files modified older than the
specified days ago
* make progress of replica check

Bug fix
* gfspooldigest – segfault when gfmd failover happens [sf.net ticket
#848]

Gfarm 2.6.4をリリース

みなさま

* Gfarmファイルシステム version 2.6.4

を公開致しました。

http://sourceforge.net/projects/gfarm/

このバージョンは、不具合修正が含まれています。
このバージョンに更新していただくことをお勧めします。

Release note for Gfarm 2.6.4
============================

[2015.4.26]

Updated feature
* gfpcopy – overwrite files when having no file replica
* gfspooldigest (aka gfspoolmd5) – -G option to read files in a spool
directory in Gfarm API, which is useful to move corrupted files to
lost+found
* gffilepath – -l and -P options to specify the metadata directory and
the backend database path, respectively
* master gfmd stops after all journal transfer for safe failover to an
asynchronous slave server [sf.net ticket #845]
* adjust log level

Bug fix
* cannot build on Mac OS X and NetBSD since Gfarm 2.6.1 [sf.net ticket
#846]
* gffilepath – it does not support hardlinked files

Gfarm 2.6.3をリリース

みなさま

* Gfarmファイルシステム version 2.6.3

を公開致しました。

http://sourceforge.net/projects/gfarm/

このバージョンは、不具合修正が含まれています。
このバージョンに更新していただくことをお勧めします。

Release note for Gfarm 2.6.3
============================

[2015.4.13]

Bug fix
* gfs_pio_sendfile/recvfile may generate incorrect digest
* when a slave gfmd is changed from asynchronous to synchronous, it
stops to work [sf.net ticket #829]