我正在尝试在BlueData上运行的docker容器中设置一个lustre客户端(docs)。
根据这篇文章,我已经修改了每个工作线程和控制器节点上的 BlueData 配置:
$ vi /opt/bluedata/common-install/bd_mgmt/releases/1/sys.config
我添加了SYS_ADMIN功能:
{allowed_docker_caps, ["SETPCAP",
"SYS_ADMIN",
...
并重新启动了主机。
接下来,我在 BlueData 中配置了一个 Centos 7.x 集群:
- 没有预先打包的应用程序或软件的 CentOS 7.x
- 映像版本:2.2
- 发行版 ID: bluedata/centos7
然后我进入 Centos 容器:
$ ssh -o StrictHostKeyChecking=no -i /Users/me/.ssh/id_rsa centos@x.x.x.x
在容器内,我安装了光泽客户端:
sudo yum install
kernel
kernel-devel
kernel-headers
kernel-abi-whitelists
kernel-tools
kernel-tools-libs
kernel-tools-libs-devel
cat >/tmp/lustre-repo.conf <<__EOF
[lustre-server]
name=lustre-server
baseurl=https://downloads.whamcloud.com/public/lustre/latest-release/el7/server
gpgcheck=0
[lustre-client]
name=lustre-client
baseurl=https://downloads.whamcloud.com/public/lustre/latest-release/el7/client
gpgcheck=0
[e2fsprogs-wc]
name=e2fsprogs-wc
baseurl=https://downloads.whamcloud.com/public/e2fsprogs/latest/el7
gpgcheck=0
__EOF
sudo mv /tmp/lustre-repo.conf /etc/yum.repos.d/lustre.repo
sudo reboot
sudo yum install epel-release
sudo yum --nogpgcheck --enablerepo=lustre-client install lustre-client-dkms lustre-client
sudo reboot
但是,当我尝试加载光泽模块时,我收到一个错误:
$ sudo modprobe -v lustre
insmod/lib/modules/3.10.0-957.21.3.el7.x86_64/kernel/crypto/crct10dif_generic.ko.xz insmod/lib/modules/3.10.0-957.21.3.el7.x86_64/kernel/lib/crc-t10dif.ko.xz modprobe:错误:无法插入"光泽":不允许操作
我已经检查了内核版本:
[bluedata@bluedata-2 ~]$ uname -a
Linux bluedata-2.bdlocal 3.10.0-957.21.3.el7.x86_64 #1 SMP Tue Jun 18 16:35:19 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
我安装的光泽版本是 2.12:
kmod-lustre-client.x86_64 2.12.2-1.el7 @lustre-client
lustre-client.x86_64 2.12.2-1.el7 @lustre-client
更新 1
使用 dmesg 未显示任何错误:
[bluedata@bluedata-3 ~]$ dmesg -c
[bluedata@bluedata-3 ~]$ sudo modprobe -v lustre
insmod /lib/modules/3.10.0-957.21.3.el7.x86_64/kernel/crypto/crct10dif_generic.ko.xz
insmod /lib/modules/3.10.0-957.21.3.el7.x86_64/kernel/lib/crc-t10dif.ko.xz
modprobe: ERROR: could not insert 'lustre': Operation not permitted
[bluedata@bluedata-3 ~]$ dmesg
更新 2
$ sudo strace modprobe lustre
输出:
execve("/sbin/modprobe", ["modprobe", "lustre"], [/* 16 vars */]) = 0
brk(NULL) = 0x1648000
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f4458ff2000
access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory)
open("/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=22387, ...}) = 0
mmap(NULL, 22387, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f4458fec000
close(3) = 0
open("/lib64/liblzma.so.5", O_RDONLY|O_CLOEXEC) = 3
read(3, "177ELF211 3 >