Yao L

探索永无止境

  • 主页
所有文章 推荐 关于我

Yao L

探索永无止境

  • 主页

利用torque-6.1.2+maui-3.3.1搭建pbs调度系统

2020-06-16

系统环境准备

本次搭建的集群系统包括2台服务器test1和test2

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
###test1
[root@test1 ~]# cat /etc/redhat-release
CentOS Linux release 7.6.1810 (Core)

###test2
[root@test2 ~]# cat /etc/redhat-release
CentOS Linux release 7.6.1810 (Core)

[root@test1 ~]# lscpu
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 128
On-line CPU(s) list: 0-127
Thread(s) per core: 1
Core(s) per socket: 64
Socket(s): 2
NUMA node(s): 8
Vendor ID: AuthenticAMD
CPU family: 23
Model: 49
Model name: AMD EPYC 7702 64-Core Processor

安装前准备

安装系统必要的库函数

1
[root]# yum install libtool openssl-devel libxml2-devel boost-devel gcc gcc-c++

准备好安装包

torque-6.1.2.zip

maui-3.3.1.tar.gz

torque-6.1.2安装配置

test1作为server节点

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
unzip torque-6.1.2.zip
cd torque-6.1.2
./autogen.sh
./configure --prefix=/opt/pbs_612 --enable-cgroups --with-scp --with-default-server=test1
make -j8 ##编译
make install ##安装

make packages ##制作安装包
torque-package-clients-linux-x86_64.sh
torque-package-devel-linux-x86_64.sh
torque-package-doc-linux-x86_64.sh
torque-package-mom-linux-x86_64.sh
torque-package-server-linux-x86_64.sh
cp contrib/systemd/pbs_sched.service /usr/lib/systemd/system

source /etc/profile.d/torque.sh ##加载环境变量
./torque.setup root ##初始化数据库

##启动服务
systemctl enable pbs_server
systemctl enable pbs_mom
systemctl enable pbs_sched
systemctl enable trqauthd

vim /var/spool/torque/server_priv/nodes ###添加计算节点
test1 np=128
test2 np=128

###指定服务端节点
vim /var/spool/torque/mom_priv/config
pbsserver head4
logevent 255

###启动服务
systemctl restart pbs_server
systemctl restart pbs_mom
systemctl restart pbs_sched
systemctl restart trqauthd

qnodes ###查看节点状态或者pbsnodes -a

客户端节点安装

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
scp torque-package-clients-linux-x86_64.sh torque-package-mom-linux-x86_64.sh test2:~
###登录到test2节点进行安装
./torque-package-clients-linux-x86_64.sh --install
./torque-package-mom-linux-x86_64.sh --install

###配置服务端节点
vim /var/spool/torque/mom_priv/config
pbsserver test1
logevent 255

###启动服务
systemctl enable pbs_mom
systemctl enable trqauthd

systemctl restart pbs_mom
systemctl restart trqauthd

安装maui

torque默认情况下使用pbs_sched管理,但是调度策略过于简单,因此建议在服务节点上安装maui来进行作业调度,注意:在计算节点上无须安装maui

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
tar -xvf maui-3.3.1.tar.gz
cd maui-3.3.1
./configure --prefix=/opt/pbs_612/maui_331 --with-pbs=/opt/pbs_612
make -j8&&make install
cp maui.cfg.dist /opt/pbs_612/maui_331/maui.cfg
vim maui.cfg
SERVERHOST test1
# primary admin must be first in list
ADMIN1 root
# Resource Manager Definition
RMCFG[TEST1] TYPE=PBS@RMNMHOST@RMTYPE[0] PBS

cp contrib/service-scripts/redhat.maui.d /etc/init.d/maui
chmod +x /etc/init.d/maui
vim /etc/init.d/maui
MAUI_PREFIX=/opt/pbs_612/maui_331
daemon --user root $MAUI_PREFIX/sbin/maui ###将用户名改为root

/etc/init.d/maui start ###启动maui

systemctl disable pbs_sched
systemctl stop maui ###停止maui服务

测试作业

1
2
###创建共享目录和用户test1,建立免密
echo sleep 30 | qsub
  • torque
  • maui
  • scheduler

扫一扫,分享到微信

微信分享二维码
基于DHCP、PXE和kickstart自动安装设置Centos7.6
iptables实现centos内网机器访问外网
© 2021 Yao L
YaoL Blog by Yao L
  • 所有文章
  • 推荐
  • 关于我

tag:

  • CAE
  • benchmark
  • OPENLDAP
  • Centos7.6
  • LSF
  • Linux
  • PAC
  • Arch
  • Config
  • Tools
  • 网络虚拟化
  • SLURM
  • Munge
  • vps
  • shadowsocks
  • iptables
  • nat
  • centos
  • FileSystem
  • kvm
  • network
  • bridge
  • lustre
  • mds
  • mgt
  • ost
  • netdata
  • influxdb
  • grafana
  • Abaqus
  • torque
  • maui
  • scheduler
  • xcat
  • Murderp2p
  • pxe
  • ESXI
  • IB
  • Virtual
  • PXE
  • DHCP
  • kickstart
  • infiniband
  • OPA
  • Cisco
  • CLI
  • perf
  • linux
  • Lustre
  • architecture
  • 2d torus
  • 3d torus
  • Fat-Tree
  • 全线速
  • 阻塞

    缺失模块。
    1、请确保node版本大于6.2
    2、在博客根目录(注意不是yilia根目录)执行以下命令:
    npm i hexo-generator-json-content --save

    3、在根目录_config.yml里添加配置:

      jsonContent:
        meta: false
        pages: false
        posts:
          title: true
          date: true
          path: true
          text: false
          raw: false
          content: false
          slug: false
          updated: false
          comments: false
          link: false
          permalink: false
          excerpt: false
          categories: false
          tags: true
    

  • 英特尔产品大全
  • 华科开源镜像
  • 朱双印博客
  • 谷歌
  • Shadowsocks分享
硕士毕业于华中科技大学

目前主要从事高性能计算的工作

谢谢大家