Yao L

探索永无止境

  • 主页
所有文章 推荐 关于我

Yao L

探索永无止境

  • 主页

IBM LSF+PAC安装教程

2020-01-17

LSF的安装

1、准备好LSF的安装包和授权文件

  • 本次安装我们选择标准版本

    包含的安装包有:

    lsf10.1_lsfinstall_linux_x86_64.tar.Z

    lsf10.1_lnx310-lib217-x86_64-520099.tar.Z

    lsf10.1_linux2.6-glibc2.3-x86_64.tar.Z

    pac10.2.0.8_standard_linux-x64.tar.Z

  • 解压修改配置文件

    1
    2
    3
    4
    5
    zcat lsf10.1_lsfinstall_linux_x86_64.tar.Z | tar -xvf -
    mkdir -p /public/software/distribut
    cp lsf10.1_lnx310-lib217-x86_64-520099.tar.Z lsf10.1_linux2.6-glibc2.3-x86_64.tar.Z /public/software/distribut
    cd lsf10.1_lsfinstall/
    vim install.config

    需要修改的参数
    LSF_TOP
    LSF_ADMINS
    LSF_CLUSTER_NAME
    LSF_MASTER_LIST
    LSF_ENTITLEMENT_FILE
    LSF_TARDIR

    1
    2
    3
    4
    5
    6
    7
    8
    9
    10
    11
    12
    13
    14
    15
    16
    17
    18
    19
    20
    21
    22
    23
    24
    25
    26
    27
    28
    29
    30
    31
    32
    33
    34
    35
    36
    37
    38
    39
    40
    41
    42
    43
    44
    45
    46
    47
    48
    49
    50
    51
    52
    53
    54
    55
    56
    57
    58
    LSF_TOP="/public/software"  #设置安装路径
    # -----------------
    # Full path to the top-level installation directory {REQUIRED}
    #
    # The path to LSF_TOP must be shared and accessible to all hosts
    # in the cluster. It cannot be the root directory (/).
    # The file system containing LSF_TOP must have enough disk space for
    # all host types (approximately 300 MB per host type).
    #
    # -----------------
    LSF_ADMINS="lsfadmin" #设置lsf管理员
    # -----------------
    # List of LSF administrators {REQUIRED}
    #
    # The first user account name in the list is the primary LSF
    # administrator. It cannot be the root user account.
    # Typically, this account is named lsfadmin.
    # It owns the LSF configuration files and log files for job events.
    # It also has permission to reconfigure LSF and to control batch
    # jobs submitted by other users. It typically does not have
    # authority to start LSF daemons. Usually, only root has
    # permission to start LSF daemons.
    # All the LSF administrator accounts must exist on all hosts in the
    # cluster before you install LSF.
    # Secondary LSF administrators are optional.
    #
    # -----------------
    LSF_CLUSTER_NAME="cluster1" #设置集群名
    # -----------------
    # Name of the LSF cluster {REQUIRED}
    #
    # It must be 39 characters or less, and cannot contain any
    # white spaces. Do not use the name of any host, user, or user group
    # as the name of your cluster.
    #
    #
    #**********************************************************
    # PART 2: PRIMARY PARAMETERS FOR NEW INSTALL
    # (These parameters are ignored if they are already defined in the cluster.)
    #**********************************************************
    #
    # -----------------
    LSF_MASTER_LIST="DDN01" #设置server主机
    # -----------------
    # List of LSF server hosts to be master or master candidate in the
    # cluster {REQUIRED when you install for the first time or during
    # upgrade if the parameter does not already exist.}
    #
    # You must specify at least one valid server host to start the
    # cluster. The first host listed is the LSF master host.
    #
    # -----------------
    LSF_ENTITLEMENT_FILE="/public/software/distribut/lsf_std_entitlement.dat"
    # -----------------
    # You must specify a full path to the LSF entitlement file.
    #
    # -----------------
    LSF_TARDIR="/public/software/distribut"
  • 安装lsf并进行配置

    1
    2
    3
    4
    5
    6
    7
    8
    9
    10
    11
    12
    13
    14
    ./lsfinstall -f install.config
    . /public/software/lsf10.1/conf/profile.lsf
    [root@DDN01 log]# lsid
    IBM Spectrum LSF Standard 10.1.0.8, May 10 2019
    Copyright International Business Machines Corp. 1992, 2016.
    US Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.
    My cluster name is cluster1
    My master name is mgt
    [root@DDN01 log]# bhosts
    HOST_NAME STATUS JL/U MAX NJOBS RUN SSUSP USUSP RSV
    mgt ok - 4 0 0 0 0 0
    cd /public/software/lsf10.1/10.1/install
    ./hostsetup --top="/public/software/lsf10.1" --boot="y" #设置开机启动
    sed -i '$a\LSF_RSH=ssh' lsf.conf #更改通信方式

PAC软件安装配置

  • 准备好LSF的安装环境

    1
    2
    3
    4
    5
    6
    7
    8
    vim $LSF_ENVDIR/lsbatch/cluster_name/configdir/lsb.params
    ALLOW_EVENT_TYPE=JOB_NEW JOB_STATUS JOB_FINISH2 JOB_START JOB_EXECUTE JOB_EXT_MSG JOB_SIGNAL JOB_REQUEUE JOB_MODIFY2 JOB_SWITCH METRIC_LOG #添加字段
    ENABLE_EVENT_STREAM=Y #更改字段
    badmin reconfig #配置生效

    vim $LSF_ENVDIR/conf
    LSF_DISABLE_LSRUN=N #更改字段
    lsadmin resrestart all #配置生效
  • 安装PAC

    1
    2
    3
    4
    5
    6
    7
    8
    9
    10
    11
    12
    13
    14
    15
    16
    tar -xzvf pac10.2_standard_linux-x64.tar.Z
    cd pac10.2_standard_linux-x64

    LSF_ENVDIR #替换为包含lsf.conf的路径
    MYSQL_JDBC_DRIVER_JAR #包含mysql-connector-java-5.1.48-bin.jar的路径

    yum install mariadb-server
    systemctl start mariadb
    ./pacinstall.sh
    . /public/software/pac10.2/lsfsuite/ext/profile.platform

    pmcsetrc.sh
    perfsetrc.sh

    perfadmin start all
    pmcadmin start #启动服务

    pac gui

  • LSF
  • Linux
  • PAC

扫一扫,分享到微信

微信分享二维码
LSF调度系统架构详解
设计infiniband Fat-Tree结构
© 2021 Yao L
YaoL Blog by Yao L
  • 所有文章
  • 推荐
  • 关于我

tag:

  • CAE
  • benchmark
  • OPENLDAP
  • Centos7.6
  • LSF
  • Linux
  • PAC
  • Arch
  • Config
  • Tools
  • 网络虚拟化
  • SLURM
  • Munge
  • vps
  • shadowsocks
  • iptables
  • nat
  • centos
  • FileSystem
  • kvm
  • network
  • bridge
  • lustre
  • mds
  • mgt
  • ost
  • netdata
  • influxdb
  • grafana
  • Abaqus
  • torque
  • maui
  • scheduler
  • xcat
  • Murderp2p
  • pxe
  • ESXI
  • IB
  • Virtual
  • PXE
  • DHCP
  • kickstart
  • infiniband
  • OPA
  • Cisco
  • CLI
  • perf
  • linux
  • Lustre
  • architecture
  • 2d torus
  • 3d torus
  • Fat-Tree
  • 全线速
  • 阻塞

    缺失模块。
    1、请确保node版本大于6.2
    2、在博客根目录(注意不是yilia根目录)执行以下命令:
    npm i hexo-generator-json-content --save

    3、在根目录_config.yml里添加配置:

      jsonContent:
        meta: false
        pages: false
        posts:
          title: true
          date: true
          path: true
          text: false
          raw: false
          content: false
          slug: false
          updated: false
          comments: false
          link: false
          permalink: false
          excerpt: false
          categories: false
          tags: true
    

  • 英特尔产品大全
  • 华科开源镜像
  • 朱双印博客
  • 谷歌
  • Shadowsocks分享
硕士毕业于华中科技大学

目前主要从事高性能计算的工作

谢谢大家