Adding Hosts to your Symphony DE Cluster - HPC Community - High Performance Computing (HPC) Community

Ajith · #1 (**permalink**) July 11th, 2008, 07:14 AM

Scenario

You have Symphony DE running on one host and you now want to run your application on a multi-host cluster.

Steps

1. Install and start Symphony DE on each host and test each installation using the symping utility.

It is not necessary to install Symphony in the same location on all hosts.

If port 8000 is not free on one host, you must find a free port for all hosts and configure the agent port to this free port.

2. Create the master vem_resource.conf file on your master host, typically the fastest host with the most memory. This example is for Windows 32 bit (NTX86), but it applies to Windows 64 (NTX64), Linux 32 (LINUX86), Linux 64 (LINUX64).

The following is the initial vem_resource.conf file found in the Symphony /conf directory.

Code:

#
# Resource configuration file
#
# For more details on configuring hosts for Symphony DE with vem_resource.conf,
# see the Symphony Reference in the Knowledge Center under
# "Configuration Files", vem_resource.conf.
#
# File format:
# <service name>:<port_number>:<host_name>:<Option1>:<Option2>:<....>
# Valid service names are: AGENT, SD_SDK, SD_ADMIN, RS_DEPLOY, WEBGUI
#

#
# AGENT service information
# <service name>:<port_number>:<host_name>:<max number of SSMs SD can start>:<max number of SIMs SSM can start>:<OS_type>:<CPU_factor>
#
AGENT:8000:localhost:20:2:NTX86:1

#
# SD service information
# <service name>:<port_number>:<host_name>:<sd startcmd>
#
SD_SDK  :15051:localhost:sd 
SD_ADMIN:15050:localhost:sd 

#
# RS service information
# <service name>:<port_number>:<host_name>:<rs startcmd>
#
RS_DEPLOY:15052:localhost:rs

#
# GUI service information
# <service name>:<port_number>:<host_name>:<gui startcmd>
# Note:The port number of WEBGUI is fixed as 18080.
#
WEBGUI:18080:localhost:startguiservice

a. If you changed the AGENT port number from 8000 to say 9000, change the following line.

Code:

AGENT:8000:localhost:20:2:NTX86:1

to

Code:

AGENT:9000:localhost:20:2:NTX86:1

b. Change all references to localhost to the fully qualified domain name of you master host. All other hosts in your cluster must be able to see this master host with this name.

Code:

#
# AGENT service information
# <service name>:<port_number>:<host_name>:<max number of SSMs SD can start>:<max number of SIMs SSM can start>:<OS_type>:<CPU_factor>
#
AGENT:9000:myhost.platform.com:20:2:NTX86:1

#
# SD service information
# <service name>:<port_number>:<host_name>:<sd startcmd>
#
SD_SDK  :15051:myhost.platform.com:sd 
SD_ADMIN:15050:myhost.platform.com:sd 

#
# RS service information
# <service name>:<port_number>:<host_name>:<rs startcmd>
#
RS_DEPLOY:15052:myhost.platform.com:rs

#
# GUI service information
# <service name>:<port_number>:<host_name>:<gui startcmd>
# Note:The port number of WEBGUI is fixed as 18080.
#
WEBGUI:18080:myhost.platform.com:startguiservice

c. Add the fully qualified domain names of the compute hosts in your cluster.

Code:

#
# AGENT service information
# <service name>:<port_number>:<host_name>:<max number of SSMs SD can start>:<max number of SIMs SSM can start>:<OS_type>:<CPU_factor>
#
# Master HOST - Start 10 SSM's, start 0 SIM's
AGENT:9000:myhost.platform.com:10:0:NTX86:1
# Compute HOST - Start 0 SSM's, start 2 SIM's
AGENT:9000:myCompute1.platform.com:0:2:NTX86:1
AGENT:9000:myCompute2.platform.com:0:2:NTX86:1

The above configuration allows you to simultaneously start 10 Symphony applications (SSM's), but limits the number of service instances started on each compute host to 2 per Symphony application.

3. Copy the new vem_resource.conf file to the Symphony /conf directory on each compute host.

4. Shutdown Symphony on all hosts and then restart Symphony by first starting the master host and then starting the compute hosts.

5. Test the cluster by running symping from any host in the cluster.

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode