Difference between revisions of "Infrastructure:Sunway"
imported>Echarlie |
imported>Pew |
||
Line 1: | Line 1: | ||
+ | ''This is deprecated | ||
+ | |||
'''Sunway''' was a 19 node cluster [[VTLUUG]] runs for general use. Each machine uses local storage, although it may use something unified later on. [http://sunway.vtluug.org Westinghouse] is accessible from a public IPv4, the rest are accessible only from IPv6. | '''Sunway''' was a 19 node cluster [[VTLUUG]] runs for general use. Each machine uses local storage, although it may use something unified later on. [http://sunway.vtluug.org Westinghouse] is accessible from a public IPv4, the rest are accessible only from IPv6. | ||
Latest revision as of 01:18, 2 January 2018
This is deprecated
Sunway was a 19 node cluster VTLUUG runs for general use. Each machine uses local storage, although it may use something unified later on. Westinghouse is accessible from a public IPv4, the rest are accessible only from IPv6.
Sunway was transfered to WUVT in winter of 2016.
For more history, see VTLUUG:Beowulf Cluster
The names of the sunway nodes were:
- dover
- esco
- fujitec
- hitachi
- kone
- marshall
- mce
- mitsubishi
- montgomery
- mowrey
- otis
- salem
- schindler
- southern
- thyssenkrupp
- toshiba
- us
- Storage
- westbrook
- storage
- westinghouse
- Headnode
Configuration
The sunway cluster is managed via ansible and has a number of libraries and distcc installed. It is free for anyone to use, with their VTLUUG credentials. Be aware there is limited disk space on these machines.
distcc
The idea behind the cluster was to use it for distributed builds. Each cluster machine is running distccd and supports pump. If you would like to build something on the cluster download the source to your home directory. The process may change based on the project but to use pump (I would use it) and distcc do the following.
pump make -j76 HOSTCC="distcc cc" HOSTCXX="distcc c++" CC="distcc cc" CXX="distcc c++"
The 76 is the level of parallelism decided upon by distcc, you can find it yourself by running:
distcc -j
Pump is a distcc utility that distributes the preprocessing as well as the compilation. The linux kernel with "defconfig" and "bzImage" produced a speed up factor of 4.36.