Difference between revisions of "Infrastructure:Sunway"

From the Linux and Unix Users Group at Virginia Teck Wiki
Jump to: navigation, search
imported>Echarlie
imported>Pew
 
(3 intermediate revisions by one other user not shown)
Line 1: Line 1:
 +
''This is deprecated
 +
 
'''Sunway''' was a 19 node cluster [[VTLUUG]] runs for general use. Each machine uses local storage, although it may use something unified later on. [http://sunway.vtluug.org Westinghouse] is accessible from a public IPv4, the rest are accessible only from IPv6.
 
'''Sunway''' was a 19 node cluster [[VTLUUG]] runs for general use. Each machine uses local storage, although it may use something unified later on. [http://sunway.vtluug.org Westinghouse] is accessible from a public IPv4, the rest are accessible only from IPv6.
  
 
Sunway was transfered to [[gp:WUVT|WUVT]] in winter of 2016.
 
Sunway was transfered to [[gp:WUVT|WUVT]] in winter of 2016.
 +
 +
For more history, see [[VTLUUG:Beowulf Cluster]]
 +
 +
The names of the sunway nodes were:
 +
* dover
 +
* esco
 +
* fujitec
 +
* hitachi
 +
* kone
 +
* marshall
 +
* mce
 +
* mitsubishi
 +
* montgomery
 +
* mowrey
 +
* otis
 +
* salem
 +
* schindler
 +
* southern
 +
* thyssenkrupp
 +
* toshiba
 +
* us
 +
** Storage
 +
* westbrook
 +
** storage
 +
* westinghouse
 +
** Headnode
  
 
== Configuration ==
 
== Configuration ==
Line 17: Line 45:
 
Pump is a distcc utility that distributes the preprocessing as well as the compilation. The linux kernel with "defconfig" and "bzImage" produced a speed up factor of 4.36.
 
Pump is a distcc utility that distributes the preprocessing as well as the compilation. The linux kernel with "defconfig" and "bzImage" produced a speed up factor of 4.36.
  
[[Category:Infrastructure]]
+
[[Category:Hosts]]
 
[[Category:Deprecated]]
 
[[Category:Deprecated]]

Latest revision as of 01:18, 2 January 2018

This is deprecated

Sunway was a 19 node cluster VTLUUG runs for general use. Each machine uses local storage, although it may use something unified later on. Westinghouse is accessible from a public IPv4, the rest are accessible only from IPv6.

Sunway was transfered to WUVT in winter of 2016.

For more history, see VTLUUG:Beowulf Cluster

The names of the sunway nodes were:

  • dover
  • esco
  • fujitec
  • hitachi
  • kone
  • marshall
  • mce
  • mitsubishi
  • montgomery
  • mowrey
  • otis
  • salem
  • schindler
  • southern
  • thyssenkrupp
  • toshiba
  • us
    • Storage
  • westbrook
    • storage
  • westinghouse
    • Headnode

Configuration

The sunway cluster is managed via ansible and has a number of libraries and distcc installed. It is free for anyone to use, with their VTLUUG credentials. Be aware there is limited disk space on these machines.

distcc

The idea behind the cluster was to use it for distributed builds. Each cluster machine is running distccd and supports pump. If you would like to build something on the cluster download the source to your home directory. The process may change based on the project but to use pump (I would use it) and distcc do the following.

  pump make -j76 HOSTCC="distcc cc" HOSTCXX="distcc c++" CC="distcc cc" CXX="distcc c++"

The 76 is the level of parallelism decided upon by distcc, you can find it yourself by running:

  distcc -j

Pump is a distcc utility that distributes the preprocessing as well as the compilation. The linux kernel with "defconfig" and "bzImage" produced a speed up factor of 4.36.