Open main menu

Linux and Unix Users Group at Virginia Teck Wiki β

Changes

Infrastructure:Sunway

1,271 bytes added, 05:56, 27 April 2014
Created page with "'''Sunway''' is a 19 node cluster VTLUUG runs for general use. Each machine uses local storage, although it may use something unified later on. [http://sunway.vtluug.org W..."
'''Sunway''' is a 19 node cluster [[VTLUUG]] runs for general use. Each machine uses local storage, although it may use something unified later on. [http://sunway.vtluug.org Westinghouse] is accessible from a public IPv4, the rest are accessible only from IPv6.

== Configuration ==
The sunway cluster is managed via [http://www.ansible.com/ ansible] and has a number of libraries and [https://code.google.com/p/distcc/ distcc] installed. It is free for anyone to use, with their VTLUUG credentials. Be aware there is limited disk space on these machines.

== distcc ==
The idea behind the cluster was to use it for distributed builds. Each cluster machine is running distccd and supports pump. If you would like to build something on the cluster download the source to your home directory. The process may change based on the project but to use pump (I would use it) and distcc do the following.

pump make -j76 HOSTCC="distcc cc" HOSTCXX="distcc c++" CC="distcc cc" CXX="distcc c++"

The 76 is the level of parallelism decided upon by distcc, you can find it yourself by running:

distcc -j

Pump is a distcc utility that distributes the preprocessing as well as the compilation. The linux kernel with "defconfig" and "bzImage" produced a speed up factor of 4.36.
Anonymous user