|
|
| (123 intermediate revisions by 6 users not shown) |
| Line 1: |
Line 1: |
| This page documents VTLUUG's infrastructure post-[[CVL eviction]]. It is intended as a scratch pad of | | This page documents VTLUUG's infrastructure post-[[CVL eviction]]. |
| sorts for organizing infrastructure changes, since [[Infrastructure:Log]] is incredibly out of date, and
| |
| there are a lot of details which must be sorted out before major infrastructure changes can be made.
| |
|
| |
|
| == Physical Infrastructure == | | == Physical Infrastructure == |
| ''Main Article [[Infrastructure:Cyberdelia]], [[VTLUUG:Inventory]]''
| | === NFS Hosts === |
| | * [[Infrastructure:Dirtycow|dirtycow]] - Primary NFS server, 8x2TB raidz2 array |
|
| |
|
| [[Infrastructure:Cyberdelia|Cyberdelia]] is the only connected physical machine right now. It contains 48 GB of memory | | === VM Hosts === |
| with 4 ethernet interfaces; only eth4 is connected and is attached to br0. All hosts are on the ECE network behind
| | * [[Infrastructure:Meltdown|meltdown]] - Primary VM/docker host |
| router.ece.vt.edu, a gateway featuring ARP proxying but no IPv6. For global DNS changes under ece.vt.edu, server
| | * [[Infrastructure:Spectre|spectre]] - Secondary VM/docker host, for example user VMs |
| room access, and getting hosts added to the ARP proxy, contact [mailto:rbrand7@vt.edu Brandon Russell]
| | * [[Infrastructure:Gibson|gibson]] - Secondary VM/docker host, Intel Arc A770, for GPU loads |
| | * [[Infrastructure:Prospit|prospit]] - Secondary VM/docker host, GTX 1080, for GPU loads |
| | === Whit Cluster === |
| | * [[Infrastructure:Vesuvius|vesuvius]] - SAN/control plane, 8x12TB raidz2 array |
| | * [[Infrastructure:Bastille|bastille (blades)]] - worker nodes |
| | |
| | === Routers === |
| | * [[Infrastructure:Shellshock|shellshock]] - Whit router, 3 disk RAID1 array |
| | * [[Infrastructure:Zerocool|zerocool]] - McBryde router |
| | |
| | All hosts are on our own 1 Gb/s port with [[Infrastructure:Shellshock|shellshock]], a gateway featuring ARP proxying, and full delegation of the 2607:b400:6:cc80/64 prefix. |
|
| |
|
| Virginia Tech has started blocking inbound ports 22 and 3389 and outbound port 25 at the campus border, in a move | | Virginia Tech has started blocking inbound ports 22 and 3389 and outbound port 25 at the campus border, in a move |
| some <!--[Who?]--> are calling [[gp:Cyber Auschwitz|Cyber Auschwitz]]. Contact itso-g@vt.edu for firewall exceptions.
| | [[User:echarlie|echarlie]] is calling [[gp:Cyber Auschwitz|Cyber Auschwitz]]. Contact itso-g@vt.edu for firewall exceptions. |
| When deploying new hosts, make ssh listen on both 2222 and 22. Acidburn currently listens on 443 as well. | | When deploying new hosts, make ssh listen on both 2222 and 22. [[Infrastructure:Acidburn|Acidburn]] currently listens on 3128 as well. |
|
| |
|
| Most other VTLUUG-owned servers are currently stored in [[user:dsetareh|Ali]]'s basement, with the exception of [[infrastructure:sunway|sunway]]
| | === Other hosts === |
| and a SuperMicro server, which were all transferred to WUVT. | | * [[Infrastructure:Joey|joey]] used to be the router, but is no longer in use due to a failure of the single drive |
| | * [[Infrastructure:Wood|Wood]] is sitting in our rack turned off because we don't have a use for it currently. It is in a 4U case capable of fitting several GPUs. |
| | * [[Infrastructure:Cyberdelia|cyberdelia]] - OFF, 7x1TB raidz2 array, sitting on shelf instead of rack |
| | * [[Infrastructure:Sunway|sunway]] and a SuperMicro server were all transferred to WUVT. Older hosts have either been thrown out or given to members. |
|
| |
|
| Some goals for once we get rackspace:
| | See [[VTLUUG:Strategic_plan]] for things we plan to do in the future. |
| * Acquire new servers
| |
| ** Phase out older infrastructure, and rebuild most existing servers, to clear out old accounts, old passwords, etc.
| |
| * Expand Tank on [[Infrastructure:Cyberdelia|cyberdelia]], as it is nearing full
| |
| * Provide an LXC host (preferably on physical hardware)
| |
| * Acquire an IPv6 prefix delegation, and either an IPv6 tunnel or something else
| |
| * Build a [[w:darknet|darknet]] for fail-over from the main network; perhaps run two OpenBSD boxes in [[w:Common Address Redundancy Protocol|CARP]].
| |
| * Relaunch and expand mirror.cc.vt.edu
| |
|
| |
|
| == On the Network Architecture == | | == On the Network Architecture == |
| ''Further Information: [[Infrastructure:Networking]]'' | | ''Further Information: [[Infrastructure:Networking]] and [[Infrastructure:Network]]'' |
| | |
| | [[File:Infra2019-network.png|thumb|500px|A simple network diagram by [[user:pew|pew]]. '''Update June 2021: Joey is dead, long live Joey. Shellshock is the new router. Cyberdelia is off.]] |
| | |
| | |
| | We currently have some services with public IPv4 address, and all hosts have an internal IPv4 address on the 10.98.x.x/16 subnet and an IPv6 address assigned via SLAAC. |
| | In the future, [[Infrastructure:IPsec|VPN]]/[[Iodine]] should be used. |
|
| |
|
| Because VTLUUG infra no longer has IPv6 access, we are limited by the IP addresses assigned to us, and what we
| | In theory, services can be provided via a hidden service such as [[w:Tor|Tor]], but that introduces other complications. |
| can get through DHCP from ECE. As a consequence, all services which do not need to have a global IP should move | | Alternately, services can require use of the [[Infrastructure:IPsec|VPN]] on [[Infrastructure:Acidburn|acidburn]], |
| to the internal network on the 10.99.x.x/16 subnet. In the future, it may be wise to bridge this network to an
| | [[Iodine]], or [[Secure Shell|ssh tunnelling]], although all of these limit usage to members with a shell account. |
| ethernet port on cyberdelia, so that a switch can be used to network our other services. When we have rackspace
| | All of these have the benefit of NAT transversal, however. |
| to do so, VPN/[[Iodine]] access to the internal network will be necessary.
| |
|
| |
|
| == Services == | | == Services == |
| | ''Further information: [[:Category:Services]]'' |
|
| |
|
| === Critical ===
| | * [[Infrastructure:Acidburn|acidburn]] |
| | |
| * [[Infrastructure:Acidburn|Acidburn]] | |
| ** Shell server | | ** Shell server |
| ** [[Email]] | | ** [[Email]] |
| ** [[Wadsworth]] | | ** [[Wadsworth]] |
| * [[Infrastructure:Razor|Razor]] | | ** [[Iodine]] |
| ** Ldap
| | * [[Infrastructure:Chimera|chimera]] |
| * [[Infrastructure:Milton|Milton]]/[[Infrastructure:Sczi|Sczi]] | | ** FreeIPA |
| | * [[Infrastructure:Sczi|Sczi]] |
| ** Website | | ** Website |
| *** Wiki | | *** [https://hokieprivacy.org hokieprivacy] |
| *** Main Page | | *** [https://bash.vtluug.org vtbash] |
| *** snapfeed | | *** [https://vtluug.org Main Site] |
| *** linx | | *** This wiki and [[gp:Main Page|Gobblerpedia]] |
| *** public file shares | | *** dex, for authing with the wikis |
| ** git | | *** https://vtluug.org/users/~$user - User homepages |
| * [[Infrastructure:Cyberdelia|Cyberdelia]] | | *** [https://search.vtluug.org 4get] a metasearch engine |
| ** VMs for projects | | *** [https://git.vtluug.org Gitea] a Github-esque git server with dex/LUUG OpenID auth |
| ** other services | | *** [https://element.vtluug.org element], a Matrix client |
| ** Tank | | *** [https://soulseek.vtluug.org slskd] |
| *** NFS | | *** [https://seed.vtluug.org qbittorrent-nox] |
| *** milton_srv (website files) | | *** [https://bitwarden.vtluug.org bitwarden] |
| | * [[Infrastructure:Nikonwormhole|nikonwormhole]] |
| | ** AdGuard DNS blackhole |
| | * [[Infrastructure:Dirtycow|dirtycow]] |
| | ** Storage for all primary services |
| | ** NFS - ZFS pool name is cistern |
| | * [[Infrastructure:Meltdown|meltdown]] |
| | ** VM host for above services |
| | * [[Infrastructure:Scaryterry|scaryterry]] |
| | ** [https://awm.vtluug.org AWM site] |
|
| |
|
| === Other (not all functional) ===
| | [[Infrastructure:Acidburn|acidburn]] and the website ''must'' be accessible through real services, and it is preferable other hosts are too. This means we must use our public IPv4 & IPv6 Addresses allotted by ECE. |
| * [[Tahoe-LAFS]]
| |
| * Jitsi Meet
| |
| * User websites
| |
| * Diaspora*
| |
| * [[Iodine]]
| |
| * [[Infrastructure:IPsec|IPsec Tunnel]]
| |
|
| |
|
| == Website details == | | == Website details == |
| ''Main article: [[Infrastructure:Milton]], [[Infrastructure:Sczi]]''
| |
| === Current Setup === | | === Current Setup === |
| | | All vtluug websites are run on nginx on [[Infrastructure:Sczi|sczi]]. These sites are currently functional: |
| All vtluug websites are run on nginx on milton. These sites are currently functional: | |
| * gobblerpedia.org | | * gobblerpedia.org |
| * hokieprivacy.org | | * hokieprivacy.org |
| * linx.vtluug.org
| |
| * snapchat.vtluug.org
| |
| * vtluug.org | | * vtluug.org |
| * wiki.vtluug.org (this redirects to vtluug.org/wiki/) | | * wiki.vtluug.org (redirects to vtluug.org/wiki/) |
| | * bash.vtluug.org |
| | * vtluug.org/users/~$user |
|
| |
|
| All of these sites exclusively allow for the use of tls connections. Hokie Privacy has a cert from letsencrypt, | | All of these sites exclusively allow for the use of TLS connections. All services use automatically updated |
| while all other services are verified by StartCom.
| | letsencrypt certs. |
| | |
| Currently, milton has '''no startup script''' for the website. If things go down, someone has to run
| |
| <pre>root@milton:/srv/http/vtluug.org# sudo -u www-data uwsgi --yaml uwsgi.yml</pre>
| |
| in a tmux session, to restart [https://uwsgi-docs.readthedocs.org/en/latest/ uWSGI]. It is also
| |
| unlikely that nginx will start properly because of weird dependencies.
| |
|
| |
|
| ==== Main Page ==== | | ==== Main Page ==== |
| | | The main VTLUUG page was scraped from the [[w:Internet Archive|Internet Archive]] and added created as a github page at |
| It currently appears that the main vtluug page (mostly written in php), is or was managed from
| | [https://vtluug.github.io vtluug.github.io], and is reverse-proxied through [[Infrastructure:Sczi|sczi]]. |
| [https://vtluug.org/atrium Drupal] as a backend, but for that to function, mysql needs to be running. | |
| | |
| uWSGI, django, and PHP appear make up most of the important features of the website in unknown ways.
| |
| This was configured by [[user:mutantmonkey|James]] at some point, we presume, but he is not available
| |
| to provide more information on the set-up, and even with more information, it would be preferable to move
| |
| the website to something more simple and sane.
| |
|
| |
|
| ==== Wiki ==== | | ==== Wiki ==== |
| | | The wiki currently runs fully on MediaWiki hosted on nginx using a [https://github.com/vtluug/mediawiki-docker modified version of the official mediawiki docker image]. You can auth with the admin account, [[User:wiki-admin|wiki-admin]] or a Google account. See note on [[Main_page]] about why LDAP isn't working yet. |
| The wiki currently runs fully on MediaWiki hosted on nginx (as opposed to the default include of apache2, | |
| demanded by the Debian package). Postgres is used for the database management, AFAIK, and authentication
| |
| is through LDAP. MediaWiki is a dated git version from the stablerepository, as of March 2016, however
| |
| updating is more complicated than a git pull
| |
|
| |
|
| ===== Gobblerpedia ===== | | ===== Gobblerpedia ===== |
| | Runs on the same Mediawiki instance as this wiki. Similarly to LUUGWiki, only Google accounts or the admin user are supported logins. |
|
| |
|
| All but disabled currently, due to spam. Runs on MediaWiki
| | === Needs Restoration === |
| | |
| ==== Linx ====
| |
| | |
| Uses [[User:andreim|aam]]'s [https://github.com/andreimarcu/linx-server linx], and is an identical implementation to his site
| |
| [https://linx.li linx.li]. One of the few sites with a complete startup script. The maintenance is currently the responsibility
| |
| of aam, however this is subject to change.
| |
| | |
| === Historically ===
| |
| | |
| Beyond these, we have data and nginx configurations for these (deprecated) sites, which
| |
| were previously hosted on milton:
| |
| | |
| ==== Needs Restoration ====
| |
| These are VTLUUG services that haven't yet been properly restored: | | These are VTLUUG services that haven't yet been properly restored: |
| * foodfor.vtluug.org - For [[Wadsworth]]'s .pickfood and .foodvote commands | | * [https://github.com/mutantmonkey/foodforus foodfor.vtluug.org] - For [[Wadsworth]]'s .pickfood and .foodvote commands. This is [[User:Timelord|jpo's]] fault. |
| * tahoe.vtluug.org - mhazinsk's Tahoe-LAFS grid | | * tahoe.vtluug.org - [[user:mjh|mhazinsk's]] Tahoe-LAFS grid |
| * git.vtluug.org - git hosting; previously a redirect to gitweb with gitosis as the SSH backend | | * git.vtluug.org - git hosting; previously a redirect to gitweb with gitosis as the SSH backend |
| * gitweb.vtluug.org - git hosting; previously gitweb | | * gitweb.vtluug.org - git hosting; previously gitweb |
| * map.vtluug.org - [[Openstreetmap|OSM]] | | * [https://github.com/vtluug/campusmap map.vtluug.org] - [[Openstreetmap|OSM]] based map of VT |
| * vtbash.org - VT QDB
| |
| * users.vtluug.org - member hosting of acidburn home directories
| |
|
| |
|
| ==== Deprecated ==== | | === Historically === |
| These are no longer needed but we should preserve the data/config:
| |
| * ccdc.vtluug.org - website used for the [[Collegiate Cyber Defense Competition]] in the spring of 2011.
| |
| * nagios.vtluug.org - was used for monitoring for a period but not kept up-to-date; the primary issue was that infrastructure, being hosted on the same server, tended to fail all at once
| |
| * uniluug.org - deprecated project
| |
| * security.ece.vt.edu - REDACTED
| |
| * wargame.vtluug.org - vtluug's wargame pre-vtcsec
| |
| * munin.vtluug.org - former attempt at monitoring
| |
| * webchat.vtluug.org - channel webchat; version of the service still runs on the vtluug website as an embeded frame from freenode's website
| |
| * cdn.vtluug.org - member website
| |
| * randynance.info - member website
| |
| * jessicaandchristopher.net - member website
| |
| * vtcybersecurity.org - member website from pre-csec days
| |
| | |
| Prior to the current site, which was written in Python using Django starting in 2010 and deployed in 2011, the VTLUUG website was a WordPress instance. The files for this still exist.
| |
| | |
| Additional files and configuration data exist for multiple versions of dokuwiki and mediawiki. There are also files for a NewsBlur installation which was never functional, and "bitcoin," the purpose of which is unknown.
| |
| | |
| For a time, a static version of vtbash.org was hosted at bash.vtluug.org.
| |
| | |
| Until recently, VTLUUG ran a Gopher server on Milton, with a small welcome page and access to /files. Git hosting was also provided; authenticated access was over SSH with [https://github.com/tv42/gitosis gitosis] and public access was via Gitweb and the insecure Git protocol.
| |
| | |
| vtluug.org/public/$user/ was previously a source directory of files placed in a user's $HOME/public directory on NFS. <nowiki>[When? I thought it was always users.vtluug.org?]</nowiki>
| |
| | |
| VTLUUG members also ran '''mirror.ece.vt.edu''', although it was never an official VTLUUG project. The IPv4 allocation for this domain is still available.
| |
| | |
| === Considerations for the future ===
| |
| | |
| It would be preferable to keep all existing sites functional. [[user:andreim|Aam]] suggested the use of [https://caddyserver.com/ caddy]
| |
| to replace nginx, especially on static sites, because it provides automatic letsencrypt.
| |
| | |
| It is also important to ensure there are '''startup scripts''' for sczi, so that a reboot of it doesn't result in a 10-hour website outage.
| |
| | |
| ==== Encryption ====
| |
| All sites should move to automatic letsencrypt certificates within the next few months. letsencrypt is still in beta, but it provides fully functional
| |
| and low-hassle 3-month certificates. They will have integration for nginx soon, which will decrease the complexity of getting certs.
| |
| | |
| It may also be of interest to the club to revive [[monkeysphere]] signing on the servers.
| |
| | |
| ==== Project Hosting ====
| |
| | |
| Most vtluug internal projects (e.g. HokiePrivacy) are currently hosted on git repositories on milton. How to move forwards with these is still
| |
| indeterminate.
| |
| | |
| For public hosting, there has been some conversation about using [https://github.com/gogits/gogs Go Git Service (gogs)], for public,
| |
| www-viewable git repositories.
| |
| | |
| ==== Gobblerpedia ====
| |
| | |
| [[gp:Main page|Gobblerpedia]] is effectively non-functional because account creation was disabled to
| |
| prevent spam. This needs to be addressed by adding captchas which are Blacksburg-specific, limiting
| |
| account creation access to local IP addresses, '''or''' enabling some form of LUUG-managed account
| |
| creation. One suggestion was using CAS/Login services to authenticate, however that makes it difficult
| |
| for Blacksburg residents to add content, and has other disadvantages.
| |
| | |
| ==== VTLUUG Main Page ====
| |
| | |
| This needs to be kept up-to-date, and have some way of adding calendar information.
| |
|
| |
|
| ==== VTLUUG Wiki ====
| | See [[Dead_projects]] for historic information |
|
| |
|
| Meeting creation script needs to be re-implemented.
| | === Goals === |
| | See [[VTLUUG:Strategic_plan#Web_Services]] for future goals involving web services |
|
| |
|
| == Addressing == | | == Addressing == |
| ''Main article: [[Infrastructure:Network]]''
| | VTLUUG currently has DNS with gandi.net. Message officers for access (please don't be scared :D). |
| | |
| VTLUUG currently has DNS with namecheap, however all domains have been re-registered with gandi under | |
| vtluug's own account, to replace the mixture of mutantmonkey-holdings and vtluug-held domains on multiple
| |
| different registrars.
| |
| | |
| https://linx.vtluug.org/ips1.txt
| |
| | |
| {| class="wikitable"
| |
| !globally addressable
| |
| !ECE DNS
| |
| !Name
| |
| !fucntion
| |
| !internal address
| |
| |-
| |
| | 128.173.88.78
| |
| | luug.ece.vt.edu.
| |
| | [[Infrastructure:sczi|sczi]]
| |
| | New webserver
| |
| | <!--10.99.0.27??--> 10.99.0.150 (Currently DHCP)
| |
| |-
| |
| | 128.173.89.244
| |
| | luug0.ece.vt.edu
| |
| | [[Infrastructure:cyberdelia|cyberdelia]]
| |
| | VM Host
| |
| | 10.99.0.1
| |
| |-
| |
| |128.173.89.245
| |
| | luug1.ece.vt.edu.
| |
| | [[Infrastructure:acidburn|acidburn]]
| |
| | shell server
| |
| | 10.99.0.4
| |
| |-
| |
| | 128.173.89.246
| |
| | luug2.ece.vt.edu.
| |
| | [[Infrastructure:milton|milton]]
| |
| | Old webserver
| |
| | 10.99.0.2
| |
| |-
| |
| | 128.173.89.247
| |
| | luug3.ece.vt.edu.
| |
| | [[Infrastructure:razor|razor]]
| |
| | LDAP
| |
| | 10.99.0.15
| |
| |-
| |
| | 128.173.88.104
| |
| | mjh.ece.vt.edu./luug4.ece.vt.edu
| |
| | <s>akhaten</s>
| |
| | currently pfsense (global v4 subject to change - IP belongs to mhazinsk)
| |
| | 10.99.0.104
| |
| |-
| |
| | 128.173.88.36
| |
| | mirror.ece.vt.edu.
| |
| | mirror
| |
| | not in use
| |
| |
| |
| |-
| |
| | 128.173.88.191
| |
| | luug5.ece.vt.edu.
| |
| | [[Infrastructure:Temp88191|router]]
| |
| | not in use
| |
| |
| |
| |-
| |
| |
| |
| | 172.xx.xx.xx
| |
| | snapfeed
| |
| | REDACTED
| |
| |
| |
| |-
| |
| | pfsense/443
| |
| | jitsi.vtluug.org
| |
| | jitsi
| |
| | [[Jitsi]]
| |
| | 10.99.0.101 (static lease)
| |
| |-
| |
| |None
| |
| | 172.16.10.13
| |
| | archiveteam-warrior
| |
| | [http://archiveteam.org/index.php?title=ArchiveTeam_Warrior Archive Team Warrior]
| |
| |
| |
| |}
| |
| | |
| == Deprecated IPs ==
| |
| IPs we were using at some point (by reclaiming CVL IPs, etc), or are mentioned in /etc/exports on Cyberdelia
| |
| * 128.173.88.161 (security.ece.vt.edu) - was once milton's IP until luug IPs got routed behind router.ece.vt.edu.
| |
| * 128.173.88.145 (cvl05.ece.vt.edu) - was once snapfeed's IP, reclaimed by bmckagen.
| |
| * 128.173.88.131 (dog.ece.vt.edu) - we have a Sun box labeled "dog.ece.vt.edu" but the IP appears to be in use now for VMware ESXi. It can be arped from cyberdelia.
| |
|
| |
|
| == Network Diagram ==
| | We currently hold the IPv6 prefix <code>2001:470:8:6d9::/64</code> from HE's allocation due to our tunnel. |
| | When CNS finally sets up prefix-delegation, we might be able to get something from <code>2607:b400::/32</code>, |
| | which is VT's largest allocation. |
|
| |
|
| This is the projected diagram of our network, once sczi is fully deployed and milton is phased out.
| | {{:Infrastructure:Network}} |
| At this time, razor may also lose its global v4 address.
| |
| [[File:Infra2016-network.png]]
| |
|
| |
|
| [[Category:Infrastructure]] | | [[Category:Infrastructure]] |
| [[Category:VTLUUG:Projects]] | | [[Category:VTLUUG:Projects]] |
| [[Category:2016]]
| |
| [[Category:Featured content]] | | [[Category:Featured content]] |