F
FreeBSD Foundation
Guest
The FreeBSD Foundation has recently made a significant investment of over $100,000 to install a server cluster in Chicago. This investment aims to strengthen the infrastructure of the FreeBSD Project, improve its capabilities, and provide better services to its users. To support this expansion, the Foundation has partnered with NYI, which has generously contributed four racks in their Chicago facility.
Image: The FreeBSD Project cluster at NYI in Chicago
The new cluster configuration is designed to optimize the FreeBSD Project’s operational efficiency and includes:
This hardware setup is expected to significantly improve the processing capabilities and service responsiveness of the FreeBSD Project.
The FreeBSD clusteradm team played a crucial role in the integration phase of the new cluster.
This new setup provides faster and more reliable services, and it positions the FreeBSD Project better to serve the requirements of its global user community and adapt to technological developments.
The FreeBSD Foundation is a 501(c)(3) non-profit organization dedicated to supporting the FreeBSD Project and community. Accepting donations from individuals and businesses, the Foundation uses funds to develop features, employ software engineers, improve build and test infrastructure, advocate for FreeBSD through in-person and online events, and provide training and educational material. Representing the FreeBSD Project in legal affairs, the Foundation stands as the recognized entity for contracts, licenses, and other legal arrangements and is entirely donation supported. Learn more at freebsdfoundation.org.
The post Powering up the future: the new FreeBSD cluster in Chicago first appeared on FreeBSD Foundation.
Continue reading...
Hardware configuration and cluster composition
Image: The FreeBSD Project cluster at NYI in Chicago
The new cluster configuration is designed to optimize the FreeBSD Project’s operational efficiency and includes:
- Two routers: For directing network traffic.
- Five package builders: Aimed at accelerating the package release process.
- Three general-purpose servers: These will enhance the availability and performance of the FreeBSD Project’s public and developer-facing services (Bugzilla, Git, Phabricator, Wiki, etc.).
- Two package mirrors: One hosted in the new cluster in Chicago and one hosted by ISC in California. These are part of the FreeBSD Project’s growing network of pkg.FreeBSD.org and download.FreeBSD.org servers, strategically positioned around the world to offer faster package downloads.
- Two CI servers: To improve the speed and efficacy of automated code testing.
- One admin bastion: A secure entry point for managing the cluster, which runs custeradm, cluster DNS, monitoring, and other services needed to administer the systems.
This hardware setup is expected to significantly improve the processing capabilities and service responsiveness of the FreeBSD Project.
The installation of the new cluster
The FreeBSD clusteradm team played a crucial role in the integration phase of the new cluster.
- Hardware compatibility and firmware debugging: Several initial hurdles had to be overcome to ensure the server firmware was compatible with FreeBSD. The cluster relies on being able to netboot machines and requires reliable out-of-band management.
- Network configuration and automation: After the servers could reliably boot, the network was configured, including the cluster-internal DNS, packet filter rules, and BGP sessions to the Internet.
- Automation and system provisioning: Using the clusteradm automation tools, installing and configuring servers is largely automated. After overcoming some bootstrapping issues using a temporary FreeBSD installation, the servers were netbooted into the cluster installation image and installed using the standard cluster builds.
- Monitoring and management integration: The team installed and configured a monitoring proxy on the admin server, integrating the new site into the Project’s central monitoring system. This allowed for efficient management and troubleshooting of the cluster, ensuring stability and performance.
- Final system installation and network services setup: The team concluded the integration work by reinstalling the admin server using the clusteradm automation, setting up routing and firewall configurations, and bringing up the BGP sessions on the fibre uplinks. This setup ensured the new cluster was operational and optimized for performance and security.
Impact and future prospects
This new setup provides faster and more reliable services, and it positions the FreeBSD Project better to serve the requirements of its global user community and adapt to technological developments.
About the FreeBSD Foundation
The FreeBSD Foundation is a 501(c)(3) non-profit organization dedicated to supporting the FreeBSD Project and community. Accepting donations from individuals and businesses, the Foundation uses funds to develop features, employ software engineers, improve build and test infrastructure, advocate for FreeBSD through in-person and online events, and provide training and educational material. Representing the FreeBSD Project in legal affairs, the Foundation stands as the recognized entity for contracts, licenses, and other legal arrangements and is entirely donation supported. Learn more at freebsdfoundation.org.
The post Powering up the future: the new FreeBSD cluster in Chicago first appeared on FreeBSD Foundation.
Continue reading...