Direct Attached Storage via SCSI for user and application data storage
The most critical problem that we currently face is running out of online storage. We often advise users to delete or move existing data from the network shares, in an effort to free-up disk space. Inadequate network data storage affects the overall end-user experience and impedes business productivity.
Islands of information are prone to creating duplicate data across the network. Centralization of these databases will reduce administrative overhead. Some file servers are only using 20% of full storage capacity, while others are at full utilization. It is difficult to track usage and implement the right sized storage for each NYCDOE location, due to frequent changes in the organization. Users demand more online storage for their work data. There is some unused storage in the datacenter, but we cannot always leverage available storage due to infrastructure limitations. We simply do not have the right level of flexibility and scalability to appropriately extend the current storage environment.
In the past, it has been a challenge for us to support software evaluation efforts for the application development teams, due to resource constraints. It takes a lot of time and energy to prepare test environments for this purpose. We are piloting the use of virtualization in a test lab environment in order to provide virtualized resources on demand in support of software evaluation initiatives. This will minimize the amount of time required to build out evaluation computing environments.
In brief, the following items represent the datacenter’s current challenges:
Our datacenter lacks floor space needed for its growth.
With a current utilization of 675 KVA, the 750 KVA Central UPS is reaching its maximum power capacity.
The current power design does not provide for parallel redundancy.
Rack size standardization with Hot and Cold aisle configuration needs to be addressed.
Cabling standardization is an ongoing concern.
Environmental application and asset management applications are required in order to keep our data center at its appropriate temperature, while managing moves, adds and changes.
Implementing efficient cooling remains a challenge due to limitations in water tower pipe capacity and obstruction of cables under raised floor
The facility’s physical security is limited, and inconsistent with the key role it plays in DOE operations. Improvement to the physical security, e.g., installing a camera system to monitor entry and exit, should be implemented.
The end-state is a reduction in the number of physical servers in the datacenter with petabytes of centrally managed storage. The reduced compute infrastructure will create a private cloud computing environment that can be leveraged by all NYCDOE entities. Unified Storage is the foundation for a resilient datacenter, business continuity and cloud computing.
The benefits of realizing the target state include:
More storage for everyone
Satisfied end-users, equates to a productive workforce
Provide shared storage between core infrastructure servers
Reduce server hardware footprint
Reduce server hardware heat and energy consumption
Provide on-demand storage solution
Ability to replicate data across the SONET ring for disaster recovery
Easily procure and install multi-terabyte SAN-attached disk array subsystems and subdivide their capacity among several servers, in many cases running unrelated applications to achieve economy of scale in both capital expenditure and management—efficiently redeploying disk storage capacity among servers as business grows.
Quickly transfer or pull critical data from application to application.
Reduce the amount of time to backup and recover data
Provide high I/O bandwidth for data mining requirements
The Data Center is also embarking on a series of projects to standardize and upgrade its physical plant. These include:
Standardizing on 42” deep equipment racks
Standardizing cabling by installing new patch panels
Standardizing power by moving from local UPS’s to central UPS’s
Maintain a policy of hot aisles and cool aisles, by installing equipment within racks in a consistent manner so that heat generation is predictably localized, allowing for more efficient cooling.
Upgrade cooling by removing unused circuitry from under the raised flooring, and pressurizing perimeter walls within the data center, preventing cool air from escaping.
These changes will be reflected in new Data Center Governance documentation that will be kept current over time.
Three other areas are being planned for as well:
The Data center plans to install sensors and make use of software applications for environmental monitoring, allowing Data Center staff to recognize “hot spots” quickly.
The Data Center will by deploying asset manager software, inventorying all the equipment in the data center.
The Data Center is developing plans for power back up, a particularly important issue given that the Data Center lacks a generator to provide back up power in case of electrical failure. The UPS currently available provides a few minutes back-up power, enough to allow Data Center staff to shut down computers and servers, but no way to maintain effective operation.
Space and power considerations remain ongoing issues for the Data Center, and will have to be addressed over the five-year horizon of this plan. Currently, the ability to add new servers in support of new educational initiatives is limited by the amount of floor space and power available. It is expected that CitiServ, the project designed to consolidate NYC data centers, will have an impact, potentially a considerable one, on the 2 MTC Data Center.