The Data Science Storage (DSS) service includes the provision of a centralized storage solution for larger data volumes, integrated into the HPC, HPDA, AI and Cloud environments of the LRZ. Integration takes place via a high-speed network, which guarantees high-performance processing of the data. Access rights are managed via a self-service portal and it is possible to share data with any LRZ, LMU and TUM users as well as any external persons. Data can be accessed from outside the LRZ via Globus Online or any tools operated by the customer in the LRZ Compute Cloud.
Main use cases are on one hand the collaborative processing of data on the LRZ Compute and AI Systems and on the other hand the sharing or provisioning of data with/for external persons which are too large for services like LRZ Sync+Share, OneDrive, Google Drive, etc..
For storage needs of more than 1 PB per year, storage can also be provided as part of a collaborative project with the customer based on a customizable modular system. In this case, the first step is always the analysis of the requirements together with the customer and the creation of an individual concept and offer.
Within the service level DSS Standard Tier, your data is stored on HDD based storage systems.
For use cases which require storage with very low access latencies, like applications from the AI and ML field, we provide the so called DSS AI Tier. On this service level, you data is stored on extremly fast and low latency NVMe SSD storage systems.
For use cases such as the longer-term storage and provision of cold data, the so-called DSS Archive Tier is also available. Here, the data is kept on tape (two copies in different data centers) and only retrieved back to the online area upon explicit request.
Scope of Services and Service Specifics
General services
- Consulting for the needs analysis
- Preparation of a customized offer based on the needs analysis
- Accommodation of the storage systems in the data center
- 19-inch rack(s) in the LRZ premises
- Air conditioning
- Power supply via two independent circuits, non-exclusive
- Connection to the dynamic UPS with an emergency runtime of at least 20 seconds
- Monitored operation in the data center
- Operation and administration
- Installation of hardware and software
- Maintenance of hardware and software
- Integration into the LRZ HPC ecosystem
- Support (including fault clearance) via LRZ service desk
- Optional services (for an additional charge)
- Professional data backup and data recovery using the LRZ ISP backup system
DSS On Demand (DSSOND)
- Provision of a storage quota at LRZ's own DSS from
- 20 TB on DSS Standard Tier
- 4 TB on DSS AI Tier
- 60 TB for DSS Archive Tier
The minimum term for a DSS On-Demand contract is 1 year and is automatically extended by a further year unless notice is given before the contract expires. The booked storage quota can be easily increased at any time. The storage is usually made available on the next working day after receipt of the order.
DSS Joint Project Offer (DSSJPO)
- Procurement of the storage system incl. manufacturer support
- Network connection within the HPC backbone with a bandwidth of at least 400 Gbit/s or a multiple thereof
- Optional services (at additional cost)
- Hierarchical storage management using the LRZ ISP archive system
- Setup of regular snapshot backups
The minimum term for a hosting contract for a DSS system is 5 years. After that, the contract can be extended annually, provided that a maintenance contract can still be concluded with the manufacturer for the hardware components used for the extension period.
The procurement of the hardware and manufacturer maintenance is carried out by the LRZ via corresponding framework agreements. The systems are formally the property of the LRZ for the duration of the contract.
Legacy systems can either be collected by the customer from the LRZ within 8 weeks of the expiry of the hosting contract, whereby they formally become the property of the customer, or, if desired, disposed of by the LRZ or the supplier in accordance with the statutory provisions.
Requirements
The service-specific usage guidelines (https://doku.lrz.de/dss-terms-and-conditions-11476130.html) must be observed.
DSSJPO fees
The fees for this service are divided into investment costs and operating costs. Procurement is handled via a framework agreement with a storage manufacturer. The framework agreement covers all storage components required for the compilation of a customised system. The LRZ is the sole contractual partner vis-à-vis the customer. The invoicing modalities (one-off total invoice, annual instalments) are determined in consultation with the customer. Each DSS system is customised and is procured and operated specifically for a customer. Needs analyses and quotations are free of charge and non-binding for the customer. The total costs incurred can hardly be meaningfully stated without a concrete specification of the technical requirements (capacity, bandwidth, IO rate, data profile, external connection, intended use, traffic profile).
NOTE:
The actual usable capacity is approx. one third less than the gross capacity.
The offer is only valid if the operating costs incurred are contractually guaranteed for 5 years.