HBONE+ plans and results of developing the academic and research network in Hungary
Budapest,03.02.2011 TF-storage meeting
János Mohácsi NIIF/Hungarnet
Outline
Nemzeti Információs Infrastruktúra Fejlesztési Intézet
• NIIF program and service structure • NDP (ÚMFT) projects of NIIF – the HBONE+ project
2. oldal
TF-Storage meeting 03.02.2011
Services and development areas of NIIF/Hungarnet Nemzeti Információs Infrastruktúra Fejlesztési Intézet
• • • •
Network: HBONE, IPv6, VPN, multicast Middleware: Directory, Shibboleth based AAI, CA/SCS, Eduroam HPC: Supercomputing, ClusterGrid, storage Applications: • Collaborative: Videoconferencing, VoIP, Video-on-Demand • Basic +Value added: webhosting, mail, Hungarian Electronic Library, MOKKA, Subject Gateway (SZEZÁM) TF-Storage meeting 03.02.2011
NIIF/Hungarnet Services Nemzeti Információs Infrastruktúra Fejlesztési Intézet A.
Network Infrastructure 1. 2. 3. 4. 5. 6.
B.
10 Gbps domestic/international connectivity (HBONE/GEANT) E2E accessibility (Optical/SDH/ADSL) Technology (IPv6, QoS, MPLS, VPN, Multicast, Cache …) Network & traffic monitoring/management Hungarian “light” project: 10G on dark fibre connections since 2004 Traffic: 10 GE transmission on DWDM – aggregate 3-3 Gbps in/out (inc.DWS)
Network Services 1. 2. 3. 4. 5. 6.
C.
Supercomputing (phys., chem., biol., geol., astron., technol. …) Home working (R&D&E community) VoIP Videoconferencing Subject gateways/portals General services (virtual helpdesk, CSIRT, directories, PKI/CA …)
Network Applications 1. 2. 3. 4.
4. oldal
Distributed/integrated public collection databases/access Tele-working, tele-teaching Networked applications (health, environment, industry, economy …) Grids (ClusterGrid, SuperGrid, int’l grid projects /EGEE, SEEGRID, KnowARC/)
TF-Storage meeting 03.02.2011
NIIF Program Nemzeti Információs Infrastruktúra Fejlesztési Intézet • Servicing – NIIF (I2F)founded in 1986 ! All universities, research institutes, major museums, libraries, some hospitals
• Resources: ! infrastructure + expertise + interest + int’l relations ! ~ 6...8 MEUR / yr (70 % govt., 20 % users, 10 % projects) ! ~ 45 NIIFI staff + part-time FTEs country-wide
• Major Programs in NDP2 (ÚMFT): ! operative program for infrastructure development (TIOP, KMOP) - based on EU structural funds ! operative program for services development (TÁMOP targeting AAI, grid, video sharing portal) – based on EU cohesion funds
• European Projects: ! GN3, 6DEPLOY, FEDERICA ! KnowARC, EGEE, HP-SEE, EMI
2009.01.21.
TF-Storage meeting 03.02.2011
5
Network infrastructure - HBONEFejlesztési Intézet Nemzeti Információs Infrastruktúra
TF-Storage meeting 03.02.2011
NIIFI participation in NDP2 Nemzeti Információs Infrastruktúra Fejlesztési Intézet Service development
TÁMOP 4.1.3
TIOP 1.3.2
KMOP 4.2.1(A_2)
Convergence regions
Central Hungary region
• HBONE+ project:
Infrastructure development
June 2009 - December 2011
• NDP2/ÚMFT projects TIOP-1.3.2-08/1-2009-0001 and KMOP-4.2.1/A_2-2009-0001 • Support: ~4.2 MdFt (~ 14 mEUR) • TÁMOP 4.1.3:
May 2008 – October 2010
• Support: ~560 mFt (~ 1.5 mEUR)
7. oldal
TF-Storage meeting 03.02.2011
HBONE+ Nemzeti Információs Infrastruktúra Fejlesztési network Intézet
• Hybrid network infrastructure ! Dark fibre ! DWDM service – VOPN / dynamic lambda allocation "
Supporting alien wavelengths – to universities
! Backbone routers – Flexible IP/MPLS Metro Ethernet
• Extension of distribution network ! Licensed Microwave systems - 34-200 Mbps 8. oldal
TF-Storage meeting 03.02.2011
Equipments and Network Nemzeti Információs Infrastruktúra Fejlesztési Intézet • Optical network: ! 79 site, ~3200km ! Backbone based on Hungarian Electricity Company ! Local loops
•
DWDM system - Alcatel-Lucent PSS-1830 ! ! ! ! !
Optical connection: from users to users 80 channel system with 40 channel licensed Engineered for 40G/100G capability 10G ROADM backbone Operated by NIIFI
• IP/MPLS system – Cisco ASR9000 ! „Green” system ! Operated by NIIFI
• State of the art technologies ! 40/100 GBps and IPv6
• Total cost: 2.1 billion HUF ~ 7.8 MEUR
TF-Storage meeting 03.02.2011
HBONE+Nemzeti DF gerinc Információs Infrastruktúra Fejlesztési Intézet
10. oldal
TF-Storage meeting 03.02.2011
Dedicated Nemzeti HPC Információs networkInfrastruktúra Fejlesztési Intézet
Sopron 2x
Debrecen
VH
2x
2x
2x
2x Dunaújváros
Szeged
NIIF site, with HPC
HPC !
Pécs
TF-Storage meeting 03.02.2011
11
Hybrid Network Services Nemzeti Információs Infrastruktúra Fejlesztési Intézet • Lightpath Service ! Dedicated Network capacity for projects "
already 10 demands
! Point-to-point circuits – !oD
• L2 VPN, managed Ethernet - Finegrained capacity provisioning – with routers • Traditional IP: IPv4/6, unicast/ multicast, L3 VPN, with QoS and SLA 12.
TF-Storage meeting 03.02.2011
HBONE+ middleware Nemzeti Információs Infrastruktúra Fejlesztési Intézet
13. oldal
Home institute
Federation
Trust
• Virtualised AAI services – for smaller institutions • Supporting federated authentication and authorisation • European eduroam/ eduGAIN compatibility • Eduroam ! 20 large universities • HREF – Hungarian Research and Education Federation /eduID ! 10 large universities
Service
TF-Storage meeting 03.02.2011
HPC Nemzeti Információs Infrastruktúra FejlesztésiHBONE+ Intézet
• Supercomputing: ! 3 universities in countryside + NIIFI center ! NUMA and cluster/MPP systems ! Dedicated network capacity between the centers ! min. 3 x 2-8 Tflops + NIIFI (1 TFlops) ! National research and academic usage ! Software stack: " "
LRMS, HPC libraries programming environments, compilers, debuggers, profilers
! National + European integration (Grid, KnowARC, DEISA -> PRACE)
14. oldal
• Storage: ! 2 further universities ! Dunaújváros, Sopron
! national storage grid ! initially min. 0.5 PByte capacity
TF-Storage meeting 03.02.2011
Nemzeti Információs Infrastruktúra Fejlesztési Intézet Goals and requirements for HPC
• Goal: provide state-of-the-art HPC capacity and facility for Hungarian researchers, professors, and students • 10 years of experience with SUN E10/15/25K SMP and grids • Requirements: ! 3x8 Tflops, ! Most advanced processors, ! Redundant QDR Infiniband internal links, 4x10GE external connectivity, ! >200 Tbyte disk/site, ! Energy efficiency (green computing)->water cooling (max 60 kW/site), ! Visualisation capability
15. oldal
TF-Storage meeting 03.02.2011
Információs Infrastruktúra Fejlesztési Intézet Result ofNemzeti the tender
• Launch: 2011. Februar-March. • 4 sites: ! ! ! !
PTE (NUMA, SGI); DE (cluster/mpp, SGI); SZTE (cluster, HP); NIIFI (cluster, HP).
• Accumulated capacity: ! ! ! !
Computing: 47.85 Tflops (100 x). Number of cores: 4780 (20 x). Memory: 8 Tbyte (20 x). Disk capacity: nettó 1033 Tbyte (50 x).
• Total cost: ~ 1.0 billion HUF ~ 3.7 MEUR 16. oldal
TF-Storage meeting 03.02.2011
Nemzeti Információs Infrastruktúra Fejlesztési Intézet Storage system
• Distributed • Scalable • Energy efficient
17. oldal
TF-Storage meeting 03.02.2011
Nemzeti Információs Infrastruktúra Fejlesztési Intézet Storage system
• Distributed • Scalable • Energy efficient
18. oldal
TF-Storage meeting 03.02.2011
HBONE+ collaboration Nemzeti Információs Infrastruktúra Fejlesztési Intézet
• Videoconferencing ! 30+2 fullHD VC room systems – installed at the universities ! Centrally manageable SIP/ H.323, fullHD MCU ! Desktop videoconferencing system Integrated with the existing videoconferencing system of NIIF/Hungarnet !
Web/Desktop conferencing ! Wide platform support 19. oldal
• VOIP ! Upgrading the existing Voice gateways ! Supporting deployment of IP PBX systems
TF-Storage meeting 03.02.2011
HBONE+ collaboration Nemzeti Információs Infrastruktúra Fejlesztési Intézet
• HD Videoconferencing ! 30 x Polycom HDX 8000 + Polycom RMX 4000 MCU + management ! Installed and used
• Desktop videoconferencing systems ! Vidyo Router/Gateway/Portal ! Installed and used
• VoIP • Upgrading the existing Voice gateways ! 35 x Cisco 2811 Voice bundle replaced old Cisco 5350s
20. oldal
TF-Storage meeting 03.02.2011
Nemzeti Információs Infrastruktúra NIIF videoconferencing service Fejlesztési Intézet
21. oldal
TF-Storage meeting 03.02.2011
Questions?
Mohácsi János
[email protected] [email protected]
