DF activities at NIIFI - HBONE+ development of the academic and research network in Hungary
Amsterdam, 09.11.2010 TF-MSP meeting
János Mohácsi NIIF/Hungarnet
Outline
Nemzeti Információs Infrastruktúra Fejlesztési Intézet
• NIIF program and service structure • NDP (ÚMFT) projects of NIIF – the HBONE+ project ! Past experiences with DF leasing/rental attempts ! Network development of HBONE+ project
2. oldal
TF-MSP meeting – Nov 2010
Services and development areas of NIIF/Hungarnet Nemzeti Információs Infrastruktúra Fejlesztési Intézet
• • • •
Network: HBONE, IPv6, VPN, multicast Middleware: eduID, CA/TCS, eduroam HPC: Supercomputing, grid, storage Applications: • Collaborative: Videoconferencing, VoIP, Video-on-Demand • Basic +Value added: webhosting, mail, Hungarian Electronic Library, MOKKA, Subject Gateway (SZEZÁM) 3.
TF-MSP meeting – Nov 2010
Pre DF Network infrastructure HBONE Nemzeti Információs Infrastruktúra- Fejlesztési Intézet
4.
TF-MSP meeting – Nov 2010
NIIFI participation in NDP2 Nemzeti Információs Infrastruktúra Fejlesztési Intézet Service development
TÁMOP 4.1.3
TIOP 1.3.2
KMOP 4.2.1(A_2)
Convergence regions
Central Hungary region
• HBONE+ project:
Infrastructure development
June 2009 - December 2011
• NDP2/ÚMFT projects TIOP-1.3.2-08/1-2009-0001 and KMOP-4.2.1/A_2-2009-0001 • Support: ~4.2 MdFt (~ 14 mEUR) • TÁMOP 4.1.3:
May 2008 – October 2010
• Support: ~560 mFt (~ 1.5 mEUR)
5. oldal
TF-MSP meeting – Nov 2010
HBONE+ Nemzeti Információs Infrastruktúra Fejlesztési network Intézet
• Hybrid network infrastructure ! Dark fibre ! DWDM service – VOPN / dynamic lambda allocation "
Supporting alien wavelengths – to universities
! Backbone routers – Flexible IP/MPLS Metro Ethernet
• Extension of distribution network ! Licensed Microwave systems - 34-200 Mbps 6. oldal
TF-MSP meeting – Nov 2010
HBONE+ network/2
Nemzeti Információs Infrastruktúra Fejlesztési Intézet
• National coverage of dark fiber ~ 90% • DWDM – Router ! Installation in progress • Extension of the distribution network ! Ceragon FibAir Microwave systems - 34-200 Mbps ! Locations: Esztergom, Pannonhalma, Pápa, Kalocsa, Gyula, Békéscsaba, Sopron, Piszkéstet! • Provide more useful and up-to-date information to universities ! User Portal/helpdesk – AAI integration ! Service management (including most of the services) ! SLA reporting ! Databases – similar to GN2 I-SHARe 7. oldal
TF-MSP meeting – Nov 2010
HBONE+ middleware Nemzeti Információs Infrastruktúra Fejlesztési Intézet
8. oldal
Home institute
Federation
Trust
• Virtualised AAI services – for smaller institutions • Supporting federated authentication and authorisation • European eduroam/ eduGAIN compatibility • Eduroam ! 20 large universities • HREF – Hungarian Research and Education Federation /eduID ! 13 large universities
Service
TF-MSP meeting – Nov 2010
HPC Nemzeti Információs Infrastruktúra FejlesztésiHBONE+ Intézet
• Supercomputing: ! 3 universities (Debrecen, Szeged,Pécs) + NIIFI center ! NUMA and cluster systems ! Dedicated network capacity between the centers ! min. 3 x 8-16 Tflops + NIIFI (2 TFlops) ! National research and academic usage ! Software stack: " "
LRMS, HPC libraries programming environments, compilers, debuggers, profilers
! National + European integration (EGEE, KnowARC, DEISA, PRACE)
9. oldal
• Storage: ! 2 further universities ! Dunaújváros, Sopron
! national storage grid ! initially min. 0.5 PByte capacity
TF-MSP meeting – Nov 2010
HBONE+ Nemzeti Információs Infrastruktúra Fejlesztési Intézet HPC/2
• HPC environment under preparation ! Debrecen, Szeged, Pécs
• Supercomputers ! Contracted
• Storage ! Flexible Ethernet based solution – Fujitsu Ethernus ! 500 TByte cloud storage ready to be used
• Services ! ! ! !
Cloud = distributed resource mgmt + virtualisation Provide cloud computing services to universities Strorage grid/cloud services for off-site backup Web portal services to access (HPC/storage) grid services
10. oldal
TF-MSP meeting – Nov 2010
HBONE+ collaboration Nemzeti Információs Infrastruktúra Fejlesztési Intézet
• Videoconferencing ! 30+2 fullHD VC room systems – installed at the universities ! Centrally manageable SIP/ H.323, fullHD MCU ! Desktop videoconferencing system Integrated with the existing videoconferencing system of NIIF/Hungarnet
11. oldal
• VOIP ! Upgrading the existing Voice gateways ! Supporting deployment of IP PBX systems
TF-MSP meeting – Nov 2010
HBONE+ collaboration Nemzeti Információs Infrastruktúra Fejlesztési Intézet
• HD Videoconferencing ! 30 x Polycom HDX 8000 + Polycom RMX 4000 MCU + management ! Installed and ready to be used
• Desktop videoconferencing systems ! Vidyo Router/Gateway/Portal ! Installed (testing in progress)
• VoIP • Upgrading the existing Voice gateways ! 35 x Cisco 2811 Voice bundle replacing old Cisco 5350s
12. oldal
TF-MSP meeting – Nov 2010
Past experience of DF rental attempts Nemzeti Információs Infrastruktúra Fejlesztési Intézet • 1997-2000 ! DF offers – price below STM-1 rentals for 5 years ! NIIF/Hungarnet was not ready for using DF
• 2001-2003 ! DF offers only in and around Budapest – we started to use them
• 2004-2005 ! We asked explicitly DF/Lit Fibre/STM-16/10GE – DF about 2x price of 10GE
• 2008-2009 ! After informal discussions with the Telcos we expected 80-90% coverage of Hungary with similar price to previous tender ! Tender result – with 1.5 years provisioning time " " " "
13. oldal
DF price about 10x of single 10GE – Telcos realised: no more fibres No competition – just 3 country-wide providers (1-2 offers per regions) No offer for 10-15 Year IRU, only 5 years rental Failure
TF-MSP meeting – Nov 2010
Current experience with DF Nemzeti Információs Infrastruktúra Fejlesztési Intézet • Re-negotiation with all Telcos ! Lack of fiber – only 3 country-wide providers Incumbent – DF available ~ 10x10G price " Alternative – inefficient usage of fibres, extensive traffic engineering needed " Electricity company – limited capacity in OPGW, far from cities "
! Expensive to lease dark fibre ! You don’t need all capacity which become available ! Sharing/cooperation
• Proposal - Hungarian Electricity Company ! Shared usage of fibre - share the DWDM resources on lambda basis ! NIIF/Hungarnet buy and operate the DWDM system ! HEC uses the alien wavelengths ! HEC provides equipment housing 14. oldal
TF-MSP meeting – Nov 2010
TechnicalNemzeti details of proposal Információs Infrastruktúra Fejlesztési Intézet • Framework contract (8 years) with IRU ! 90% coverage of Hungary ~ 3000 km fibre ! Shared usage in C-Band - at least 40" on fibre-pairs ! Lambdas are engineered to support 40G, maybe 100G also ! Housing locations in every ~80-100 km ! Two partners shared view to the entire network - shared mgmt system ! Two mgmt domains to maintain own lambdas
15.
TF-MSP meeting – Nov 2010
HBONE+ Nemzeti network coverage Információs Infrastruktúra Fejlesztési Intézet
TF-MSP meeting – Nov 2010
16
HBONE+Nemzeti network coverage /2 Fejlesztési Intézet Információs Infrastruktúra • Cable types – backbone is OPGW ! ITU-T G.652B / G.652D ! Coverage: 79 PoPs, ~3200 Km
• Challenges ! Redundant fibre path between the core PoPs – L1 and L3 point of view ! Separate tenders for local-loop DFs – done – on time delivery? ! Housing requirements before finishing the DWDM equipment tender ! PMD on OPGW
17.
TF-MSP meeting – Nov 2010
Tender results Nemzeti Információs Infrastruktúra Fejlesztési Intézet • Process: competitive negotiation (together with L3 equipments) 2010 February-August – 10 equipment vendors • DWDM Equipment - Alcatel-Lucent PSS-1830 ! 80 channel system with 40 channel licensed ! Engineered for 40G/100G capability, Only EDFA amplifiers, distance up to 1000 km ! Mostly 10GE lambdas, some 40G lambda used in the system with muxponders ! WSS ROADMs + terminal multiplexers + Colorless/Tunable Transponders ! No optical restoration – but free channel capacity to reroute " ! Device managed by NIIF/Hungarnet with maintenance contract for long period
• IP/MPLS Equipment – Cisco ASR9000 series routers ! ! ! ! !
MEF Carrier Ethernet/MPLS SP Platform 92 (184) Gbps slot capacity Cisco IOS-XR Modular OS Green design Device managed by NIIF/Hungarnet with maintenance contract for long period
18.
TF-MSP meeting – Nov 2010
Hybrid Network Services - development Nemzeti Információs Infrastruktúra Fejlesztési Intézet • Lightpath Service ! Dedicated Network capacity for projects "
already 3 demands
! Point-to-point circuits – "oD
• L2 VPN, managed Ethernet - Finegrained capacity provisioning – with routers • Traditional IP: IPv4/6, unicast/ multicast, L3 VPN, with QoS and SLA 19.
TF-MSP meeting – Nov 2010
Conclusions and remarks/lessons Nemzeti Információs Infrastruktúra Fejlesztési Intézet • Todo ! Deploy the DWDM and IP network ! Develop lightpath/alien wavelength/more finer granular bandwidth service ! Overcome limitations of DWDM management systems " " "
" "
Two operating entity systems Operational models for dynamic wavelength handling Test and research activity on the DWDM platform could effect other working wavelength and services? – procedures? Common documentation? Vendor communication?
! Cross Border Fiber extension? – next to AMRES
• Remarks/lessons ! ! ! ! !
20.
No unique way to acquire DF Dealing with fiber providers can be challenging Try to find local providers to get competitive prices Development fund might be available for CAPEX KISS
TF-MSP meeting – Nov 2010
Questions?
Mohácsi János
[email protected] [email protected]
