{"id":10492,"date":"2020-01-20T15:37:34","date_gmt":"2020-01-20T07:37:34","guid":{"rendered":"https:\/\/nusit.nus.edu.sg\/technus\/projecting-2020-hpc-trends-copy\/"},"modified":"2020-01-23T15:20:24","modified_gmt":"2020-01-23T07:20:24","slug":"projecting-2020-hpc-trends","status":"publish","type":"post","link":"https:\/\/nusit.nus.edu.sg\/technus\/projecting-2020-hpc-trends\/","title":{"rendered":"\u00bb Projecting 2020 HPC Trends"},"content":{"rendered":"\n<div class=\"wp-block-group\"><div class=\"wp-block-group__inner-container is-layout-flow wp-block-group-is-layout-flow\">\n<h4><strong>Projecting 2020 HPC Trends<\/strong><\/h4>\n<p><em>by Tan Chee Chiang, Research Computing, NUS Information Technology.<\/em><\/p><br>\n<p>Based on current market trends and technology roadmaps from market leaders, we can expect greater convergence of HPC and AI technologies, more processor (CPU) and accelerator options, further adoption of HPC Cloud and higher demand for storage capacity in 2020.<\/p>\n<p><img fetchpriority=\"high\" decoding=\"async\" class=\"aligncenter size-full wp-image-10092\" src=\"https:\/\/nusit.nus.edu.sg\/wp-content\/uploads\/2020\/01\/projecting-2020-hpc-trends-picture1.png\" alt=\"\" width=\"824\" height=\"347\" srcset=\"https:\/\/nusit.nus.edu.sg\/wp-content\/uploads\/2020\/01\/projecting-2020-hpc-trends-picture1.png 824w, https:\/\/nusit.nus.edu.sg\/wp-content\/uploads\/2020\/01\/projecting-2020-hpc-trends-picture1-768x323.png 768w\" sizes=\"(max-width: 824px) 100vw, 824px\" \/><\/p>\n<h5><strong><em>HPC and AI Convergence<\/em><\/strong><\/h5>\n<p>At the latest round of SC2019 (Supercomputing) Conference at Denver Colorado in November 2019, about 15% of panel sessions, 21% of presented papers and 42% of invited talks were focusing on AI, Machine Learning or Data Analytics topics. The statistics suggested a high degree of common technological interests among the HPC and AI practitioners.<\/p>\n<p><img decoding=\"async\" class=\"aligncenter size-full wp-image-10093\" src=\"https:\/\/nusit.nus.edu.sg\/wp-content\/uploads\/2020\/01\/projecting-2020-hpc-trends-picture2.png\" alt=\"\" width=\"637\" height=\"366\"><\/p>\n<p>This is good news to HPC resource and service providers like us at NUS IT where we have to transform our capability and expertise to cater for new AI requirements. As the existing HPC centric capability has to be extended to support AI applications, having more common technologies (hardware or software) that can be used to accelerate both HPC and AI applications will definitely shorten the transformation process. Let\u2019s look at some of the developments that are benefiting both the HPC and AI community.<\/p>\n<h5><strong><em>More CPU\/GPU\/Accelerators options<\/em><\/strong><\/h5>\n<p>We can expect new generation of CPU with more cores (from Intel, AMD and IBM) and greater energy efficiency (from ARM) to be delivered to the market as part of HPC-AI solution in the coming year.<\/p>\n<p>For HPC-AI accelerator such as GPU, we will have new options from AMD and Intel besides those from Nvidia.<\/p>\n<p>We are also looking forward to the launch of a new chip, the Intelligence Processing Unit (IPU) from Graphcore, which claims to offer 100-fold better AI\/Machine Learning performance than GPU or other accelerators. The new chip is expected to be introduced early this year at Azure Cloud.<\/p>\n<p>With more options and hence greater competition among suppliers, one obvious benefit to users is the lower cost. However, such new options also introduce new challenges, particularly in software compatibility or the lack of it. It took many years for GPU providers to develop and port enough software to make the accelerator popular among HPC community. As Industry 4.0 revolution is driving the technology development at a breakneck speed now, any new HPC-AI technology will have to gain adoption quickly to be successful. Some of such efforts shared at SC2019 include oneAPI (software tools that allow codes to be written once and run on different processing resources) from Intel, ROCm (an open-source HPC platform for GPU computing) from AMD and Tensorflow support from Graphcore. We will have to wait and see how these new technologies will impact the HPC-AI market.<\/p>\n<h5><strong><em>More Focus on Data Storage and Preparation<\/em><\/strong><\/h5>\n<p>With rapid expansion of HPC-AI application, greater data storage demand in the coming year is a given. At NUS IT, we provide variety of storage solutions to cater for the various storage demands. We provide high-speed SSD storage to accelerate ML\/DL on GPU system, Hadoop based Data Repository and Analytics System (DRAS) to support Big Data analytics and Utility Storage Service for data storage.<\/p>\n<p>The other aspect of HPC-AI development that will gain more attention will be the time-consuming data preparation effort. For a typical Machine Learning\/Deep Learning (ML\/DL) project, data preparation effort such as data collection, exploring, cleaning and transformation can consume up to 80% of the total project time. Therefore, it makes sense to invest more effort in automating this process.<\/p>\n<p><img decoding=\"async\" class=\"aligncenter size-full wp-image-10094\" src=\"https:\/\/nusit.nus.edu.sg\/wp-content\/uploads\/2020\/01\/projecting-2020-hpc-trends-picture3.png\" alt=\"\" width=\"974\" height=\"268\" srcset=\"https:\/\/nusit.nus.edu.sg\/wp-content\/uploads\/2020\/01\/projecting-2020-hpc-trends-picture3.png 974w, https:\/\/nusit.nus.edu.sg\/wp-content\/uploads\/2020\/01\/projecting-2020-hpc-trends-picture3-768x211.png 768w\" sizes=\"(max-width: 974px) 100vw, 974px\" \/><\/p>\n<p>The Data Engineering team at NUS IT was set up as part of the HPC support team more than a year ago. The team provides technical support\/consultation in both data preparation and Big Data\/ML\/DL implementation. The team also conduct regular R\/Python\/ML\/DL trainings. NUS staff and students can register as a HPC user at <a href=\"https:\/\/nusit.nus.edu.sg\/services\/hpc\/getting-started\/register-for-hpc\/\">our HPC Website<\/a> to receive the training notifications.<\/p>\n<h5><strong><em>HPC-Cloud Adoption<\/em><\/strong><\/h5>\n<p>2019 had been identified by market analysts as a tipping point year where they have observed a significant jump in HPC Cloud adoption. Even with that increase in adoption, the HPC workloads migrated to the Cloud remains at a low percentage level of around 20%. The potential showstoppers are data transfer performance and cost.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-10095\" src=\"https:\/\/nusit.nus.edu.sg\/wp-content\/uploads\/2020\/01\/projecting-2020-hpc-trends-picture4.png\" alt=\"\" width=\"802\" height=\"287\" srcset=\"https:\/\/nusit.nus.edu.sg\/wp-content\/uploads\/2020\/01\/projecting-2020-hpc-trends-picture4.png 802w, https:\/\/nusit.nus.edu.sg\/wp-content\/uploads\/2020\/01\/projecting-2020-hpc-trends-picture4-768x275.png 768w\" sizes=\"(max-width: 802px) 100vw, 802px\" \/><\/p>\n<p>At NUS IT, we are migrating the less data-intensive CPU workloads to the Cloud. We plan to tap into the Cloud scalability and agility features to cut user job queuing time to the minimum. For the data-intensive GPU workload, we will continue to support it in-house until a cost-effective Cloud solution is available.<\/p>\n<h5><strong><em>Container for HPC?<\/em><\/strong><\/h5>\n<p>The adoption of container technologies is expected to expand along with the increase in ML\/DL workloads. Can container technology be a catalyst to drive the convergence of HPC and AI further? What benefit will it bring if both HPC and AI workloads can be containerised? Will it help in our Cloud migration? My colleague at NUS IT will be pondering over these questions in the coming months.<\/p>\n<p>For any HPC-AI consultation and support, please contact us using the nTouch (<a href=\"https:\/\/ntouch.nus.edu.sg\/install\/\">https:\/\/ntouch.nus.edu.sg\/install\/<\/a>) service portal.<\/p>\n<\/div><\/div>\n","protected":false},"excerpt":{"rendered":"<p>By Tan Chee Chiang, Research Computing, NUS Information Technology, on 20 January 2020<\/p>\n<p>Based on current market trends and technology roadmaps from market leaders, we can expect greater convergence of HPC and AI technologies, more processor (CPU) and accelerator options, further adoption of HPC Cloud and higher demand for storage capacity in 2020.<\/p>\n","protected":false},"author":96,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_oasis_is_in_workflow":0,"_oasis_original":0,"footnotes":""},"categories":[69,119,68],"tags":[146,145],"class_list":["post-10492","post","type-post","status-publish","format-standard","hentry","category-hpc-newsletter","category-hpc-technical-updates","category-technus","tag-2020-01","tag-hpc_at_nus_newsletter"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v23.2 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>\u00bb Projecting 2020 HPC Trends - NUS Information Technology | NUS IT Services, Solutions & Governance<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/nusit.nus.edu.sg\/technus\/projecting-2020-hpc-trends\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"\u00bb Projecting 2020 HPC Trends - NUS Information Technology | NUS IT Services, Solutions & Governance\" \/>\n<meta property=\"og:description\" content=\"By Tan Chee Chiang, Research Computing, NUS Information Technology, on 20 January 2020 Based on current market trends and technology roadmaps from market leaders, we can expect greater convergence of HPC and AI technologies, more processor (CPU) and accelerator options, further adoption of HPC Cloud and higher demand for storage capacity in 2020.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/nusit.nus.edu.sg\/technus\/projecting-2020-hpc-trends\/\" \/>\n<meta property=\"og:site_name\" content=\"NUS Information Technology | NUS IT Services, Solutions & Governance\" \/>\n<meta property=\"article:published_time\" content=\"2020-01-20T07:37:34+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-01-23T07:20:24+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/nusit.nus.edu.sg\/wp-content\/uploads\/2020\/01\/projecting-2020-hpc-trends-picture1.png\" \/>\n<meta name=\"author\" content=\"Yeo Eng Hee\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Yeo Eng Hee\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/nusit.nus.edu.sg\/technus\/projecting-2020-hpc-trends\/\",\"url\":\"https:\/\/nusit.nus.edu.sg\/technus\/projecting-2020-hpc-trends\/\",\"name\":\"\u00bb Projecting 2020 HPC Trends - NUS Information Technology | NUS IT Services, Solutions & Governance\",\"isPartOf\":{\"@id\":\"https:\/\/nusit.nus.edu.sg\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/nusit.nus.edu.sg\/technus\/projecting-2020-hpc-trends\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/nusit.nus.edu.sg\/technus\/projecting-2020-hpc-trends\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/nusit.nus.edu.sg\/wp-content\/uploads\/2020\/01\/projecting-2020-hpc-trends-picture1.png\",\"datePublished\":\"2020-01-20T07:37:34+00:00\",\"dateModified\":\"2020-01-23T07:20:24+00:00\",\"author\":{\"@id\":\"https:\/\/nusit.nus.edu.sg\/#\/schema\/person\/80aa44951a0064079b1331819d1dde1c\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/nusit.nus.edu.sg\/technus\/projecting-2020-hpc-trends\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/nusit.nus.edu.sg\/technus\/projecting-2020-hpc-trends\/#primaryimage\",\"url\":\"https:\/\/nusit.nus.edu.sg\/wp-content\/uploads\/2020\/01\/projecting-2020-hpc-trends-picture1.png\",\"contentUrl\":\"https:\/\/nusit.nus.edu.sg\/wp-content\/uploads\/2020\/01\/projecting-2020-hpc-trends-picture1.png\",\"width\":824,\"height\":347},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/nusit.nus.edu.sg\/#website\",\"url\":\"https:\/\/nusit.nus.edu.sg\/\",\"name\":\"NUS Information Technology | NUS IT Services, Solutions & Governance\",\"description\":\"Borderless University, powered by Infinite Technology\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/nusit.nus.edu.sg\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/nusit.nus.edu.sg\/#\/schema\/person\/80aa44951a0064079b1331819d1dde1c\",\"name\":\"Yeo Eng Hee\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/nusit.nus.edu.sg\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/058ba350a3203dbe3957aa683b473d03?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/058ba350a3203dbe3957aa683b473d03?s=96&d=mm&r=g\",\"caption\":\"Yeo Eng Hee\"},\"url\":\"https:\/\/nusit.nus.edu.sg\/author\/cceyeoeh\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"\u00bb Projecting 2020 HPC Trends - NUS Information Technology | NUS IT Services, Solutions & Governance","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/nusit.nus.edu.sg\/technus\/projecting-2020-hpc-trends\/","og_locale":"en_US","og_type":"article","og_title":"\u00bb Projecting 2020 HPC Trends - NUS Information Technology | NUS IT Services, Solutions & Governance","og_description":"By Tan Chee Chiang, Research Computing, NUS Information Technology, on 20 January 2020 Based on current market trends and technology roadmaps from market leaders, we can expect greater convergence of HPC and AI technologies, more processor (CPU) and accelerator options, further adoption of HPC Cloud and higher demand for storage capacity in 2020.","og_url":"https:\/\/nusit.nus.edu.sg\/technus\/projecting-2020-hpc-trends\/","og_site_name":"NUS Information Technology | NUS IT Services, Solutions & Governance","article_published_time":"2020-01-20T07:37:34+00:00","article_modified_time":"2020-01-23T07:20:24+00:00","og_image":[{"url":"https:\/\/nusit.nus.edu.sg\/wp-content\/uploads\/2020\/01\/projecting-2020-hpc-trends-picture1.png"}],"author":"Yeo Eng Hee","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Yeo Eng Hee","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/nusit.nus.edu.sg\/technus\/projecting-2020-hpc-trends\/","url":"https:\/\/nusit.nus.edu.sg\/technus\/projecting-2020-hpc-trends\/","name":"\u00bb Projecting 2020 HPC Trends - NUS Information Technology | NUS IT Services, Solutions & Governance","isPartOf":{"@id":"https:\/\/nusit.nus.edu.sg\/#website"},"primaryImageOfPage":{"@id":"https:\/\/nusit.nus.edu.sg\/technus\/projecting-2020-hpc-trends\/#primaryimage"},"image":{"@id":"https:\/\/nusit.nus.edu.sg\/technus\/projecting-2020-hpc-trends\/#primaryimage"},"thumbnailUrl":"https:\/\/nusit.nus.edu.sg\/wp-content\/uploads\/2020\/01\/projecting-2020-hpc-trends-picture1.png","datePublished":"2020-01-20T07:37:34+00:00","dateModified":"2020-01-23T07:20:24+00:00","author":{"@id":"https:\/\/nusit.nus.edu.sg\/#\/schema\/person\/80aa44951a0064079b1331819d1dde1c"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/nusit.nus.edu.sg\/technus\/projecting-2020-hpc-trends\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/nusit.nus.edu.sg\/technus\/projecting-2020-hpc-trends\/#primaryimage","url":"https:\/\/nusit.nus.edu.sg\/wp-content\/uploads\/2020\/01\/projecting-2020-hpc-trends-picture1.png","contentUrl":"https:\/\/nusit.nus.edu.sg\/wp-content\/uploads\/2020\/01\/projecting-2020-hpc-trends-picture1.png","width":824,"height":347},{"@type":"WebSite","@id":"https:\/\/nusit.nus.edu.sg\/#website","url":"https:\/\/nusit.nus.edu.sg\/","name":"NUS Information Technology | NUS IT Services, Solutions & Governance","description":"Borderless University, powered by Infinite Technology","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/nusit.nus.edu.sg\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/nusit.nus.edu.sg\/#\/schema\/person\/80aa44951a0064079b1331819d1dde1c","name":"Yeo Eng Hee","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/nusit.nus.edu.sg\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/058ba350a3203dbe3957aa683b473d03?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/058ba350a3203dbe3957aa683b473d03?s=96&d=mm&r=g","caption":"Yeo Eng Hee"},"url":"https:\/\/nusit.nus.edu.sg\/author\/cceyeoeh\/"}]}},"_links":{"self":[{"href":"https:\/\/nusit.nus.edu.sg\/wp-json\/wp\/v2\/posts\/10492"}],"collection":[{"href":"https:\/\/nusit.nus.edu.sg\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/nusit.nus.edu.sg\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/nusit.nus.edu.sg\/wp-json\/wp\/v2\/users\/96"}],"replies":[{"embeddable":true,"href":"https:\/\/nusit.nus.edu.sg\/wp-json\/wp\/v2\/comments?post=10492"}],"version-history":[{"count":0,"href":"https:\/\/nusit.nus.edu.sg\/wp-json\/wp\/v2\/posts\/10492\/revisions"}],"wp:attachment":[{"href":"https:\/\/nusit.nus.edu.sg\/wp-json\/wp\/v2\/media?parent=10492"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/nusit.nus.edu.sg\/wp-json\/wp\/v2\/categories?post=10492"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/nusit.nus.edu.sg\/wp-json\/wp\/v2\/tags?post=10492"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}