{"id":6295,"date":"2017-06-27T02:47:12","date_gmt":"2017-06-27T02:47:12","guid":{"rendered":"https:\/\/nusit.nus.edu.sg\/technus\/hpc-technus\/efficient-processing-of-large-next-generation-sequencing-datasets-copy\/"},"modified":"2019-09-24T04:18:14","modified_gmt":"2019-09-24T04:18:14","slug":"ai-hpc-resources","status":"publish","type":"post","link":"https:\/\/nusit.nus.edu.sg\/services\/hpc-newsletter\/ai-hpc-resources\/","title":{"rendered":"\u00bb AI-HPC Resources"},"content":{"rendered":"<section class=\"wpb-content-wrapper\"><p>[vc_row css=”.vc_custom_1568103671773{padding-top: 0px !important;padding-bottom: 0px !important;}” el_class=”hpc-microsite-technus”][vc_column][vc_row_inner][vc_column_inner]<div class=\"section-title-wrapper ip-section-title shortcode-rand-1 pixzlo-inline-css\" data-css=\"".shortcode-rand-1 .background-title { font-family:Abril Fatface;font-weight:400;font-style:normal }.shortcode-rand-1 .section-title { text-transform: none; }"\"><div class=\"title-wrap\"><h2 class=\"section-title\">AI-HPC RESOURCES<\/h2><\/div><!-- .title-wrap --><div class=\"section-description\"><span class=\"authordate\">By Tan Chee Chiang, NUS Informatics Technology on 27 Jun, 2017<\/span><\/div><!-- .section-description --><div class=\"button-section\"><\/div><!-- .button-section --><\/div><!-- .section-title-wrapper -->[vc_column_text]With the recent announcement of AI.SG national initiative, we will explore the synergy between AI and HPC, and how HPC technologies and resources can be tapped to support related research and application.[\/vc_column_text]<div class=\"section-title-wrapper ip-section-title-h5 shortcode-rand-2 pixzlo-inline-css\" data-css=\"".shortcode-rand-2 .background-title { font-family:Abril Fatface;font-weight:400;font-style:normal }.shortcode-rand-2 .section-title { text-transform: none; }"\"><div class=\"title-wrap\"><h5 class=\"section-title\">AI, Machine\/Deep Learning, Big Data and HPC<\/h5><\/div><!-- .title-wrap --><div class=\"section-description\"><\/div><!-- .section-description --><div class=\"button-section\"><\/div><!-- .button-section --><\/div><!-- .section-title-wrapper -->[vc_column_text]AI refers to technology that could mimic the intelligence of humans. Machine Learning is an AI program that can learn by itself, similar to what humans can do. Deep Learning is a form of Machine Learning that accelerates solution for certain type of problems, specifically those related to computer vision and natural language processing.[\/vc_column_text][vc_column_text]Over the past years, we had been discussing about the emergence of Big Data related research and the use of Hadoop and HPC resources for large-scale data analytics. It is clear that the parallel computing power of HPC systems is needed to enable such large-scale computation. Moving forward, the recent rise of Machine Learning and Deep Learning in AI development apparently has something to do with Big Data and HPC. According to some experts, the increase in the volume of data collected in the Big Data era and the advancement of parallel computing power in HPC (such as the use of parallel computing capability in GPU and Xeon Phi) has helped to fuel the AI development. The availability of a large amount of data facilitates the training process in Machine\/Deep Learning. The powerful HPC system enables the compute intensive Machine\/Deep Learning to be completed within a reasonable timeframe.[\/vc_column_text][vc_column_text]With this relationship, it is no surprise to see Big Data and Machine\/Deep Learning applications co-existing in the HPC environment. While GPU and Xeon Phi HPC systems are being used for traditional compute-intensive HPC applications (molecular dynamics, financial analysis, image processing etc.), Machine\/Deep Learning and data analytics, the Hadoop systems running on HPC cluster are being used for Big Data Analytics and for some Machine Learning applications.[\/vc_column_text]<div class=\"section-title-wrapper ip-section-title-h5 shortcode-rand-3 pixzlo-inline-css\" data-css=\"".shortcode-rand-3 .background-title { font-family:Abril Fatface;font-weight:400;font-style:normal }.shortcode-rand-3 .section-title { text-transform: none; }"\"><div class=\"title-wrap\"><h5 class=\"section-title\">AI Resources and Services<\/h5><\/div><!-- .title-wrap --><div class=\"section-description\"><\/div><!-- .section-description --><div class=\"button-section\"><\/div><!-- .button-section --><\/div><!-- .section-title-wrapper -->[vc_column_text]At NUS IT, we have been working with our partners (e.g. National Supercomputing Centre, NSCC) and developing resources to support data intensive applications over the past years. It turns out that some of these resources can also be extended to support AI research.<\/p>\n<ol>\n<li>Two commonly used programming languages in HPC systems for Bioinformatics research, Java and Python, can now be used to enable Machine\/Deep Learning applications. More details of our central HPC resources and services can be found at our\u00a0<a href=\"https:\/\/nusit.nus.edu.sg\/services\/hpc\/getting-started\/introductory-guide-for-new-hpc-users\/\" target=\"_blank\" rel=\"noopener noreferrer\">website<\/a>.<\/li>\n<li>The Hadoop data repository and analytics system developed by NUS IT will be available for use in July. The system will support Machine Learning through the Sparks libraries. Machine Learning related programming languages such as Java, Python and Scala will be supported. Check out the introductory\u00a0<a href=\"https:\/\/nusit.nus.edu.sg\/technus\/hpc\/new-hadoop-system-available-big-data-management-analytics\/\">article<\/a>\u00a0from my colleague for more details.<\/li>\n<li>We will be tapping on the Cloud to complement our HPC resources. We are currently working on making some of the AWS Cloud resources available to our users. One of our plans is to enable TensorFlow (software library for Machine Learning) support using GPU in the Cloud. Register as a HPC user\u00a0<a href=\"https:\/\/nusit.nus.edu.sg\/services\/hpc\/getting-started\/registration-guide\/\" target=\"_blank\" rel=\"noopener noreferrer\">here<\/a>\u00a0to receive future updates on this.<\/li>\n<li>NSCC provides a 128-node GPU cluster to support HPC applications including Machine Learning. The resources are open for use by NUS researchers. You may register to use NSCC resources as an NUS user\u00a0<a href=\"https:\/\/help.nscc.sg\/\" target=\"_blank\" rel=\"noopener noreferrer\">here<\/a>.<\/li>\n<\/ol>\n<p>[\/vc_column_text][\/vc_column_inner][\/vc_row_inner][\/vc_column][\/vc_row]<\/p>\n<\/section>","protected":false},"excerpt":{"rendered":"<p>By Tan Chee Chiang, NUS Informatics Technology on 27 Jun, 2017<br \/>\nWith the recent announcement of AI.SG national initiative, we will explore the synergy between AI and HPC, and how HPC technologies …<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_oasis_is_in_workflow":0,"_oasis_original":0,"footnotes":""},"categories":[69,119],"tags":[],"class_list":["post-6295","post","type-post","status-publish","format-standard","hentry","category-hpc-newsletter","category-hpc-technical-updates"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v23.2 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>\u00bb AI-HPC Resources - NUS Information Technology | NUS IT Services, Solutions & Governance<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/nusit.nus.edu.sg\/services\/hpc-newsletter\/ai-hpc-resources\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"\u00bb AI-HPC Resources - NUS Information Technology | NUS IT Services, Solutions & Governance\" \/>\n<meta property=\"og:description\" content=\"By Tan Chee Chiang, NUS Informatics Technology on 27 Jun, 2017 With the recent announcement of AI.SG national initiative, we will explore the synergy between AI and HPC, and how HPC technologies ...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/nusit.nus.edu.sg\/services\/hpc-newsletter\/ai-hpc-resources\/\" \/>\n<meta property=\"og:site_name\" content=\"NUS Information Technology | NUS IT Services, Solutions & Governance\" \/>\n<meta property=\"article:published_time\" content=\"2017-06-27T02:47:12+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2019-09-24T04:18:14+00:00\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/nusit.nus.edu.sg\/services\/hpc-newsletter\/ai-hpc-resources\/\",\"url\":\"https:\/\/nusit.nus.edu.sg\/services\/hpc-newsletter\/ai-hpc-resources\/\",\"name\":\"\u00bb AI-HPC Resources - NUS Information Technology | NUS IT Services, Solutions & Governance\",\"isPartOf\":{\"@id\":\"https:\/\/nusit.nus.edu.sg\/#website\"},\"datePublished\":\"2017-06-27T02:47:12+00:00\",\"dateModified\":\"2019-09-24T04:18:14+00:00\",\"author\":{\"@id\":\"https:\/\/nusit.nus.edu.sg\/#\/schema\/person\/1d48503b1ae5833c749ed5cfc87fda28\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/nusit.nus.edu.sg\/services\/hpc-newsletter\/ai-hpc-resources\/\"]}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/nusit.nus.edu.sg\/#website\",\"url\":\"https:\/\/nusit.nus.edu.sg\/\",\"name\":\"NUS Information Technology | NUS IT Services, Solutions & Governance\",\"description\":\"Borderless University, powered by Infinite Technology\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/nusit.nus.edu.sg\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/nusit.nus.edu.sg\/#\/schema\/person\/1d48503b1ae5833c749ed5cfc87fda28\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/nusit.nus.edu.sg\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/955212ca4884ab2a06f3f581f8e497c5?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/955212ca4884ab2a06f3f581f8e497c5?s=96&d=mm&r=g\",\"caption\":\"admin\"},\"url\":\"https:\/\/nusit.nus.edu.sg\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"\u00bb AI-HPC Resources - NUS Information Technology | NUS IT Services, Solutions & Governance","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/nusit.nus.edu.sg\/services\/hpc-newsletter\/ai-hpc-resources\/","og_locale":"en_US","og_type":"article","og_title":"\u00bb AI-HPC Resources - NUS Information Technology | NUS IT Services, Solutions & Governance","og_description":"By Tan Chee Chiang, NUS Informatics Technology on 27 Jun, 2017 With the recent announcement of AI.SG national initiative, we will explore the synergy between AI and HPC, and how HPC technologies ...","og_url":"https:\/\/nusit.nus.edu.sg\/services\/hpc-newsletter\/ai-hpc-resources\/","og_site_name":"NUS Information Technology | NUS IT Services, Solutions & Governance","article_published_time":"2017-06-27T02:47:12+00:00","article_modified_time":"2019-09-24T04:18:14+00:00","author":"admin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/nusit.nus.edu.sg\/services\/hpc-newsletter\/ai-hpc-resources\/","url":"https:\/\/nusit.nus.edu.sg\/services\/hpc-newsletter\/ai-hpc-resources\/","name":"\u00bb AI-HPC Resources - NUS Information Technology | NUS IT Services, Solutions & Governance","isPartOf":{"@id":"https:\/\/nusit.nus.edu.sg\/#website"},"datePublished":"2017-06-27T02:47:12+00:00","dateModified":"2019-09-24T04:18:14+00:00","author":{"@id":"https:\/\/nusit.nus.edu.sg\/#\/schema\/person\/1d48503b1ae5833c749ed5cfc87fda28"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/nusit.nus.edu.sg\/services\/hpc-newsletter\/ai-hpc-resources\/"]}]},{"@type":"WebSite","@id":"https:\/\/nusit.nus.edu.sg\/#website","url":"https:\/\/nusit.nus.edu.sg\/","name":"NUS Information Technology | NUS IT Services, Solutions & Governance","description":"Borderless University, powered by Infinite Technology","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/nusit.nus.edu.sg\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/nusit.nus.edu.sg\/#\/schema\/person\/1d48503b1ae5833c749ed5cfc87fda28","name":"admin","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/nusit.nus.edu.sg\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/955212ca4884ab2a06f3f581f8e497c5?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/955212ca4884ab2a06f3f581f8e497c5?s=96&d=mm&r=g","caption":"admin"},"url":"https:\/\/nusit.nus.edu.sg\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/nusit.nus.edu.sg\/wp-json\/wp\/v2\/posts\/6295"}],"collection":[{"href":"https:\/\/nusit.nus.edu.sg\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/nusit.nus.edu.sg\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/nusit.nus.edu.sg\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/nusit.nus.edu.sg\/wp-json\/wp\/v2\/comments?post=6295"}],"version-history":[{"count":0,"href":"https:\/\/nusit.nus.edu.sg\/wp-json\/wp\/v2\/posts\/6295\/revisions"}],"wp:attachment":[{"href":"https:\/\/nusit.nus.edu.sg\/wp-json\/wp\/v2\/media?parent=6295"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/nusit.nus.edu.sg\/wp-json\/wp\/v2\/categories?post=6295"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/nusit.nus.edu.sg\/wp-json\/wp\/v2\/tags?post=6295"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}