{"id":31072,"date":"2024-10-25T12:55:03","date_gmt":"2024-10-25T19:55:03","guid":{"rendered":"https:\/\/www.pugetsystems.com\/?post_type=hpc_post&#038;p=31072"},"modified":"2024-11-04T09:13:19","modified_gmt":"2024-11-04T17:13:19","slug":"whats-the-deal-with-npus","status":"publish","type":"hpc_post","link":"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/","title":{"rendered":"What&#8217;s the deal with NPUs?"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_80 counter-hierarchy ez-toc-counter ez-toc-transparent ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<span class=\"ez-toc-title-toggle\"><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/#Introduction\" >Introduction<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/#NPUs_the_hot_%E2%80%9Cnew%E2%80%9D_thing\" >NPUs, the hot &#8220;new&#8221; thing?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/#Microsoft_to_the_rescue\" >Microsoft to the rescue?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/#Why_not_include_NPUs_in_desktop_systems\" >Why not include NPUs in desktop systems?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/#Conclusion\" >Conclusion<\/a><\/li><\/ul><\/nav><\/div>\n\n<h2 class=\"wp-block-heading\" id=\"h-introduction\"><span class=\"ez-toc-section\" id=\"Introduction\"><\/span>Introduction<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>From large organizations utilizing tens of thousands of graphics cards working in tandem to produce new pre-trained models, to hobbyists at home using generative AI with off-the-shelf hardware, the modern graphics card has emerged as the engine powering the surge of AI tools and applications. Although GPUs are well-suited for these tasks for a multitude of reasons, they are not a &#8220;one size fits all&#8221; solution to the exploding variety of workloads built upon neural networks. In particular, due to their energy and cooling requirements, powerful GPUs are not feasible for lower-power devices such as smartphones, tablets, and notebooks. On the other hand, while CPUs are undoubtedly capable of performing the calculations required for machine learning workloads, their performance is typically inadequate for all but the smallest of models.<\/p>\n\n\n\n<p>As a result, a growing demand for specialized hardware to execute these workloads has emerged, leading to the inclusion of AI accelerators into a variety of computing devices. The industry seems to have settled on the term &#8220;Neural Processing Unit&#8221; or &#8220;NPU&#8221; to describe these accelerators. Put simply, NPUs represent dedicated hardware that\u2019s designed to quickly and efficiently perform the kinds of calculations (e.g. the <a href=\"https:\/\/en.wikipedia.org\/wiki\/Multiply%E2%80%93accumulate_operation\">MAC operation<\/a>) at the heart of today&#8217;s AI workloads.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-npus-the-hot-new-thing\"><span class=\"ez-toc-section\" id=\"NPUs_the_hot_%E2%80%9Cnew%E2%80%9D_thing\"><\/span>NPUs, the hot &#8220;new&#8221; thing?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>Despite the recent buzz around NPUs, hardware manufacturers have been integrating these types of accelerators into their products for years. Qualcomm\u2019s \u201cHexagon NPU\u201d was iterated upon and rebranded from their \u201cHexagon DSP\u201d (Digital Signal Processor), the latter being a part of the Snapdragon architecture since it was announced back in 2006. Although most examples of NPUs and similar hardware can be found within the mobile ecosystem, where there is a strong incentive to offload applicable workloads to specialized co-processors to preserve these devices\u2019 limited battery life, there are exceptions. Intel introduced their \u201cGaussian &amp; Neural Accelerator\u201d or \u201cGNA\u201d with the launch of their mobile 10th-generation CPUs, and since 11th-gen, both their mobile and desktop \u201cCore\u201d CPU lines still retain this feature to this day.<\/p>\n\n\n\n<p>Yet for devices that do not rely on a battery, such as a desktop workstation, the incentive to include an NPU is greatly diminished since most of these devices have other hardware (such as GPUs) that can do the job. On top of that, most consumer applications that are candidates for acceleration by an NPU have been developed for mobile devices rather than desktops or laptops. This has led to a \u201cchicken and egg\u201d problem for manufacturers because, without robust software support or potential gains in battery life, there hasn\u2019t been much incentive to devote resources to improving support for AI workloads outside of smartphones and tablets.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-microsoft-to-the-rescue\"><span class=\"ez-toc-section\" id=\"Microsoft_to_the_rescue\"><\/span>Microsoft to the rescue?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>Back in May, Microsoft announced the <a href=\"https:\/\/blogs.microsoft.com\/blog\/2024\/05\/20\/introducing-copilot-pcs\/\">&#8220;CoPilot+ PC&#8221; initiative<\/a> to support the introduction of locally-run AI tools they are currently implementing within Windows. Not to be confused with Microsoft Copilot itself, the cloud-based AI assistant introduced as a replacement for Cortana, \u201cCopilot+ PC\u201d is a new category of PCs defined by Microsoft. The main requirement for a system to qualify as a \u201cCopilot+ PC\u201d is to contain hardware that achieves at least 40 TOPS (Trillion Operations per Second [INT8]). In addition to defining this new category, Microsoft is also introducing several new features to Windows that take advantage of this added compute capability. As a result of these efforts, we are seeing a wave of hardware being released that aims to meet this new 40 TOPS standard.&nbsp;<\/p>\n\n\n\n<p>Regardless of this push from Microsoft, manufacturers still don\u2019t appear to have much appetite to beef up the NPUs for CPUs intended for desktop workstations. For example, although all of Intel\u2019s Lunar Lake (Mobile) processors are advertised as achieving a minimum of 40 TOPS, their upcoming <a href=\"https:\/\/www.pugetsystems.com\/landing\/intel-core-ultra-processors\/\">Arrow Lake (Desktop)<\/a> processors retain the same NPU from the older Meteor Lake line, with a modest 13 TOPS. AMD has released some mobile processors containing NPUs, which are advertised to reach up to 50 TOPS, even going so far as to brand them as \u201cAMD Ryzen AI\u201d processors. However, like Intel, AMD offers only a handful of desktop CPUs featuring NPUs, and they provide a similar level of performance to the Intel desktop offerings with a maximum of 16 TOPS. For now, this means that Intel and AMD don\u2019t appear to be aiming for the \u201cCopilot+ PC\u201d certification with their desktop CPU offerings.<\/p>\n\n\n\n<p>That said, it does appear that software support for NPUs is gaining traction, and we may soon see rapid expansion of NPU support by developers looking to attract &#8220;Co-Pilot PC+&#8221; owners. For example, Blackmagic Design&#8217;s &#8220;Neural Engine&#8221; tools found in DaVinci Resolve 19 now support the NPU in Qualcomm&#8217;s new &#8220;Snapdragon X&#8221; series processors. Adobe is also actively working on <a href=\"https:\/\/helpx.adobe.com\/download-install\/kb\/arm-processors.html\">expanding support for these processors<\/a>, but that work is more for the ARM architecture in general rather than for NPU support specifically.<\/p>\n\n\n\n<div style=\"height:15px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<div class=\"mod-img wp-block-image aligncenter\" data-target=\"single-image-modal-39654\">\n<figure class=\"aligncenter\">\n\t<!-- If image is not empty, print image, else, print from image URL -->\n\t\t\t<img decoding=\"async\" src=\"https:\/\/wp-cdn.pugetsystems.com\/2024\/10\/Intel-Core-Ultra-2.png\" alt=\"Chart showing all SKUs of Intel Core Ultra 200S Series desktop CPUs feature 13 TOPS NPUs\" ><\/img>\n\t\t<\/figure>\n<\/div>\n\n<!-- Displays caption if entered -->\n\n<!-- Displays modal upon click of an image -->\n<script type=\"text\/javascript\">\n\t\/\/Using unique random generated id\n\tjQuery(document).ready(function(){\n\t\tjQuery('[data-target=\"single-image-modal-39654\"]').click(function(){\n            jQuery('#single-image-modal-39654Modal').modal('show');\n\t\t\t});\n        });\n<\/script>\n\n<div class=\"modal fade popup-image\" id=\"single-image-modal-39654Modal\" tabindex=\"-1\" role=\"dialog\"> \n\t<div class=\"modal-dialog modal-xl\" role=\"document\">\n\t\t<div class=\"modal-content\">\n\t\t\t<div class=\"modal-header\">\n\t\t\t\t<h5 class=\"modal-title\">Image<\/h5>\n\t\t\t\t<button type=\"button\" class=\"close\" data-dismiss=\"modal\" aria-label=\"Close\">\n\t\t\t\t\t<span aria-hidden=\"true\">&times;<\/span>\n\t\t\t\t<\/button>\n\t\t\t<\/div> <!-- \/modal-header -->\n\n            <div class=\"modal-body inner-modal\">\t\t\t\t\n\t\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" src=\"https:\/\/wp-cdn.pugetsystems.com\/2024\/10\/Intel-Core-Ultra-2.png\" alt=\"\" \/>\n\t\t\t\t\t\t<div class=\"text-center full-res-image-wrapper\">\n\t\t\t\t\t\t\t<a class=\"btn btn-light btn-lg full-res-image-link\" href=\"https:\/\/wp-cdn.pugetsystems.com\/2024\/10\/Intel-Core-Ultra-2.png\" target=\"_blank\">Open Full Resolution <i class=\"fas fa-external-link-alt\"><\/i><\/a>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div><!-- \/modal-body -->\n    \t<\/div><!-- \/modal-content -->\n    <\/div><!-- \/modal-dialog -->\n<\/div><!-- \/modal fade --> \n\n\n\n<div style=\"height:15px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-why-not-include-npus-in-desktop-systems\"><span class=\"ez-toc-section\" id=\"Why_not_include_NPUs_in_desktop_systems\"><\/span>Why not include NPUs in desktop systems?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>First, although energy efficiency is a worthwhile goal for any computer hardware, it is simply not valued as highly on systems that don\u2019t rely on battery power, particularly on powerful workstations where performance supersedes all or most other concerns. Secondly, it\u2019s much harder to justify taking up valuable chip real estate on an NPU for a workstation CPU when most users will already have access to a GPU that provides far more than 40 TOPS of performance. For example, NVIDIA&#8217;s documentation states that RTX GeForce 4090 can reach a peak of 660.6 INT8 TOPS, and even the now six-year-old NVIDIA RTX 2080 Ti offers nearly 230 TOPS!<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-conclusion\"><span class=\"ez-toc-section\" id=\"Conclusion\"><\/span>Conclusion<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>In the near future, we should not expect to see much change being driven by NPUs in the desktop workstation ecosystem. This is because the benefits of more efficient computations to battery life simply do not translate to the desktop ecosystem, and because dedicated GPUs offer many times the raw performance of integrated NPUs. As time passes and more applications are developed that can take advantage of NPU hardware, we will continue to see NPUs integrated into more devices, most notably laptops in the near term.<\/p>\n\n\n<div class=\"wp-bootstrap-blocks-row row puget-icon-section\">\n\t\n\n<div class=\"col-12 col-md-6\">\n\t\t\t\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<figure class=\"wp-block-image size-thumbnail is-resized text-center\"><a href=\"https:\/\/www.pugetsystems.com\/solutions\/scientific-computing-workstations\/machine-learning-ai\/\"><img loading=\"lazy\" decoding=\"async\" width=\"150\" height=\"150\" src=\"https:\/\/wp-cdn.pugetsystems.com\/2022\/12\/computer-icon.png\" alt=\"Tower Computer Icon in Puget Systems Colors\" class=\"wp-image-12659\" style=\"width:113px;height:113px\" title=\"\"\/><\/a><\/figure>\n\n\n\n<h4 class=\"wp-block-heading has-text-align-center\" id=\"h-looking-for-an-ai-workstation-or-server\">Looking for an AI workstation or server?<\/h4>\n\n\n\n<p class=\"has-text-align-center\">We build computers tailor-made for your workflow.&nbsp;<\/p>\n\n\n<div class=\"wp-bootstrap-blocks-button text-center\">\n\t<a\n\t\thref=\"https:\/\/www.pugetsystems.com\/solutions\/scientific-computing-workstations\/machine-learning-ai\/\"\n\t\t\t\t\t\tclass=\"btn btn-primary\"\n\t>\n\t\tConfigure a System\t<\/a>\n<\/div>\n\n\n\n<div style=\"height:40px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\t<\/div>\n\n\n\n<div class=\"col-12 col-md-6\">\n\t\t\t\n\n<div style=\"height:10px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<figure class=\"wp-block-image size-thumbnail is-resized text-center\"><a href=\"\/contact-expert\/\"><img loading=\"lazy\" decoding=\"async\" width=\"150\" height=\"150\" src=\"https:\/\/wp-cdn.pugetsystems.com\/2022\/08\/talking-icon.png\" alt=\"Talking Head Icon in Puget Systems Colors\" class=\"wp-image-12657\" style=\"width:113px;height:113px\" title=\"\"\/><\/a><\/figure>\n\n\n\n<h4 class=\"wp-block-heading has-text-align-center\" id=\"h-don-t-know-where-to-start-we-can-help\">Don&#8217;t know where to start?<br>We can help!<\/h4>\n\n\n\n<p class=\"has-text-align-center\">Get in touch with one of our technical consultants today.<\/p>\n\n\n<div class=\"wp-bootstrap-blocks-button text-center\">\n\t<a\n\t\thref=\"\/contact-expert\/\"\n\t\t\t\t\t\tclass=\"btn btn-primary\"\n\t>\n\t\tTalk to an Expert\t<\/a>\n<\/div>\n\n\n\n<div style=\"height:40px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\t<\/div>\n\n<\/div>\n\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<h3 class=\"wp-block-heading has-text-align-center\" id=\"h-related-content\">Related Content<\/h3>\n\n\n \n<div class=\"related-content\">\n\t<ul class=\"related-content-list\">\n\t\t\t\t\t\t<li class=\"related-content-list-item\">\n\t\t\t\t\t<a href=\"https:\/\/www.pugetsystems.com\/labs\/hpc\/standing-up-ai-development-quickly-for-supercomputing-2025\/\" title=\"Standing Up AI Development Quickly for Supercomputing 2025\">Standing Up AI Development Quickly for Supercomputing 2025<\/a>\n\t\t\t\t<\/li>\n\t\t\t\t\t\t\t<li class=\"related-content-list-item\">\n\t\t\t\t\t<a href=\"https:\/\/www.pugetsystems.com\/labs\/hpc\/exploring-hybrid-cpu-gpu-llm-inference\/\" title=\"Exploring Hybrid CPU\/GPU LLM Inference\">Exploring Hybrid CPU\/GPU LLM Inference<\/a>\n\t\t\t\t<\/li>\n\t\t\t\t\t\t\t<li class=\"related-content-list-item\">\n\t\t\t\t\t<a href=\"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/\" title=\"What&#8217;s the deal with NPUs?\">What&#8217;s the deal with NPUs?<\/a>\n\t\t\t\t<\/li>\n\t\t\t\t\t\t\t<li class=\"related-content-list-item\">\n\t\t\t\t\t<a href=\"https:\/\/www.pugetsystems.com\/labs\/hpc\/local-alternatives-to-cloud-ai-services\/\" title=\"Local alternatives to Cloud AI services\">Local alternatives to Cloud AI services<\/a>\n\t\t\t\t<\/li>\n\t\t\t\t<\/ul>\n\t \n\t<a class=\"view-term-link\" href=\"\/all_articles?filter=machine-learning\">View\n\t\tAll Related Content<\/a>\n\t<\/div><\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<h3 class=\"wp-block-heading has-text-align-center\" id=\"h-latest-content\">Latest Content<\/h3>\n\n\n \n<div class=\"latest-content\">\n\t<ul class=\"latest-content-list\">\n\t\t\t\t\t\t<li class=\"latest-content-list-item\">\n\t\t\t\t\t<a href=\"https:\/\/www.pugetsystems.com\/labs\/hpc\/standing-up-ai-development-quickly-for-supercomputing-2025\/\" title=\"Standing Up AI Development Quickly for Supercomputing 2025\">Standing Up AI Development Quickly for Supercomputing 2025<\/a>\n\t\t\t\t<\/li>\n\t\t\t\t\t\t\t<li class=\"latest-content-list-item\">\n\t\t\t\t\t<a href=\"https:\/\/www.pugetsystems.com\/labs\/hpc\/exploring-hybrid-cpu-gpu-llm-inference\/\" title=\"Exploring Hybrid CPU\/GPU LLM Inference\">Exploring Hybrid CPU\/GPU LLM Inference<\/a>\n\t\t\t\t<\/li>\n\t\t\t\t\t\t\t<li class=\"latest-content-list-item\">\n\t\t\t\t\t<a href=\"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/\" title=\"What&#8217;s the deal with NPUs?\">What&#8217;s the deal with NPUs?<\/a>\n\t\t\t\t<\/li>\n\t\t\t\t\t\t\t<li class=\"latest-content-list-item\">\n\t\t\t\t\t<a href=\"https:\/\/www.pugetsystems.com\/labs\/hpc\/local-alternatives-to-cloud-ai-services\/\" title=\"Local alternatives to Cloud AI services\">Local alternatives to Cloud AI services<\/a>\n\t\t\t\t<\/li>\n\t\t\t\t<\/ul>\n\t \n\t\t<a href=\"https:\/\/www.pugetsystems.com\/all-hpc\/\" class=\"view-posts-link\">View All<\/a>\n\t<\/div><\/div>\n<\/div>\n\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>An introduction to NPU hardware and its growing presence outside of mobile computing devices.<\/p>\n","protected":false},"author":166,"featured_media":0,"menu_order":0,"comment_status":"open","ping_status":"closed","template":"","meta":{"_acf_changed":false,"content-type":"","classic-editor-remember":"","legacy_id":"","redirect_url":[],"expire_date":"","alert_message":"","alert_link":[],"configure_ids":"","system_grid_title":"","system_grid_ids":"","footnotes":""},"hpc_categories":[8879,8883,8885],"hpc_tags":[8683,8746,8765,8768,8770],"coauthors":[9063],"class_list":["post-31072","hpc_post","type-hpc_post","status-publish","hentry","hpc_category-hardware","hpc_category-machine-learning","hpc_category-software","hpc_tag-amd","hpc_tag-intel","hpc_tag-machine-learning","hpc_tag-microsoft","hpc_tag-ml-ai"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v26.7 (Yoast SEO v26.7) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>What&#039;s the deal with NPUs? | Puget Systems<\/title>\n<meta name=\"description\" content=\"An introduction to NPU hardware and its growing presence outside of mobile computing devices.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"What&#039;s the deal with NPUs?\" \/>\n<meta property=\"og:description\" content=\"An introduction to NPU hardware and its growing presence outside of mobile computing devices.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/\" \/>\n<meta property=\"og:site_name\" content=\"Puget Systems\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/PugetSystems\" \/>\n<meta property=\"article:modified_time\" content=\"2024-11-04T17:13:19+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.pugetsystems.com\/wp-content\/uploads\/2022\/12\/computer-icon-150x150.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@PugetSystems\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"5 minutes\" \/>\n\t<meta name=\"twitter:label2\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data2\" content=\"Jon Allman\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/\",\"url\":\"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/\",\"name\":\"What's the deal with NPUs? | Puget Systems\",\"isPartOf\":{\"@id\":\"https:\/\/www.pugetsystems.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.pugetsystems.com\/wp-content\/uploads\/2022\/12\/computer-icon-150x150.png\",\"datePublished\":\"2024-10-25T19:55:03+00:00\",\"dateModified\":\"2024-11-04T17:13:19+00:00\",\"description\":\"An introduction to NPU hardware and its growing presence outside of mobile computing devices.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/#primaryimage\",\"url\":\"https:\/\/wp-cdn.pugetsystems.com\/2022\/12\/computer-icon.png\",\"contentUrl\":\"https:\/\/wp-cdn.pugetsystems.com\/2022\/12\/computer-icon.png\",\"width\":500,\"height\":500,\"caption\":\"Tower Computer Icon in Puget Systems Colors\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.pugetsystems.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"HPC Posts\",\"item\":\"https:\/\/www.pugetsystems.com\/all-hpc\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"What&#8217;s the deal with NPUs?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.pugetsystems.com\/#website\",\"url\":\"https:\/\/www.pugetsystems.com\/\",\"name\":\"Puget Systems\",\"description\":\"Workstations for creators.\",\"publisher\":{\"@id\":\"https:\/\/www.pugetsystems.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.pugetsystems.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.pugetsystems.com\/#organization\",\"name\":\"Puget Systems\",\"url\":\"https:\/\/www.pugetsystems.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.pugetsystems.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.pugetsystems.com\/wp-content\/uploads\/2022\/08\/Puget-Systems-2020-logo-color-full.png\",\"contentUrl\":\"https:\/\/www.pugetsystems.com\/wp-content\/uploads\/2022\/08\/Puget-Systems-2020-logo-color-full.png\",\"width\":2560,\"height\":363,\"caption\":\"Puget Systems\"},\"image\":{\"@id\":\"https:\/\/www.pugetsystems.com\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/PugetSystems\",\"https:\/\/x.com\/PugetSystems\",\"https:\/\/www.instagram.com\/pugetsystems\/\",\"https:\/\/www.linkedin.com\/company\/puget-systems\",\"https:\/\/www.youtube.com\/user\/pugetsys\",\"https:\/\/en.wikipedia.org\/wiki\/Puget_Systems\"],\"telephone\":\"(425) 458-0273\",\"legalName\":\"Puget Sound Systems, Inc.\",\"foundingDate\":\"2000-12-01\",\"duns\":\"128267585\",\"naics\":\"334111\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"What's the deal with NPUs? | Puget Systems","description":"An introduction to NPU hardware and its growing presence outside of mobile computing devices.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/","og_locale":"en_US","og_type":"article","og_title":"What's the deal with NPUs?","og_description":"An introduction to NPU hardware and its growing presence outside of mobile computing devices.","og_url":"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/","og_site_name":"Puget Systems","article_publisher":"https:\/\/www.facebook.com\/PugetSystems","article_modified_time":"2024-11-04T17:13:19+00:00","og_image":[{"url":"https:\/\/www.pugetsystems.com\/wp-content\/uploads\/2022\/12\/computer-icon-150x150.png","type":"","width":"","height":""}],"twitter_card":"summary_large_image","twitter_site":"@PugetSystems","twitter_misc":{"Est. reading time":"5 minutes","Written by":"Jon Allman"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/","url":"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/","name":"What's the deal with NPUs? | Puget Systems","isPartOf":{"@id":"https:\/\/www.pugetsystems.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/#primaryimage"},"image":{"@id":"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/#primaryimage"},"thumbnailUrl":"https:\/\/www.pugetsystems.com\/wp-content\/uploads\/2022\/12\/computer-icon-150x150.png","datePublished":"2024-10-25T19:55:03+00:00","dateModified":"2024-11-04T17:13:19+00:00","description":"An introduction to NPU hardware and its growing presence outside of mobile computing devices.","breadcrumb":{"@id":"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/#primaryimage","url":"https:\/\/wp-cdn.pugetsystems.com\/2022\/12\/computer-icon.png","contentUrl":"https:\/\/wp-cdn.pugetsystems.com\/2022\/12\/computer-icon.png","width":500,"height":500,"caption":"Tower Computer Icon in Puget Systems Colors"},{"@type":"BreadcrumbList","@id":"https:\/\/www.pugetsystems.com\/labs\/hpc\/whats-the-deal-with-npus\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.pugetsystems.com\/"},{"@type":"ListItem","position":2,"name":"HPC Posts","item":"https:\/\/www.pugetsystems.com\/all-hpc\/"},{"@type":"ListItem","position":3,"name":"What&#8217;s the deal with NPUs?"}]},{"@type":"WebSite","@id":"https:\/\/www.pugetsystems.com\/#website","url":"https:\/\/www.pugetsystems.com\/","name":"Puget Systems","description":"Workstations for creators.","publisher":{"@id":"https:\/\/www.pugetsystems.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.pugetsystems.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.pugetsystems.com\/#organization","name":"Puget Systems","url":"https:\/\/www.pugetsystems.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.pugetsystems.com\/#\/schema\/logo\/image\/","url":"https:\/\/www.pugetsystems.com\/wp-content\/uploads\/2022\/08\/Puget-Systems-2020-logo-color-full.png","contentUrl":"https:\/\/www.pugetsystems.com\/wp-content\/uploads\/2022\/08\/Puget-Systems-2020-logo-color-full.png","width":2560,"height":363,"caption":"Puget Systems"},"image":{"@id":"https:\/\/www.pugetsystems.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/PugetSystems","https:\/\/x.com\/PugetSystems","https:\/\/www.instagram.com\/pugetsystems\/","https:\/\/www.linkedin.com\/company\/puget-systems","https:\/\/www.youtube.com\/user\/pugetsys","https:\/\/en.wikipedia.org\/wiki\/Puget_Systems"],"telephone":"(425) 458-0273","legalName":"Puget Sound Systems, Inc.","foundingDate":"2000-12-01","duns":"128267585","naics":"334111"}]}},"_links":{"self":[{"href":"https:\/\/www.pugetsystems.com\/wp-json\/wp\/v2\/hpc_posts\/31072","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.pugetsystems.com\/wp-json\/wp\/v2\/hpc_posts"}],"about":[{"href":"https:\/\/www.pugetsystems.com\/wp-json\/wp\/v2\/types\/hpc_post"}],"author":[{"embeddable":true,"href":"https:\/\/www.pugetsystems.com\/wp-json\/wp\/v2\/users\/166"}],"replies":[{"embeddable":true,"href":"https:\/\/www.pugetsystems.com\/wp-json\/wp\/v2\/comments?post=31072"}],"version-history":[{"count":0,"href":"https:\/\/www.pugetsystems.com\/wp-json\/wp\/v2\/hpc_posts\/31072\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.pugetsystems.com\/wp-json\/wp\/v2\/media?parent=31072"}],"wp:term":[{"taxonomy":"hpc_category","embeddable":true,"href":"https:\/\/www.pugetsystems.com\/wp-json\/wp\/v2\/hpc_categories?post=31072"},{"taxonomy":"hpc_tag","embeddable":true,"href":"https:\/\/www.pugetsystems.com\/wp-json\/wp\/v2\/hpc_tags?post=31072"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.pugetsystems.com\/wp-json\/wp\/v2\/coauthors?post=31072"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}