NPU澶ㄤ腑缇璧 缇借蛋姝锛

浜哄伐鸿藉娣卞害瀛娓杩ヤ汉浠涓璋锋IBM变杈剧涓烘涓涔绾风悍轰ㄤ繁搴涔澶ㄣㄤ杩颁骇涓㈡CPUGPUDSP杩风浼缁锛涔涓ㄤ负娣卞害瀛NPUｄ锛CPUGPUDSPNPU绛娣卞害瀛澶ㄥ浠涔圭癸杩浜娣卞害瀛澶ㄨ村哄僵

CPUGPUDSP锛浠ョ琛寰

ㄨ变杈惧洪瀵逛汉宸ユ鸿界瀹GPU锛骞跺DGX-1 绯荤涔Intel涔涓藉ㄦ惰喘娣卞害瀛涓 Nervana Systems涔Intel涔浜ㄤ繁搴涔Xeon Phi瀹舵版锛ㄦ繁搴涔澶ㄩ寮杈版恒涔Intel变杈炬存绉拌繁浜у浼浜圭浜у锛ㄨ璁轰璧锋ュ姘存界剁舵堕寸杩GPU浼库Intel浼歌涔ㄤ瀹绋搴稿浜GPU浼裤涓杩锛璁烘瀵逛汉宸ユ鸿界浼歌杩剁GPU锛川涓戒ㄥ瀹涓跨稿舵搴瀵规扮浜哄伐鸿斤骞舵病╁芥х淬

620ワ涓寰板澶濯浣藉瑰楠瀹ゅㄤ含瀹ｅ锛涓介娆惧ュNPU锛绁缁缁澶璇锛宸插ㄤㄧ棣娆惧ュ棰澶鸿戒涓杩锛ㄧ浠缁璋涓介娆惧ュ缁缁澶ㄢ寰芥娆惧浠ヨ琛绁缁缁DSP锛姝ｆ绁缁缁涓ㄨ

涓炬鸿戒甯绯荤舵撅卞涓NPU革姣釜NPU稿4涓革姣釜告涓や釜娴澶Dataflow Processor锛锛姣釜娴澶ㄥ锋8涓夸瀹芥16浣瀹界SIMD杩绠姣釜NPU哥宄板兼ц戒负38Gops锛16浣瀹癸76Gops锛8浣瀹癸や澶告澶ㄦ韩ㄤ风Н杩绠澶锛鸿戒浜涓涓挎浠ゅ锛VLIW锛澶ㄧㄤ绁缁缁涓瓒瓒芥扮杩绠256KBL2Cache浠ュDMA妯″ㄤぇ版Щ

浠朵瀹界瀹硅绠ㄦ鸿戒浠绁缁缁姝ｅ杩绠锛娉绁缁缁璁浠涓瀛ㄧ锛鸿戒轰缁涓缂瀛锛Cache锛锛杩娴琛绁缁FPGA规涓蜂娇ㄤ究绛惧ㄣ姝わㄦ鸿戒稿х惰伴规锛灏浼缁㈠板淇″澶DSP澶ㄦ舵ㄤ绁缁缁锛涓昏ㄨ绠ㄦ归浜稿淇癸渚濡浣瀹藉瓒瓒芥帮骞堕绁缁缁涓ㄥㄣ

姝わ鸿戒跺DSP锛NPU跺锛CadenceTensilica Vision P5澶ㄣSynopsysEV澶ㄥ涓濡轰杈锛涔浼缁㈠板淇″澶DSP澶ㄦ舵ㄤ绁缁缁锛涓昏ㄨ绠ㄦ归浜稿淇癸渚濡浣瀹藉瓒瓒芥帮骞堕姝ｇNPU锛藉ㄤ风Н绁缁璺CNN锛锛瀵瑰惊绁缁缁锛RNN锛跨璁板缃缁锛LSTM锛绛澶璇冲惰瑷缃缁藉氨戒负浜

讳锛Intel变杈俱SynopsysCadence绛芥ㄤ娇ㄧ姣杈婊¤冻娣卞害瀛姹锛浼歌瀹剁GPUㄦ川涓ヨ渚фCPUGPU锛骞堕涓ㄩ瀵规繁搴涔涓涓锛SynopsysCadenceㄤ缁SIMD/DSP舵ラ绁缁缁锛姝ｇNPU渚舵涓瀹宸涓涓癸ㄤ歌GPUDSP璺娣卞害瀛锛灏辩被浼间ㄨ娇杞璐э杞胯溅韩圭圭讹璐х╄杈藉涓姝ｅぇ椹楂璐杞界璐ц溅涓瀹宸锛充究涓烘稿村锛Intel变杈剧ㄩ搴堕宸ヨ轰锋浼匡浣变CPUGPUDSP骞堕瀵规繁搴涔涓涓锛稿浜涓锛惰琛蹇跺颁瀹褰卞

NPU锛涓烘繁搴涔涓涓

浜哄伐绁缁缁绫绘ā浠跨╃缁缁寤虹璁＄虹娉荤О锛辫ュ共浜哄伐绁缁缁逛绁缁涔撮杩绐瑙袱涓よ锛绐瑙褰浜绁缁磋绯荤煎己寮便

姣釜绁缁借薄涓轰涓卞芥帮璇ュ芥扮杈ョ变剁歌绁缁杈轰互杩绁缁绐瑙卞冲涓轰琛ㄨ揪瑰ヨ锛浣跨ㄨ甯搁瑕锛杩浜瑰绠娉锛璋翠汉宸ョ缁缁涓瑙笺缃缁缁绛璇ヨ绋绉颁负瀛ㄥ涔涔浜哄伐绁缁缁杩涔寰ヨヨВ崇瑰

变繁搴涔烘浣缁绐瑙澶锛浼缁澶ㄦ浠ら锛x86ARM绛锛负浜杩琛ㄨ绠灞璧锋ョ锛跺烘浣涓虹浣锛わ昏浣锛涓锛锛寰寰瑕扮剧充℃浠ゆ藉涓涓缁澶锛娣卞害瀛澶涓楂姝よ胺姝抽瑕浣跨ㄤ涓涓x86 CPU歌琛7澶╂ヨ缁涓涓哥娣卞害瀛绁缁缁姝わ浼缁ㄥx86ARM绛锛ㄤ繁搴涔澶涓楂锛杩跺氨蹇椤诲㈠娣卞害瀛涓ㄥㄣ

涓界瀛㈣绠绌舵介涓╃绌舵繁搴缁缁澶ㄧ浣涔涓2014骞达涓㈣绠娉Inria浣琛ㄧ稿冲寰浜璁＄虹‖浠堕椤剁骇浼璁ASPLOS14MICRO14浣宠濂杩涔娲查娆″ㄦ棰椤剁骇浼璁寰浣宠濂

介璁＄哄浼锛Association for Computing Machinery锛璁灏杩涓绯诲宸ヤ涓鸿绠洪绌剁广杩蹇藉ㄦ鸿借棰宸茬ヤ介棰琛姝ゅ腑绉㈣绠朵涓棣涓繁搴涔澶ㄨ---瀵姝邯锛甯浜涓棣涓缁缁澶ㄦ浠ら锛浜2016骞磋璁＄轰绯荤棰椤剁骇介浼璁ISCA2016锛International Symposiumon Computer Architecture锛讹惰杩300绡绋跨绗

瀵姝邯稿浜CPUGPU绌剁浼垮瀵姝邯甯Cambricon浠ら存㈠澶ц妯＄缁绐瑙澶锛涓℃浠ゅ冲瀹涓缁绁缁澶锛骞跺绁缁绐瑙版ㄨ涓浼杈渚浜涓绯诲涓ㄧ瀵姝邯涓ㄥㄩ㈠娣卞害瀛搴ㄤㄥ朵藉涓瀛ㄥ娆★跺やㄥㄤ腑涓烘澶峰搴ㄨョ澶昏锛濡ㄦ娴姘寸嚎绛锛锛姝やCPUGPU告锛绁缁缁涓ㄥㄤ惧浠ヤц芥借姣宸

界跺姝邯涓㈣绠灏跺ㄤ骇锛浣浠浠ヤ腑绉㈣绠涓Inria浣2014骞村琛ㄤASPLOS2014瀛璁DianNao娣卞害瀛ㄦ舵轰浜绔DianNao涓哄告舵锛涓婚涓0.98GHz锛宄板兼ц借揪姣4520浜挎绁缁缁烘绠锛65nm宸ヨ轰涓0.485W锛㈢Н3.02mm^2ㄨュ共浠ｈ〃х缁缁涓瀹楠缁琛ㄦDianNao骞冲ц借杩涓绘CPU哥100锛浣㈢Н浠涓1/10锛芥杈句涓伴骇锛DianNao骞冲ц戒富娴GPGPU稿锛浣㈢Н浠涓轰富娴GPGPU惧涔涓骇

(瀵姝邯垮)

NPU涓涓介缇

变IBM寰涓骞哥规浜绉锛杩存瀵艰翠腑藉NPU涓堕浜姐

韩绌舵轰茬缁缁锛Spiking Neural Network锛SNN锛锛瀵姝邯涓撮㈠哄ㄥ涔绫荤绁缁缁锛濡MLP锛澶灞ユ猴CNN锛风Н绁缁缁锛DNN锛娣卞害绁缁缁锛

涓ょ缃缁规涓ㄤ缁涓淇℃琛ㄧず锛锛SNN锛杩茬棰堕达瑙笺ㄧ娴璇涓锛哄ㄥ涔绫荤绁缁缁锋撮绮惧害锛灏ゅ舵繁搴缁缁锛锛ㄧ簿搴涓戒姣

绮惧害棰寰冲甯搁瑕锛姣濡杩骞寸ImageNet绔璧涔互璇簿搴负琛￠姝ｆ涓烘剧ㄧ簿搴归㈢宸锛浠ュIBM惧浜ョ璺嚎撅涔寮濮璐磋哄ㄥ涔绫荤绁缁缁锛骞堕ㄤ涓浜寰叉规ュ杩涓

涔璇磋锛韩轰茬缁缁璁捐锛骞朵ㄤ昏堕涓1KHz杩风浣ユā姣绾у╀诧杩涔浣垮寰浣70mW锛锛褰舵ц戒姣杈瀵姝邯哄ㄥ涔绫荤绁缁缁璁捐锛杩琛堕棰GHz宸锛藉跺揩涓楂澶缃缁璁＄杩浣垮瀵姝邯稿浜锋ц戒浼裤

告涔涓锛瀵姝邯绯诲ㄨ绠瀹ㄧ哄ㄥ涔绫荤缁缁锛哄ㄥ涔绫荤缁韩涔娌℃濡茬缁缁涓风瑰创╃缁妯″锛锛杩璋搴ㄤ跺昏绠涓绁缁浠瀹翠釜绁缁缁璁＄杩朵腑锛娑板ㄨ璁℃韩涓规杩涓扮灏辫藉瀹涓瑙硷澶藉锛澶ㄥ

绗鹃璁胯瀛涓澹瀛涓澹挎浠浜哄伐绁缁缁茬缁缁澶ㄧ绌跺伐浣锛ㄥㄦ舵濂界涓涓介椤剁骇浼璁ISCA/MICRO/ASPLOS涓琛ㄨ澶绡璁烘锛腑借绠轰绯荤棰骞寸绌惰涓缈妤锛锛瀛涓澹〃绀猴浠IBM锛ㄥ锛澶у借涓轰浠IBM锛璧伴浜璺......锛骞惰涓猴稿浜姝邯娌℃浠涔浼裤纭璇存璇锛ｅ氨IBM浼垮骞垮浼库

缁璇

灏辨繁搴涔澶ㄨ瑷锛缇藉浠ュ跺CPUGPU涓娣卞Н绱骞跺ㄨ搴堕宸ヨ烘按骞冲瀵逛跨典锛寮鸿界ㄤ繁搴涔锛涓ц戒淇浼歌GPGPU锛涓杩浜缇IT宸ㄥご浼╃ㄤ浠法澶т甯烘骞裤藉锛澶у骞跨ㄨ浜浼缁ヨ琛娣卞害瀛澶锛ㄥ涓涓芥寰澶寸

灏辩舵瑷锛浼缁CPUGPUDSP锛舵川涓涔琛寰惰锛变缁CPUGPUDSP川涓骞堕浠ョ‖浠剁缁绐瑙负烘锛稿浜NPUㄦ繁搴涔归㈠ぉ浼涓瀹ｅ匡ㄨ搴堕宸ヨ烘按骞崇稿典锛惰〃蹇堕蹭NPU

NPU棰锛变IBM规浜绉锛浠ュ涓㈠ㄨ棰锋绘х寮灞浜涓绯诲绉宸ヤ锛浣夸腑借藉ㄧ澶浜垮颁充腑藉缇界娣卞害瀛澶娆句骇藉ㄥ涓涓寰锛寰澶х搴充互澶绱灏辩ㄦ垫ョ锛澶у烘浜涓璧疯绾匡楣挎璋锛杩ャ      

哄锛绉腑

朵锛娲㈤

讹涓界瀛㈣绠虹缁淇℃腑蹇

绉腑解腑界哄绀句瑰╃ㄤ俊娈靛灞绉瀛绉瀛濞

辩腑借浣哄锛杞浇璇锋敞哄