La Uchenjeri hwekugadzira hunoshanda munharaunda paWindows 11 Hazvisisiri zvemarabhoritari chete kana makambani makuru. Nhasi uno unogona kushandisa mamodheru epamusoro zvakananga paPC yako, usingashandise cloud, uchishandisa CPU, GPU, uye kunyange NPU kana muchina wako uri wepamusoro-soro. Uye kiyi yekuita izvi zviri nyore ndeye... ONNX Runtime yakabatana neWindows ML uye .NET.
Mumitsara inotevera tichaona, zvakanyarara asi tisingatenderere, Maitiro ekushandisa AI yemuno neONNX Runtime paWindows 11Chii chinonzi ONNX nenguva yayo yekushandisa, kuti inoenderana sei neWindows ML, zvaunoda kuisa, maitiro ekugadzira mienzaniso chaiyo mu .NET/WinUI 3, maitiro ekushandisa DirectML uye kukurumidza kwehardware, uye zviitiko zvinoshanda zvaunogona kufukidza (kupatsanura mifananidzo, kutaura-ku-rugwaro, mamodheru emitauro yemuno, RAG, nezvimwewo). Uchaona imwe kodhi, asi chinangwa chiri pakunzwisisa kwako kuyerera kwakazara kwe Isa, gadzirira, uye mhanyisa mamodheru eONNX pamuchina wako.
Chii chinonzi ONNX uye ONNX Runtime inoita basa rei muWindows 11?
Mwero ONNX (Kuchinjana kweNeural Network) Ifomati yakavhurika yakagadzirirwa kutsanangura mamodheru e neural network nenzira inoshanda pamwe chete. Zviri nyore: unogona dzidzisa modhi muPyTorch kana TensorFlowTumira kunze kuONNX wozoishandisa paWindows, mugore, pawebhu, kana chero kwaunoda, usinganyore zvese kubva pakutanga.
Un Muenzaniso weONNX Izvi zvinosanganisira chimiro chenetwork (zvikamu, kubatana, mhando dzekushanda), huremu hunobva mukudzidziswa, uye tsananguro yezvinopinzwa uye zvinobuda. Nekuda kweizvi, maturusi akasiyana uye nguva dzekushanda zvinogona kunzwisiswa zvakanaka. kuti vanotarisira data ripi, kuti vangarigadzirisa sei, uye kuti vanodzosa chiiSemuenzaniso, modhi yekupatsanura mifananidzo inogamuchira mufananidzo wakagadzirwa kare uye inodzosera vhekitari yemhedzisiro yekirasi yega yega.
Yakavakirwa pachimiro ichocho chakajairwa ONNX Runtimeinova injini yekushanda yakagadzirisika yekushandisa mamodheru aya pamapuratifomu akasiyana-siyana. Iyi nguva yekushanda inopa API yakafanana ye:
- Rodha mamodheru eONNX kubva padiski kana ndangariro.
- Gadzira zvidzidzo zvekufungidzira nesarudzo dzakasiyana dzekuita.
- Batanidza vanopa mabasa ekuita (Vanopa Rubatsiro) veCPU, GPU neNPU.
- Dyisa modhi ne input tensors uye tora ma tensioner anobuda.
MuWindows 11, ONNX Runtime yakabatanidzwa kuburikidza ne Windows ML uye nezvemamiriro ekunze e Windows App SDK neDirectMLIzvi zvinobvumira mapurogiramu ako edesktop, kungave muC#, WinUI 3, WPF, kana kunyange mapurogiramu ewebhu ane WebNN, kushandisa mukana we Kukurumidzisa Hardware pasina matambudziko evatyairi nemaSDK chaiwo emugadziri.
Zvakanakira kushandisa AI munharaunda yako kana iri mugore
Shanda na mamodheru eAI emunharaunda muWindows 11 Ine zvakanakira zvakawanda zviri pachena kupfuura kungovimba chete nemasevhisi ari kure akadai seChatGPT, Gemini, kana mamwe:
Kutanga, iyo kuvanzika kwedata uye kuvanzika Zvinovandudzika zvikuru nekuti kugadzirisa kunoitwa pamudziyo wako wega. Kana uchimhanyisa modhi yeONNX pakombuta yako, magwaro ako, odhiyo, mifananidzo, kana zvinyorwa zvekurapa hazvimbobvi panetwork yako, izvo zvinoderedza zvikuru njodzi yekubuda kweruzivo kana kushandiswa zvisirizvo.
Panewo chikonzero chacho mutengo uye kutongaNekusavimba nekukumbira nguva dzose ku paid cloud API, unodzivisa mabhiri asingatarisirwi uye unogona kuisa mhinduro dzinoshanda zvakanyanya mukambani yese pasina kuwedzera mari yekunyorera. Unoisa mari muhardware kamwe chete uye unobatsirwa zvakanyanya neONNX Runtime neWindows ML.
La yakaderera latency Iri ibasa guru. Kana uri kuita ongororo yekuona kwekombiyuta, vabatsiri vemamiriro ezvinhu, kana kuziva kutaura, rwendo rwese rwekutenderera kuenda kugore runowedzera mamilisekonzi. Kumhanyisa modhi iyi munharaunda kunoderedza nguva yekupindura uye kunovandudza kunzwa kwekuyerera, izvo zvakakosha mumapurogiramu ekudyidzana kana pamidziyo yemumucheto.
Chekupedzisira asi chisiri chidiki ndiye kuzvimiririra kubva paInternetKana app yako ichifanira kushanda mundege, mufekitori iri kure, kana munzvimbo chero ipi zvayo ine network shoma, kuva nemamodheru eONNX akaiswa mukati meapplication pachayo (semuenzaniso, mukati meMSIX) kunoita kuti AI irambe ichishanda zvakanaka, sezviri mu PhotoPrism ine AI yemuno.
Windows ML, ONNX Runtime uye DirectML: kuti zvese zvinoenderana sei
MuWindows 11 ecosystem yemazuva ano, Windows ML inoshanda sechikamu chepakati cheware Inobatanidza manejimendi eCPU, GPU, neNPU kuti ionekwe seAI model inference. Chinangwa chayo ndechekuronga zvishandiso zvehardware zviripo kuitira kuti ONNX model iite zvakanaka sezvinobvira, pasina kuti iwe utamburire neruzivo rwechip yega yega.
Windows ML ndiyo yakabatana zvakasimba neONNX RuntimeInoshandisazve maAPI ayo, inovimba neVanopa Basa reKuita (EPs), uye inopa kuunganidzwa nekugadzirisa modhi yacho. Microsoft inobatawo kugovera nekuchengetedza ONNX Runtime nemaEP kubva kuvagadziri vakasiyana-siyanaIzvi zvinoita kuti zvive nyore kurongedza mapurogiramu ako uye zvinoderedza kutsamira kwekunze.
Chinhu chikuru mupuzzle iyi ndeche DirectMLChimiro chekusashandisa chinokutendera kuti ushandise maML models uchishandisa GPU (uye NPU pamasystem anoenderana) nenzira yakabatana. ONNX Runtime inopa EP yakatsaurirwa yeDirectML, saka unogona Gadzira zvikamu zvekufungidzira zvinoshandisa otomatiki CPU, GPU, kana NPU zvichienderana nezviripo pakombuta.
Vagadziri vakuru vanoda AMD, Intel, NVIDIA uye Qualcomm Vanoshanda pamwe chete neMicrosoft kupa maEP akagadziridzwa: AMD inobatanidza Ryzen AI, Intel inobatanidza OpenVINO neWindows ML, NVIDIA inopa TensorRT yeRTX GPUs, uye Qualcomm inogadzirisa Snapdragon X NPU. Nekuda kweizvi, maONNX models akafanana anogona kushandisa hardware dzakasiyana siyana pasina kuchinja kodhi yako yepamusoro; kana uchida kugadzirisa system, dzidza maitiro ekuita izvozvo. gadzirisa maprofayiro ekushanda.
Zvese izvi zvinouya zvakaputirwa mu Windows App SDK (kubva pavhezheni 1.8.1 zvichienda mberi) uye inotsigirwa zviri pamutemo pamidziyo ine Windows 11 24H2 kana kupfuuraIzvi zvinoita kuti sisitimu yekushandisa ive puratifomu yakasimba kwazvo yeruzivo rweAI rwemunharaunda mukugadzira.
Zvinodiwa pakushandisa AI yemuno neONNX Runtime paWindows 11
Kutanga Mhanya mamodheru eONNX munharaunda yako paWindows 11 Kubva muzvishandiso zvako zve .NET, zvinokurudzirwa kuti uongorore zvimwe zvinodiwa zvemamiriro ekunze uye zvishandiso:
Padanho rehurongwa, uchafanira Windows 11 yakagadziridzwa (zvingangoda kuvaka 22621 kana kupfuura) uye, kana uchida kuisa maapplication emazuva ano, shanda ne Mapurojekiti eWindows App SDK neWinUI 3 akaiswa muMSIXIzvi zvinokupa mukana wekuwana maWindows ML neDirectML APIs, pamwe chete nemabasa matsva ekubatanidza AI.
Nezvenzvimbo yekuvandudza, sarudzo inonyanya kushandiswa ndeyekushandisa Visual Studio 2022 kana yakakwira ne .NET desktop development loadload yakagoneswa. Kubva ipapo unogona kugadzira mapurojekiti Mapurogiramu eWinUI 3, WPF, .NET MAUI kana kunyange econsole muC# kana VB.NET iyo inotaura nezve ONNX Runtime neWindows ML.
Panyaya yekutsamira, kune akati wandei makiyi eNuGet mapakeji anodzokororwa mune akawanda mamiriro: Microsoft.ML.OnnxRuntime yeCPU, Microsoft.ML.OnnxRuntime.DirectML Kana uchida kushandisa GPU neDirectML, Kudzidza kweMicrosoft.AI.Machine kushanda neWindows ML muWinUI 3, uye maraibhurari akadai se SixLabors.ImageSharp kana zvakafanana pakugadzirisa mifananidzo yekuisa.
Ehe, uchazodawo kanenge kamwe chete modhi yeONNX inoenderanaUnogona kudhawunirodha mamodheru akadzidziswa kare kubva ku ONNX Model Zoo (semuenzaniso, ResNet, SqueezeNet, mamodheru ekupatsanura, kuona zvinhu, kana NLP), kana kushandura mamodheru ako kubva kuPyTorch kana TensorFlow uchishandisa maturusi akadai se Zvishandiso zveAI zveVS Code, tf2onnx kana onnxruntime-tools.
Panyaya yehardware, kunyangwe ONNX Runtime yakagadziriswa neCPU uye ichishanda zvakanaka pasina GPU, uchaona kuvandudzika kwakajeka kana ukaishandisa. zvinokurumidzisa zvemunharaunda zvakaita seGPU kana NPUkunyanya nemamodeli makuru (mamodeli emitauro, Stable Diffusion, Whisper, nezvimwewo). Ona yedu Ongororo yemidziyo inokosha.
Maitiro ekuisa uye kushandisa ONNX Runtime mumapurojekiti e.NET neWinUI 3
Imwe yenzira dzakananga dzekutanga nadzo Kushandisa ONNX Runtime paWindows 11 Zviri pamusoro pekugadzira application yedesktop mu.NET. Maitiro ekutanga anodzokororwa muC# neVB.NET: tarisa package, rodha modhi, gadzirira ma inputs, uye mhanyisa inference session.
Muchirongwa chekare che .NET (semuenzaniso, app ye console kana application yekare yedesktop), nzira yakajairika ndeyekuwedzera package Microsoft.ML.OnnxRuntime kubva kuVisual Studio NuGet Package Manager, uye wobva wagadzira Chikamu cheKufunga kutanga kubva panzira kuenda kufaira rako re.onnx. Chikamu ichocho ndicho chauchazoshandisazve pese paunoda kufanotaura.
Kana iri application Desktop yeWinUI 3 NeWindows App SDK, maitiro acho akafanana, asi kazhinji unobatanidza ONNX Runtime nemamwe maraibhurari anotsigira. Semuenzaniso, demo yakajairika yekupatsanura mifananidzo inogona kusanganisira:
- Microsoft.ML.OnnxRuntime uye Microsoft.ML.OnnxRuntime.Inodzorwa yekuitwa kwemuenzaniso.
- SixLabors.ImageSharp kurodha, kuyera saizi uye kugadzirisa mifananidzo.
- SharpDX.DXGI kana uchida kusarudza zvakajeka adapta yemifananidzo yeDirectML.
Mukati mehwindo guru (semuenzaniso, MainWindow.xaml.cs) unowanzo gadzira nzira yekutanga yemuenzaniso inogadzirisa iyo Sarudzo dzeSessionMupi wekuita (CPU kana DirectML) uye nzira yekuenda kumuenzaniso weONNX. Nenzira iyi, application yako inotanga, inotanga chikamu kamwe chete, uye yozoshandisazve chikamu ichocho kune yega yega inference call, zvichiwedzera mashandiro.
Kana uchida kushanda naye Windows ML zvakananga Muchirongwa cheWinUI 3, uchawedzera pasuru yacho Kudzidza kweMicrosoft.AI.Machine uye uchakopa modhi yako yeONNX (semuenzaniso, model_mnist.onnx kana modhi yekupatsanura mifananidzo) kufolda yakaita se Zvinhu/ML uye uchagadzirisa magadzirirwo ayo kuti abatanidzwe mukuburitswa kwekuunganidza sezviri mukati.
Muenzaniso unoshanda: Kupatsanura mifananidzo neONNX Runtime uye DirectML
Muenzaniso wekare uye unoratidza zvakajeka AI yemunharaunda ine ONNX Runtime muWindows 11 Ndiko kupatsanurwa kwemifananidzo uchishandisa modhi yakaita se ResNet50 kana SqueezeNetKufamba kwepfungwa nguva dzose kwakafanana, kunyange zvazvo kodhi yacho inogona kusiyana zvichienderana nehurongwa hwaunoshandisa.
MuWinUI 3 app, unogona kugadzira interface iri nyore ne bhatani rekusarudza mufananidzokudzora Mufananidzo wekuratidza mufananidzo wakasarudzwa uye a TextBlock kuti uronge fungidziroMushandisi anodzvanya bhatani, FileOpenPicker inovhurwa, mufananidzo unosarudzwa, uye kumashure, purogiramu inougadzirisa uye inoupa kumuenzaniso weONNX.
Kugadzirisa mufananidzo kunowanzo sanganisira ipake mu 24-bit RGB formatChinja saizi yacho kuita saizi inotarisirwa nemuenzaniso (semuenzaniso, 224×224 pixels), bvisa kana zvichidikanwa, uye gadzirisa kukosha kwechiteshi chimwe nechimwe zvichienderana nenzira uye kutsauka kwakajairwa kunoratidzwa mumagwaro emuenzaniso. NeImageSharp, izvi zvinoreva kuchinja saizi yemufananidzo, kudzokorora mutsetse nemutsara wemapikiseli, uye kuzadza a Tensor yakakora nemaitiro akajairwa.
Mushure mekugadzirira tensioner, OrtValue kubva mu tensor memory (pasina makopi asina basa), duramazwi rinovakwa nezvinyorwa zvemuenzaniso (kazhinji tensor imwe chete inonzi chimwe chinhu chakaita se "data" kana chakafanana) uye nzira yacho inotorwa. manya kubva kuInferenceSession. Chinobuda chinowanzova probability tensor pakirasi imwe neimwe, yaunogona kugadzirisa uchishandisa softmax kuitira kuti ma values ​​​​ave mu uye asvike ku1.
Pakupedzisira, unoronga mikana kubva pane yepamusoro kusvika pane yakaderera, uye unosara ne Mazita gumi ane chivimbo chakawanda uye zviratidze pachiratidziro. Izvi zvinowanzoitwa uchishandisa kirasi yekuwedzera (semuenzaniso, Prediction with Label and Confidence properties) uye tafura yemazita (LabelMap) iyo inobatanidza indekisi yega yega yekubuda kune kirasi yemazwi (imbwa, mota, keyboard, nezvimwewo).
Muenzaniso werudzi urwu unoratidza kuti ONNX Runtime, DirectML, uye WinUI 3 zvinoenderana sei kuti zvipe Nakidzwa nehunyanzvi hwekugadzira ruzivo rwechizvino-zvino (AI) hwemunharaunda yako neUI yemazuva ano, kukurumidza kwehardware, uye hapana chikonzero chekubatana neinternet nguva dzose..
Kushanda nemamodheru eWindows ML neONNX muWinUI 3
Kuwedzera pakushandisa "pure" ONNX Runtime, unogona zvakare kuvimba ne Windows ML mukati mepurojekiti yeWinUI 3 kuti ubatsirwe nekubatanidzwa kwesystem yekushandisa yemuno. Maitiro aya anobatsira zvikuru kana uchida kurongedza application yako muMSIX, kushandisa Windows App SDK, uye kuve nechokwadi chekuti mashandiro anoitwa pamidziyo yemazuva ano yeWindows 11 anoshanda nguva dzose.
Iyo yakajairika maitiro inosanganisira Wedzera Microsoft.AI.MachineLearning package kupurojekiti, kopi modhi yako yeONNX (semuenzaniso, model_mnist.onnx kana modhi yekupatsanura mifananidzo) kufolda yakaita se Zvinhu/ML uye kugadzirisa zvivakwa zvayo kuti zvibatanidzwe mukuburitswa kwekuunganidza sezviri mukati.
Kubva pakodhi yeC#, unoisa modhi uchishandisa maWindows ML APIs, Unogadzira chikamu uye unogadzirira data rekupinda mufomati inotarisirwa (semuenzaniso, tensor ine mufananidzo wegirisi we28×28 weMNIST, kana mufananidzo we224×224 wemuenzaniso wekuona wakaoma). Chikamu chinozoshanda uchishandisa Kukurumidzisa DirectML uye hardware zvakajeka kana mudziyo uchiutsigira.
Kana fungidziro yangoitwa, unoshanda nezvinobuda kuti uwane kukosha kwakakosha (semuenzaniso, nhamba ingangodaro iri muMNIST) kana seti yemikana yaunogona kuratidza mu interface. Zvese izvi zvinobatana zvakanaka ne WinUI 3 XAML UI, zvichikubvumidza kuti ugadzirise zvidzoreso zvinoonekwa nemhedzisiro yeAI.
Windows ML inobatawo vanopa mabasa ekuita uye batanidza kushandiswa kweCPU, GPU, uye NPU zvichienderana nehardware iripo, pasina kuchinja mamodheru ako kana kurongazve kodhi yako zvakanyanya.
Mienzaniso yemitauro yemuno, maRAG, nemimwe mienzaniso yepamusoro
Kushanda kwekombiyuta muWindows 11 hakungogumiri pakuona kwekombiyuta chete. Uchishandisa ONNX Runtime neDirectML, unogona zvakare kumhanyisa Mienzaniso yemitauro (LLM) yakashandurwa kuita ONNX, mamodheru ezwi-ku-rugwaro akadai seWhisper, kana masekisheni uye magadzirirwo ekugadzira mifananidzo akadai seStable Diffusion.
Microsoft ine akawanda ma mienzaniso yepamutemo uye AI Dev GalleryChishandiso chakavhurika chine madhizaini anopfuura makumi maviri nemashanu anoratidza maitiro ekubatanidza mamodheru emuno mumapurogiramu chaiwo: kubva kuvagadziri vemaaudio vanofambisa AI vanonyora zvidimbu zvichibva pamubvunzo werugwaro, kusvika kumapurogiramu ekunyora manotsi akangwara anoshandisa mamodheru akaita se Phi-3 yekupfupisa, kupedzisa otomatiki, uye kufunga pasina kushandisa internet.
Nzira yakakodzera zvikuru ndiyo Recovery Enhanced Generation (RAG)Munzira iyi, unosanganisa modhi yemutauro wemuno neruzivo rwekunze. Semuenzaniso, WPF app inogona kurodha PDF, kuicheka-cheka, uye kuiisa muvector uchishandisa modhi ye local embeddings, kuchengeta mavector iwayo, uye, panguva yekubvunza, kutora zvidimbu zvakakosha kuitira kuti modhi yemutauro igone kugadzira mhinduro zvichibva padata chairo, pasina kufanira kugadzirisa huremu hwemodhi.
Mienzaniso iyi inoratidza kuti unogona kugadzira vabatsiri vemashoko anoshanda, masisitimu ekutsvaga mashoko, kunyorwa kwemashoko, uye machatbots ane chinangwa chakakosha. zviri nyore kushandisa paWindows 11, vachishandisa ONNX Runtime neDirectML kuti mashandiro arambe achidzorwa.
Pamusoro pezvo, kune mapurojekiti ekutarisa mamodheru ekumhanya akadai se Phi-3, Flame 3 kana Mistral Yakagadziridzwa neDirectML, muchimiro cheONNX uye zvakananga kubva kuPyTorch, ichishandisa maapplication akareruka (semuenzaniso, ine Gradio-style web interface) kuyedza mashandiro uye kugadzirisa marongero usati waabatanidza muchirongwa chekupedzisira.
Kushanda kweAI kwakakurumidziswa pawebhu neONNX Runtime Web neWebNN
Imwe nzira inonakidza yekushandisa AI yemunharaunda ine ONNX Runtime muWindows 11 Ndiyo nzvimbo yewebhu, inokutsigira ONNX Runtime Web uye WebNN APIMunyaya iyi, mamodheru ane huremu hwakanyanya akadai seStable Diffusion, Segment Anything, kana Whisper anogona kushandiswa zvakananga paGPU kana NPU yemuchina kuburikidza neDirectML, asi kubva pawebhu application yemazuva ano.
Kune kuratidzira pachena kunoratidza, semuenzaniso, Turbo inoburitsa mifananidzo kubva mumashoko mumasekonzi mashoma chete uchishandisa WebNN neDirectML pamichina ine hunyanzvi hwepamusoro hweAI. Izvi zvinoshandawo kune Segment Anythingiyo inokutendera kuti ubvise chero chinhu kubva pamufananidzo wakaiswa nemushandisi, kana ne Nzvimbo yeKuzevezera, iyo inoshandura kutaura kuita mashoko ari munharaunda mubrowser.
Muzviitiko izvi, ONNX Runtime Web inobata rodha modhi yeONNX mune browser mamiriroGadzirisa ma tensor ekupinda nekubuda uye taurirana neWebNN kuti utungamirire mashandiro kuenda kuDirectML pachishandiso cheWindows 11. Mugumisiro wacho ndewekuti unogona kupa ruzivo rwakapfuma rweAI pasina kutumira odhiyo, mifananidzo, kana mameseji kune sevha iri kure.
Kusanganiswa uku kunoita kuti Windows 11 ive puratifomu ine simba zvikuru kwete chete ye mapurogiramu epakombiyuta emuno, asiwo for mawebhusaiti ane fungidziro yakasanganiswaapo chikamu chepfungwa chinogara mugore uye chikamu chinoshandiswa zvakananga pakombuta yemushandisi.
Kune vagadziri vewebhu vatove vachishandisa matekinoroji ewebhu (JavaScript, SPA frameworks, nezvimwewo), nzira iyi inzira iri nyore yekuita pasina chikonzero chekunyorazve application yese Enda kune AI yemuno pasina kufanira kunyora patsva application yese mu .NET kana C#.
Maitiro akanaka, kuchengetedzeka uye budiriro ine mutoro
Nekubatanidza Mashandiro eAI muWindows applicationsMicrosoft inokurudzira kutevedzera nhevedzano yemirairo yekuvandudza ine mutoro, kunyanya kana tichitarisa mamodheru ekugadzira uye kugadzirisa zviri mukati zvine hungwaru. Izvi hazvisi zvekushanda chete, asiwo nezvekuderedza kukuvara kunogona kuitika kana kushandiswa zvisina kunaka.
MaWindows AI API ane nzira dzekushandisa kuenzanisa zviri mumagwaro kuburikidza nemasevhisi akaita seMicrosoft Foundry, ayo anobatsira kubvisa mhedzisiro inogona kukonzera matambudziko. Kunyangwe kana uchishanda nemamodeli emunharaunda, zvinokurudzirwa kushandisa mamwe matanho ekusimbisa zvinongedzo uye ongororo yezvinobuda munzvimbo dzakakosha (zvemari, hutano, kuchengetedzeka, nezvimwewo).
Kubva pamaonero ekugadzira mashandisirwo, zvinokurudzirwa simbisa zviri mukati usati watanga kufungidzira (saizi dzemifananidzo, mhando dzemafaira, kureba kwemavara), gadzirisa kudonha kweGPU kana kushaya kukurumidza uchishandisa dzimwe nzira dzeCPU, uye dzivisa kurodha modhi kakawanda pane chikumbiro chega chega. Kuchengetedza nguva yekufungidzira iri mhenyu uye kuishandisa zvakare ndicho chinhu chakakosha kuti ishande zvakanaka.
Zvakakoshawo kufunga nezve kugadzirisa mamodheru eONNXMatekiniki akadai se quantization, pruning, uye operation connecting anogona kuderedza saizi yemodhi uye kuvandudza kumhanya pasina kukanganisa zvakanyanya kururama. Zvishandiso zvakaita seAI Toolkit yeVS Code kana ONNX Runtime's build infrastructure (kusanganisira ma build API matsva akaunzwa mushanduro dzichangoburwa) zvakagadzirirwa kuita kuti izvi zviitike.
Pakupedzisira, musakanganwa kutarisa kuwanikwa kwehardware uye maitiro ekugadzira pamudziyo wauchaisa maapplication ako, kunyanya kana uchizoedza pamidziyo yekushandisa, makiosk, midziyo yemaindasitiri, kana nzvimbo dzine mitemo yakasimba yekuchengetedza.
Nezvinhu izvi zvese zvakarongeka zvakanaka—ONNX sechimiro chakajairwa, ONNX Runtime neWindows ML semainjini ekuita, DirectML nemaEP kubva kuAMD, Intel, NVIDIA, neQualcomm kushandisa CPU, GPU, neNPU, uye maturusi akaita seAI Dev Gallery kana AI Toolkit—Windows 11 inova puratifomu ine simba kwazvo yekuvaka. Mapurogiramu eAI emunharaunda, epachivande, anokurumidza, uye akagadzirira kugadzirwa, kubva pakuisa mifananidzo muzvikamu zviri nyore kusvika kune vabatsiri vakaomarara zvichibva pamitauro uye RAG.
