[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"$fc51m4ichhao0":3,"$f1exl8eqe9jho8":52,"$f2506qq40wkkox":54,"$f31vgn84k7d6kj":432,"$f27ltztn45i9l4":435,"$f12f9c00yrhx38":437},{"id":4,"name":5,"publisher":6,"paramsB":7,"useCase":8,"licenseStatus":9,"licenseUrl":10,"sourceUrl":10,"descriptionZh":10,"descriptionEn":10,"imageUrl":10,"downloadUrls":11,"stats":12,"variants":17,"derivations":18,"measuredHardware":21,"updatedAt":51},55,"Qwen3-1.7B","Qwen",1.7,"CHAT","UNVERIFIED",null,[],{"recordCount":13,"variantCount":14,"hardwareCount":15,"unlinkedRecordCount":13,"evidence":16},41,0,10,{"L0":14,"L1":14,"L2":13},[],{"parents":19,"children":20},[],[],[22,26,29,32,35,38,40,43,47,49],{"name":23,"vramGb":24,"recordCount":25},"AMD Radeon RX 7900 XTX",24,5,{"name":27,"vramGb":28,"recordCount":25},"Apple M3 Max",36,{"name":30,"vramGb":31,"recordCount":25},"Intel Arc B580",12,{"name":33,"vramGb":34,"recordCount":25},"NVIDIA RTX 5090",32,{"name":36,"vramGb":24,"recordCount":37},"NVIDIA RTX 4090",4,{"name":39,"vramGb":31,"recordCount":37},"NVIDIA RTX 5070",{"name":41,"vramGb":42,"recordCount":37},"NVIDIA RTX 5080",16,{"name":44,"vramGb":45,"recordCount":46},"Apple M4 Max",128,3,{"name":48,"vramGb":31,"recordCount":46},"NVIDIA RTX 3060 12GB",{"name":50,"vramGb":24,"recordCount":46},"NVIDIA RTX 3090","2026-10-02T04:13:10.853Z",{"favorited":53},false,{"items":55,"total":13,"page":57,"pageSize":431},[56,74,86,99,108,120,131,141,153,161,172,182,190,201,212,221,231,242,253,260,266,273,282,290,298,305,312,321,328,336,344,352,359,367,377,385,393,401,408,415,422],{"modelId":4,"modelName":5,"hardwareId":57,"hardwareName":36,"frameworkId":57,"frameworkName":58,"quantization":59,"hardwareVramGb":24,"decodeTps":60,"prefillTps":61,"vramGb":62,"genSeconds":10,"modelUseCase":8,"ttftS":63,"ttfbGb":64,"mtpAcceptanceRate":10,"powerW":65,"sampleCount":57,"reproduceCount":57,"sourceTypes":66,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":70,"latestOs":71,"latestCudaVersion":72,"latestFlashAttention":73,"latestOutputSpec":10},1,"llama.cpp","IQ2_M",323.97,1188.09,3.96,2.052,2.59,470.3,[67],"OTHER","L2","2026-10-10T05:44:09.043Z","v0.33","Windows 11 23H2","12.6",true,{"modelId":4,"modelName":5,"hardwareId":57,"hardwareName":36,"frameworkId":57,"frameworkName":58,"quantization":75,"hardwareVramGb":24,"decodeTps":76,"prefillTps":77,"vramGb":78,"genSeconds":10,"modelUseCase":8,"ttftS":79,"ttfbGb":80,"mtpAcceptanceRate":10,"powerW":81,"sampleCount":57,"reproduceCount":57,"sourceTypes":82,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":83,"latestOs":84,"latestCudaVersion":85,"latestFlashAttention":73,"latestOutputSpec":10},"Q2_K",306.65,1436.24,4.06,1.306,2.45,479.7,[67],"v0.52","Ubuntu 24.04","12.8",{"modelId":4,"modelName":5,"hardwareId":57,"hardwareName":36,"frameworkId":87,"frameworkName":88,"quantization":89,"hardwareVramGb":24,"decodeTps":90,"prefillTps":91,"vramGb":92,"genSeconds":10,"modelUseCase":8,"ttftS":93,"ttfbGb":94,"mtpAcceptanceRate":95,"powerW":96,"sampleCount":57,"reproduceCount":57,"sourceTypes":97,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":98,"latestOs":84,"latestCudaVersion":85,"latestFlashAttention":73,"latestOutputSpec":10},9,"Strata","IQ1_S",287.87,1066.63,3.6,0.323,2.3,0.6304,343.1,[67],"v0.35",{"modelId":4,"modelName":5,"hardwareId":57,"hardwareName":36,"frameworkId":87,"frameworkName":88,"quantization":75,"hardwareVramGb":24,"decodeTps":100,"prefillTps":101,"vramGb":78,"genSeconds":10,"modelUseCase":8,"ttftS":102,"ttfbGb":103,"mtpAcceptanceRate":104,"powerW":105,"sampleCount":57,"reproduceCount":57,"sourceTypes":106,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":107,"latestOs":71,"latestCudaVersion":72,"latestFlashAttention":73,"latestOutputSpec":10},285.75,1116.76,0.601,2.29,0.6338,415.2,[67],"v0.51",{"modelId":4,"modelName":5,"hardwareId":109,"hardwareName":50,"frameworkId":57,"frameworkName":58,"quantization":110,"hardwareVramGb":24,"decodeTps":111,"prefillTps":112,"vramGb":113,"genSeconds":10,"modelUseCase":8,"ttftS":114,"ttfbGb":115,"mtpAcceptanceRate":10,"powerW":116,"sampleCount":57,"reproduceCount":57,"sourceTypes":117,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":118,"latestOs":119,"latestCudaVersion":72,"latestFlashAttention":73,"latestOutputSpec":10},2,"Q3_K_L",227.45,862.55,4.67,0.455,1.82,341.2,[67],"v0.31","Ubuntu 22.04",{"modelId":4,"modelName":5,"hardwareId":109,"hardwareName":50,"frameworkId":57,"frameworkName":58,"quantization":121,"hardwareVramGb":24,"decodeTps":122,"prefillTps":123,"vramGb":124,"genSeconds":10,"modelUseCase":8,"ttftS":125,"ttfbGb":126,"mtpAcceptanceRate":10,"powerW":127,"sampleCount":57,"reproduceCount":57,"sourceTypes":128,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":129,"latestOs":130,"latestCudaVersion":72,"latestFlashAttention":53,"latestOutputSpec":10},"Q5_K_S",175.42,578.57,5.31,0.864,1.4,418,[67],"v0.23","macOS 15.0",{"modelId":4,"modelName":5,"hardwareId":109,"hardwareName":50,"frameworkId":87,"frameworkName":88,"quantization":132,"hardwareVramGb":24,"decodeTps":133,"prefillTps":134,"vramGb":135,"genSeconds":10,"modelUseCase":8,"ttftS":136,"ttfbGb":137,"mtpAcceptanceRate":138,"powerW":139,"sampleCount":57,"reproduceCount":57,"sourceTypes":140,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":107,"latestOs":84,"latestCudaVersion":72,"latestFlashAttention":73,"latestOutputSpec":10},"Q6_K",215.56,902.66,5.67,0.244,1.72,0.7539,472.6,[67],{"modelId":4,"modelName":5,"hardwareId":37,"hardwareName":27,"frameworkId":109,"frameworkName":142,"quantization":143,"hardwareVramGb":28,"decodeTps":144,"prefillTps":145,"vramGb":146,"genSeconds":10,"modelUseCase":8,"ttftS":147,"ttfbGb":148,"mtpAcceptanceRate":10,"powerW":149,"sampleCount":57,"reproduceCount":57,"sourceTypes":150,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":151,"latestOs":130,"latestCudaVersion":152,"latestFlashAttention":73,"latestOutputSpec":10},"vLLM","IQ2_XS",309.15,1109.54,3.81,2.174,2.47,37.6,[67],"v0.24","N\u002FA",{"modelId":4,"modelName":5,"hardwareId":37,"hardwareName":27,"frameworkId":109,"frameworkName":142,"quantization":110,"hardwareVramGb":28,"decodeTps":154,"prefillTps":155,"vramGb":113,"genSeconds":10,"modelUseCase":8,"ttftS":156,"ttfbGb":157,"mtpAcceptanceRate":10,"powerW":158,"sampleCount":57,"reproduceCount":57,"sourceTypes":159,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":160,"latestOs":130,"latestCudaVersion":152,"latestFlashAttention":73,"latestOutputSpec":10},226.47,1116.37,0.185,1.81,62,[67],"v0.41",{"modelId":4,"modelName":5,"hardwareId":37,"hardwareName":27,"frameworkId":46,"frameworkName":162,"quantization":163,"hardwareVramGb":28,"decodeTps":164,"prefillTps":165,"vramGb":166,"genSeconds":10,"modelUseCase":8,"ttftS":167,"ttfbGb":168,"mtpAcceptanceRate":10,"powerW":169,"sampleCount":57,"reproduceCount":57,"sourceTypes":170,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":171,"latestOs":130,"latestCudaVersion":152,"latestFlashAttention":73,"latestOutputSpec":10},"Ollama","FP16",96.85,510.37,8.7,0.442,0.77,81.8,[67],"v0.28",{"modelId":4,"modelName":5,"hardwareId":37,"hardwareName":27,"frameworkId":46,"frameworkName":162,"quantization":173,"hardwareVramGb":28,"decodeTps":174,"prefillTps":175,"vramGb":176,"genSeconds":10,"modelUseCase":8,"ttftS":177,"ttfbGb":178,"mtpAcceptanceRate":10,"powerW":179,"sampleCount":57,"reproduceCount":57,"sourceTypes":180,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":181,"latestOs":130,"latestCudaVersion":152,"latestFlashAttention":73,"latestOutputSpec":10},"IQ4_XS",188.36,704.89,4.75,1.313,1.51,58.8,[67],"v0.39",{"modelId":4,"modelName":5,"hardwareId":37,"hardwareName":27,"frameworkId":87,"frameworkName":88,"quantization":121,"hardwareVramGb":28,"decodeTps":183,"prefillTps":184,"vramGb":124,"genSeconds":10,"modelUseCase":8,"ttftS":185,"ttfbGb":186,"mtpAcceptanceRate":187,"powerW":188,"sampleCount":57,"reproduceCount":57,"sourceTypes":189,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":118,"latestOs":130,"latestCudaVersion":152,"latestFlashAttention":53,"latestOutputSpec":10},239.13,849.25,1.363,1.91,0.4629,62.4,[67],{"modelId":4,"modelName":5,"hardwareId":191,"hardwareName":23,"frameworkId":57,"frameworkName":58,"quantization":192,"hardwareVramGb":24,"decodeTps":193,"prefillTps":194,"vramGb":195,"genSeconds":10,"modelUseCase":8,"ttftS":196,"ttfbGb":197,"mtpAcceptanceRate":10,"powerW":198,"sampleCount":57,"reproduceCount":57,"sourceTypes":199,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":200,"latestOs":71,"latestCudaVersion":85,"latestFlashAttention":73,"latestOutputSpec":10},11,"IQ3_XS",234.47,1079.52,4.32,2.394,1.88,461,[67],"v0.27",{"modelId":4,"modelName":5,"hardwareId":191,"hardwareName":23,"frameworkId":57,"frameworkName":58,"quantization":202,"hardwareVramGb":24,"decodeTps":203,"prefillTps":204,"vramGb":205,"genSeconds":10,"modelUseCase":8,"ttftS":206,"ttfbGb":207,"mtpAcceptanceRate":10,"powerW":208,"sampleCount":57,"reproduceCount":57,"sourceTypes":209,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":210,"latestOs":84,"latestCudaVersion":211,"latestFlashAttention":53,"latestOutputSpec":10},"Q4_K_M",178.72,842.7,5.03,0.982,1.43,419.1,[67],"v0.38","12.4",{"modelId":4,"modelName":5,"hardwareId":191,"hardwareName":23,"frameworkId":46,"frameworkName":162,"quantization":213,"hardwareVramGb":24,"decodeTps":214,"prefillTps":215,"vramGb":216,"genSeconds":10,"modelUseCase":8,"ttftS":217,"ttfbGb":218,"mtpAcceptanceRate":10,"powerW":219,"sampleCount":57,"reproduceCount":57,"sourceTypes":220,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":210,"latestOs":119,"latestCudaVersion":211,"latestFlashAttention":73,"latestOutputSpec":10},"Q3_K_M",196.24,705.31,4.53,0.208,1.57,328,[67],{"modelId":4,"modelName":5,"hardwareId":191,"hardwareName":23,"frameworkId":46,"frameworkName":162,"quantization":222,"hardwareVramGb":24,"decodeTps":223,"prefillTps":224,"vramGb":225,"genSeconds":10,"modelUseCase":8,"ttftS":226,"ttfbGb":227,"mtpAcceptanceRate":10,"powerW":228,"sampleCount":57,"reproduceCount":57,"sourceTypes":229,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":230,"latestOs":71,"latestCudaVersion":85,"latestFlashAttention":73,"latestOutputSpec":10},"Q8_0",111.35,362.65,6.21,0.885,0.89,372.8,[67],"v0.37",{"modelId":4,"modelName":5,"hardwareId":191,"hardwareName":23,"frameworkId":87,"frameworkName":88,"quantization":232,"hardwareVramGb":24,"decodeTps":233,"prefillTps":234,"vramGb":235,"genSeconds":10,"modelUseCase":8,"ttftS":236,"ttfbGb":237,"mtpAcceptanceRate":238,"powerW":239,"sampleCount":57,"reproduceCount":57,"sourceTypes":240,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":241,"latestOs":130,"latestCudaVersion":85,"latestFlashAttention":73,"latestOutputSpec":10},"Q4_K_S",249,1211.72,4.88,2.066,1.99,0.7415,318.8,[67],"v0.22",{"modelId":4,"modelName":5,"hardwareId":243,"hardwareName":33,"frameworkId":57,"frameworkName":58,"quantization":244,"hardwareVramGb":34,"decodeTps":245,"prefillTps":246,"vramGb":247,"genSeconds":10,"modelUseCase":8,"ttftS":248,"ttfbGb":249,"mtpAcceptanceRate":10,"powerW":250,"sampleCount":57,"reproduceCount":57,"sourceTypes":251,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":252,"latestOs":130,"latestCudaVersion":72,"latestFlashAttention":73,"latestOutputSpec":10},13,"Q5_K_M",353.77,1906.09,5.42,1.045,2.83,470.2,[67],"v0.36",{"modelId":4,"modelName":5,"hardwareId":243,"hardwareName":33,"frameworkId":57,"frameworkName":58,"quantization":132,"hardwareVramGb":34,"decodeTps":254,"prefillTps":255,"vramGb":135,"genSeconds":10,"modelUseCase":8,"ttftS":256,"ttfbGb":257,"mtpAcceptanceRate":10,"powerW":258,"sampleCount":57,"reproduceCount":57,"sourceTypes":259,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":200,"latestOs":84,"latestCudaVersion":85,"latestFlashAttention":73,"latestOutputSpec":10},345.13,1779.25,0.42,2.76,480,[67],{"modelId":4,"modelName":5,"hardwareId":243,"hardwareName":33,"frameworkId":46,"frameworkName":162,"quantization":163,"hardwareVramGb":34,"decodeTps":261,"prefillTps":262,"vramGb":166,"genSeconds":10,"modelUseCase":8,"ttftS":147,"ttfbGb":263,"mtpAcceptanceRate":10,"powerW":264,"sampleCount":57,"reproduceCount":57,"sourceTypes":265,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":210,"latestOs":130,"latestCudaVersion":211,"latestFlashAttention":53,"latestOutputSpec":10},199.27,1057.11,1.59,424.1,[67],{"modelId":4,"modelName":5,"hardwareId":243,"hardwareName":33,"frameworkId":87,"frameworkName":88,"quantization":75,"hardwareVramGb":34,"decodeTps":267,"prefillTps":268,"vramGb":78,"genSeconds":10,"modelUseCase":8,"ttftS":178,"ttfbGb":269,"mtpAcceptanceRate":270,"powerW":271,"sampleCount":57,"reproduceCount":57,"sourceTypes":272,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":98,"latestOs":71,"latestCudaVersion":85,"latestFlashAttention":73,"latestOutputSpec":10},300.65,1243.6,2.41,0.4549,512.1,[67],{"modelId":4,"modelName":5,"hardwareId":243,"hardwareName":33,"frameworkId":87,"frameworkName":88,"quantization":202,"hardwareVramGb":34,"decodeTps":274,"prefillTps":275,"vramGb":205,"genSeconds":10,"modelUseCase":8,"ttftS":276,"ttfbGb":277,"mtpAcceptanceRate":278,"powerW":279,"sampleCount":57,"reproduceCount":57,"sourceTypes":280,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":281,"latestOs":130,"latestCudaVersion":85,"latestFlashAttention":73,"latestOutputSpec":10},280.21,1416.33,1.447,2.24,0.5249,482.2,[67],"v0.50",{"modelId":4,"modelName":5,"hardwareId":283,"hardwareName":41,"frameworkId":57,"frameworkName":58,"quantization":232,"hardwareVramGb":42,"decodeTps":284,"prefillTps":285,"vramGb":235,"genSeconds":10,"modelUseCase":8,"ttftS":286,"ttfbGb":287,"mtpAcceptanceRate":10,"powerW":288,"sampleCount":57,"reproduceCount":57,"sourceTypes":289,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":160,"latestOs":130,"latestCudaVersion":85,"latestFlashAttention":53,"latestOutputSpec":10},14,194.19,976.97,0.507,1.55,255.3,[67],{"modelId":4,"modelName":5,"hardwareId":283,"hardwareName":41,"frameworkId":57,"frameworkName":58,"quantization":222,"hardwareVramGb":42,"decodeTps":291,"prefillTps":292,"vramGb":225,"genSeconds":10,"modelUseCase":8,"ttftS":293,"ttfbGb":294,"mtpAcceptanceRate":10,"powerW":295,"sampleCount":57,"reproduceCount":57,"sourceTypes":296,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":297,"latestOs":71,"latestCudaVersion":85,"latestFlashAttention":73,"latestOutputSpec":10},121.42,409.38,1.9,0.97,290.2,[67],"v0.29",{"modelId":4,"modelName":5,"hardwareId":283,"hardwareName":41,"frameworkId":46,"frameworkName":162,"quantization":213,"hardwareVramGb":42,"decodeTps":299,"prefillTps":300,"vramGb":216,"genSeconds":10,"modelUseCase":8,"ttftS":301,"ttfbGb":263,"mtpAcceptanceRate":10,"powerW":302,"sampleCount":57,"reproduceCount":57,"sourceTypes":303,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":304,"latestOs":119,"latestCudaVersion":85,"latestFlashAttention":73,"latestOutputSpec":10},198.41,879.72,2.367,339.2,[67],"v0.47",{"modelId":4,"modelName":5,"hardwareId":283,"hardwareName":41,"frameworkId":46,"frameworkName":162,"quantization":222,"hardwareVramGb":42,"decodeTps":306,"prefillTps":307,"vramGb":225,"genSeconds":10,"modelUseCase":8,"ttftS":308,"ttfbGb":309,"mtpAcceptanceRate":10,"powerW":310,"sampleCount":57,"reproduceCount":57,"sourceTypes":311,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":160,"latestOs":119,"latestCudaVersion":85,"latestFlashAttention":73,"latestOutputSpec":10},116.38,555.86,1.626,0.93,308.2,[67],{"modelId":4,"modelName":5,"hardwareId":313,"hardwareName":48,"frameworkId":57,"frameworkName":58,"quantization":75,"hardwareVramGb":31,"decodeTps":314,"prefillTps":315,"vramGb":78,"genSeconds":10,"modelUseCase":8,"ttftS":316,"ttfbGb":317,"mtpAcceptanceRate":10,"powerW":318,"sampleCount":57,"reproduceCount":57,"sourceTypes":319,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":320,"latestOs":71,"latestCudaVersion":211,"latestFlashAttention":53,"latestOutputSpec":10},15,169.7,583.54,1.986,1.36,278.6,[67],"v0.54",{"modelId":4,"modelName":5,"hardwareId":313,"hardwareName":48,"frameworkId":109,"frameworkName":142,"quantization":110,"hardwareVramGb":31,"decodeTps":322,"prefillTps":323,"vramGb":113,"genSeconds":10,"modelUseCase":8,"ttftS":324,"ttfbGb":325,"mtpAcceptanceRate":10,"powerW":326,"sampleCount":57,"reproduceCount":57,"sourceTypes":327,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":281,"latestOs":71,"latestCudaVersion":85,"latestFlashAttention":73,"latestOutputSpec":10},134.55,711.57,1.692,1.08,170.5,[67],{"modelId":4,"modelName":5,"hardwareId":313,"hardwareName":48,"frameworkId":109,"frameworkName":142,"quantization":222,"hardwareVramGb":31,"decodeTps":329,"prefillTps":330,"vramGb":225,"genSeconds":10,"modelUseCase":8,"ttftS":331,"ttfbGb":332,"mtpAcceptanceRate":10,"powerW":333,"sampleCount":57,"reproduceCount":57,"sourceTypes":334,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":335,"latestOs":84,"latestCudaVersion":72,"latestFlashAttention":53,"latestOutputSpec":10},84.49,329.46,1.467,0.68,240.2,[67],"v0.42",{"modelId":4,"modelName":5,"hardwareId":337,"hardwareName":39,"frameworkId":109,"frameworkName":142,"quantization":59,"hardwareVramGb":31,"decodeTps":338,"prefillTps":339,"vramGb":62,"genSeconds":10,"modelUseCase":8,"ttftS":340,"ttfbGb":341,"mtpAcceptanceRate":10,"powerW":342,"sampleCount":57,"reproduceCount":57,"sourceTypes":343,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":230,"latestOs":119,"latestCudaVersion":85,"latestFlashAttention":73,"latestOutputSpec":10},18,185.93,658.25,0.296,1.49,150.4,[67],{"modelId":4,"modelName":5,"hardwareId":337,"hardwareName":39,"frameworkId":46,"frameworkName":162,"quantization":110,"hardwareVramGb":31,"decodeTps":345,"prefillTps":346,"vramGb":113,"genSeconds":10,"modelUseCase":8,"ttftS":347,"ttfbGb":348,"mtpAcceptanceRate":10,"powerW":349,"sampleCount":57,"reproduceCount":57,"sourceTypes":350,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":351,"latestOs":71,"latestCudaVersion":85,"latestFlashAttention":53,"latestOutputSpec":10},127.9,682.85,1.18,1.02,197.5,[67],"v0.34",{"modelId":4,"modelName":5,"hardwareId":337,"hardwareName":39,"frameworkId":46,"frameworkName":162,"quantization":244,"hardwareVramGb":31,"decodeTps":353,"prefillTps":354,"vramGb":247,"genSeconds":10,"modelUseCase":8,"ttftS":355,"ttfbGb":356,"mtpAcceptanceRate":10,"powerW":357,"sampleCount":57,"reproduceCount":57,"sourceTypes":358,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":181,"latestOs":119,"latestCudaVersion":85,"latestFlashAttention":73,"latestOutputSpec":10},93.03,365.14,0.835,0.74,250,[67],{"modelId":4,"modelName":5,"hardwareId":337,"hardwareName":39,"frameworkId":87,"frameworkName":88,"quantization":110,"hardwareVramGb":31,"decodeTps":360,"prefillTps":361,"vramGb":113,"genSeconds":10,"modelUseCase":8,"ttftS":362,"ttfbGb":363,"mtpAcceptanceRate":364,"powerW":365,"sampleCount":57,"reproduceCount":57,"sourceTypes":366,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":281,"latestOs":119,"latestCudaVersion":72,"latestFlashAttention":73,"latestOutputSpec":10},187.58,667.52,0.699,1.5,0.502,255.6,[67],{"modelId":4,"modelName":5,"hardwareId":368,"hardwareName":44,"frameworkId":109,"frameworkName":142,"quantization":369,"hardwareVramGb":45,"decodeTps":370,"prefillTps":371,"vramGb":372,"genSeconds":10,"modelUseCase":8,"ttftS":373,"ttfbGb":374,"mtpAcceptanceRate":10,"powerW":375,"sampleCount":57,"reproduceCount":57,"sourceTypes":376,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":320,"latestOs":130,"latestCudaVersion":152,"latestFlashAttention":73,"latestOutputSpec":10},26,"IQ3_S",318.24,1490.26,4.45,0.117,2.55,59.2,[67],{"modelId":4,"modelName":5,"hardwareId":368,"hardwareName":44,"frameworkId":109,"frameworkName":142,"quantization":121,"hardwareVramGb":45,"decodeTps":378,"prefillTps":379,"vramGb":124,"genSeconds":10,"modelUseCase":8,"ttftS":380,"ttfbGb":381,"mtpAcceptanceRate":10,"powerW":382,"sampleCount":57,"reproduceCount":57,"sourceTypes":383,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":384,"latestOs":130,"latestCudaVersion":152,"latestFlashAttention":73,"latestOutputSpec":10},322.68,1251.16,0.843,2.58,40.4,[67],"v0.44",{"modelId":4,"modelName":5,"hardwareId":368,"hardwareName":44,"frameworkId":87,"frameworkName":88,"quantization":143,"hardwareVramGb":45,"decodeTps":386,"prefillTps":387,"vramGb":146,"genSeconds":10,"modelUseCase":8,"ttftS":388,"ttfbGb":389,"mtpAcceptanceRate":390,"powerW":391,"sampleCount":57,"reproduceCount":57,"sourceTypes":392,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":160,"latestOs":130,"latestCudaVersion":152,"latestFlashAttention":73,"latestOutputSpec":10},304.05,1416.13,2.399,2.43,0.5605,62.8,[67],{"modelId":4,"modelName":5,"hardwareId":394,"hardwareName":30,"frameworkId":57,"frameworkName":58,"quantization":143,"hardwareVramGb":31,"decodeTps":395,"prefillTps":396,"vramGb":146,"genSeconds":10,"modelUseCase":8,"ttftS":397,"ttfbGb":398,"mtpAcceptanceRate":10,"powerW":399,"sampleCount":57,"reproduceCount":57,"sourceTypes":400,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":70,"latestOs":84,"latestCudaVersion":72,"latestFlashAttention":73,"latestOutputSpec":10},94,140.48,573.63,1.321,1.12,276.1,[67],{"modelId":4,"modelName":5,"hardwareId":394,"hardwareName":30,"frameworkId":57,"frameworkName":58,"quantization":132,"hardwareVramGb":31,"decodeTps":402,"prefillTps":403,"vramGb":135,"genSeconds":10,"modelUseCase":8,"ttftS":404,"ttfbGb":405,"mtpAcceptanceRate":10,"powerW":406,"sampleCount":57,"reproduceCount":57,"sourceTypes":407,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":70,"latestOs":84,"latestCudaVersion":72,"latestFlashAttention":53,"latestOutputSpec":10},72.12,270.78,1.433,0.58,192.7,[67],{"modelId":4,"modelName":5,"hardwareId":394,"hardwareName":30,"frameworkId":109,"frameworkName":142,"quantization":369,"hardwareVramGb":31,"decodeTps":409,"prefillTps":410,"vramGb":372,"genSeconds":10,"modelUseCase":8,"ttftS":411,"ttfbGb":412,"mtpAcceptanceRate":10,"powerW":413,"sampleCount":57,"reproduceCount":57,"sourceTypes":414,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":181,"latestOs":84,"latestCudaVersion":72,"latestFlashAttention":73,"latestOutputSpec":10},115.58,443.88,2.429,0.92,202.1,[67],{"modelId":4,"modelName":5,"hardwareId":394,"hardwareName":30,"frameworkId":109,"frameworkName":142,"quantization":213,"hardwareVramGb":31,"decodeTps":416,"prefillTps":417,"vramGb":216,"genSeconds":10,"modelUseCase":8,"ttftS":418,"ttfbGb":419,"mtpAcceptanceRate":10,"powerW":420,"sampleCount":57,"reproduceCount":57,"sourceTypes":421,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":118,"latestOs":84,"latestCudaVersion":72,"latestFlashAttention":53,"latestOutputSpec":10},109.13,478.21,0.474,0.87,199.1,[67],{"modelId":4,"modelName":5,"hardwareId":394,"hardwareName":30,"frameworkId":87,"frameworkName":88,"quantization":369,"hardwareVramGb":31,"decodeTps":423,"prefillTps":424,"vramGb":372,"genSeconds":10,"modelUseCase":8,"ttftS":425,"ttfbGb":426,"mtpAcceptanceRate":427,"powerW":428,"sampleCount":57,"reproduceCount":57,"sourceTypes":429,"evidenceLevel":68,"updatedAt":69,"latestFrameworkVersion":430,"latestOs":84,"latestCudaVersion":72,"latestFlashAttention":73,"latestOutputSpec":10},143.13,545.08,1.886,1.15,0.5125,250.6,[67],"v0.55",50,{"items":433,"total":14,"page":57,"pageSize":434},[],20,{"items":436,"total":14,"page":57,"pageSize":46},[],{"items":438},[]]