FaceMin
whisper-kss-model
Dedicated Endpoints
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Container
Run this model inference with full control and performance in your environment.
Get help setting up a custom Dedicated Endpoints.
Talk with our engineer to get a quote for reserved GPU instances with discounts.
README
License: apache-2.0Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 1e-05
- train_batch_size: 32
- eval_batch_size: 16
- seed: 42
- optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 500
- training_steps: 5000
- mixed_precision_training: Native AMP
Training results
| Training Loss | Epoch | Step | Validation Loss | Wer |
|---|---|---|---|---|
| 8.8449 | 0.0346 | 25 | 7.2246 | 100.6831 |
| 5.79 | 0.0692 | 50 | 4.9938 | 100.6516 |
| 4.1409 | 0.1037 | 75 | 3.0934 | 170.1858 |
| 2.7161 | 0.1383 | 100 | 2.6763 | 100.0528 |
| 2.7033 | 0.1729 | 125 | 2.5222 | 101.9024 |
| 2.5808 | 0.2075 | 150 | 2.4298 | 118.5847 |
| 2.3761 | 0.2420 | 175 | 2.3257 | 140.0440 |
| 2.3161 | 0.2766 | 200 | 2.2273 | 91.3945 |
| 2.1491 | 0.3112 | 225 | 2.2243 | 79.8649 |
| 2.0948 | 0.3458 | 250 | 2.0493 | 440.3429 |
| 1.7144 | 0.3804 | 275 | 1.2596 | 206.7145 |
| 1.1149 | 0.4149 | 300 | 1.1042 | 216.9204 |
| 1.0789 | 0.4495 | 325 | 1.0707 | 351.0901 |
| 1.0254 | 0.4841 | 350 | 1.0166 | 236.3858 |
| 1.08 | 0.5187 | 375 | 0.9928 | 191.0787 |
| 1.0116 | 0.5533 | 400 | 0.9832 | 166.7260 |
| 1.0105 | 0.5878 | 425 | 0.9782 | 165.3540 |
| 0.9122 | 0.6224 | 450 | 0.9595 | 117.0455 |
| 0.9577 | 0.6570 | 475 | 0.9387 | 118.7912 |
| 0.9331 | 0.6916 | 500 | 0.9090 | 138.5781 |
| 0.8757 | 0.7261 | 525 | 0.9211 | 137.1420 |
| 0.8926 | 0.7607 | 550 | 0.8667 | 184.8980 |
| 0.912 | 0.7953 | 575 | 0.8793 | 212.2682 |
| 0.8691 | 0.8299 | 600 | 0.8762 | 166.9460 |
| 0.8263 | 0.8645 | 625 | 0.8687 | 154.8995 |
| 0.7806 | 0.8990 | 650 | 0.8227 | 156.4442 |
| 0.7645 | 0.9336 | 675 | 0.8382 | 216.6598 |
| 0.7975 | 0.9682 | 700 | 0.7901 | 165.6084 |
| 0.7934 | 1.0028 | 725 | 0.7438 | 120.6291 |
| 0.769 | 1.0373 | 750 | 0.7438 | 218.1116 |
| 0.7992 | 1.0719 | 775 | 0.7885 | 259.8376 |
| 0.7745 | 1.1065 | 800 | 0.7686 | 179.9579 |
| 0.7349 | 1.1411 | 825 | 0.7466 | 162.1403 |
| 0.725 | 1.1757 | 850 | 0.7193 | 218.4822 |
| 0.7556 | 1.2102 | 875 | 0.7174 | 209.3269 |
| 0.7395 | 1.2448 | 900 | 0.7290 | 291.2190 |
| 0.6818 | 1.2794 | 925 | 0.6959 | 212.7851 |
| 0.7325 | 1.3140 | 950 | 0.6805 | 186.9867 |
| 0.7034 | 1.3485 | 975 | 0.6926 | 215.1493 |
| 0.7254 | 1.3831 | 1000 | 0.6952 | 195.1569 |
| 0.6574 | 1.4177 | 1025 | 0.6794 | 190.6886 |
| 0.6728 | 1.4523 | 1050 | 0.6707 | 201.2204 |
| 0.7047 | 1.4869 | 1075 | 0.6808 | 212.6877 |
| 0.6262 | 1.5214 | 1100 | 0.6513 | 265.1156 |
| 0.6588 | 1.5560 | 1125 | 0.6495 | 451.8608 |
| 0.6521 | 1.5906 | 1150 | 0.6237 | 353.7313 |
| 0.6245 | 1.6252 | 1175 | 0.6181 | 292.6338 |
| 0.5529 | 1.6598 | 1200 | 0.5895 | 221.0098 |
| 0.5895 | 1.6943 | 1225 | 0.5896 | 176.8251 |
| 0.6088 | 1.7289 | 1250 | 0.5862 | 124.4094 |
| 0.6104 | 1.7635 | 1275 | 0.6013 | 149.8396 |
| 0.5598 | 1.7981 | 1300 | 0.5346 | 107.1293 |
| 0.5695 | 1.8326 | 1325 | 0.5958 | 145.3336 |
| 0.5829 | 1.8672 | 1350 | 0.5294 | 141.4980 |
| 0.5203 | 1.9018 | 1375 | 0.5402 | 235.1803 |
| 0.5206 | 1.9364 | 1400 | 0.5394 | 230.0891 |
| 0.5448 | 1.9710 | 1425 | 0.5440 | 214.9932 |
| 0.5179 | 2.0055 | 1450 | 0.5342 | 255.9379 |
| 0.4953 | 2.0401 | 1475 | 0.5169 | 231.7033 |
| 0.52 | 2.0747 | 1500 | 0.4929 | 334.5504 |
| 0.4923 | 2.1093 | 1525 | 0.4894 | 215.9817 |
| 0.478 | 2.1438 | 1550 | 0.5068 | 299.2691 |
| 0.4952 | 2.1784 | 1575 | 0.4833 | 324.2779 |
| 0.4806 | 2.2130 | 1600 | 0.4889 | 241.6753 |
| 0.4909 | 2.2476 | 1625 | 0.4777 | 264.4795 |
| 0.4802 | 2.2822 | 1650 | 0.4487 | 199.4435 |
| 0.4301 | 2.3167 | 1675 | 0.4488 | 182.4179 |
| 0.4698 | 2.3513 | 1700 | 0.4612 | 262.3237 |
| 0.4752 | 2.3859 | 1725 | 0.4646 | 372.9149 |
| 0.4378 | 2.4205 | 1750 | 0.4663 | 237.8527 |
| 0.4473 | 2.4550 | 1775 | 0.4687 | 282.1577 |
| 0.4632 | 2.4896 | 1800 | 0.4266 | 283.8381 |
| 0.4035 | 2.5242 | 1825 | 0.4152 | 270.4255 |
| 0.4473 | 2.5588 | 1850 | 0.4201 | 315.6571 |
| 0.4171 | 2.5934 | 1875 | 0.4169 | 379.2287 |
| 0.3921 | 2.6279 | 1900 | 0.4186 | 399.1616 |
| 0.4403 | 2.6625 | 1925 | 0.4181 | 335.2756 |
| 0.4049 | 2.6971 | 1950 | 0.4180 | 279.9728 |
| 0.427 | 2.7317 | 1975 | 0.4203 | 241.3959 |
| 0.4468 | 2.7663 | 2000 | 0.4185 | 275.8122 |
| 0.3864 | 2.8008 | 2025 | 0.4206 | 333.1377 |
| 0.4217 | 2.8354 | 2050 | 0.4207 | 272.2071 |
| 0.4554 | 2.8700 | 2075 | 0.4220 | 362.6389 |
| 0.3856 | 2.9046 | 2100 | 0.3459 | 366.1595 |
| 0.3112 | 2.9391 | 2125 | 0.3450 | 381.3861 |
| 0.3979 | 2.9737 | 2150 | 0.3453 | 476.1855 |
| 0.3476 | 3.0083 | 2175 | 0.3465 | 361.8760 |
| 0.3003 | 3.0429 | 2200 | 0.3488 | 399.7811 |
| 0.353 | 3.0775 | 2225 | 0.3473 | 583.0224 |
| 0.3301 | 3.1120 | 2250 | 0.3489 | 623.8666 |
| 0.3181 | 3.1466 | 2275 | 0.3495 | 496.9255 |
| 0.3523 | 3.1812 | 2300 | 0.3513 | 434.4554 |
| 0.3577 | 3.2158 | 2325 | 0.3515 | 267.3580 |
| 0.3376 | 3.2503 | 2350 | 0.3539 | 208.7754 |
| 0.3604 | 3.2849 | 2375 | 0.3508 | 284.9401 |
| 0.3192 | 3.3195 | 2400 | 0.3529 | 345.7634 |
| 0.3315 | 3.3541 | 2425 | 0.3508 | 320.4169 |
| 0.3352 | 3.3887 | 2450 | 0.3510 | 353.3194 |
| 0.2677 | 3.4232 | 2475 | 0.2803 | 288.2148 |
| 0.2644 | 3.4578 | 2500 | 0.2801 | 308.2338 |
| 0.275 | 3.4924 | 2525 | 0.2818 | 381.4079 |
| 0.2723 | 3.5270 | 2550 | 0.2835 | 352.1826 |
| 0.2781 | 3.5615 | 2575 | 0.2836 | 276.9052 |
| 0.2649 | 3.5961 | 2600 | 0.2854 | 303.5409 |
| 0.2916 | 3.6307 | 2625 | 0.2862 | 320.8857 |
| 0.3021 | 3.6653 | 2650 | 0.2873 | 272.8570 |
| 0.302 | 3.6999 | 2675 | 0.2864 | 405.3588 |
| 0.2791 | 3.7344 | 2700 | 0.2866 | 360.0782 |
| 0.2682 | 3.7690 | 2725 | 0.2870 | 266.1347 |
| 0.2831 | 3.8036 | 2750 | 0.2894 | 342.1414 |
| 0.2895 | 3.8382 | 2775 | 0.2901 | 354.2226 |
| 0.3137 | 3.8728 | 2800 | 0.2916 | 334.0133 |
| 0.272 | 3.9073 | 2825 | 0.2903 | 327.9886 |
| 0.2892 | 3.9419 | 2850 | 0.2898 | 285.9423 |
| 0.3156 | 3.9765 | 2875 | 0.2898 | 256.1146 |
| 0.2492 | 4.0111 | 2900 | 0.2870 | 247.8596 |
| 0.1842 | 4.0456 | 2925 | 0.2905 | 267.4770 |
| 0.1908 | 4.0802 | 2950 | 0.2905 | 280.4566 |
| 0.2035 | 4.1148 | 2975 | 0.2927 | 283.1202 |
| 0.2072 | 4.1494 | 3000 | 0.1993 | 302.1461 |
| 0.1645 | 4.1840 | 3025 | 0.2001 | 443.5101 |
| 0.2144 | 4.2185 | 3050 | 0.2008 | 522.6579 |
| 0.2168 | 4.2531 | 3075 | 0.2025 | 454.2819 |
| 0.2059 | 4.2877 | 3100 | 0.2025 | 438.9496 |
| 0.209 | 4.3223 | 3125 | 0.2036 | 402.1667 |
| 0.2054 | 4.3568 | 3150 | 0.2030 | 482.2121 |
| 0.2537 | 4.3914 | 3175 | 0.2037 | 564.0528 |
| 0.1953 | 4.4260 | 3200 | 0.2024 | 386.3496 |
| 0.2412 | 4.4606 | 3225 | 0.2047 | 416.8283 |
| 0.2183 | 4.4952 | 3250 | 0.2046 | 360.2043 |
| 0.2357 | 4.5297 | 3275 | 0.2044 | 374.4222 |
| 0.195 | 4.5643 | 3300 | 0.2043 | 464.0528 |
| 0.2029 | 4.5989 | 3325 | 0.2042 | 375.7738 |
| 0.184 | 4.6335 | 3350 | 0.2043 | 326.0008 |
| 0.1938 | 4.6680 | 3375 | 0.2041 | 373.6381 |
| 0.197 | 4.7026 | 3400 | 0.2032 | 391.5910 |
| 0.1906 | 4.7372 | 3425 | 0.2050 | 494.8205 |
| 0.2236 | 4.7718 | 3450 | 0.2047 | 535.1733 |
| 0.2054 | 4.8064 | 3475 | 0.2048 | 460.1114 |
| 0.156 | 4.8409 | 3500 | 0.1438 | 402.3349 |
| 0.1438 | 4.8755 | 3525 | 0.1477 | 394.8726 |
| 0.1294 | 4.9101 | 3550 | 0.1389 | 351.3879 |
| 0.1408 | 4.9447 | 3575 | 0.1354 | 367.8489 |
| 0.141 | 4.9793 | 3600 | 0.1345 | 469.6171 |
| 0.1471 | 5.0138 | 3625 | 0.1347 | 465.4007 |
| 0.1344 | 5.0484 | 3650 | 0.1346 | 465.6937 |
| 0.1436 | 5.0830 | 3675 | 0.1345 | 549.9895 |
| 0.1404 | 5.1176 | 3700 | 0.1346 | 553.1492 |
| 0.1424 | 5.1521 | 3725 | 0.1348 | 491.0546 |
| 0.1581 | 5.1867 | 3750 | 0.1353 | 511.9900 |
| 0.1484 | 5.2213 | 3775 | 0.1351 | 429.5145 |
| 0.1642 | 5.2559 | 3800 | 0.1358 | 460.6926 |
| 0.1313 | 5.2905 | 3825 | 0.1358 | 510.2741 |
| 0.1238 | 5.3250 | 3850 | 0.1360 | 491.1906 |
| 0.1437 | 5.3596 | 3875 | 0.1363 | 452.1762 |
| 0.1375 | 5.3942 | 3900 | 0.1371 | 439.6003 |
| 0.1514 | 5.4288 | 3925 | 0.1365 | 433.0299 |
| 0.1243 | 5.4633 | 3950 | 0.1370 | 397.3949 |
| 0.1465 | 5.4979 | 3975 | 0.1364 | 452.3959 |
| 0.1427 | 5.5325 | 4000 | 0.1363 | 520.0983 |
| 0.1373 | 5.5671 | 4025 | 0.1365 | 602.1553 |
| 0.1541 | 5.6017 | 4050 | 0.1368 | 602.0611 |
| 0.1027 | 5.6362 | 4075 | 0.1205 | 571.3285 |
| 0.0924 | 5.6708 | 4100 | 0.1206 | 597.3635 |
| 0.1167 | 5.7054 | 4125 | 0.1210 | 631.2152 |
| 0.1139 | 5.7400 | 4150 | 0.1207 | 663.5221 |
| 0.1038 | 5.7746 | 4175 | 0.1206 | 612.3378 |
| 0.1056 | 5.8091 | 4200 | 0.1209 | 660.6076 |
| 0.1029 | 5.8437 | 4225 | 0.1207 | 622.7394 |
| 0.1157 | 5.8783 | 4250 | 0.1208 | 633.6045 |
| 0.1095 | 5.9129 | 4275 | 0.1212 | 599.1143 |
| 0.1024 | 5.9474 | 4300 | 0.1211 | 589.3203 |
| 0.101 | 5.9820 | 4325 | 0.1212 | 560.9578 |
| 0.0807 | 6.0166 | 4350 | 0.1213 | 562.8218 |
| 0.0958 | 6.0512 | 4375 | 0.1213 | 579.9176 |
| 0.1002 | 6.0858 | 4400 | 0.1212 | 634.5932 |
| 0.1144 | 6.1203 | 4425 | 0.1212 | 635.9835 |
| 0.0954 | 6.1549 | 4450 | 0.1210 | 633.5839 |
| 0.0831 | 6.1895 | 4475 | 0.1214 | 578.2492 |
| 0.0835 | 6.2241 | 4500 | 0.1214 | 604.1504 |
| 0.1079 | 6.2586 | 4525 | 0.1213 | 629.2688 |
| 0.0963 | 6.2932 | 4550 | 0.1214 | 615.5510 |
| 0.0902 | 6.3278 | 4575 | 0.1214 | 603.1823 |
| 0.0884 | 6.3624 | 4600 | 0.0835 | 600.7927 |
| 0.0775 | 6.3970 | 4625 | 0.0838 | 601.6594 |
| 0.0856 | 6.4315 | 4650 | 0.0840 | 585.1707 |
| 0.0941 | 6.4661 | 4675 | 0.0840 | 586.3968 |
| 0.0893 | 6.5007 | 4700 | 0.0839 | 610.2315 |
| 0.0861 | 6.5353 | 4725 | 0.0838 | 593.9224 |
| 0.0828 | 6.5698 | 4750 | 0.0838 | 590.7726 |
| 0.0957 | 6.6044 | 4775 | 0.0838 | 540.1015 |
| 0.091 | 6.6390 | 4800 | 0.0837 | 529.6480 |
| 0.0934 | 6.6736 | 4825 | 0.0837 | 552.8063 |
| 0.0878 | 6.7082 | 4850 | 0.0837 | 585.4244 |
| 0.0841 | 6.7427 | 4875 | 0.0837 | 608.0013 |
| 0.1034 | 6.7773 | 4900 | 0.0837 | 603.1603 |
| 0.0918 | 6.8119 | 4925 | 0.0837 | 621.2134 |
| 0.0836 | 6.8465 | 4950 | 0.0837 | 620.0507 |
| 0.0826 | 6.8811 | 4975 | 0.0836 | 615.6115 |
| 0.0828 | 6.9156 | 5000 | 0.0836 | 612.9690 |
Framework versions
- Transformers 4.57.1
- Pytorch 2.8.0+cu126
- Datasets 4.4.2
- Tokenizers 0.22.1
Model provider
FaceMin
Model tree
Base
openai/whisper-small
Fine-tuned
this model
Modalities
Input
Audio
Output
Text
Pricing
Dedicated Endpoints
View detailsSupported Functionality
Model APIs
Dedicated Endpoints
Container
More information