Improving mor1kx Performance Overview

Improving mor1kx performance Alexey Baturo Andrey Voroshilov

What is mor1kx? New implementation of OpenRISC system architecture Great flexibility Has 4 different pipelines in it: o Espresso o Pronto Espresso o Cappuccino o Marocchino 2

Cappuccino Pipeline 6 stage pipeline Address Fetch Decode Writeback Control/Memory Execute o Single issue o Has a delay slot o Debug unit o Timers o PIC o I-cache and D-cache o MMU o ORBIS32/64, ORFPX32 support 3

What do we want? Improve the knowledge of computer architecture Get familiar with mor1kx internals Improve mor1kx cappuccino performance Contribute to the community 4

Branch Predictors Branch predictor is isolated from the pipeline Cappuccino implements static branch predictor 6 stage pipeline has low penalty for branch misprediction 5

mor1kx: getting prediction rate Speed VCD Trace Dump $display() Icarus Slow Verilator Faster FPGA Fastest Run simulator with saving trace dump Print something if mispredict Calculate hit rate 6

Performance Counter Unit 12 architecture defined performance counters o Load Access event o Store Access event o Instruction Fetch event o Data Cache Miss event o Instruction Cache Miss event o Instruction Fetch Stall event o LSU Stall event o Branch Stalls event o DTLB Miss event o ITLB Miss event o Data Dependency Stalls event o Watch Point event Up to 8 custom performance counters Programmable counting conditions 7

PCU: pros and cons Pro o Allows to get data from FPGA Contra o Not clear event description o Not enough different events o Not enough counters o Still slow using simulators 8

C++ Framework Operates on extracted branch instructions o Branch address o Branch jump offset (for static predictor evaluation) o Ground truth branch outcome Or branch instruction generator, but it is not yet tweaked/well-balanced Quickly prototype/test different branch prediction schemes Help validate RTL implementation 9

Branch Predictor Structure Branch Prediction Unit o Static o Saturating counter o Perceptron o FC Neural network Branch Prediction Addressing o Direct o Bimodal (bucketing) o Local o GShare o Etc. Combined, Combining Branch Predictors , Scott McFarling 10

Perceptron Prediction Overview Dynamic Branch Prediction with Perceptrons , Daniel Jim nez, Calvin Lin Weighted sum of all the input + bias Input history, -1 not taken / 1 taken ; output is similar Update weights after each misprediction Integer math, simplifies HW implementation o Increment weight when branch outcome matches corresponding input o Decrement otherwise o Feed-forward is just a sum, no multiplication needed May overflow (but possible to fix with shift) 11

Perceptrons in Branch Prediction Perceptrons in the referenced paper are accessed using bimodal addressing scheme Use global (shared) history as inputs Using Bimodal addressing for smaller predictors, and GShare addressing for larger ones 12

Fully Connected Neural Networks Perceptron is just a very special case of neural network o 1 neuron o Linear output FC NN - greater complexity o Hidden layer(s) of neurons, and weighted sum of inputs is transformed using non-linear activation function in each neuron o Every input connected to each neuron in the next layer (M*N) Result is tiny bit better than perceptron in our tests (using direct mapping) Huge design space o Activation functions o Optimization algorithm (and hyperparameters) o Number of neurons 13

FC NN Testing Results In our tests o Direct addressing only slightly better than perceptron o GShare addressing still insignificantly better than perceptron o Even with higher memory usage We didn t explore design space well enough o Activation fns: logistic sigmoid and tanh o Gradient Descent optimization o Fixed step size (although we tried different numbers) 14

FC NN HW Implementation Has significantly higher complexity (in SW framework this creates difficulties for exploring design space) Branch Prediction with Neural Networks: Hidden layers and Recurrent Connections , Andrew Smith o Used fixed-point maths o Activation fns LookUp Table o Be careful with gradient derivation formulas better derive manually o Still significantly higher HW complexity than perceptrons 15

Results (CoreMark) Prediction Accuracy % GShare_Satur GShareSh_Perc BimodalSh_Perc GShareLoc_Perc 100 95 90 85 80 75 memory in bits 70 16

Results (Dhrystone) Prediction Accuracy % GShare_Satur GShareSh_Perc BimodalSh_Perc GShareLoc_Perc 100 95 90 85 80 75 memory in bits 70 17

Conclusions In our case, we consider using predictors: o GShare Saturated (< 0.2 KB) o Bimodal Perceptron w/ shared history (< 10 KB) o GShare Perceptron w/ shared history (> 10 KB) At the moment, using FC NNs doesn t seem to be justified Combining branch predictors majority of time yields best of two worlds 18

Future Work I (Hash) Direct/Knuth (93.35%) Jenkins Mix (93.7%) direct Knuth mix 2500000 2500000 2000000 2000000 1500000 1500000 1000000 1000000 500000 500000 0 0 19

Future Work II Gather branch statistics from existing traces and try to tweak instruction generator potentially could help exploring design space Consider neural networks or perceptrons for other stages in the pipeline (e.g. cache eviction policy) Further explore Branch Prediction design space, different BPUs / addressing modes / parameters / combined, plus a neural network BPU design space Try out different neural network topologies, like RNN (A. Smith proposed simplistic RNN network) (or LSTM/GRU), and Reinforced Learning 20

Future Work III Implement support for trace dump for verilated simulations Implement support for stdout for verilated simulations Implement system register that contains ticks happened after start 21

References Combining Branch Predictors , Scott McFarling Branch Prediction Techniques and Optimizations , Raj Parihar Dynamic Branch Prediction with Perceptrons , Daniel Jimenez, Calvin Lin Branch Prediction with Neural Networks: Hidden layers and Recurrent Connections , Andrew Smith 22

What do we contribute PCU implementation Saturating counter predictor implementation GShare predictor implementation Software framework for branch prediction evaluation 23

Thanks for your attention Questions 24

Bonus slides 25

CoreMark GShare-Perc: hitrate vs size 2 4 6 8 10 12 14 16 18 20 2 4 6 8 10 12 14 16 18 20 2 73,54 78,69 81,26 84,64 88,01 89,45 90,45 92,12 92,81 93,3 2 88 342 1352 5386 21516 86030 344080 1376274 5505044 22020118 4 78,01 82 83,87 85,51 88,73 89,92 90,68 92,24 92,88 93,36 4 146 568 2250 8972 35854 143376 573458 2293780 9175062 36700184 6 78,9 82,61 84,45 85,94 88,98 90,05 90,72 92,26 92,89 93,37 6 204 794 3148 12558 50192 200722 802836 3211286 12845080 51380250 8 79,72 83,48 85,49 86,21 89,03 90,06 90,73 92,26 92,9 93,37 8 262 1020 4046 16144 64530 258068 1032214 4128792 16515098 66060316 10 81,8 85,78 88,05 88,93 89,04 90,06 90,73 92,26 92,89 93,36 10 320 1246 4944 19730 78868 315414 1261592 5046298 20185116 80740382 12 81,87 86,64 88,83 89,72 90,07 90,06 90,73 92,26 92,89 93,37 12 378 1472 5842 23316 93206 372760 1490970 5963804 23855134 95420448 14 82,11 86,71 89,03 89,93 90,38 90,66 90,73 92,26 92,89 93,37 14 436 1698 6740 26902 107544 430106 1720348 6881310 27525152 110100514 16 82,64 86,9 89,37 90,44 91,05 91,6 92,22 92,26 92,89 93,36 16 494 1924 7638 30488 121882 487452 1949726 7798816 31195170 124780580 18 82,69 86,96 89,45 90,67 91,39 91,99 92,67 92,85 92,89 93,36 18 552 2150 8536 34074 136220 544798 2179104 8716322 34865188 139460646 20 82,71 87,07 89,67 90,98 91,74 92,39 93,1 93,28 93,38 93,36 20 610 2376 9434 37660 150558 602144 2408482 9633828 38535206 154140712 22 83 87,05 89,81 91,21 92,02 92,71 93,41 93,6 93,62 93,61 22 668 2602 10332 41246 164896 659490 2637860 10551334 42205224 168820778 24 83,2 87,16 90,13 91,63 92,53 93,25 93,94 94,11 94,15 94,14 24 726 2828 11230 44832 179234 716836 2867238 11468840 45875242 183500844 26 83,28 87,27 90,37 91,9 92,87 93,61 94,28 94,45 94,49 94,48 26 784 3054 12128 48418 193572 774182 3096616 12386346 49545260 198180910 28 83,15 87,31 90,47 92 93 93,72 94,37 94,53 94,57 94,57 28 842 3280 13026 52004 207910 831528 3325994 13303852 53215278 212860976 30 83,48 87,85 91,12 92,77 93,76 94,49 95,1 95,22 95,3 95,31 30 900 3506 13924 55590 222248 888874 3555372 14221358 56885296 227541042 32 83,45 88,02 91,3 93,05 94,11 94,77 95,29 95,5 95,54 95,56 32 958 3732 14822 59176 236586 946220 3784750 15138864 60555314 242221108 34 83,43 88,04 91,44 93,16 94,2 94,83 95,38 95,54 95,63 95,64 34 1016 3958 15720 62762 250924 1003566 4014128 16056370 64225332 256901174 36 83,4 88,15 91,62 93,37 94,39 95 95,53 95,69 95,78 95,79 36 1074 4184 16618 66348 265262 1060912 4243506 16973876 67895350 271581240 38 83,43 88,15 91,65 93,43 94,44 95,03 95,55 95,71 95,79 95,8 38 1132 4410 17516 69934 279600 1118258 4472884 17891382 71565368 286261306 40 83,37 88,2 91,74 93,51 94,52 95,1 95,6 95,77 95,85 95,86 40 1190 4636 18414 73520 293938 1175604 4702262 18808888 75235386 300941372 42 83,42 88,31 91,78 93,57 94,56 95,12 95,61 95,79 95,86 95,88 42 1248 4862 19312 77106 308276 1232950 4931640 19726394 78905404 315621438 44 83,36 88,34 91,83 93,61 94,6 95,14 95,63 95,8 95,87 95,88 44 1306 5088 20210 80692 322614 1290296 5161018 20643900 82575422 330301504 46 83,25 88,36 91,95 93,85 94,82 95,35 95,83 95,99 96,06 96,07 46 1364 5314 21108 84278 336952 1347642 5390396 21561406 86245440 344981570 48 83,21 88,35 92,07 93,88 94,85 95,37 95,84 96,01 96,07 96,08 48 1422 5540 22006 87864 351290 1404988 5619774 22478912 89915458 359661636 50 83,09 88,35 92,1 93,92 94,88 95,39 95,86 96,02 96,09 96,08 50 1480 5766 22904 91450 365628 1462334 5849152 23396418 93585476 374341702 52 82,98 88,43 92,21 94,04 95 95,5 95,96 96,13 96,19 96,19 52 1538 5992 23802 95036 379966 1519680 6078530 24313924 97255494 389021768 54 82,9 88,43 92,26 94,15 95,09 95,59 96,04 96,22 96,29 96,28 54 1596 6218 24700 98622 394304 1577026 6307908 25231430 100925512 403701834 56 82,84 88,49 92,41 94,32 95,26 95,74 96,19 96,37 96,44 96,44 56 1654 6444 25598 102208 408642 1634372 6537286 26148936 104595530 418381900 58 82,94 88,72 92,67 94,6 95,54 96,02 96,46 96,65 96,72 96,71 58 1712 6670 26496 105794 422980 1691718 6766664 27066442 108265548 433061966 60 83,28 89,06 92,97 94,91 95,85 96,32 96,77 96,96 97,03 97,03 60 1770 6896 27394 109380 437318 1749064 6996042 27983948 111935566 447742032 62 83,2 89,06 93,05 94,99 95,93 96,38 96,83 97,01 97,09 97,09 62 1828 7122 28292 112966 451656 1806410 7225420 28901454 115605584 462422098 64 83,12 89,08 93,07 95,02 95,94 96,39 96,83 97,02 97,1 97,1 64 1886 7348 29190 116552 465994 1863756 7454798 29818960 119275602 477102164 66 83,19 89,09 93,16 95,12 96,04 96,47 96,91 97,1 97,18 97,18 66 1944 7574 30088 120138 480332 1921102 7684176 30736466 122945620 491782230 68 83,16 89,15 93,2 95,15 96,06 96,48 96,91 97,11 97,19 97,18 68 2002 7800 30986 123724 494670 1978448 7913554 31653972 126615638 506462296 70 83,2 89,14 93,31 95,27 96,19 96,6 97,03 97,23 97,31 97,31 70 2060 8026 31884 127310 509008 2035794 8142932 32571478 130285656 521142362 72 83,24 89,21 93,34 95,29 96,2 96,61 97,04 97,24 97,31 97,32 72 2118 8252 32782 130896 523346 2093140 8372310 33488984 133955674 535822428 74 83,17 89,23 93,38 95,32 96,21 96,62 97,04 97,24 97,32 97,32 74 2176 8478 33680 134482 537684 2150486 8601688 34406490 137625692 550502494 76 83,17 89,25 93,4 95,34 96,22 96,62 97,04 97,25 97,33 97,33 76 2234 8704 34578 138068 552022 2207832 8831066 35323996 141295710 565182560 78 83,16 89,24 93,42 95,36 96,23 96,63 97,05 97,25 97,33 97,34 78 2292 8930 35476 141654 566360 2265178 9060444 36241502 144965728 579862626 80 83,09 89,3 93,52 95,49 96,35 96,75 97,17 97,38 97,46 97,45 80 2350 9156 36374 145240 580698 2322524 9289822 37159008 148635746 594542692 82 83,18 89,49 93,67 95,7 96,55 96,94 97,36 97,57 97,65 97,65 82 2408 9382 37272 148826 595036 2379870 9519200 38076514 152305764 609222758 84 83,21 89,54 93,71 95,73 96,56 96,96 97,36 97,58 97,66 97,66 84 2466 9608 38170 152412 609374 2437216 9748578 38994020 155975782 623902824 86 83,2 89,69 93,75 95,75 96,57 96,96 97,36 97,59 97,66 97,66 86 2524 9834 39068 155998 623712 2494562 9977956 39911526 159645800 638582890 88 83,2 89,7 93,78 95,77 96,59 96,97 97,37 97,59 97,67 97,67 88 2582 10060 39966 159584 638050 2551908 10207334 40829032 163315818 653262956 90 83,24 89,77 93,81 95,79 96,6 96,98 97,38 97,6 97,68 97,68 90 2640 10286 40864 163170 652388 2609254 10436712 41746538 166985836 667943022 92 83,32 89,9 93,86 95,82 96,61 96,98 97,39 97,61 97,69 97,68 92 2698 10512 41762 166756 666726 2666600 10666090 42664044 170655854 682623088 94 83,38 89,91 93,91 95,85 96,63 97 97,4 97,63 97,71 97,7 94 2756 10738 42660 170342 681064 2723946 10895468 43581550 174325872 697303154 96 83,36 89,92 93,95 95,92 96,69 97,06 97,45 97,68 97,76 97,75 96 2814 10964 43558 173928 695402 2781292 11124846 44499056 177995890 711983220 98 83,37 89,94 93,99 95,95 96,7 97,06 97,46 97,69 97,76 97,75 98 2872 11190 44456 177514 709740 2838638 11354224 45416562 181665908 726663286 100 83,44 90,04 94,02 95,97 96,71 97,06 97,46 97,69 97,77 97,76 100 2930 11416 45354 181100 724078 2895984 11583602 46334068 185335926 741343352 102 83,49 90,03 94,04 95,98 96,71 97,07 97,47 97,7 97,77 97,76 102 2988 11642 46252 184686 738416 2953330 11812980 47251574 189005944 756023418 104 83,5 90,04 94,06 96 96,72 97,07 97,47 97,7 97,78 97,76 104 3046 11868 47150 188272 752754 3010676 12042358 48169080 192675962 770703484 106 83,55 90,04 94,08 96,01 96,73 97,08 97,47 97,71 97,78 97,76 106 3104 12094 48048 191858 767092 3068022 12271736 49086586 196345980 785383550 108 83,52 90,05 94,1 96,02 96,73 97,08 97,47 97,71 97,78 97,76 108 3162 12320 48946 195444 781430 3125368 12501114 50004092 200015998 800063616 110 83,52 90,09 94,12 96,03 96,74 97,08 97,47 97,71 97,78 97,76 110 3220 12546 49844 199030 795768 3182714 12730492 50921598 203686016 814743682 112 83,5 90,12 94,15 96,05 96,74 97,09 97,47 97,71 97,79 97,76 112 3278 12772 50742 202616 810106 3240060 12959870 51839104 207356034 829423748 114 83,51 90,14 94,17 96,06 96,75 97,09 97,48 97,72 97,79 97,77 114 3336 12998 51640 206202 824444 3297406 13189248 52756610 211026052 844103814 116 83,49 90,14 94,19 96,07 96,76 97,09 97,48 97,72 97,79 97,77 116 3394 13224 52538 209788 838782 3354752 13418626 53674116 214696070 858783880 26 902824078 118 83,54 90,14 94,21 96,08 96,76 97,1 97,48 97,73 97,8 97,77 118 3452 13450 53436 213374 853120 3412098 13648004 54591622 218366088 873463946 120 83,58 90,17 94,22 96,1 96,76 97,1 97,48 97,73 97,8 97,77 120 3510 13676 54334 216960 867458 3469444 13877382 55509128 222036106 888144012 122 83,59 90,17 94,23 96,11 96,77 97,1 97,49 97,73 97,8 97,77 122 3568 13902 55232 220546 881796 3526790 14106760 56426634 225706124 124 83,58 90,18 94,26 96,12 96,77 97,11 97,49 97,74 97,81 97,78 124 3626 14128 56130 224132 896134 3584136 14336138 57344140 229376142 917504144

CoreMark Bimodal-Perc: hitrate vs size 2 71,19 73,55 77,94 79,31 83,2 79,67 81,92 81,5 80,97 84,62 84,17 81,29 82,94 82,62 84,32 83,34 80,89 82,34 84,33 84,39 84,62 84,71 84,65 82,29 84,94 2 4 6 8 10 12 14 16 18 20 22 24 26 28 30 32 34 36 38 40 42 44 46 48 50 2 4 6 8 10 12 14 16 18 20 22 24 26 28 30 32 34 36 38 40 42 44 46 48 50 2 44 86 128 170 212 254 296 338 380 422 464 506 548 590 632 674 716 758 800 842 884 926 968 1010 1052 4 74 144 214 284 354 424 494 564 634 704 774 844 914 984 1054 1124 1194 1264 1334 1404 1474 1544 1614 1684 1754 4 73,76 75,86 79,43 80,67 83,84 80,63 82,64 82,16 81,9 84,25 84,46 82,57 83,98 83,47 84,88 83,75 81,28 82,99 84,23 84,43 84,8 84,72 84,93 83,3 85 6 104 202 300 398 496 594 692 790 888 986 1084 1182 1280 1378 1476 1574 1672 1770 1868 1966 2064 2162 2260 2358 2456 8 134 260 386 512 638 764 890 1016 1142 1268 1394 1520 1646 1772 1898 2024 2150 2276 2402 2528 2654 2780 2906 3032 3158 6 75 77,55 81,68 81,6 84,15 82,63 83,25 83,05 84,1 84,9 84,86 83,42 85,08 83,88 85,27 84,21 82,31 84,75 84,59 85,06 85,26 85,17 85,36 83,95 85,46 10 164 318 472 626 780 934 1088 1242 1396 1550 1704 1858 2012 2166 2320 2474 2628 2782 2936 3090 3244 3398 3552 3706 3860 8 74,67 77,44 82,27 82,15 83,94 83,23 83,91 83,56 84,36 85,17 85,42 84,14 85,56 84,75 85,53 84,9 82,3 85,07 84,76 85,46 85,83 85,74 85,8 84,63 85,86 12 194 376 558 740 922 1104 1286 1468 1650 1832 2014 2196 2378 2560 2742 2924 3106 3288 3470 3652 3834 4016 4198 4380 4562 10 76,93 79,69 84,48 84,56 86,12 85,46 86,37 86,03 86,58 87,57 87,91 86,5 87,97 87,42 87,96 87,49 84,71 87,46 87,41 88,15 88,41 88,44 88,35 86,91 88,28 14 224 434 644 854 1064 1274 1484 1694 1904 2114 2324 2534 2744 2954 3164 3374 3584 3794 4004 4214 4424 4634 4844 5054 5264 16 254 492 730 968 1206 1444 1682 1920 2158 2396 2634 2872 3110 3348 3586 3824 4062 4300 4538 4776 5014 5252 5490 5728 5966 12 77,36 80,43 84,75 84,84 86,55 85,92 86,85 86,54 87,09 88,04 88,45 87,02 88,54 88,11 88,53 88,27 85,58 88,27 87,82 88,77 89,11 89,02 89 87,58 88,88 18 284 550 816 1082 1348 1614 1880 2146 2412 2678 2944 3210 3476 3742 4008 4274 4540 4806 5072 5338 5604 5870 6136 6402 6668 14 77,42 80,57 84,73 84,96 86,63 85,95 86,84 86,52 87,15 87,91 88,51 87,13 88,56 88,14 88,38 88,32 85,7 88,24 87,95 88,81 89,09 89,23 88,98 87,74 88,96 20 314 608 902 1196 1490 1784 2078 2372 2666 2960 3254 3548 3842 4136 4430 4724 5018 5312 5606 5900 6194 6488 6782 7076 7370 22 344 666 988 1310 1632 1954 2276 2598 2920 3242 3564 3886 4208 4530 4852 5174 5496 5818 6140 6462 6784 7106 7428 7750 8072 16 77,33 81 84,81 85,1 87,01 86,19 87,18 86,83 87,44 88,37 88,85 87,47 89,07 88,43 88,75 88,74 86,31 88,5 88,61 89,23 89,68 89,53 89,37 88,19 89,44 24 374 724 1074 1424 1774 2124 2474 2824 3174 3524 3874 4224 4574 4924 5274 5624 5974 6324 6674 7024 7374 7724 8074 8424 8774 18 77,69 81,24 84,82 85,23 87,21 86,45 87,45 86,97 87,79 88,54 89,03 87,62 89,28 88,7 88,88 88,78 86,65 88,89 88,75 89,47 89,86 89,81 89,59 88,42 89,66 26 404 782 1160 1538 1916 2294 2672 3050 3428 3806 4184 4562 4940 5318 5696 6074 6452 6830 7208 7586 7964 8342 8720 9098 9476 20 77,95 81,03 84,78 85,23 87,31 86,45 87,5 87,11 87,77 88,68 89,35 87,69 89,47 88,87 89,19 89,12 87,05 89,07 89,02 89,66 90,04 90,04 89,59 88,49 89,71 28 434 840 1246 1652 2058 2464 2870 3276 3682 4088 4494 4900 5306 5712 6118 6524 6930 7336 7742 8148 8554 8960 9366 9772 10178 22 78,16 81,06 84,77 85,25 87,54 86,49 87,62 87,18 87,9 88,89 89,38 87,78 89,51 88,91 89,33 89,28 87,19 89,21 89,08 89,73 90,11 90,05 89,74 88,69 89,97 30 464 898 1332 1766 2200 2634 3068 3502 3936 4370 4804 5238 5672 6106 6540 6974 7408 7842 8276 8710 9144 9578 10012 10446 10880 24 78,89 81,34 84,73 85,25 87,68 86,53 87,73 87,27 88,02 89,09 89,63 87,83 89,8 89,23 89,58 89,53 87,26 89,39 89,19 89,96 90,47 90,35 90,21 88,85 90,24 26 78,96 81,52 84,71 85,34 87,74 86,62 88,06 87,37 88,22 89,38 89,86 88 90,04 89,57 89,8 89,77 87,45 89,69 89,55 90,29 90,65 90,58 90,47 89,06 90,54 32 494 956 1418 1880 2342 2804 3266 3728 4190 4652 5114 5576 6038 6500 6962 7424 7886 8348 8810 9272 9734 10196 10658 11120 11582 28 78,99 81,5 84,68 85,3 87,79 86,61 88,16 87,44 88,21 89,42 89,98 88 90,1 89,68 89,9 89,85 87,5 89,69 89,65 90,29 90,87 90,66 90,57 89,13 90,6 34 524 1014 1504 1994 2484 2974 3464 3954 4444 4934 5424 5914 6404 6894 7384 7874 8364 8854 9344 9834 10324 10814 11304 11794 12284 30 79,22 81,82 84,87 85,59 88,25 86,91 88,68 87,7 88,74 90 90,68 88,31 90,74 90,41 90,7 90,63 88,24 90,25 90,2 91 91,63 91,44 91,4 89,57 91,36 36 554 1072 1590 2108 2626 3144 3662 4180 4698 5216 5734 6252 6770 7288 7806 8324 8842 9360 9878 10396 10914 11432 11950 12468 12986 32 79,33 81,81 85,08 85,8 88,31 87,19 88,72 88,2 88,92 90,23 90,94 88,66 91,11 90,62 91,12 90,95 88,47 90,42 90,4 91,38 91,84 91,78 91,62 89,89 91,49 34 79,19 81,68 85,02 85,85 88,3 87,17 88,96 88,22 88,9 90,32 90,97 88,62 91,17 90,88 91,16 91,08 88,42 90,56 90,44 91,51 91,97 91,81 91,69 89,94 91,58 38 584 1130 1676 2222 2768 3314 3860 4406 4952 5498 6044 6590 7136 7682 8228 8774 9320 9866 10412 10958 11504 12050 12596 13142 13688 36 79,02 81,69 84,94 85,88 88,27 87,19 89,01 88,31 88,98 90,4 91,05 88,68 91,29 91 91,22 91,31 88,43 90,72 90,52 91,62 92,09 91,93 91,78 90,1 91,72 40 614 1188 1762 2336 2910 3484 4058 4632 5206 5780 6354 6928 7502 8076 8650 9224 9798 10372 10946 11520 12094 12668 13242 13816 14390 38 79,05 81,55 84,95 85,94 88,25 87,15 89,06 88,34 88,98 90,45 91,14 88,71 91,25 91,01 91,21 91,33 88,51 90,71 90,55 91,67 92,11 91,98 91,78 90,13 91,82 42 644 1246 1848 2450 3052 3654 4256 4858 5460 6062 6664 7266 7868 8470 9072 9674 10276 10878 11480 12082 12684 13286 13888 14490 15092 40 79,06 81,55 85,07 86 88,25 87,25 89,1 88,46 89,02 90,59 91,25 88,85 91,3 91,1 91,24 91,47 88,62 90,84 90,66 91,82 92,23 92,02 91,79 90,26 91,95 42 79,73 81,88 85,14 86,07 88,4 87,37 89,33 88,57 89,16 90,69 91,31 88,96 91,35 91,17 91,28 91,49 88,76 90,96 90,83 91,84 92,24 92,03 91,78 90,43 91,97 44 674 1304 1934 2564 3194 3824 4454 5084 5714 6344 6974 7604 8234 8864 9494 10124 10754 11384 12014 12644 13274 13904 14534 15164 15794 44 79,78 81,86 85,06 86 88,41 87,33 89,34 88,62 89,13 90,78 91,34 88,95 91,38 91,25 91,31 91,55 88,71 90,97 91,03 91,9 92,24 92,08 91,79 90,54 92 46 704 1362 2020 2678 3336 3994 4652 5310 5968 6626 7284 7942 8600 9258 9916 10574 11232 11890 12548 13206 13864 14522 15180 15838 16496 46 79,95 82,01 85,02 85,92 88,4 87,25 89,35 88,61 89,15 90,82 91,4 88,9 91,44 91,33 91,31 91,66 88,78 91,06 91,05 91,97 92,3 92,14 91,87 90,62 92,1 48 734 1420 2106 2792 3478 4164 4850 5536 6222 6908 7594 8280 8966 9652 10338 11024 11710 12396 13082 13768 14454 15140 15826 16512 17198 27 48 79,86 81,94 85,04 85,96 88,53 87,22 89,36 88,61 89,28 90,95 91,51 88,89 91,49 91,38 91,35 91,68 88,88 91,14 91,08 92,08 92,42 92,25 91,95 90,6 92,2 50 764 1478 2192 2906 3620 4334 5048 5762 6476 7190 7904 8618 9332 10046 10760 11474 12188 12902 13616 14330 15044 15758 16472 17186 17900 50 79,8 81,86 84,95 85,88 88,51 87,23 89,39 88,54 89,3 90,97 91,52 88,92 91,54 91,45 91,34 91,73 88,95 91,15 91,22 92,1 92,43 92,26 91,94 90,58 92,19