IEEE 802.11-14 MAC Calibration Results Comparison
"This document presents a comparison of MAC calibration results from various companies and proposes criteria for result alignment. It clarifies simulation scenarios and parameter settings for test alignment. Status: aligned, no need for Calibration Box 3. Companies involved: Huawei, Qualcomm, MediaTek, Intel, Ericsson, Nokia, NTT, Samsung, Broadcom, ZTE, Toshiba, Newracom." (242 characters)
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
October 2014 doc.: IEEE 802.11-14/1192r6 MAC calibration results comparison Date: 2014-09-10 Authors: Name Affiliations Address Yanchun Li Huawei Technology 518129 P.R. China Xueli Kong Phone +86- 15337257958 +86- 18575596011 +86- 18565826350 email liyanchun@huawei.com Bantian Longgang Shenzhen kongxueli@huawei.com Zhou Lan lanzhou1@huawei.com Gwen Barriac Qualcomm Qingjiang Tian Suhwook Kim LGE Wookbong Lee HanGyu Cho Peng Meng Intel Corp Rongzhen Yang Robert Stacey Po-Kai Huang Chinghwa Yu MediaTek Inc. ChaoChun Wang Submission Slide 1 Zhou Lan (Huawei Technology)
October 2014 doc.: IEEE 802.11-14/1192r6 Name Filip Mestanov Affiliations Address Ericsson AB Phone email +46 725 298 161 +46 767 602 907 +46 722 449 170 +46 727 242 910 F r gatan 6, Stockholm Sweden 168 40 filip.mestanov@ericsson.com Yu Wang yu.a.wang@ericsson.com Johan S der johan.soder@ericsson.com Gustav Wikstr m gustav.wikstrom@ericsson.com Esa Tuomaala Nokia esa.tuomaala@nokia.com 2075 Allston Way #200 Berkeley, CA, USA Olli Alanen Sayantan Choudhury Jarkko Kneckt Shoko Shinohara NTT shinohara.shoko@lab.ntt.co.jp Akira Kishida kishida.akira@lab.ntt.co.jp Yasuhiko Inoue inoue.yasuhiko@lab.ntt.co.jp Akira Yamada NTT DOCOMO ZTE kishida.akira@lab.ntt.co.jp Ke Yao Yao.ke5@zte.com.cn Bo Sun ByoungHoon Jung HyunJeong Kang SangHyun Chang Seung-Hoon Park Kaushik Josiam Sun.bo1@zte.com.cn bh14.jung@samsung.com hyunjeong.kang@samsung.com s29.chang@samsung.com shannon.park@samsung.com k.josiam@samsung.com Samsung Submission Slide 2 Zhou Lan (Huawei Technology)
October 2014 doc.: IEEE 802.11-14/1192r6 Name Stephanie Pereira Affiliations Address Broadcom Phone email spereira@broadcom.com Matthew Fischer Broadcom mfischer@broadcom.com Toshihisa Nabetani Toshiba toshihisa.nabetani@toshiba.co.jp Narendar Madhavan narendar.madhavan@toshiba.co.jp 9008 Research Drive, Irvine, CA 92618 Vida Ferdowsi Newracom vida.ferdowsi@newracom.com Reza Hedayat reza.hedayat@newracom.com Submission Slide 3 Zhou Lan (Huawei Technology)
October 2014 doc.: IEEE 802.11-14/1192r6 Summary This contribution provides result comparison of MAC calibration of test 1-3 from variety of companies [1][2][3] This contribution also proposes a criteria for result alignment There are some parameter setting in the simulation scenario document that may generate different interpretation, this contribution clarifies these parameter settings Submission Slide 4 Zhou Lan (Huawei Technology)
October 2014 doc.: IEEE 802.11-14/1192r6 Status Overview Status : aligned, : No need to provide Calibration Box 3 MAC Calibration Simulation Scenarios Test 1a Test 1b Test 2a Test 2b Test 3 Test 4 Deferral Test for 20 and 40MHz BSSs Scenario Names MAC overhead w/out RTS/CTS MAC overhead w RTS/CTS Deferral Test 1 Deferral Test 2 NAV deferral Configurations MCS = [0] MCS = [0] MCS = [8] MCS = [8] MCS = [0] MCS = [0] MCS = [8] MCS = [8] RTS/CTS [OFF] RTS/CTS [ON] RTS/CTS [OFF] RTS/CTS [ON] Metrics MAC Tput Check Points MAC Tput Check Points MAC Tput Check Points MAC Tput Check Points MAC Tput MAC Tput MAC Tput MAC Tput LG Huawei Qualcomm MediaTek Intel Ericsson Nokia NTT Samsung Broadcom ZTE Toshiba Newracom Criteria: Make average over most close three companies as the baseline to compare If the performance value intended for calibration is within 5% deviation, it is marked as aligned Submission Slide 5 Zhou Lan (Huawei Technology)
AP1 October 2014 doc.: IEEE 802.11-14/1192r6 MCS0 (6.5Mbps) 500 1000 1500 2000 4.79 5.55 5.84 6.00 4.81 5.55 5.84 5.99 4.76 5.53 5.82 5.98 4.76 5.53 5.82 5.98 4.76 5.53 5.82 5.98 4.75 5.52 5.82 5.97 4.76 5.52 5.83 5.97 4.79 5.54 5.84 6.00 4.76 5.53 5.82 5.97 4.76 5.53 5.83 5.98 4.76 5.53 5.82 5.98 4.79 5.54 5.83 5.99 4.85 5.55 5.84 5.99 Configurations MCS8 (78Mbps) 1000 21.98 34.91 22.4 35.2 21.45 34.26 21.71 34.65 21.53 34.46 21.53 34.47 21.19 34.22 22.00 35.00 21.54 34.48 21.4 34.2 21.42 34.23 21.94 34.87 23.8 36.64 500 1500 43.24 43.25 42.57 42.71 42.58 42.57 41.93 43.20 42.60 42.5 42.55 43.19 43.87 2000 48.67 48.9 48.02 48.15 48.14 48.09 47.74 48.40 48.15 48.0 48.01 48.62 49.73 Test 1a Huawei LGE Qualcomm MediaTek Intel Ericsson Nokia NTT Samsung Broadcom ZTE Toshiba Newracom test1a (MCS8) test1a (MCS0) 50 5.9 45 LGE Huawei Qualcomm MediaTek Intel Ericsson Nokia NTT Samsung Broadcom ZTE Toshiba Newracom 5.7 LGE Huawei Qualcomm MediaTek Intel Ericsson Nokia NTT Samsung Broadcom ZTE Toshiba Newracom 40 5.5 L4 Tput (Mbps) L4 Tput (Mbps) 5.3 35 5.1 30 4.9 25 4.7 4.5 20 500 1000 1500 2000 500 1000 1500 2000 MSDU size (bytes) MSDU size (bytes) Submission Slide 6 Zhou Lan (Huawei Technology)
AP1 October 2014 doc.: IEEE 802.11-14/1192r6 MCS0 (6.5Mbps) 500 1000 1500 2000 4.42 5.31 5.66 5.85 4.45 5.31 5.66 5.86 4.4 5.29 5.64 5.84 4.40 5.29 5.64 5.84 4.4 5.29 5.64 5.84 4.36 5.26 5.62 5.82 4.40 5.28 5.64 5.83 4.42 5.30 5.67 5.85 4.40 5.28 5.63 5.83 4.40 5.29 5.65 5.84 4.39 5.28 5.64 5.83 4.42 5.30 5.65 5.85 4.43 5.27 5.62 5.82 Configurations MCS8 (78Mbps) 1000 15.94 27.07 16.2 27.3 15.67 26.7 15.79 26.90 15.7 26.8 15.36 26.33 15.52 26.66 16.00 27.10 15.94 27.09 15.6 26.7 15.61 26.61 15.92 27.04 16.29 27.06 500 1500 34.97 2000 40.61 40.8 40.18 40.24 40.26 40.45 39.96 40.40 40.35 40.14 40.08 40.58 39.99 Test 1b Huawei LGE Qualcomm MediaTek Intel Ericsson Nokia NTT Samsung Broadcom ZTE Toshiba Newracom 35 34.56 34.62 34.55 34.02 34.12 34.97 34.59 34.5 34.45 34.94 34.50 test1b (MCS8) test1b (MCS0) 45 6 5.8 40 LGE Huawei Qualcomm MediaTek Intel Ericsson Nokia NTT Samsung Broadcom ZTE Toshiba Newracom 5.6 LGE Huawei Qualcomm MediaTek Intel Ericsson Nokia NTT Samsung Broadcom ZTE Toshiba Newracom 5.4 35 L4 Tput (Mbps) L4 Tput (Mbps) 5.2 30 5 4.8 25 4.6 20 4.4 4.2 15 500 1000 1500 2000 500 1000 1500 2000 MSDU size (bytes) MSDU size (bytes) Submission Slide 7 Zhou Lan (Huawei Technology)
AP1 October 2014 doc.: IEEE 802.11-14/1192r6 Without RTS/CTS 500 1000 1500 2000 4.56 5.25 5.51 5.66 4.62 5.28 5.54 5.66 4.57 5.26 5.53 5.67 4.71 5.48 5.78 5.94 4.52 5.22 5.48 5.62 4.53 5.21 5.48 5.63 4.58 5.29 5.56 5.71 4.58 5.25 5.45 5.66 4.58 5.27 5.53 5.67 4.52 5.23 5.47 5.61 4.56 5.25 5.51 5.65 4.52 5.21 5.48 5.62 4.80 5.49 5.77 5.93 Configurations With RTS/CTS 1000 5.33 5.34 5.32 5.24 5.31 5.30 5.32 5.35 5.31 5.32 5.29 5.30 5.22 500 4.46 4.5 4.45 4.35 4.44 4.42 4.48 4.49 4.45 4.44 4.39 4.42 4.39 1500 5.68 5.68 5.67 5.62 5.67 5.65 5.67 5.70 5.67 5.67 5.63 5.66 5.57 2000 5.87 5.88 5.86 5.81 5.86 5.85 5.85 5.88 5.86 5.86 5.82 5.85 5.77 Test 2a Huawei LGE Qualcomm MediaTek Intel Ericsson Nokia NTT Samsung Broadcom ZTE Toshiba Newracom test2a (no RTS/CTS) test2a (RTS/CTS) 6 5.9 5.8 5.7 LGE Huawei Qualcomm MediaTek Intel Ericsson Nokia NTT Samsung Broadcom ZTE Toshiba Newracom LGE Huawei Qualcomm MediaTek Intel Ericsson Nokia NTT Samsung Broadcom ZTE Toshiba Newracom 5.6 5.5 5.4 L4 Tput (Mbps) L4 Tput (Mbps) 5.2 5.3 5 5.1 4.8 4.9 4.6 4.7 4.4 4.2 4.5 500 1000 1500 2000 500 1000 1500 2000 MSDU size (bytes) MSDU size (bytes) Submission Slide 8 Zhou Lan (Huawei Technology)
October 2014 doc.: IEEE 802.11-14/1192r6 Test 2b results L4 Tputs with MPDU Frame Aggregation (FA) test 2b (no RTS/CTS) 40 LGE Huawei Qualcomm MediaTek Intel Ericsson Nokia NTT Samsung Broadcom ZTE Toshiba Newracom 35 Scenarios MCS0 MCS8 noFA FA noFA 26.54 26.8 FA 34.75 35.0 30 Huawei LGE Qualcomm MediaTek Intel Ericsson Nokia NTT Samsung Broadcom ZTE Toshiba Newracom 1.62 1.7 1.01 1.02 0.98 L4 Tput (Mbps) 25 0.03631 1.01 1.22 1.20 1.06 1.01 1.05 1.61 1.78 26.66 25,49 35.20 33,52 35.66 35.27 37.22 34.30 20 15 1.71 26.77 10 1.2 1.01 1.03 5 35.11 34.21 0 MCS0 MCS8 Submission Slide 9 Zhou Lan (Huawei Technology)
October 2014 doc.: IEEE 802.11-14/1192r6 Test 3 results L4 Tputs with MPDU Frame Aggregation (FA) test 3 (RTS/CTS) 35 LGE Huawei Qualcomm MediaTek Intel Ericsson Nokia NTT Samsung Broadcom ZTE Toshiba Newracom Scenarios MCS0 MCS8 30 noFA FA noFA 22.04 22.4 FA 34.05 34.2 Huawei LGE Qualcomm MediaTek Intel Ericsson Nokia NTT Samsung Broadcom ZTE Toshiba Newracom 5.15 5.14 5.58 5.58 5.55 25 L4 Tput (Mbps) 5.63933 5.57 5.63 5.59 5.60 5.41 5.32 5.58 5.61 5.78 20 5.06 5.21 20.35 22.84 31.93 34.41 31.35 34.01 33.55 30.45 15 5.18 22.10 10 5 33.81 34.24 0 MCS0 MCS8 Submission Slide 10 Zhou Lan (Huawei Technology)
September 2014 doc.: IEEE 802.11-14/1192r6 Summary The functional test results from different parties are generally aligned. MAC/PHY Framing aligned very well Deferral in light collision case aligned very well Deferral in intensive collision case (with hidden node) is not so well aligned. But we shall reduce the gap among different parties to allow the simulator could be still pretty well aligned when more functions are added and applied to more general performance test scenarios. Submission Slide 11 Zhou Lan (Huawei Technology)
October 2014 doc.: IEEE 802.11-14/1192r6 Reference [1]11-14-1230-00-00ax-mac-calibration-result.pptx [2]11-14-1192-00-00ax-comparing-mac-calibration-results.pptx [3] NTT UPDATE 11-14-1192-03-00ax-comparing-mac-calibration- results.pptx [4] ZTE-UPDATE 11-14-1192-04-00ax-comparing-mac-calibration- results.pptx [5] Intel UPDATE 11-14-1192-04-00ax-comparing-mac-calibration- results.pptx [6] Broadcom UPDATE 11-14-1192-04-00ax-comparing-mac-calibration- results.pptx [7] Ericsson UPDATE 11-14-1192-04-00ax-comparing-mac-calibration- results.pptx [8] Samsung UPDATE 11-14-1192-04-00ax-comparing-mac-calibration- results.pptx [9] Toshiba UPDATE 11-14-1192-04-00ax-comparing-mac-calibration- results_43991_r1.pptx Submission Slide 12 Zhou Lan (Huawei Technology)
