Bluetooth Interoperability & Testing
Bluetooth Interoperability & Testing
Bluetooth Interoperability & Testing
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
<strong>Bluetooth</strong> <strong>Interoperability</strong> & <strong>Testing</strong><br />
Wednesday, August 28, 2013
Ellisys presents<br />
<strong>Testing</strong>
<strong>Testing</strong><br />
Types of testing<br />
– Radio Performance testing<br />
• Radio frequency testing is performed to simulate the performance<br />
and functionality of a wireless device and ensure the device under<br />
test meets specified requirements<br />
– Protocol <strong>Testing</strong><br />
• Is where you check conformance of protocol implementations with<br />
their corresponding standards.<br />
– Profile<br />
• Is where you check conformance of profile implementations with<br />
their corresponding standards.
<strong>Testing</strong><br />
Test Tools<br />
– Test Plan Generator<br />
• The test plan generator is an essential tool that helps determine<br />
what testing needs to be performed including the class of each test<br />
case.<br />
• https://www.bluetooth.org/Technical/TestTools/TPG/Listings/Build/Ov<br />
erview.htm<br />
• https://www.bluetooth.org/Events/Training/TPG_Training.htm<br />
– Radio Performance testers<br />
• Radio frequency testing is performed to simulate the performance<br />
and functionality of a wireless device and ensure the tested device<br />
meets specified requirements.<br />
• There are a list of validated test systems included in the TCRL.
<strong>Testing</strong><br />
Test Tools<br />
– Protocol Testers<br />
• Currently the majority of protocol testing is performed on the AT4<br />
bite protocol tester.<br />
• PTS is beginning to incorporate some protocols primarily for<br />
<strong>Bluetooth</strong> low energy<br />
• Both Listed in the TCRL<br />
– Profile Tuning Suite<br />
• The Profile Tuning suite is mandatory to use to show compliance to<br />
applicable profiles.<br />
• Incorporates all classic profiles and currently trying to keep up to<br />
date with all the low energy profiles releases.
<strong>Testing</strong><br />
What do I have to test?<br />
– This is dependant on each design, and what you have<br />
incorporated into your design.<br />
– Mixture of RF, Protocol and Profile testing may be required<br />
in order to be fully <strong>Bluetooth</strong> qualified.
<strong>Testing</strong><br />
Common Example 1<br />
– I have incorporated components into my design as I had to<br />
keep the design as small as possible.<br />
• Common testing to be Performed would be RF and profile<br />
• What if the component is module?
<strong>Testing</strong><br />
Common example 2<br />
– Space isn’t an issue so I used a module that has been<br />
listed as a controller sub-system and combined that with a<br />
host and profile sub-system<br />
• No official qualification testing required, its always suggested to run<br />
verification testing to ensure you still meet the core specification you<br />
support<br />
• What if I change one of the sub-systems?
<strong>Testing</strong><br />
Common Example 3<br />
– I have incorporated sub-systems and components into my<br />
design not realising<br />
– There are two ways of going about qualification<br />
• List the component as a sub-system to compliment the other<br />
• Reassess the sub-system to ensure that it meets all the current core<br />
<strong>Bluetooth</strong> specification and list as an end product.<br />
– Depending what you decide to do, RF, protocol or profile<br />
could be applicable
<strong>Testing</strong><br />
Options for testing<br />
– In house<br />
– External test facility
Ellisys <strong>Bluetooth</strong> Explorer 400
Ellisys Wide-Band RF sniffing<br />
Ellisys method: Listen to all 79 BR + 79 EDR2 +<br />
79 EDR3 + 40 BLE channels concurrently with a<br />
proprietary digital radio<br />
Topology reconstruction and decryption achieved<br />
in software by post-processing<br />
Result: Successfully capture all packets, from all<br />
piconets, at any time, with zero configuration<br />
No more limitations, It Just Works<br />
12
Live Demonstration<br />
A demonstration is better<br />
than a thousand words…
Wired Capture<br />
HCI – USB, UART, SPI<br />
Wireless Coexistence Interface 2<br />
Audio I2S: Inter-IC Sound<br />
Logic Transitions and inputs<br />
14
<strong>Bluetooth</strong> SIG presents<br />
Making <strong>Bluetooth</strong>® Technology Better
Overview<br />
Why we have issues<br />
What we plan to do<br />
Looking for participants!
<strong>Interoperability</strong> (IOP) Issues<br />
Qualification Program is compliance-based<br />
– Compliance is needed for license and brand<br />
– Insufficient for ensuring high levels of <strong>Interoperability</strong> and Quality on its<br />
own.<br />
Other organizations recognized this deficiency<br />
– Developed own testing standards, certification programs and other<br />
recommendations.<br />
Multiple test requirements and recommendations<br />
– Confusing and inefficient<br />
No industry-accepted recognized standard for <strong>Bluetooth</strong><br />
quality or ensuring interoperability
Audio Quality Issues<br />
Insufficient performance or implementation of electrical<br />
and acoustic components<br />
Issues and performance are outside the scope of<br />
existing <strong>Bluetooth</strong> specifications<br />
– Perception that the <strong>Bluetooth</strong> is associated with poor audio<br />
performance.<br />
Qualification Program is limited to specification<br />
compliance
Good news<br />
The SIG is going lead the efforts to improve IOP and<br />
Audio Quality<br />
Other organizations agree and willing to participate<br />
We have the tools<br />
– Test Plan Generator (TPG): Complete test plan that includes all<br />
testing requirements.<br />
– Profile Tuning Suite (PTS): Test platform for development and<br />
issue resolution, emulate invalid behaviors for more robust devices.<br />
– Errata: Issue and document management system to enable regular<br />
maintenance and enhancements to test specifications.
How<br />
Enhanced Quality &<br />
<strong>Interoperability</strong> (EQI)<br />
Task Force<br />
Enhanced IOP<br />
(eIOP)<br />
Subgroup<br />
Enhanced Audio<br />
(eAudio)<br />
Subgroup<br />
Task Force - Program initiatives, work facilitation and liaison activities<br />
• Subgroups – Research, test development, NWP/FRD<br />
• Open to all Members
eIOP
Why different?<br />
Dedicated Task Force<br />
Collaboration with external organizations<br />
Tool enhancements
Test Specification 0.9<br />
eIOP Phase 1<br />
Establish baseline<br />
March – June 2013<br />
• Use case priority: Auto Phone<br />
SIG Staff writing draft
eIOP Phase 2<br />
Evaluation Process<br />
July – December 2013<br />
Market Issue Evaluation<br />
Test Specification<br />
Review<br />
Specification Review<br />
• What are the common issues?<br />
• Do we have sufficient test coverage?<br />
• Can the specification be improved?<br />
Test Events<br />
Maintenance<br />
• UPFs and IOP events<br />
• Auto IOP – Detroit (Aug.)<br />
• UPF 46 – Vienna (Oct.)<br />
• Keeping the tests current
eIOP Phase 3<br />
Deployment<br />
First half 2014<br />
Tool Integration<br />
TPG<br />
PTS*<br />
Errata<br />
Enhancements
eAudio
eAudio Phase 1<br />
First Drafts<br />
Technical Requirements<br />
Audio Quality<br />
Program<br />
Requirements<br />
1.0<br />
Test<br />
Parameters<br />
and Limits 1.0<br />
Test<br />
Specification<br />
1.0<br />
Collaboration with other organizations
eAudio Phase 2<br />
Evaluation and <strong>Testing</strong><br />
Q3 2013<br />
Specification Review<br />
Test Specification Review<br />
New Work Proposals (NWP)<br />
Test Events<br />
Maintenance
eAudio Phase 3<br />
Deployment<br />
First half 2014<br />
Tool Integration<br />
TPG<br />
QLI<br />
Errata
Summary<br />
We are committed to improving IOP and Audio Quality<br />
We will collaborate with external organizations<br />
We can deliver our first drafts this year<br />
We need participation
Let’s Get Started!<br />
To observe the activities of the subgroups, please<br />
join the EQI.<br />
To enhance IOP, please join the eIOP subgroup.<br />
To enhance Audio Quality, please join the eAudio<br />
subgroup.<br />
Today<br />
– EQI: 70 Registrants<br />
– eIOP: 34 Registrants<br />
– eAudio: 122 Registrants
Future Platform<br />
• Integrated, holistic solution for <strong>Bluetooth</strong><br />
members encompassing everything from<br />
development to IOP testing.<br />
Development<br />
<strong>Testing</strong><br />
Qualification<br />
<strong>Interoperability</strong>
Frontline presents<br />
PTS
What is PTS?<br />
PTS stands for “Profile Tuning Suite”<br />
<strong>Bluetooth</strong> Qualification Tool<br />
Valuable for Development and QA<br />
Automation tool for protocol and profile<br />
interoperability testing<br />
Save on cost and time by reducing development,<br />
testing and qualification process<br />
Over 7,500 registered users from more than 600<br />
companies.
Who needs PTS? What are the benefits?<br />
Qualification Staff<br />
– Self qualification<br />
– Make sure products are compliant before sending for<br />
qualification<br />
<strong>Bluetooth</strong> Product Developers and Quality<br />
Assurance Staff<br />
– Identify issues early in the development cycle<br />
– Unbiased test results<br />
– Tool for verifying <strong>Bluetooth</strong> product<br />
– Test automation
Implementation<br />
Based on Profile Specification, Test Specification<br />
and Profile Implementation Conformance<br />
Statement (PICS).<br />
Tester role of test case.<br />
Report PTS issue if error is found.<br />
– https://www.bluetooth.org/pts/issues/<br />
Create TSE if error is found in test specification.<br />
– https://www.bluetooth.org/tse/index.cfm
What PTS is NOT<br />
A full implementation of <strong>Bluetooth</strong> product<br />
A tester of <strong>Bluetooth</strong> controller<br />
Test specification
Test Suite Coverage<br />
65 Test Suites<br />
– 26 Basic Rate<br />
• Most of the profile test suites, MCAP, L2CAP<br />
and AVCTP<br />
– 4 Low Energy<br />
– 35 GATT-Based<br />
• GAP, GATT, L2CAP and SM<br />
• All adopted GATT-Based profiles up to date<br />
– 2 High Speed<br />
• A2MP and L2CAP
Test Suite Coverage (Cont.)<br />
Basic Rate<br />
A2DP 1.2 AVCTP 1.4 AVRCP 1.4 BIP 1.0 BPP 1.2<br />
DID 1.3 DUN 1.1 FTP 1.1 GAVDP 1.2 GOEP 2.0<br />
GNSS 1.0 HCRP 1.2 HDP 1.0 HFP 1.6 HID 1.0<br />
HSP 1.2 IOPT L2CAP 2.1 MAP 1.0 MCAP 1.0<br />
OPP 1.1 PAN 1.0 PBAP 1.0 SAP 1.1 SYNC 1.1<br />
VDP 1.0<br />
High Speed<br />
A2MP L2CAP 3.0
Test Suite Coverage (Cont.)<br />
Low Energy<br />
GAP 4.0 GATT 1.0 L2CAP 4.0 SM<br />
GATT-Based<br />
ANP 1.0 ANS 1.0 BAS 1.0 BLP 1.0 BLS 1.0<br />
CPP 1.0 CPS 1.0 CSCP 1.0 CSCS 1.0 CTS 1.0<br />
DIS 1.1 FMP 1.0 GLP 1.0 GLS 1.0 HIDS 1.0<br />
HOGP 1.0 HRP 1.0 HRS 1.0 HTP 1.0 HTS 1.0<br />
IAS 1.0 LLS 1.0 LNP 1.0 LNS 1.0 NDCS 1.0<br />
PASP 1.0 PASS 1.0 PXP 1.0 RSCP 1.0 RSCS 1.0<br />
RTUS 1.0 ScPP 1.0 ScPS 1.0 TIP 1.0 TPS 1.0
Output<br />
Test report for qualification<br />
Test log for debugging and test verification<br />
Protocol Viewer logs<br />
– Frontline Virtual Sniffer
PTS Protocol Viewer<br />
Come with the PTS installer<br />
Special build of Frontline FTS4BT<br />
Capture HCI frames send to and receive from<br />
controller (PTS dongle)<br />
Displays both sides from HCI upward.<br />
NOT air trace<br />
Includes Link Key information seen on HCI.
Automation<br />
Implicit Send DLL<br />
– Allow customizing the default handle of request action.<br />
Through it, IUT can automatically initiate request action.<br />
PTS Control API<br />
– Allow controlling PTS without UI.<br />
– Easy integrating PTS into existing test environment.
PTS Summary<br />
IUT<br />
PTS test<br />
suites<br />
Test Report<br />
(XML)
PTS Summary (Automation Options)<br />
PTS<br />
Control<br />
PTS<br />
test<br />
suites<br />
User’s Own<br />
Test Harness<br />
IUT<br />
Implicit<br />
Send<br />
Test Report<br />
(XML)
Support<br />
Issue Tracking System<br />
– Report bugs and issues related to PTS<br />
– https://www.bluetooth.org/pts/issues/<br />
Ticketing system<br />
– General questions and FAQ<br />
– https://www.bluetooth.org/ticketing/faq.cfm
Requirements<br />
Free for Promoters and Associate<br />
Members<br />
For adopter members, $7500 annual<br />
license fee<br />
Company-wide license<br />
OS: Windows XP, Vista and Win 7<br />
(32 bit and 64 bit)<br />
Require PTS <strong>Bluetooth</strong> 3.0 and 4.0<br />
dongles available on <strong>Bluetooth</strong> SIG<br />
shop
Wireless Communications Diagnostics Tools<br />
Frontline offers a full range of tools for developers of devices and applications<br />
Consulting and <strong>Testing</strong> Services<br />
Frontline’s Consulting and <strong>Testing</strong> Services combines thorough and proven test plans and unmatched industry experience<br />
with an industry-best device library<br />
Industrial Analyzers and Tools<br />
Frontline’s industrial line of analyzers
GNSS Satellite Simulator
<strong>Bluetooth</strong> Profile Simulator
OTHER CHANCES FOR INTEROPERABILITY
Build Your Prototype<br />
Product Development Overview<br />
– Review information on building with <strong>Bluetooth</strong> technology<br />
on <strong>Bluetooth</strong>.org:<br />
https://www.bluetooth.org/Building/Product/BuildProduct.htm<br />
Test against dozens of other prototypes at UPF!<br />
UPF Overview…<br />
– Unreleased and unannounced products and prototypes<br />
are tested in this confidential forum with the assurance that<br />
all participants in the testing are bound by an event-based<br />
non-disclosure pact.<br />
– UPF events are only open for engineers to test products.<br />
– https://www.bluetooth.org/Events/UPF/UnPlugFests.htm
Build Your Prototype – Share Ideas<br />
Device Development Discussion Forum<br />
– Here’s where to discuss issues such as what profiles your device<br />
supports and where to find dev kits for creating a prototype<br />
device.<br />
– http://developer.bluetooth.org/Forum/Pages/Forum.aspx
Donate Your Devices<br />
‣ Device donations are an integral part of providing<br />
members high-quality test and qualification tools. All<br />
devices, including prototypes are beneficial, but the SIG<br />
is currently most in need of devices supporting CSCS/P<br />
and RSCS/P. Also, development stacks and kits<br />
supporting GATT & GAP test suites. To donate, visit<br />
the Device Donation Page. Donations will be used for:<br />
‣ Development, verification and testing of the <strong>Bluetooth</strong><br />
PTS tool.<br />
‣ Internal device-to-device testing for improvements to<br />
device interoperability.<br />
‣ Research into resolving PTS issues for SIG members.
NEW Task Force<br />
‣ Main Goals:<br />
Collaborate with other organizations (CTIA, GSMA, CE4A,<br />
JASPAR, etc.)<br />
Work to combine the different interoperability testing<br />
requirements into a single test specification<br />
Develop standard testing requirements for enhanced audio<br />
quality<br />
‣ New subgroups : Enhanced Audio Subgroup (eAudio)<br />
and Enhanced <strong>Interoperability</strong> Subgroup (eIOP) open to<br />
all members<br />
‣ Kick-off: Conference call and WebEx meeting Monday,<br />
18 March at 8:00am PST.<br />
‣ https://www.bluetooth.org/groups/group.aspx?gId=602<br />
for the details and join
Thank you!