Introduction to Qualcomm's QDSP Access Program– Qualcomm ...
Introduction to Qualcomm's QDSP Access Program– Qualcomm ...
Introduction to Qualcomm's QDSP Access Program– Qualcomm ...
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
<strong>Introduction</strong> <strong>to</strong> <strong>Qualcomm</strong>’s<br />
<strong>QDSP</strong> <strong>Access</strong> Program<br />
Kuntal Sampat<br />
Engineer, Sr. Staff / Manager, <strong>Qualcomm</strong>
Agenda<br />
• Overview<br />
• Deliverables<br />
• Utilization<br />
• Q&A<br />
2
<strong>QDSP</strong> <strong>Access</strong><br />
Overview<br />
3
Multimedia Acceleration<br />
• Benefits of acceleration<br />
– Offload the applications CPU <strong>to</strong> focus on HLOS tasks<br />
– Higher performance<br />
– Lower power than ARM implementation<br />
• OEMs and application developers can now program the<br />
multimedia hardware directly<br />
4
DSP <strong>Access</strong> Product Support Roadmap<br />
2010 2011 2012<br />
Q4 Q1 Q2 Q3 Q4 Q1<br />
7x30<br />
8x55<br />
<strong>Access</strong><br />
Release<br />
<strong>QDSP</strong>5 Tools<br />
HW& Video<br />
APIs<br />
June–<br />
7x30/8x55<br />
Framework& ISV Integration<br />
<strong>QDSP</strong>5<br />
7627<br />
<strong>Access</strong><br />
Release<br />
<strong>QDSP</strong>5 Tools<br />
HW& Video<br />
APIs<br />
7627A<br />
<strong>Access</strong><br />
Release<br />
July<br />
7x27 Framework<br />
ISV integration<br />
<strong>QDSP</strong>5 Tools<br />
HW APIs<br />
Oct<br />
7x27a<br />
Framework<br />
Nov<br />
7x27a ISV Integration<br />
QDS6<br />
MSM8660<br />
/APQ8x60<br />
<strong>Access</strong><br />
Release<br />
Hexagon<br />
Tools<br />
Elite<br />
Framework<br />
June--<br />
ISV Software Integration<br />
MSM8960<br />
/APQ8064<br />
<strong>Access</strong><br />
Release<br />
Hexagon<br />
Tools<br />
HW APIs<br />
Oc<strong>to</strong>ber<br />
Elite<br />
Framework<br />
Dec<br />
ISV Software Integration<br />
NOTE: Not all features listed
<strong>QDSP</strong> <strong>Access</strong><br />
Deliverables
Deliverables<br />
ARM development framework<br />
OpenMAX IL/Video Hardware API Doc<br />
Apps processor<br />
Application<br />
Multimedia framework<br />
RTOS<br />
DSP<br />
Messaging Pro<strong>to</strong>col<br />
Shared memory<br />
Video<br />
hardware<br />
VPE<br />
Other multimedia processors/cores<br />
7
Deliverables<br />
• Varies based on version of MSM/APQ<br />
• ARM development framework<br />
– <strong>Qualcomm</strong>-created platform for MSM8x55 and below<br />
– Android-based platform for MSM8x60 and higher<br />
• <strong>QDSP</strong><br />
– Hexagon DSP for MSM8x60 and higher<br />
• 600 MHz multi-threaded<br />
• C Compiler<br />
– <strong>QDSP</strong>5 DSP for MSM8x55 and below<br />
• 320 MHz, single core<br />
• Assembly-only<br />
• Video<br />
– OpenMax IL API for MSM 8x55 and higher<br />
– Hardware Interface document and sample code for MSM7x27 and its variants<br />
• VPE<br />
– Only on MSM8x55 and higher<br />
8
Deliverables—Tools<br />
• <strong>QDSP</strong> Development Tools<br />
– Compiler (for Hexagon DSP based MSMs)<br />
– Assembler<br />
– Linker<br />
– Debugger<br />
– Simula<strong>to</strong>r<br />
• <strong>QDSP</strong> test framework<br />
• Can debug on simula<strong>to</strong>r and on target using<br />
Trace32 JTAG from Lauterbach<br />
9
Deliverables—Documents<br />
• <strong>QDSP</strong> programming reference manuals<br />
• Multimedia framework<br />
• ARM test framework<br />
• MSM overview<br />
• Self-training on <strong>to</strong>ols, multimedia framework<br />
on <strong>QDSP</strong><br />
• Video OpenMax API documents<br />
10
Deliverables—Software<br />
• ARM Development Framework<br />
– Download <strong>QDSP</strong><br />
– Interface with multimedia cores<br />
• DSP<br />
– RTOS<br />
– Multimedia framework<br />
– Example code <strong>to</strong> do audio playback and record<br />
11
<strong>QDSP</strong> <strong>Access</strong><br />
Utilization
<strong>Qualcomm</strong>’s Usage of the <strong>QDSP</strong><br />
• <strong>Qualcomm</strong> uses the DSP <strong>to</strong> deliver audio<br />
features <strong>to</strong> its OEMs<br />
– Voice codecs, post-processing such as echo<br />
cancellation<br />
– Audio codecs, post-processing such as equalizer<br />
• On older platforms<br />
– DSP is used <strong>to</strong> control video codec accelera<strong>to</strong>r<br />
hardware and video-front-end hardware<br />
13
Benefits of <strong>QDSP</strong> <strong>Access</strong> for OEM Partners<br />
• Faster time-<strong>to</strong>-market for new features<br />
• Have multiple sources of <strong>QDSP</strong> firmware delivery<br />
• Methodology<br />
– Replace<br />
– Add<br />
• Plug in cus<strong>to</strong>m Echo Cancellation<br />
• Replace <strong>Qualcomm</strong> provided modules with their own modules, such as<br />
Equalizer, Audio Decoder<br />
• Use cus<strong>to</strong>m codec drivers<br />
• Add a new post-processing step at an arbitrary point in the audio path<br />
• Add a new codec<br />
– Delete<br />
• Remove unused features <strong>to</strong> make DSP image smaller<br />
– Co-exist<br />
• Use the <strong>QDSP</strong> for non-audio applications, without affecting audio<br />
14
Software Delivery Model for<br />
Independent Software Vendors<br />
<strong>Qualcomm</strong><br />
ISV<br />
OEM<br />
Legend:<br />
ISV Development Framework<br />
OEM Specific Framework<br />
ISV enhancements<br />
OEM enhancements<br />
15
Software Delivery Model for ISVs<br />
• Integration is based upon build-time changes<br />
– No run-time feature modification is currently<br />
supported<br />
• Integration effort is <strong>to</strong> be expected when ISV<br />
merges its algorithm in<strong>to</strong> the OEM’s DSP image<br />
• An ARM test framework is provided that<br />
exercises the APIs and interfaces<br />
– Reduces integration time/risk with OEM<br />
16
Composition<br />
Benefits of <strong>QDSP</strong> <strong>Access</strong> for ISVs<br />
• Demonstrate algorithms running on the<br />
<strong>QDSP</strong> on real hardware<br />
• Guidance on which features <strong>to</strong> target for<br />
upcoming <strong>Qualcomm</strong> MSMs<br />
• <strong>Qualcomm</strong> team can help place product<br />
demos in<strong>to</strong> OEMs<br />
– Enables match making with OEMs looking for<br />
features<br />
17
Feature Needs—List Illustrates OEM Needs<br />
Audio<br />
AAC-LD / AAC-ELD<br />
AAC-LTP<br />
MPEG Surround<br />
MPEG Lossless<br />
MP3 Surround<br />
ATRAC3Plus<br />
MP2 decoder<br />
MP2 Encoder<br />
18
Utilization<br />
• Product Model<br />
– Develop and produce cus<strong>to</strong>m application accelerated<br />
on the <strong>QDSP</strong><br />
– Provide <strong>to</strong>ols <strong>to</strong> enhance programmability of the<br />
<strong>QDSP</strong><br />
• Service Model<br />
– Provide integration services <strong>to</strong> OEMs<br />
– Provide algorithm optimization services <strong>to</strong><br />
<strong>Qualcomm</strong>/OEMs/other ISVs<br />
– Host support centers for <strong>Qualcomm</strong>/OEMs<br />
19
How <strong>to</strong> Proceed<br />
• Learn more<br />
http://developer.qualcomm.com/multimedia<br />
20
Q&A
Thank you!<br />
<strong>Qualcomm</strong> is a registered trademark and registered service mark of <strong>Qualcomm</strong> Incorporated. Other products and brand names may be trademarks<br />
or registered trademarks of their respective owners.<br />
Product descriptions contained herein are subject <strong>to</strong> change from time <strong>to</strong> time without notice.<br />
© 2011 QUALCOMM Incorporated. All rights reserved.<br />
QUALCOMM Incorporated, 5775 Morehouse Drive, San Diego, CA 92121-1714
Change language