Error Tolerant Multimedia Stream Processing: There's ... - IEEE Xplore

More documents

Recommendations

Info

302 IEEE TRANSACTIONS ON MULTIMEDIA, VOL. 15, NO. 2, FEBRUARY 2013[21] J. Pearl, “Theoretical bounds on the complexity of inexact computations,”IEEE Trans. Inf. Theory, vol. 22, no. 5, pp. 580–586, May 1976.[22] D. Sow and A. Eleftheriadis, “Complexity distortion theory,” IEEETrans. Inf. Theory, vol. 49, no. 3, pp. 604–608, Mar. 2003.[23] N. Vereshchagin and P. Vitányi, “Rate distortion and denoising of individualdata using Kolmogorov complexity,” IEEE Trans. Inf. Theory,vol. 56, no. 7, pp. 3438–3454, Jul. 2010.[24] K. Vereshchagin and P. Vitanyi, “Algorithmic rate-distortion function,”in Proc. IEEE Int. Symp. Inf. Theory, 2006, pp. 798–802.[25] V. Goyal and M. Vetterli, “Computation-distortion characteristics ofblock transform coding,” in Proc. IEEE Int. Conf. Acoust., Speech,Signal Process., ICASSP-97, 1997, vol. 4, pp. 2729–2732.[26] J. Ostermann, J. Bormans, P. List,D.Marpe,M.Narroschke,F.Pereira,T. Stockhammer, and T. Wedi, “Video coding with h. 264/avc: Tools,performance, complexity,” IEEE Circuits Syst. Mag., vol. 4, no. 1, pp.7–28, Jan. 2004.[27] J. Ludwig, S. Nawab, and A. Chandrakasan, “Low-power digital filteringusing approximate processing,” IEEE J. Solid-State Circuits,vol. 31, no. 3, pp. 395–400, Mar. 1996.[28] A. Chandrakasan, V. Gutnik, and T. Xanthopoulos, “Data driven signalprocessing: An approach for energy efficient computing,” in Proc. Int.Symp. Low Power Electr. and Design, ISLPED’96, 1996, pp. 347–352.[29] Y. Andreopoulos and M. van der Schaar, “Incremental refinement ofcomputation for the discrete wavelet transform,” IEEE Trans. SignalProcess., vol. 56, no. 1, pp. 140–157, Jan. 2008.[30] D. Anastasia and Y. Andreopoulos, “Software designs of imageprocessing tasks with incremental refinement of computation,” IEEETrans. Image Process., vol. 19, no. 8, pp. 2099–2114, Aug. 2010.[31] D. Anastasia and Y. Andreopoulos, “Scheduling and energy-distortiontradeoffs with operational refinement of image processing,” in Proc.Design, Automat. & Test in Europe Conf. & Expo., DATE’10, 2010,pp. 1719–1724.[32] D. Lee, L. Kim, and J. Villasenor, “Precision-aware self-quantizinghardware architectures for the discrete wavelet transform,” IEEETrans. Image Process., vol. 21, no. 2, pp. 768–777, Feb. 2012.[33] T. Xanthopoulos and A. Chandrakasan, “A low-power DCT core usingadaptive bitwidth and arithmetic activity exploiting signal correlationsand quantization,” IEEE J. Solid-State Circuits, vol.35,no.5,pp.740–750, May 2000.[34] Y. Chen and H. Sundaram, “Basis projection for linear transformapproximation in real-time applications,” in Proc. IEEE Int. Conf.Acoust., Speech and Signal Process., ICASSP’06, 2006, vol. 2, p. II-II.[35] M. van der Schaar and Y. Andreopoulos, “Rate-distortion-complexitymodeling for network and receiver aware adaptation,” IEEE Trans.Multimedia, vol. 7, no. 3, pp. 471–479, Jun. 2005.[36] Y. Andreopoulos and M. van der Schaar, “Complexity-constrainedvideo bitstream shaping,” IEEE Trans. Signal Process., vol. 55, no. 5,pp. 1967–1974, May 2007.[37] B. Foo, Y. Andreopoulos, and M. van der Schaar, “Analytical ratedistortion-complexitymodeling of wavelet-based video coders,” IEEETrans. Signal Process., vol. 56, no. 2, pp. 797–815, Feb. 2008.[38] Y. Andreopoulos and M. van der Schaar, “Adaptive linear predictionfor resource estimation of video decoding,” IEEE Trans. Circuits Syst.Video Technol., vol. 17, no. 6, pp. 751–764, Jun. 2007.[39] H. Stolberg, M. Bereković, and P. Pirsch, “A platform-independentmethodology for performance estimation of multimedia signal processingapplications,” J. VLSI Signal Process., vol. 41, no. 2, pp.139–151, Feb. 2005.[40] I. Bauermann and E. Steinbach, “RDTC optimized compression ofimage-based scene representations (part i): Modeling and theoreticalanalysis,” IEEE Trans. Image Process., vol. 17, no. 5, pp. 709–723,May 2008.[41] I. Bauermann and E. Steinbach, “RDTC optimized compression ofimage-based scene representations (part ii): Practical coding,” IEEETrans. Image Process., vol. 17, no. 5, pp. 724–736, May 2008.[42] D. Turaga, M. van der Schaar, and B. Pesquet-Popescu, “Complexityscalable motion compensated wavelet video encoding,” IEEE Trans.Circuits Syst. Video Technol., vol. 15, no. 8, pp. 982–993, Aug. 2005.[43] G. Lee, Y. Chen, M. Mattavelli, and E. Jang, “Algorithm/architectureco-exploration of visual computing on emergent platforms: Overviewand future prospects,” IEEE Trans. Circuits Syst. Video Technol., vol.19, no. 11, pp. 1576–1587, Nov. 2009.[44] J. Valentim, P. Nunes, and F. Pereira, “Evaluating mpeg-4 videodecoding complexity for an alternative video complexity verifiermodel,” IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 11, pp.1034–1044, Nov. 2002.[45] M. Horowitz, A. Joch, F. Kossentini, and A. Hallapuro, “H.264/AVCbaseline profile decoder complexity analysis,” IEEE Trans. CircuitsSyst. Video Technol., vol. 13, no. 7, pp. 704–716, Jul. 2003.[46] S. Regunathan, P. Chou, and J. Ribas-Corbera, “A generalized videocomplexity verifier for flexible decoding,” in Proc. IEEE Int. Conf.Image Processing, ICIP’03, 2003, vol. 3, pp. 289–292.[47] W. Yuan and K. Nahrstedt, “Practical voltage scaling for mobile multimediadevices,” in Proc. 12th ACM Int. Conf. Multimedia, 2004, pp.924–931.[48] Z. He, Y. Liang, L. Chen, I. Ahmad, and D. Wu, “Power-rate-distortionanalysis for wireless video communication under energy constraints,”IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 5, pp. 645–658,May 2005.[49] W. Yuan, K. Nahrstedt, S. Adve, D. Jones, and R. Kravets, “Grace-1:Cross-layer adaptation for multimedia quality and battery energy,”IEEE Trans. Mobile Comput., vol. 5, no. 7, pp. 799–815, Jul. 2006.[50] J. Srinivasan and S. Adve, “Predictive dynamic thermal managementfor multimedia applications,” in Proc, 17th Int. Conf. Supercomput.,ICS’03, 2003, pp. 109–120.[51] Z. Cao, B. Foo, L. He, and M. van der Schaar, “Optimality and improvementof dynamic voltage scaling algorithms for multimedia applications,”IEEE Trans. Circuits Syst., vol. 57, no. 3, pp. 681–690,Mar. 2010.[52] N. Mastronarde and M. van der Schaar, “A bargaining theoretic approachto quality-fair system resource allocation for multiple decodingtasks,” IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 4, pp.453–466, Apr. 2008.[53] W. Xu, X. Liu, and Y. Gong, “Document clustering based on nonnegativematrix factorization,” in Proc.26thInt.ACMConf.Res.andDev. in Inf. Retr., 2003, pp. 267–273.[54] D. Ellis, C. Cotton, and M. Mandel, “Cross-correlation of beatsynchronousrepresentations for music similarity,” in Proc. IEEEInt. Conf. Acoust., Speech and Signal Process., ICASSP’08, 2008,pp. 57–60.[55] B. Dally, “The future of GPU computing,” in Proc. ACM/IEEE Int.Conf. Supercomp., SC’09 (presentation), 2009.[56] H. Asthana, R. Fu, and I. Cox, “On the feasibility of unstructuredpeer-to-peer information retrieval,” Adv. Inf. Retr. Theory, pp.125–138, 2011.[57] R. Datta, D. Joshi, J. Li, and J. Wang, “Image retrieval: Ideas, influences,trends of the new age,” ACM Comput. Surv.,vol.40,no.2,p.5,Apr. 2008.[58] C. Schmid, R. Mohr, and C. Bauckhage, “Evaluation of interest pointdetectors,” Int. J. Comput. Vis., vol. 37, no. 2, pp. 151–172, Feb. 2000.[59] Y. Andreopoulos and I. Patras, “Incremental refinement of imagesalient-point detection,” IEEE Trans. Image Process., vol. 17, no. 9,pp. 1685–1699, Sep. 2008.[60] D. Jun and D. Jones, “An energy-aware framework for cascaded detectionalgorithms,” in Proc. IEEE Workshop Signal Process. Syst.,SIPS’10, 2010, pp. 1–6.[61] P. Mainali, Q. Yang, G. Lafruit, L. Gool, and R. Lauwereins, “Robustlow complexity corner detector,” IEEE Trans. Circuits Syst. VideoTechnol., vol. 21, no. 4, pp. 435–445, Apr. 2011.[62] K. Fukunaga, Introduction to Statistical Pattern Recognition. NewYork: Elsevier, 1990.[63] B. Foo and M. van der Schaar, “A distributed approach for optimizingcascaded classifier topologies in real-time stream mining systems,”IEEE Trans. Image Process., vol. 19, no. 11, pp. 3035–3048, Nov.2010.[64] K. Asanovic and N. Morgan, Univ. of California Berkeley, InternationalComputer Science Institute, Experimental Determination ofPrecision Requirements for Back-Propagation Training of ArtificialNeural Networks, TR-91-036, 1991, Tech. Rep.[65] M. Bartlett, J. Movellan, and T. Sejnowski, “Face recognition by independentcomponent analysis,” IEEE Trans. Neural Netw., vol. 13, no.6, pp. 1450–1464, Jun. 2002.[66] J. Yang, D. Zhang, A. Frangi, and J. Yang, “Two-dimensional PCA:A new approach to appearance-based face representation and recognition,”IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 1, pp.131–137, Jan. 2004.[67] D. Lowe, “Object recognition from local scale-invariant features,”in Proc. 7th IEEE Conf. Comp. Vis., ICCV’99, 1999, vol. 2, pp.1150–1157.[68] K. Goto and R. Van De Geijn, “High-performance implementation ofthe level-3 blas,” ACM Trans. Math. Softw., vol. 35, no. 1, Jan. 2008,article 4.
ANDREOPOULOS: ERROR TOLERANT MULTIMEDIA STREAM PROCESSING: THERE’S PLENTY OF ROOM AT THE TOP (OF THE SYSTEM STACK) 303[69] E. Agullo, J. Demmel, J. Dongarra, B. Hadri, J. Kurzak, J. Langou,H. Ltaief, P. Luszczek, and S. Tomov, “Numerical linear algebra onemerging architectures: The PLASMA and MAGMA projects,” J.Phys.: Conf. Series, vol. 180, no. 012037, 2009.[70] A. Portero, G. Talavera, M. Moreno, J. Carrabina, and F. Catthoor,“Methodology for energy-flexibility space exploration and mappingof multimedia applications to single-processor platform styles,” IEEETrans. Circuits Syst. Video Technol., vol. 21, no. 8, pp. 1027–1039,Aug. 2011.[71] S. Bhattacharyya, J. Eker, J. Janneck, C. Lucarz, M. Mattavelli, andM. Raulet, “Overview of the mpeg reconfigurable video coding framework,”J. Signal Process. Syst., vol. 63, no. 2, pp. 251–263, Apr. 2011.[72] L. Buatois, G. Caumon, and B. Levy, “Concurrent number cruncher:A gpu implementation of a general sparse linear solver,” Int. J. Par.,Emerg., Distrib. Syst., vol. 24, no. 3, pp. 205–223, Jun. 2009.[73] J. Langou, P. Luszczek, J. Kurzak, A. Buttari, and J. Dongarra, “Exploitingthe performance of 32 bit floating point arithmetic in obtaining64 bit accuracy (revisiting iterative refinement for linear systems),” inProc. ACM/IEEE Conf. Supercomput., SC’06, 2006, pp. 50–50.[74] D. Murray and S. Hand, “Spread-spectrum computation,” in Proc. 4thUSENIX Conf. Hot Top. in Syst. Depend., 2008, pp. 5–8.[75] N. Maruyama, A. Nukada, and S. Matsuoka, “Software-based eccfor gpus,” in Proc. Symp. Appl. Accel. in High Perf. Comput.,SAAHPCŠ’09, 2009.[76] J. Sheaffer, D. Luebke, and K. Skadron, “A hardware redundancy andrecovery mechanism for reliable scientific computation on graphicsprocessors,” in Proc. 22nd ACM/SIGGRAPH/EUROGRAPHICSSymp. Graph. Hardw., 2007, pp. 55–64.[77] M. Breuer, “Hardware that produces bounded rather than exact results,”in Proc 47th Des. Autom. Conf., 2010, pp. 871–876.[78] H. Chung and A. Ortega, “Analysis and testing for error tolerant motionestimation,” in Proc. 20th IEEE Int. Symp. Defect and Fault Tol. inVLSI Syst., DFT’05, 2005, pp. 514–522.[79] K. Lengwehasatit and A. Ortega, “Scalable variable complexity approximateforward dct,” IEEE Circuits Syst. Video Technol., vol. 14,no. 11, pp. 1236–1248, Nov. 2004.[80] E. Phillips, “CUDA accelerated linpack on clusters,” in Proc. ACM/IEEE Int. Conf. Supercomp., SC’09 (presentation), 2009.[81] D. Anastasia and Y. Andreopoulos, “Linear image processing operationswith operational tight packing,” IEEE Signal Process. Lett., vol.17, no. 4, pp. 375–378, Apr. 2010.[82] A. Kadyrov and M. Petrou, “The Invaders’ algorithm: Range of valuesmodulation for accelerated correlation,” IEEE Trans. Pattern Anal.Mach. Intell., vol. 28, no. 11, pp. 1882–1886, Nov. 2006.[83] J. Allen, “An approach to fast transform coding in software,” ElsevierSignal Process.: Image Commun., vol. 8, no. 1, pp. 3–11, Jan. 1996.[84] C. Lin, B. Zhang, and Y. Zheng, “Packed integer wavelet transformconstructed by lifting scheme,” IEEE Trans. Circuits Syst. VideoTechnol., vol. 10, no. 8, pp. 1496–1501, Aug. 2000.[85] D. Borland and G. Constantinides, “A scalable precision analysisframework,” IEEE Trans. Multimedia, this issue.[86] S. Nassif, N. Mehta, and Y. Cao, “A resilience roadmap,” in Proc. Des.,Autom. & Test in Eur. Conf. & Expo., DATE’10, 2010, pp. 1011–1016.[87] N. Mastronarde, K. Kanoun, D. Atienza, P. Frossard, and M. vander Schaar, “Markov decision process based energy-efficient on-linescheduling for slice-parallel video decoders on multicore systems,”IEEE Trans. Multimedia, this issue.[88] J. Dean and S. Ghemawat, “MapReduce: Simplified data processing onlarge clusters,” Commun. ACM, vol. 51, no. 1, pp. 107–113, Jan. 2008.[89] M. Liu, Z. Lu, W. Kuehn, and A. Jantsch, “Fpga-based adaptive computingfor correlated multi-stream processing,” in Proc. Des., Automat.& Test in Europe Conf. & Expo., DATE’10, 2010, pp. 973–976.[90] W. Li, X. Tong, T. Wang, Y. Zhang, and Y. Chen, “Parallelizationstrategies and performance analysis of media mining applications onmulti-core processors,” J. Signal Process. Syst., vol.57,no.2,pp.213–228, Mar. 2009.[91] L. Leem, H. Cho, J. Bau, Q. Jacobson, and S. Mitra, “ERSA: Errorresilient system architecture for probabilistic applications,” in Proc.Des., Autom. & Test in Europe Conf. & Expo., DATE’10, 2010, pp.1560–1565.[92] P. Subramanyan, V. Singh, K. Saluja, and E. Larsson, “Multiplexed redundantexecution: A technique for efficient fault tolerance in chip multiprocessors,”in Proc. Des., Autom. & Test in Europe Conf. & Expo.,DATE’10, 2010, pp. 1572–1577.[93] P. Korkmaz, B. Akgul, and K. Palem, “Energy, performance, probabilitytradeoffs for energy-efficient probabilistic cmos circuits,” IEEETrans. Circuits Syst. I: Reg. Papers, vol. 55, no. 8, pp. 2249–2262, Aug.2008.[94]N.Carter,H.Naeimi,andD.Gardner,EuropeanDesignandAutomationAssociation, “Design techniques for cross-layer resilience,”in Proc. Des., Automat. & Test in Europe Conf. & Expo., DATE’10,2010, pp. 1023–1028.[95] M. Nicolaidis, “Time redundancy based soft-error tolerance to rescuenanometer technologies,” in Proc. 17th IEEE. Int. VLSI Test Symp.,VTS’99, 1999, pp. 86–94.[96] M. Nicolaidis, “Design for soft error mitigation,” IEEE Trans. Dev.Mater. Reliab., vol. 5, no. 3, pp. 405–418, Mar. 2005.[97] K. Nepal, R. Bahar, J. Mundy, W. Patterson, and A. Zaslavsky, “Designingnanoscale logic circuits based on Markov random fields,” J.Electron. Test., vol. 23, no. 2, pp. 255–266, Feb. 2007.[98] G. Varatkar, S. Narayanan, N. Shanbhag, and D. Jones, “Stochasticnetworked computation,” IEEE Trans. Very Large Scale Integr., vol.18, no. 10, pp. 1421–1432, Oct. 2010.[99] W. Qian, X. Li, M. Riedel, K. Bazargan, and D. Lilja, “An architecturefor fault-tolerant computation with stochastic logic,” IEEE Trans.Comput., vol. 60, no. 1, pp. 93–105, Jan. 2011.[100] T. Austin, D. Blaauw, T. Mudge, and K. Flautner, “Making typicalsilicon matter with razor,” IEEE Comput., vol. 37, no. 3, pp. 57–65,Mar. 2004.[101] J. Sartori and R. Kumar, “Branch and data herding: Reducing controland memory divergence for error-tolerant GPU applications,” IEEETrans. Multimedia, this issue.[102] R. A. Abdallah and N. R. Shanbhag, “Robust and energy efficient multimediasystems via likelihood processing,” IEEE Trans. Multimedia,this issue.[103] H. Kaul, M. Anders, S. Mathew, S. Hsu, A. Agarwal, F. Sheikh, R.Krishnamurthy, and S. Borkar, “A 1.45 GHz 52-to-162GFLOPS/Wvariable-precision floating-point fused multiply-add unit with certaintytracking in 32 nm CMOS,” in Proc. IEEE Int. Solid-State Circ. Conf.Dig of Tech. Papers, ISSCC’12, 2012, pp. 182–184.[104] A. Lingamneni, K. Muntimadugu, C. Enz, R. Karp, K. Palem, and C.Piguet, “Algorithmic methodologies for ultra-efficient inexact architecturesfor sustaining technology scaling,” in Proc. 9th ACM Conf.Comput. Front., 2012, pp. 3–12.Yiannis Andreopoulos (M’00) received the ElectricalEngineering Diploma and the M.Sc. degreein signal processing systems from the University ofPatras, Greece, in 1999 and 2000, respectively. Hereceived the Ph.D. degree in applied sciences fromthe University of Brussels (Belgium) in May 2005,where he defended a thesis on scalable video codingand complexity modeling for multimedia systems.During his thesis work, he participated and wassupported by the EU IST-project MASCOT, a Futureand Emerging Technologies (FET) project. Duringhis post-doctoral work at the University of California Los Angeles (USA), heperformed research on cross-layer optimization of wireless media systems,video streaming, and theoretical aspects of rate-distortion-complexity modelingfor multimedia systems. Since October 2006, he has been a Lecturer at theUniversity of London (U.K.), currently with the University College London.During 2002–2003, he made several decisive contributions to the ISO/IECJTC1/SC29/WG11 (Motion Picture Experts Group—MPEG) committee inthe early exploration on scalable video coding, which has now moved intothe standardization phase. He received the 2007 “Most-Cited Paper” awardfrom the ELSEVIER EURASIP SIGNAL PROCESSING: IMAGE COMMUNICATIONjournal and a best-paper award from the 2009 IEEE Workshop on SignalProcessing Systems.Dr. Andreopoulos was Special Sessions Co-chair of the 10th InternationalWorkshop on Image Analysis for Multimedia Interactive Services (WIAMIS2009) and Programme Co-chair of the 18th International Conference onMultimedia Modeling (MMM 2012). He is an Associate editor of the IEEETRANSACTIONS ON MULTIMEDIA, the IEEE SIGNAL PROCESSING LETTERS andthe Elsevier Image and Vision Computing journal.
Page 3 and 4: ANDREOPOULOS: ERROR TOLERANT MULTIM
Page 6 and 7: 296 IEEE TRANSACTIONS ON MULTIMEDIA

Error Tolerant Multimedia Stream Processing: There's ... - IEEE Xplore

Create successful ePaper yourself

Delete template?

Save as template?