ECE1780F - Advanced Mobile User Interfaces
With the rapid advancement of mobile computing, and the limited physical space available for keyboards/buttons on mobile devices, there will be an ever greater need for novel types of mobile user interfaces including dynamic keyboards, computer-vision based interfaces, speech and audio processing (with Siri as one example), as well as other interface modalities. The goal of this course is to provide an overview of the information processing algorithms and design principles behind today's most popular and tomorrow's emerging mobile user interface systems.

ECE1780F consists of a few background lectures focusing on a full-term course project where students will devise and create their own mobile application. Students, working in groups of 1-3, will work on a mobile app with a focus on unique/optimized User Interfaces. App ideas need to be finalized by September 22, with the functional app demo due on October 20, and final app demo by December 1.

Lecture 1A
Lecture 1B
Mobile Touch UI Optimization
Lecture 2A
Speech Recognition
Lecture 2B
Speech Enhancement
Lecture 3A
Conversational Systems
Lecture 3B
The Future of Mobile UI
Sept. 8 - Lecture 1A+1B
Sept. 15 - Overview of 2013 project + group formation
Sept. 22 - Lecture 2A+2B
Sept. 29 - Project Proposal Presentations (10%)
Oct. 6 - Lecture 3A+3B
Oct. 20 - Functional Demo (30%)
Oct. 27 - Group Discussion/Meeting Hours
Nov. 3 - Final Demo Rehearsal 1 (0%)
Nov. 10 - NO CLASS
Nov. 17 - Group Discussion/Meeting Hours
Nov. 24 - Final Demo Rehearsal 2 (0%) + Preliminary Report Due (0%)
Dec. 1 - Final Demo (30%) + Final Report Due (30%)

2013 FINAL RESULTS: Click here for a recap post on the most exciting projects of the 2013 edition of ECE1780.
Relevant Publications

[1] Mavandadi, S., Aarabi, P., Khaleghi, A., Appel, R., Predictive Dynamic User Interfaces For Interactive Visual Search, ICME 2006.
[2] Aarabi, P., Probabilistic Design of Space-constrained Touch-based User Interfaces, IEEE MMSP, 2013.
[3] Ward D.J., Blackwell, A.F., and MacKay, D.J.C., Dasher data entry interface using continuous gestures and language models, UIST, 2000.
[4] Chowdhury, T., Zhou, K., Zou, K., Yuan, M., Aarabi, P., Extended Touch Mobile User Interfaces, IEEE International Conference on Multimedia and Expo, July 2013.
[5] G. Hinton, L. Deng, D. Yu, G. Dahl, A.Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. Sainath, and B. Kingsbury, Deep Neural Networks for Acoustic Modeling in Speech Recognition, IEEE Signal Processing Magazine, 29, November 2012
[6] Rabiner, L.R., Schafer, R.W., Introduction to Digital Speech Processing, Foundations, and Trends, in Signal Processing, Vol. 1, no. 1-2, pp. 1-194, 2007.
[7] Aarabi, P., Shi, G., Jahromi, O., Robust Speech Separation Using Time-Frequency Masking. Proceedings of the 2003 IEEE Conference on Multimedia and Expo (ICME 2003), Baltimore, Maryland, July 2003.
[8] Aarabi, P., Shi, G., Phase-Based Dual-Microphone Robust Speech Enhancement, IEEE Transactions on Systems, Man, and Cybernetics Part B, Vol. 34, No. 4, pp. 1763-1773, August 2004.
[9] Shi, G., Shanechi, M., Aarabi, P., On the importance of phase in human speech recognition, IEEE Transactions on Audio, Speech, and Language Processing, Vol. 14, No. 5, pp. 1867-1874, September 2006.
[10] Mungamuru, B., Aarabi, P., Enhanced Sound Localization, IEEE Transactions on Systems, Man, and Cybernetics Part B, Vol. 34, No. 3, pp. 1526-1540, June 2004.
[11] Aarabi, P., The Fusion of Distributed Microphone Arrays for Sound Localization, EURASIP Journal of Applied Signal Processing (Special Issue on Sensor Networks), Vol. 2003, No. 4, pp. 338-347, March 2003.
[12] Aarabi, P., Virtual Cardiologist - A Conversational System for Medical Diagnosis, Canadian Conference on Electrical and Computer Engineering, May, 2013.
Quick Links
• APL Website
• ECE1778S
• Prof. Parham Aarabi
Contact Us
If you have any questions, please contact us:
Prof. Aarabi: p(AT)arh(D0T)am
© 2014 University of Toronto