Chapter 8 - Multichannel and Multimodal User Interfaces  pp. 497-554

Multichannel and Multimodal User Interfaces

By Reza B'Far and Roy T. Fielding

Image View Previous Chapter Next Chapter

Seek first God's Kingdom, that is, become like the lilies and the birds, become perfectly silent. Then shall the rest be added to you.

Søren Kierkegaard


We have thus far discussed user interfaces in some detail. We have seen that, depending on the function of the mobile application, we may want to interact with the user through audio, a traditional GUI, or a combination thereof. We have also seen that, because of the wide variety of capabilities among mobile devices and the proliferation of the platforms, there are a great number of user interfaces that we may have to implement for a given application. Although we have looked at mobile GUIs and then VUIs individually, we have not looked at the discipline of building applications that may use more than one channel of communication with the network or interact with the user through more than one mode of their user interface. This is what we will be discussing in this chapter.

First, let us define what multichannel and multimodal mean for these two terms have been incorrectly used widely in the literature on mobile computing. To start, remember that multimodal and multichannel are not the same thing. Multichannel may have two different meetings. First, it can be used to imply a user interface that establishes more than one communication channel to the user. For example, a user interface may present an audio and a video channel to the user.

Chapter 8

Reference Title: References

Reference Type: reference-list

Reference Type: reference-list

[3GPP 2000] 3rd Generation Partnership Project: Technical Specification Group SA WG3; A Guide to 3rd Generation Security, 3G TR 33.900, 3GPP TSG, 2000
[ACSS 1998] W3C CSS 2 Aural Style Sheets Specification. 1999, available at–19980512/aural.html
[Afnan 2002] Mobile Code for Mobile Devices: Migration for Improved Application Performance. O. Afnan, Carleton University, Ottawa, Canada, 2002
[Agarwal, Starobinski, and Trachtenberg 2000] On the Scalability of Data Synchronization Protocols for PDA's and Mobile Devices. S. Agarwal, D. Starobinski, and A. Trachtenberg, Boston University, 2000
[Agre et al. 2001] A Layered Architecture for Location-Based Services in Wireless Ad Hoc Networks. J. Agre, A. Akinyemi, L. Ji, R. Masuka, and P. Thakkar, IEEE Press, November 2001 available at∼rmasuoka/papers/200203-LocationProtocol7.doc
[Alatalo and Peraaho 2001] Designing Mobile-Aware Adaptive Hypermedia. T. Alatalo and J. Peraaho, University of Oulu, Finland, OWLA project, 2001, available at
[AMASE 1999] AMASE Bench Marking Report. L. Sacks, T. Michalareas, and W. S. Lee, University College London, 1992, available at∼pants/projects/amase/
[Amyot and Andradel 2001] Description of Wireless Intelligent Network Services with Use Case Maps. D. Amyot and R. Andradel, University of Ottawa, 2001
[Andersson 2002] Mobile Positioning—Where You Want to Be! C. Andersson, Wireless Developer Network, 2002, available at
[Apache 2000] Apache Software Foundation, available at
[Apache XML 2002] Cocoon Web site at Apache Foundation,
[Apaydin 2002] Networked Humanoid Animation Driven by Human Voice Using Extensible 3D, H-ANIM, and Java Speech Open Standards. O. Apaydin, Thesis, United States Navy Post Graduate School, Monterey, CA, 2002, available at
[Appleby et al 2000] An Introduction to IBM WebSphere Everyplace Suite Version 1.1. J. R. Rodriguez, R. Appleby, B. Bisgaard, H. Wang, A. McGory, A. Mryhij, A. Patton, and M. Omarjee, IBM Corporation, International Technical Support Organization, Research Triangle Park, N.C.
Vol, issue, pg range [Arbaugh 2003] Firewalls: An Outdated Defense. W. A. Arbuagh, IEEE Computer Magazine, June 2003
[Asensio et al. 2001] UML Profiles for the Specification and Instrumentation of QOS Management Information in Distributed Object-Based Applications. J. I. Asensio, V. A. Villagra, J. E. Lopez de Vergara, J. J. Berrocal, Technical University of Madrid, Spain, 2001
[Aziz and Diffie 1993] Privacy and Authentication for Wireless Local Area Networks. A. Aziz and W. Diffie, Sun Microsystems, 1993
[Bahl 2002] An Overview of Cell Search in WCDMA. S. K. Bahl, University of Maryland, 2002
[Balani 2002] Build Java Apps, Like an EPOC-based Phone, for the Symbian OS. N. Balani, IBM Developer Works, available at
[Bannon et al. 2002] Extraction of Axis OpenBT Bluetooth Stack. R. Bannon, A. Chin, F. Kassam, and A. Roszko, University of Waterloo, CS 798 Software Architecture Course Notes, 2002
[Baragry and Reed 1998] “Why Is It So Hard to Define Software Architecture?” J. Baragry and C. Reed, IEEE Conference Proceedings, Asia Pacific Software Engineering Conference, IEEE, 1998
Publisher? Pages? [Bauer 2001] “UML Class Diagrams: Revisited in the Context of Agent-Based Systems.” B. Bauer in Proceedings of Agent-Oriented Software Engineering, 2001
[Bauer, Odell, and Muller 2001] Agent UML: A Formalism for Specifying Multiagent Interaction Agent-Oriented Software Engineering. P. Ciancarini and M. Wooldridge, eds., Springer-Verlag, pp. 91–103, 2001
[Baumeister, Koch, and Mandel 1999] Towards a UML Extension for Hypermedia Design. H. Baumeister, N. Koch, and L. Mandel, Institut für Informatik Ludwig-Maximilians-Universität München and Forschungsinstitut für Angewandte Software Technologie (FAST e. V.), 1999
Vol, issue, pgs [Beresford and Stajano 2003] Location Privacy in Pervasive Computing. A. R. Beresford and F. Stajano, IEEE Pervasive Computing Magazine, March 2003
[Bergenti and Poggi 2001] LEAP: A FIPA Platform for Handheld and Mobile Devices. F. Bergenti and A. Poggi, 2001, available at
[Bernsen 2002] Multimodality in Language and Speech Systems—From Theory to Design Support Tool. N. O. Bernsen, Kluwer Academic Publishers, 2002
[Berre 2001] The Model-Driven Approach to Geographic Information System Standardization—Lessons Learned, A. J. Berre, SINTEF, Oslo, Norway, Distributed Information Systems, 2001, available at
[B'Far 2000] “Next Generation of Internet: The 4th-Tier Is Born.” R. B'Far, IEEE Tools 2000 Conference Proceeding, IEEE, 2000
Publisher? Pages? [Bisdikian 1999] “L2CAP—Logical Link Control.” C. Bisdikian in Bluetooth Developer's Conference Proceedings, 1999
[Bluetooth] Bluetooth Specifications, available at
[Bolcer 2000] “Magi: An Architecture for Mobile and Disconnected Work Flow.” G. A. Bolcer, Endeavor's Technology, IEEE Internet Computing, May–June 2000
[Bolcer and Oreizy 2000] Introducing Peer-to-Peer. G. Bolcer and P. Oreizy, White paper, Endeavors Technology, 2000
[Booch et al. 1999] UML for XML Schema Mapping Specification. G. Booch, M. Christerson, M. Fuchs, and J. Koistinen. Rational Rose Corporation and CommerceOne Inc., 1999
[Booch, Rumbaugh, and Jacobsen 1999] The Unified Modeling Language User Guide. G. Booch, J. Rumbagh, and I. Jacobsen, Addison-Wesley, 1999
[Booch, Rumbaugh, and Jacobson 1999] The Unified Modeling Language User Guide. G. Booch, J. Rumbaugh, and I. Jacobson, Addison-Wesley, 1999
Provide Publisher, not affiliation/ [Bozinovska and Gusev] Push Technology. N. Bozinovska and M. Gusev, Institute of Informatics, Faculty of Natural Sciences and Mathematics, SS Cyril and Maethodius University, Macedonia
[Brannan 2003] How to Build an XMLForm Wizard. H. Brannan, Apache Software Foundation, 2002–2003
[Bray and Brickley 2001] What Is RDF? T. Bray and D. Brickley,, available at
[Brecht et al. 2002] SRI's Digital Earth Project. Y. Leclerc, M. Reddy, M. Eriksen, J. Brecht, and D. Colleen, Stanford Research Institute, 2002
Publisher/sponser. pgs [Broadbent and Marti 2002] “Location Aware Mobile Interactive Guides: Usability Issues.” J. Broadbent and P. Marti, CB&J and University of Siena. Proceedings of the Fourth International Conference on Hypermedia and Interactivity in Museums (ICHIM97), 1997
[Brown and Singh 1996] M-UDP: UDP for Mobile Cellular Networks. K. Brown and S. Singh, University of South Carolina, 1996
[Brown et al. 1998] AntiPatterns: Refactoring Software, Architectures, and Projects in Crisis. W. H. Brown, R. C. Malveau, H. W. McCormick III, and T. J Mowbray, Wiley, 1998
Publisher or sponser [Budrovich 2001] “Techniques for Preventing Wireless System Software Errors.” V. Budrovich, Proceedings of Wireless One, SIGS 101 Conference, 2001
[Bunt and Romary 2002] Towards Multimodal Content Representation. H. Bunt and L. Romary, Computation Linguistics and AI, Tilsburg University, Netherlands, and University de Nancy, France, 2002
[Burnett, Prekop, and Rainsford 2001] Intimate Location Modeling for Context Aware Computing. M. Burnett, P. Prekop, and C. Rainsford, Department of Defense, Fern Hill Park, Australia, 2001
pg range [Buschkes et al. 1998] How to Increase Security in Mobile Networks by Anomaly Detection. R. Buschke, D. Kesdogan, and P. Reichl, Informatik 4, 1998
[Buschmann et al. 1996] Pattern Oriented Software Architecture: A System of Patterns. F. Buschmann, R. Meunier, H. Rohnert, P. Sommerlad, and M. Stal, Wiley, 1996
[Campbell 2001] Wireless and Mobile Networking Course Notes, E6951, Mobile IP. A. T. Campbell, Columbia University, 2001
[Candolin 2000] Security Issues for Wearable Computing and Bluetooth Technology. C. Candolin, Helsinki University of Technology, 2000
[Candolin 2002] Transaction Privacy in Wireless Networks. C. Candolin, Helsinki University of Technology, 2002
[CC/PP P3P W3C 2001] CC/PP Implementer's Guide: Privacy and Protocols. H. Ohto, L. Suryanarayana, and J. Hjelm, W3C Working Draft, December 20, 2001
[CC/PP W3C Specification] Composite Capability/Preferences Profiles (CC/PP): Structure and Vocabularies, W3C Working Draft 15 March 2001, available at
Title, authors? pgs? [CCML 2002] 2002, available at
[Chess 1993] “Itinerant Agents for Mobile Computing.” D. Chess, B. Grosof, C. Harrison, D. Levine, C. Parris, and G. Tsudik, Journal of Personal Communication, Vol. 2, No. 5, October 1993
[Cheyer and Julia 1995] Multimodal Maps: An Agent-Based Approach. A. Cheyer and L. Julia, SRI International, June 9, 1995
Give publisher [Claessens et al. 2003] Pioneering Advanced Mobile Privacy and Security. J. Claessens, A. Fuchsberger, C. Gunther, S. Holtmanns, G. Horn, K. Howker, R. J. Hulsebosch, C. Mitchell, K. Paterson, B. Preneel, D. Schellekens, and M. Schuba, 2003
vol, issue, pgs [Clarkin 2003] “10 Tips for Mobile Security.” M. Clarkin, Communication News, January 2003
[Cocoon 2002] Introducing Cocoon 2.0. S. Mazzocchi, February 2002, available at
Page, range, vol. #? [Consolvo and Walker 2003] “Using the Experience Sampling Method to Evaluate Ubicomp Applications.” S. Consolvo and M. Walker in IEEE Pervasive Computing, April–June 2003
[Cook 2001] Software Engineering Concerns for Mobile Agent Systems. J. Cook, New Mexico State University, 2001
[Corradini and Cohen 2002] Multimodal Speech-Gesture Interface for Handfree Painting on a Virtual Paper Using Partial Recurrent Neural Networks as Gesture Recognizer. A. Corradini and P. R. Cohen, Oregon Graduate Institute for Science and Technology, 2002
[Coutaz 2002] Software Architecture Modeling for User Interfaces. J. Coutaz, Laboratoire CLIPS (IMAG), 2002
Author: Provide page ranges and publihser/sponser [Coutaz et al. 2003] Towards Automatic Evaluation of Multimodal User Interfaces. J. Coutaz, D. Salber, and S. Balbo, Laboratoire de Genie Informatique, IMAG, 2003
[Cranefield 2001] UML and the Semantic Web. S. Cranefield, Department of Information Science, University of Otago, New Zealand, 2001
Provide publisher and pub's location [Cranefield et al. 1999] “UML as an Ontology Modeling Language.” S. Cranefield and M. Purvis in Proceedings of the Workshop on Intelligent Information Integration, 16th International Joint Conference on Artificial Intelligence 1999, 1999
[Crease, Gray, and Cargill 2001] Using Location Information in an Undergraduate Computing Science Laboratory Support System. M. Crease, P. Gray, and J. Cargill, University of Glasgow, 2001
[Dahl 2003] “The Role of Speech in Mutilmodal Applications.” D. Dahl in Speech Technology Magazine, May/June 2003
Include publisher only, not author affiliations [Davis and Prashar 2002] Latency Performance of SOAP Implementations. D. Davis and M. Prashar, IEEE Cluster Computing and the GRID, IEEE, Compaq Corporation, and Department of Computer Science at Rutgers University, 2002
Modify as necessary [DCM 2001] A Complete Solution for Remote Synchronization, Version 1.0. DCM Technologies LTD, August 6, 2001
Is Muench the author? [Development tools for Mobile and Embedded Applications 2002] Microsoft Corporation, 2002, available at;C.Muench
[Dewan 2002] Replication for Mobile Computing. P. Dewan, University of North Carolina, 2002
[Dimitri 2002] Mobile Platforms for Mobile Agents. V. Dimitri, University of Brussels at Vrije, 2002
[Dix et al. 1998] Human-Computer Interaction, A. J. Dix, J. E. Finlay, G. D. Abowd, and R. Beale, Prentice Hall Europe, 1998
[Djenidi et al. 2002] Dynamic Based Agent Reconfiguration of Multimedia Multimodal Architecture. H. Djenidi, A. Ramdane-Cherif, Pr. C. Tadj, and Pr. N. Levy, Electrical Engineering Department, Ecole de Technologie Superieure, 2002
[Djuknic and Richton 2002] Geolocation and Assisted-GPS, G. M. Djuknic and R. E. Richton., Bell Laboratories, Lucent Technologies, 2002
[Domnitcheva 2002] Location Modeling: State of the Art Challenges. S. Domitcheva, Distributed Systems Group, Swiss Federal Institute of Technology, 2002
[Dru and Saada 2000] Location-Based Mobile Services: The Essentials. M.-A. Dru and S. Saada, 2000, available at
[Dubinko 2002] Interactive Web Services with XForms, M. Dubinko, January 2002, available at
[ECMA TR-61 1992] User Interface Taxonomy Report. European Computer Manufacturer Association, 1992
[EMMA W3C 2003] EMMA: Extensible Multimodal Annotation Markup Language. R. Pieraccini, W. Chou, D. A. Dahl, and D. Raggett, W3C Working Draft, August 11, 2003
Author initial? [Ericsson 2002] Wideband Code-Division Multiple-Access. Ericsson, 2002, available at
[Eronen 2000] JINI–A Technology for Interconnecting Heterogeneous Devices. L. Eronen, Department of Computer Science, University of Helsinki, available at
[EURESCOM P1104 2002] Multimodal Multilingual Information Services for Small Mobile Terminals. L. Boves and E. den Os, eds., Project P1104, EURESCOM, 2002
[FAA 1999] A Human Factors Process Survey of the Ground Delay Program—Enhancements. Federal Aviation Administration and Crown Consulting, Document No. G004-001-002, 1999
[Falk and Robbins 1997] An Explanation of the Architecture of the MMS Standard. H. Falk and J. Robins, 1997, available at
Publisher/sponsor, pg range [Fasbender et al. 1996] “Analysis of Security and Privacy in Mobile IP.” A. Fasbender, D. Kesdogan, and O. Kubitz, Lehrstuhl fur Informatik 4, Proceedings of 4th International Conference on Telecommunication Systems, Modeling and Analysis, 1996
[Fielding 2000] Architectural Styles and the Design of Network-Based Software Architectures. Roy Thomas Fielding, Dissertation, University of California at Irvine, 2000
[Fielding 2000] Architectural Styles and the Design of Network-based Software Architectures. R. T. Fielding, Dissertation, University of California at Irvine, 2000
[FIPA Arch 2001] FIPA Abstract Architecture Specification, 2001, available at
page range, vol #? [Flach and Courvoisier 2001] “XML-based Multimedia Content Management for Wireless-Oriented Applications.” G. Flach and T. Courvoisier in CG Topics Magazine, 2001
Publisher? [Flippo et al. 2003] A Multimodal Framework: Rapid Development of Multiodal Systems. F. Flippo, A. Krebs, and I. Marsic, Rutgers University, 2003
[Foley and Van Dam 1983] Fundamentals of Interactive Computer Graphics. J. D. Foley and A. Van Dam, Addison-Wesley, 1983
[Fowler and Scott 1999] UML Distilled, 2nd ed. M. Fowler and K. Scott, Addison-Wesley, 1999
[Franklin and Zdonik 1998] Data in Your Face: Push Technologies in Perspective. M. Franklin and S. Zdonick, ACM Publications, 1998
Pages? [Fuggetta et al. 1998] “Understanding Code Mobility.” A. Fuggetta, G. P. Picco, and G. Vigna, in IEEE Transactions on Software Engineering, Vol. 24, No. 5, 1998
[Fujino 2002] Patterns for Analogous Representation. T. Fujino, InArcadia, Ltd., Tokyo, Japan, PLOP, 2002
[Gamma et al. 1995] Design Patterns. E. Gamma, R. Helm, R. Johnson, and J. Vlissides, Addison-Wesley, p. 4, 1995
[Gamma et al. 1999] Design Patterns, Elements of Reusable Object-Oriented Software. E. Gamma, R. Helm, R. Johnson, and J. Vlissides, Addison-Wesley, 1999
Pages, vol? [Garber 2002] “Will 3G Really Be the Next Big Wireless Technology?” L. Garber in IEEE Computer Magazine, January 2002
[Gervai and Muscutariu 2000] Towards an ADL for Designing Agent-Based Systems. M.-P. Gervais and F. Muscutariu, LIP6 and University of Paris X, 2000
[GML 3.0] Open GIS Geography Markup Language (GML) Implementation Specification. S. Cox, P. Daisey, R. Lake, C. Portele, and A. Whiteside, January 2003
[GML Specifications 2002] The OpenGIS Geography Markup Language (GML) Specifications, 2002, available at
[Goβmann and Specht 2001] Location Models for Augmented Environments. J. Goβmann and M. Specht, Hyperinteraction with Physical Spaces (HIPS) as supported by EU LTR project in ESPRIT, 2001
Pages, publisher? [Goose et al. 2002] “Toward Improving the Mobile Experience with Proxy Transcoding and Virtual Composite Devices for a Scalable Bluetooth LAN Access Solution.” S. Goose, G. Schneider, R. Tanikella, H. Mollenhauer, P. Menard, Y. Le Floc'h, and P. Pillan, in IEEE Proceedings of the Third International Conference on Mobile Data Management (MDM.02), 2002
Page range, vol.# [Gorin et al. 2002] “Automated Natural Spoken Dialogue.” A. L. Gorin, A. Abella, T. Alonso, G. Riccardi, J. H. Wright, in IEEE Computer Magazine, April 2002
[Graham 2002] “Using UML to Drive Java Can Alleviate Chaos.” B. Graham in EE Times, Rose Real-Time Technical Marketing, Rational Software Ltd., Kanata, Ontario, April 1, 2002, available at
[Grasshopper 2001] Grasshopper, The First Reference Implementation of the OMG MASIF. S. Covaci, German National Research Center for Information Technology, Research Institute for Open Communication Systems, Intelligent Mobile Agent Center for Competence, 2001, available at
[Grassi et al. 2002] Performance Validation of Mobile Software Architectures. V. Grassi, V. Cortellessa, and R. Mirandola, Rome University and L'Aquila University, Italy, 2002
[Griss and Pour 2001] “Accelerating Development with Agent Components.” M. L. Griss and G. Pour. IEEE Computer Magazine, Vol. 34, No. 5, May 2001
[Griswold et al. 2001] Using Mobile Technology to Create Opportunistic Interactions on a University. W. G. Griswold, R. Boyer, S. W. Brown, T. M. Truong, E. Bhasker, G. R. Jay, and R. B. Shapiro, University of California at San Diego, 2001
Provide publiser or sponser, pgrange [Gronmo, Solheim, and Skogan 2002] “Experiences of UML-to-GML Encoding.” R. Gronmo, I. Solheim, and D. Skogan, SINTEF Telecom and Informatics. 5th Agile Conference on Geographic Information Science, April 2002
[Hager 2002] Mobile Adhoc Network Security. C. T. Hager, Virginia Polytechnic Institute, 2002
[Hansmann 2002] SyncML: Synchronizing Your Mobile Data. U. Hansmann, Prentice-Hall, 2002
page range? [Hardison 1998] “Spoken Word Identification by Native and Nonnative Speakers of English: Effects of Training, Modality, Context and Phonetic Environment.” D. M. Hardison in Proceedings of the 5th International Conference on Spoken Language Processing, Causal Productions PTY Ltd., Sydney, Australia, 1998
[Hashman and Knudsen 2001] The Application of JINI Technology to Enhance the Delivery of Mobile Services. S. Hashman and S. Knudsen, PSINaptic, December 2001
[Hausmann et al.] Towards Dynamic Meta Modeling of UML Extensions: An Extensible Semantics for UML Sequence Diagrams. J. H. Hausmann, R. Heckel, and S. Sauer 2001, available at
[Hausmann, Heckel, and Sauer 2002] Dynamic Meta Modeling with Time: Specifying the Semantics of Multimedia Sequence Diagrams. J. H. Hausmann, R. Heckel, and S. Sauer, Department of Computer Science, University of Paderborn, Germany, 2002
[Hauswirth and Jazayeri 1999] A Component and Communication Model for Push Systems. M. Hauswirth and M. Jazayeri, Technical University of Vienna, Distributed Systems Group, available at
[Hennicker and Koch 2001] Modeling the User Interface of Web Applications with UML. R. Hennicker and N. Koch, Institute of Computer Science at Ludwig-Maximilian-University of Munich and F.A.S.T. Applied Software Technology GmbH, 2001
[Henricksen et al. 2002] “Pervasive 2002.” K. Henricksen, J. Indulska, and A. Rakotonirainy, in Modeling Context Information in Pervasive Computing Systems, Springer-Verlag, 2002, pp. 167–180
[Herzog et al. 2003] “MULTIPLATFORM Testbed: An Integration Platform for Multimodal Dialog Systems.” G. Herzog, H. Kirchmann, S. Mertn, A. Ndiaye, and P. Poller, German Research Center for Artificial Intelligence, HLT-NAACL 2003 Workshop: Software Engineering and Architecture of Language Technology Systems, Pate 75–82, May–June 2003
[Hickey W3C] Position Paper for W3C/WAP Workshop on the Multimodal Web. M. Hickey, Hewlett-Packard, 2000
Publisher? page range? [Hieda et al. 2003] “Design of SMIL Browser Functionality in Mobile Terminals.” S. Hieda, Y. Saida, H. Chishima, N. Sato, and Y. Nakamoto, in Proceedings of the Sixth IEEE International Symposium on Object-Oriented Real-Time Distributed Computing, 2003
Insert page range, vol#, issue# [Hightower and Borrielo 2001] “Location Systems for Ubiquitous Computing.” J. Hightower and G. Borriello in IEEE Computer, August 2001
[Hightower and Borrielo 2001] “Location Systems for Ubiquitous Computing.” J. Hightower and G. Borriello, IEEE Computer, August 2001
[Hightower et al. 2002] “The Location Stack: A Layered Model for Location in Ubiquitous Computing.” J. Hightower, B. Brumitt, and G. Boriello, Proceedings of the Fourth IEEE Workshop on Mobile Computing Systems and Applications (WMCSA), IEEE Computer Society, 2002
Provide publiser [Holland and Oppenheim 1999] “Direct Combination.” S. Holland and D. Oppenheim in ACM CHI 99 Proceedings 1999, 1999
Provide publisher [Holland, Morse, and Gedenryd 2002] “Direct Combination: A New User Interaction Principle for Mobile and Ubiquitous HCI.” S. Holland, D. R. Morse, and H. Gedenryd in Human Computer Interaction with Mobile Devices, 4th International Symposium, Mobile HCI 2002 Proceedings, Springer-Verlag, 2002
[Huang 2000] Communication Infrastructures and Protocols for Mobile Agents, F. Y. Huang, December 2000, available at
[IEEE 2000] IEEE Standard 1471–2000. IEEE Standards Office, Piscataway, NJ, 2000, available at
[IKV 2001] Grasshopper Basics and Concepts, Release 2.2, available at
[Indal 2002] Development of Mobile Agents in J2ME or Similar Technologies. E. Indal, Hovedoppagave, Department of Mathematics and Information Technology at University of Norway, 2002
[Intel 2003] Mobile Systems and Security. Technologies for Safe, Anywhere/Anytime Computing. White paper, Intel Corporation, 2003, available at,39025945,60063878p-39000516q,00.htm
[Introduction to eVC++] Microsoft Corporation, 2002, available at
Publiser? [Jacobsen and John 2000] Two Case Studies in Using Cognitive Walkthrough for Interface Evaluation. N. E. Jacobsen and B. E. John, 2002
Provide author initials [Jacobson, Booch, and Raumbaugh 1999] The Unified Software Development Process. Jacobson, Booch, and Raumbaugh, Addison-Wesley, 1999
Publiser/sponser [Jameson 2002] “Usability Issues and Methods for Mobile Multimodal Systems.” A. Jameson, German Research Center for Artificial Intelligence and International University in Germany, Proceedings of the ISCA Tutorial and Research Workshop on Multi-Modal Dialogue in Mobile Environments, 2002
[Jansen et al. 1999] Applying Mobile Agents to Intrusion Detection and Response. W. Jansen, P. Mell, T. Karygiannis, and D. Marks, National Institute of Standards and Technology (United States Government). 1999
[Jensen 2002] Research Challenges in Location-Enabled M-Services. C. S. Jensen, Aalborg University, Denmark, 2002, available at∼csj
[JSGF 2002] Java Speech Grammar Format Specifications. Sun Microsystems, available at
[JTAPI 1999] Java Telephony API documentation, Sun Microsystems, 1999, available at
[Katz 1995] Adaptation and Mobility in Wireless Information Systems. R. H. Katz, University of California Berkeley, 1995
[Kleinrock 1996] Nomadicity: Anytime, Anywhere in a Disconnected World. L. Kleinrock, J. C. Baltzer AG, Science Publishers, Mobile Networks and Applications, pp. 351–357, 1996
[Knudsen 2002] Parsing XML in J2ME: XML in MIDP Environment. J. Knudsen, March 7, 2002, available at
[Ko and Vaidya 1998] Location-Aided Routing (LAR) in Mobile Ad Hoc Networks. N. Ko and Y.-B. IEEE Press, 1998
Publiser correct? [Korkea-aho and Tang 2001] Experiences of Expressing Location Information for Applications in the Internet. M. Korkea-aho and H. Tang, Nokia Research Center, Finland, 2001
[Kumar and Romary 2003] A Comprehensive Framework for Multimodal Meaning Representation. A. Kumar and L. Romary, Laboratoire Loria, B.P. 239, 2003
[Kunins 2001] VoiceXML: Strategies and Techniques for Effective Voice Application Development with VoiceXML 2.0. C. Sharma and J. Kunins, Wiley, 2001
[Kutar, Nehaniv, and Britton 2001] NGT: Natural Specification of Temporal Properties of Interactive Systems with Multiple Time Granularities. M. Kutar, C. Nehaniv, and C. Britton, University of Hertfordshire, U.K., 2001
Publiser? [Landay, Mathews, and Waterson 2002] In the Lab and Out in the Wild: Remote Web Usability Testing for Mobile Devices. S. Waterson, J. A. Landay, and T. Mathews, 2002
[Lang 1997] Java Aglet Application Programming Interface (J-AAPI). D. Lang, IBM Research group in Japan, 1997, available at
[Lanowitz 2002] “Testing Is a Mobile Application Imperative.” T. Lanowitz, Gartner Group Note Number COM-14-1970, February 11, 2002, available at
[Larson 2003] “Technology Trends: InkML and Speech.” J. Larson in Speech Technology Magazine, October 2003
[Lathi 1989] Modern Signal and Analog Communication Systems. B. P. Lathi, Holt, Rinehart, and Winston, 1989
[Lathi ‘89] Modern Signal and Analog Communication Systems. B. P. Lathi, Holt, Rinehart, and Winston, Inc., 1989
[Laukkanen 2002] Java on Handheld Devices–Comparing J2ME CDC to Java 1.1. M. Laukkanen, Department of Computer Science, University of Helsinki, available at
Pages? vol? [Lawton 2001] “New Technologies Place Video in Your Hands.” G. Lawton in IEEE Computer Magazine, April 2001
[Lee 2000] Operation-Based Update Propagation in Mobile File Systems. Y.-W. Lee, The Chinese University of Hong Kong, January 2000
Pages? vol#? [Leeper 2001] “A Long-Term View of Short-Range Wireless.” D. G. Leeper in IEEE Computer Magazine, June 2001
[Leonhardt and Magee 1997] Security Considerations for a Distributed Location Service. U. Leonhardt and J. Magee, Imperial College, London, England, 1997
[Leufven 2001] Synchronization in a Wireless World. U. Lefven, Royal Institute of Technology and Microsoft Mobile Internet Laboratories, June 2001
[Liao et al. 2000] “Geogrid: A Geocasting Protocol for Mobile Ad Hoc Networks Based on GRID.” W.-H. Liao, Y.-C. Tseng, K.-L. Lo, and J.-P. Sheu, Internet Technology, Vol. 1, No. 2, 2000
[Lieberman 2001] UML Activity Diagrams: Detailing User Interface Navigation. B. Lieberman, The Rational Edge, Rational Software, October 2001, available at
[Lieberman 2001] UML Activity Diagrams: Detailing User Interface Navigation. B. Lieberman, The Rational Edge, Rational Software, October 2001, available at
[LIF Specifications 2000] Location Interoperability Forum Mobile Location Protocol TS 101 Specification. Version 3.0, June 2002
Publisher or sponser? PAge range? [Lin and Stojmenovic 1999] “Gedir: Loop-Free Location Based Routing in Wireless Networks.” X. Lin and I. Stojmenovic, Proceedings of Conference on Parallel and Distributed Computing and Systems, November 3–6, 1999
[Lindmark 2000] Interpreting Symptoms of Cognitive Load and Time Pressure in Manual Input. K. Lindmark, Master's thesis, Department of Computer Science, Saarland University, 2000
[Lodderstedt et al. 2002] SecureUML: A UML-Based Modeling Language for Model-Driven Security? T. Lodderstedt, D. Basin, and J. Doser, University of Freiburg, Germany
[Maes 2002] A VoiceXML Framework for Reusable Dialog Components, S. H. Maes, IBM T. J. Watson Research Center, Yorktown Heights, N.Y., 2002
[Malhotra 2002] Introduction to SMS. V. Malhotra, IBM Developer Works, 2002, available at
Page range, vol#? [Mandel, Koch, and Maier 1999] “Extending UML to Model Hypermedia and Distributed Systems.” L. Mandel, N. Koch, and C. Maier, in Bayerische Forschungsstiftung, February 1999
[Mantyla 2002] User Experience Research. M. Mantyla, Helsinki Institute for Information Technology, 2002
[Martin-Flatin 1999] Push vs. Pull in Web-Based Network Management. J.-P. Martin-Flatin, Swiss Federal Institute of Technology, Lausanne, 1999
[MASIF 1997] Mobile Agent System Interoperability Facilities Specification. GMD FOKUS, IBM Corporation, with cooperation from Crystliz, Inc., General Magic, Inc., and the Open group, 1997
[MAUI 2000] Mobile Agent to User Interaction (MAUI). P. Mihailescu, C. Gamage, and E. A. Kendall, Monash University, Australia, 2000
[McClure, Scambray, and Kurtz 1999] Hacking Exposed: Network Security Secrets and Solutions, McGraw-Hill Osborne Media, 1999
[McLaughlin 2000] Java and XML. B. Mclaughlin, O'Reily & Associates, 2000
[Melnik and Decker 2000] A Layered Approach to Information Modeling and Interoperability on the Web. S. Melnik and S. Decker, Stanford University, available at∼melnik/pub/sw00/sw00.pdf
[Meyers 1993] Why Are Human-Computer Interfaces Difficult to Design and Implement? B. A. Myers, Carnegie Mellon University, July 1993
[Miga et al. 2002] Deriving Message Sequence Charts from Use Case Maps Scenario Specifications. A. Miga, D. Amyot, F. Bordeleau, D. Cameron, and M. Woodside, Carlton University at Ottawa, Canada, 2002
[Minh 1997] Multimodal User Interface Research (MUIR), Modal, Specification and Design. C. Min, Master's Thesis, Department of Computer Science and Technology, Peking University, June 20, 1997
[Moczar and Aston 2002] Cocoon Developer's Handbook. L. Moczar and J. Aston, Sams Publishing, 2002
[Mohseni 1996] Web Database Primer Plus. P. Mohseni, WAIT Group Press, 1996
Publisher? university? [Mummert 1996] Exploiting Weak Connectivity in a Distributed File System. Lily B. Mummert, CMU-CS-96–195, December 1996
vol, pages [Munoz et al. 2003] “Context-Aware Mobile Communication in Hospitals.” M. A. Munoz, M. Rodriguez, J. Favela, A. I. Marinez-Garcia, and V. Gonzalez, in IEEE Computer Magazine, September 2003
[Murphy 2000] Enabling the Rapid Development of Dependable Applications in the Mobile Environment. A. L. Murphy, Washington University Server Institute of Technology, 2000
[NCC 2002] Wireless—A New Challenge in Software Testing. National Computing Centre, available at
Title, authors? [Nettech 1999] Beginner's Guide to Implementing a Successful Wireless Solution. Nettech Systems, Inc., 1999, available at
[Nielson 1994] Usability Engineering. J. Nielson, Morgan Kaufmann, 1994
[Niklfeld, Finan, and Pucher 2001] Component-Based Multimodal Dialog Interfaces for Mobile Knowledge Creation. G. Niklfeld, R. Finan, and M. Pucher, Telecommunication Research Center, Vienna and Mobilkom, Austria, 2001
[Nunes 2001] Object Modeling for User-Centered Development and User Interface Design: The Wisdom Approach. D. N. J. Nunes, University of Maderia, Funchal, Portugal, April 2001
[OASIS tML 2001] tML Guidelines for Mapping UML Notation to XML Schemas and Vice Versa. OASIS Committee T1–Telecommunications working group T1M1 in conjunction with Sprint Corp., available at
[Olsen 1992] User Interface Management Systems: Models and Algorithms. D. R. Olsen Jr., Morgan Kaufmann Publishers, San Mateo, Ca., 1992
[Openwave 2002] WAP Push Technology Overview. Openwave Systems Inc., May 2002, available at
[Openwave 2002] WAP Push Technology Overview. Openwave Systems, Redwood City, CA, available at
[Orfali and Harkey 1997] Client/Server Programming with Java and CORBA. R. Orfali and D. Harkey, John Wiley & Sons, 1997
[Oshima, Karjoth, and Onon 1998] Aglet Specification 1.1 Draft. M. Oshima, G. Karjoth, and K. Ono, IBM Research Group in Japan, 1998, available at
[Oviatt 2000] Designing Robust Multimodal Systems for Diverse Users and Environments. S. Oviatt, Computer Science Department, Oregon Graduate Institute of Science and Technology, 2000
[Oviatt 2002] Taming Recognition Errors with a Multimodal Interface. S. Oviatt, National Science Foundation, Special Extension for Creativity, 2002
[Oviatt and Cohen 2000] Multimodal Interfaces That Process What Comes Naturally. S. Oviatt and P. Cohen, Center for Human Communication, Department of Computer Science, Oregon Graduate Institute of Science and Technology, 2000
[Oviatt OHSU 2002] Multimodal Interfaces for Future Geographical Information Systems. NRC Committee on Beyond Mapping: The Challenge of New Technologies in the Geographic Information Sciences, August 2002
[Oviatt, Jacko, and Sears 2002] Handbook of Human-Computer Interaction—Multimodal Interfaces. S. Oviatt, Center for Human-Computer Communication, Computer Science Department of Oregon Graduate Institute of Science and Technology 2002
[Owen 2002] When Data Sync Breaks. J. Owen, White Paper, XcelleNet, Inc., 2002
[P809-GI 1999] Mobility in the Broadband Environment Based on IN Evolution. P809-GI project of EUROSCOM, Network Architectures for Broadband Mobility, Vol. 1, Architecture for the Benchmark Services, 1999
[Page 2000] Neuropsychology of Memory. A. Page, University of Western Australia, available at
Page range, vol#? [Paulson 2003] “New Techniques for Speeding Wireless Streaming Video.” L. D. Paulson in IEEE Computer Magazine, May 2003
Pages? vol? [Pinhanez et al. 2003] “Fostering a Symbiotic Handheld Environment.” C. Pinhanez, M. Raghunath, and C. Narayanasuwami, in IEEE Computer Magazine, September 2003
[Pohl, Kobsa, and Kutter 1995] User Model Acquisition Heuristics Based on Dialogue Acts. W. Pohl, A. Kobsa, and O. Kutter, Working Group Knowledge-Based Information Systems, University of Konstanz, 1995
[Raggat and Wugofski 2000] Towards Convergence of WML, XHTML and Other W3C Technologies. World Wide Web Consortium, available at
[Rausch et al. 2001] Extensions of the Unified Modeling Language for Mobile Agents. C. Klein, A. Rausch, M. Sihling, and Z. Wen, Siemens ICN, Munich, Germany, Institut fur Informatic, Technische Universitat Munchen, Munich, Germany, 2001
[Rausch, Sihling, and Wen 1998] Extensions of the UML around Language Concepts for Mobility. A. Rausch, M. Sihling, and Z. Wen, 1998, available at∼rausch/publications/2001/MobileUML.pdf
[Reiher et al. 1996] Peer-to-Peer Reconciliation Based Replication for Mobile Computers. P. Reiher, J. Popek, M. Gunter, J. Salomone, and D. Ratner, University of California, Los Angeles, 1996
[RFC822] RFC 822, available at
[Rodriquez et al. 2000] An Introduction to IBM WebSphere Everyplace Suite Version 1.1. J. Rodriguez, R. Appleby, B. Bisgaard, H. Wang, A. McGrory, A. Mryhig, A. Patton, and M. Omarjee, IBM RedBooks, 2000
[Rossler et al. 2001] Multimodal Interaction for Mobile Environment. H. Rossler, J. Sienel, W. Wajda, J. Hoffmann, and M. Kostrzewa, Private Network Department, Alcatel SEL AG Research and Innovation, Germany, 2001
[RS232 2003] RS232 Quick Reference, available at
[Ruuskanen 2000] JAVACARD. J.-P.Ruuskanen, Department of Computer Science, University of Helsinki, Finland, available at
[Sadoski 1997] Client–Server Software Architectures–An Overview. D. Sadoski, Carnegie Mellon University, 1997, available at
Publisher? [Saeyor et al. 2003] Multimodal Presentation Markup Language on Mobile Phones. S. Saeyor, K. Uchiyama, and M. Ishizuka, 2003
[Sandor and Reicher 2001] CUIML: A Language for Generating Multimodal Human-Computer Interfaces. C. Sandor and T. Reicher, 2001, available at
[Sauer and Engles 1999] OMMMA: An Object-Oriented Approach for Modeling Multimedia Information Systems. S. S. G. Engels, University of Paderborn, Germany Information Systems Group, 1999
[Schlieder et al. 2001] Location Modeling for Intentional Behavior in Spatial Partonomies. C. Schlieder, T. Vogele, and A. Werner, Bremen University, 2001
[Scott 2001] Service Discovery Protocol (SDP). M. Scott, 2001, available at
[Sears 1992] Layout Appropriateness: A Metric for Evaluating User Interface Widget Layout. A. Sears, Human–Computer Interaction Laboratory & Computer Science Department, University of Maryland, December 8, 1992
[Selic and Raumbaugh 2003] Mapping SDL to UML. B. Selic and J. Raumbaugh, Rational White Papers, May 8, 2003, available at
Page range vol, and issue #? [Sharma et al. 2003] “Speech-Gesture Driven Multimodal Interfaces for Crisis Management.” R. Sharma, M. Yeasin, N. Krahnstoever, I. Raushert, G. Cai, I. Brewer, A. S. MacEachren, and K. Sengupta, in Proceedings of IEEE Special Issue on Multimodal Human-Computer Interface 2003, 2003
[Shipman, Marshal, and Moran 1995] “Finding and Using Implicit Structure in Human-Organized Spatial Layouts of Information.” F. M. Shipman III, C. C. Marshall, T. P. Moran, CHI ‘95 Proceedings, ACM, 1995
[Singh et al. 1999] RAT: A Quick (And Dirty?) Push for Mobility Support. R. Singh, Y. C. Tay, W. T. Teo, and S. W. Yeow, IEEE Publications, 1999
[Sissonen 2002] Wireless Applications Evaluation and Development Process: Case-Paper Industry Logistics. A. Sissonen, Lappeenranta University of Technology, February 1, 2002
Title and authors? Year? [SMIL 2.0] Available at–20010807/smil20.html
[Smith et. al. 1982] “Designing the Star User Interface.” D. C. S. Smith, C. Irby, R. Kimball, B. Verplank, and E. Harlem, Byte, Vol. 7, No. 4, April 1982, pp. 242–282
[Sparkman et al. 2001] Automated Derivation of Complex Agent Architectures from Analysis Specification. C. H. Sparkman, S. A. DeLoach, and A. L. Self, 2nd International Workshop on Agent-Oriented Software Engineering (AOSE-2001), Montreal, Canada, May 29, 2001
[Spolsky 2001] User Interface Design For Programmers. J. Spolsky, 2001, available at
Year? Title correct? [Spyrou, et al.] Wireless Computational Models: Mobile Agents to Rescue. Constantinos. G. Spyrou, P. Pitoura, and E. Evirpidou
[SSML 2002] 2002, available at
[Star and Estes 1990] Geographic Information Systems: An Introduction. J. Star and J. Estes,. Prentice-Hall, Englewood Cliffs, NJ, 1990
[Stemberger 2002] Is Buetooth WI-FI? S. Stemberger, IBM Developer Works, 2002, available at
[Sun Micro J2ME Spec 2000] Introduction to Java 2 Micro Edition and KVM. Sun Microsystems, May 19, 2000
[Sylvain 2001] MPML 3.0 Specifications. D. Sylvain, Master's Student, Internal Report, Ishizuka Laboratory, June 15, 2001
[SyncML Specification 1.1] SyncML Sync Protocol, Version 1.1. Available at
[SyncML White Paper 2003] Building an Industry-Wide Mobile Data Synchronization Protocol. SyncML White Paper, 2003, available at
Pg range [Tanenbaum and van Renesse 1985] “Distributed Operating Systems.” A. S. Tanenbaum and R. van Renesse, ACM Computing Surveys, December 1985
[Tomlin 1990] Geographic Information Systems and Cartographic Modeling. C. D. Tomlin, Prentice Hall College Division, 1990
[Trabelsi et al. 2002] Multimodal Integration of Voice and Ink for Pervasive Computing. S. Trabelsi, S.-H. Cha, D. Desai, and C. Tappert, CSIS Pace University, 2002
Provide authors, title of document Vol, issue, pgs? [Trantor 2002]
[Tseng et al. 2001] “Location Awareness in Ad Hoc Wireless Mobile Networks.” Y.-C. Tseng, S.-L. Wu, W.-H. Liao, and C.-M. Chao, IEEE Computer Magazine, June 2001
[Tuning 2000] How Do You Test an Interface How Do You Test an Interface You Can't See? Nuance Communications, 2000, available at
[UMTS 2002] UMTS White Paper 1. 2002, available at
[UTMS P1104 2002] Multimodal Multilingual Information Services for Small Mobile Terminals. L. Boves and E. den Os, eds., Eurescom UTMS, 2002
vol, issue, pgrange [Varshney 2003] “The Status and Future of 802.11-Based WLAN's.” U. Varshney, IEEE Computer Magazine, June 2003
[Varshney and Jain 2001] Issues in Emerging 4G Wireless Networks. U. Varshney and R. Jain, Georgia State University, 2001
[Vaughan-Nichols 2002] “OFDM: Back to the Wireless Future.” S. J. Vaughan-Nichols in IEEE Computer Magazine, December 2002
[Vaughan-Nichols 2003] “Mobile IPv6 and the Future of Wireless Internet Access.” S. J. Vaughan-Nichols in IEEE Computer Magazine, February 2003
[Venners 1997] “The Architecture of Aglets.” B. Venners, Java World, April 1997, available at–1997/jw-04-hood_p.html
[Vichr 2002] The ABC's of 802.11. R. Vichr, IBM Developer Works, 2002, available at
[VXML 2002] Speech Synthesis Markup Language. D. C. Burnett, Nuance, M. R. Walker, Intel, and A. Hunt, SpeechWorks International, World Wide Web Consortium, 2002, available at
[W3C Schema—2] W3C XML Schema Part 2—Data Types, Revision 2, January of 2001, available at
[W3C Semantic Web] Semantic Web documentation on World Wide Web Consortium Web site, 2002, available at
[W3C Speech Grammar 2002] W3C Speech Grammar Specifications. A. Hunt and S. McGlashan of W3C, 2002, available at
[W3C XForms] W3C XForms Specifications Working Draft 18, January 2002, available at
[W3C XML Pipeline] XML Pipeline Definition Language Version 1.0. N. Walsh and E. Maler, Sun Microsystems, W3C Note, February 28, 2002
[Wahlster 2003] SmarkKom: Symmetric Multimodality in an Adaptive and Reusable Dialogue Shell. W. Wahlster, German Research Center for Artificial Intelligence (DFKI), 2003
[Wahlster et al. 1998] SmartKom: Towards Multimodal Dialogues with Anthropomorphic Interface Agents. W. Wahlster, N. Riethinger, and A. Blocher, German Research Center for Artificial Intelligence 1998
Vol#, pages? [Waldo 2001] “Mobile Code, Distributed Computing, and Agents.” J. Waldo, in IEEE Intelligent Systems, March/April 2001
[WAP 2.0] Wireless Application Protocol WAP 2.0 Technical White Paper, WAP Forum, available at
[WAP Architecture 2001] Wireless Application Protocol Architecture Specification WAP-210-WAPArch-20010712, Wireless Application Protocol Forum, July 2001, available at
[WAP MMS Encapsulation 2002] Wireless Application Protocol MMS Encapsulation Protocol. Wireless Application Protocol Forum, Ltd. WAP-209-MMS Encapsulation-20020105-a, Version 05-Jan-2002
Title and year correct? [WAP Professional 2000] WAP Professional 2000. C. Arehart, N. Chidambaram, S. Guruprasad, A. Homer, R. Howelll, S. Kasippilai, R. Machin, T. Myers, A. Nakhimovsky, L. Passani, C. Pedley, R. Taylor, and M. Toschi. WROX Press Ltd., Acocks Green, UK, 2000
[WAP UAPROF] Wireless Application Protocol WAP-248-UAPROF-2001 1020-a, Wireless Application Protocol Forum, available at
[Welch 2000] A Survey of Power Management Techniques in Mobile Computing Operating Systems. G. F. Welch, University of North Carolina at Chapel Hill, 2000
[WFMC and Fisher 2000] The Work Flow Handbook 2001, Work Flow Management Coalition, October 2000
Publisher? [Yang et al. 2000] Mobile Agent on the SARA Digital Library. Y. Yang, O. F. Rana, D. W. Walker, and C. Georgousopoulos, and R. Williams, 2000
Provide publisher, not affiliations [Yang et al. 2000] Mobile Agents on SARA Digital Library. Y. Yang, O. F. Rana, D. W. Walker, C. Georgousopoulos, and R. Williams, 2000
[Yim et al. 2001] Architecture-Centric Object-Oriented Design Method for Multi-Agent Systems. H. Yim, K. Cho, J. Kim, and S. Park, KAIST (Korea Advanced Institute of Science and Technology), Korea, 2001
[Yu et al. 2003] Scalable Portriat Video for Mobile Video Conferencing. J. Keman Yu, T. He, Y. Lin, and S. Li, Microsoft Research Asia, 2003
[Zhang 2001] Mobile Computing and Wireless Networks. Y. Zhang, 2001, available at
[Zhang 2002] Provably-Secure Enhancements on 3GPP Authentication and Key Agreement Protocol. M. Zhang, Verizon Laboratories, Waltham, MA, 2002