The Design Amanuensis supports design protocol analysis and supports synchronous co-located group work by capturing designers’ spoken and drawing actions and converting speech to text to construct a machine-readable multimedia document that can be replayed and searched for words spoken during the design session or for graphical configurations.
The Design Amanuensis: an Instrument for Multimodal Design Capture, Gross, M.D. Do, E. Y-L., and Johnson, B.R., in B. de Vries, J.P. van Leeuwen, and H.H. Achten. Proc. Computer Aided Architectural Design Futures 2001, Eindhoven, Netherlands. Kluwer Academic Publishers, pp. 1-13. [pdf]