Abstract This paper presents architecture of intelligent agent for distributed speech recognition (DSR) system. We found there are three alternative to develop DSR system: serveronly processing, client-only processing, clientserver processing and in this paper, we develop a DSR system based on client-server processing. However, with mobile agent technology, we believed that mobile agent can ease the process development of distributed system (client-server processing) and also support (computation) both side of DSR system: front-end and back-end processing. We also apply mobile agent design pattern (master-slave pattern) in architecture design to achieve that purpose and the system run on Local Area Network (LAN) environment.