LOCAL LANGUAGE BASED COMPUTER TROUBLESHOOTING APPROACH FOR WOREDANET DEVICES Advisor Name: Dr. Shishay Welay Co-advisor Name: Solomon (MSc.) Student Name: Alene Girmay Date: Oct 12, 2023 Contents • • • • • • • • • • INTRODUCTION STATEMENT OF THE PROBLEM OBJECTIVE REVIEW OF RELATED WORKS METHODOLOGY TESTING AND EVALUATIONS SUMARY OF KEY FINDING CONTIRBUTION TO THE FIELD RECOMMENDATION FOR FUTURE RESEARCH CONCLUSION 2 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense Introduction … • WoredaNet is a government network connecting more than 1000 Woredas, regional and federal government offices across the country (the name woredaNet comes from “Woreda”). • WoredaNet is a terrestrial and satellite-based network designed with the primary objective to provide ICT services such as video conferencing, directory, messaging and Voice Over IP, and Internet connectivity to the Regional and Woreda level government entities. 3 By:- Alene Girmay OCT 12, 2023 MSc Thesis Defense Introduction… • WoredaNet systems (hardware, software and network ADSL connection) face problems from time to time and endanger the functionality of the institutions. These problems need ICT technicians to be solved. • The ICT technicians follow traditional (manual) ways of solving WoredaNet Device problems which is taking long time and high cost to reach the solution. 4 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense • STATEMENT OF THE PROBLEM … locally and internationally on Several studies were conducted expert system in order to support reasoning and finding solutions for certain problems. However, to the best of our knowledge, the aspect of WoredaNet device diagnosis and troubleshooting which considers localization has not been given due attention so far. • There is a research gap on the implementation and evaluation of expert system for diagnosis and troubleshooting of WoredaNet Devices • our research will tie expert system together with ICT device in order to solve the woredaNet device troubleshooting. This local language WoredaNet expert system troubleshooting has the ability to learn new problems occurring in the WoredaNet Device to cope up with the technological changes and complexities. 5 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense Objective of the Study • The main objective of this study is to develop local language based expert system which enables users to perform WoredaNet device troubleshooting so as to utilize computer and WoredaNet device related resources effectively and efficiently 6 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense Specific Objective of the Study • To acquire the knowledge from the human expert • Review literatures on concept of knowledge based system that give deep understanding to conduct this research work • Model and represent WoredaNet Device troubleshooting using suitable knowledge representation techniques • Implement a prototype system that assists for Woredanet device troubleshooting • Evaluate the new expert system prototype with the help of domain experts in Tigrai ICT Agency 7 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense RESEARCH QUESTIONS … • At the end, this study will answer the following research questions: – What type of knowledge is required to design a local language knowledge-based system? – What are the suitable approaches to acquired knowledge from experts? – What are the suitable models, representation techniques and implementing tools for a local language based knowledgebased system? – How to model and represent the acquired knowledge to developing a Local language based knowledge-based system? – How to design and implement learning knowledge-based system techniques that are automatically updates its knowledge from experience? – How to measure the performance of the prototype system. 8 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense LITERATURE REVIEW • Relevant current research that is close to this study • Different theories that applied to this research • Areas of weakness that are currently highlighted 9 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense LITERATURE REVIEW No Author Title Sector Research methodol ogy Language support Tools 1 Mazlina Md Mustaffa etal. (2014) DIAGNOSIS AND TROUBLESHOOTI NG OF COMPUTER FAULTS ICT Literature review, data collection, purposive sampling, production rules and evaluation English CLIPS 2 Sourav Mandal etal. (2013) DIAGNOSIS AND TROUBLESHOOTI NG OF COMPUTER FAULTS ICT LR,DC,PS,PR and Evalution English Turbo Prolog PL and SQL 3 Sylvester I. Ele and Adesola, W.A (2013) CFDTS ICT LR,DC,PS,PR and Evalution English NetBeans, Java and MySQL 4 Youssef Bassil developed an expert PC ICT LR,DC,PS,P English 10 ASP.NET,C# ) By:- Alene(2012 Girmay Oct 12, 2023 MSc Thesis Defense METHODOLOGY … The details of the research methodology appeared in the following • • • • • sections and Methodological steps followed for this research are: Formulation of the problem and its justifications Knowledge was acquired: Using structural, unstructured interviews with experts and from existing document Develop a conceptual design for concept formation using decision tree and productive rule for rule representations techniques. Implement a local language prototype system: Architecture for prototype system and implementation part of the system was developed based on the conceptual design Testing and evaluations of the prototype system through visual interactions and test case were carried out. 11 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense • CONN.. … Study Area, Population and Sampling Technique – In this study, the necessary knowledge was acquired and elicited using interviews with the ICT experts, particularly the physicians in the area of WoredaNet device in which four domain experts were selected from Tigrai Digita ICT Agency based their professions, educational qualification level, and years of experience. – The study area for this research is Tigra ICT agency.. We used purposive sampling technique to select domain experts for knowledge acquisitions. The reasons to select four domain experts are to share their expertise and experience. 12 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense • CONN.. … Data Collection Methods and Implantation Tool – In this study, the necessary knowledge was acquired and elicited using interviews with the ICT experts, particularly the physicians in the area of WoredaNet device in which four domain experts were selected from Tigrai Digita ICT Agency based their professions, educational qualification level, and years of experience. – The interview with experts covered issues like, how woredaNet device problems are defined from the aspect of ICT technicians, What are the methods and techniques ICT experts use to identify the causes of woredaNet device problem, How the ICT technicians identify the unique characteristics of each problem and What are the common types of problems that occur in the woredaNet devices. 13 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense • CONN.. … Data Collection Methods and Implantation Tool – A secondary data from documents such as computer books, training manuals, public or private documents, reports, online materials and journal woredaNet articles was also assessed. Furthermore, demonstration and direct observation were considered to acquire the necessary knowledge – Prolog language is chosen as implementation tool because it is suitable for rule based programming, forward chaining execution and pattern matching 14 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense Knowledge Base Evaluate Digital ICT Experts Literature and Documented knowledge Knowledge Acquisition Knowledge Modeling Knowledge Base user Knowledge Representations Activities of the Knowledge-Base Development By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense 15 • Model METHODOLOGY … – Knowledge is to be modeled at a conceptual level. Typically, a knowledge model provides formats for writing down both static domain knowledge (rules, classes, relations) and reasoning strategies. According to (Lidtke, 2003) one of the most extensively applied methods for conceptual modeling is decision tree. – Decision tree commonly acts a key role in a knowledge modeling process. The decision tree structure that has the flow of knowledge in the diagnosis and troubleshooting of WoredaNet Device. 16 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense con.… • General Structure of WNDTES WoredaNet device troubleshooting expert system Network Problem Hardware problem video converenc e sound system camera ups plasma tv printer pc ip telephon e 17 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense • CONN.. … Knowledge Representation – In the Previous section knowledge has been acquired and modeled; the next step is knowledge representation by using appropriate format that is understandable by inference engine. Knowledge representation is a means of encoding the human expert knowledge in an appropriate way. – We used rule-based knowledge representation techniques to represent the acquired knowledge. All rules that are used in this study are developed based on the concepts of knowledge modeling approaches. To setup all rules, production rule Knowledge representation techniques are used in which knowledge is represented in the form of condition-action pairs 18 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense • CONN.. … Architecture of the Prototype System – System architecture is a conceptual model that defines the structure and guidelines of the system. – The architecture of WoredaNet device troubleshooting and maintenance expert system consists of Knowledge Base, Inference Engine, Knowledge Translation, Learning and Memorization Component, Explanation Facility, User Interface and the End User – The overall architecture of our system is shown below 19 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense Architecture of the prototype Learning memorization component User Interface english ትግርኛ USER Knowledge Translation (UNICODE) አማርኛ Inference Engine Knowledge Base (English,Tigrign a, and amharic) Rules Explanation facility Facts 20 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense • METHODOLOGY … User interface – User interface is used as a bridge between the system and the user for communication. The interaction of the user and the prototype system is in English, Amharic and Tigrigna languages – The user interface of the prototype system allows a non-expert and physicians users to query (question) the KBS, and to see delivery of advices. In this prototype, users can interact with the system through “yes” , እወ ,አዎ”, “no” ,” አይኮንን,“አይ_የለብኝም”, “what”,” እንታይ”, “ምን”, “why”,” ንምንታይ”, “ለምን” and “how”, “ከመይ”, “እንዴት” responses. – Based on the user response, the system draws a conclusion and displayed in the user interface window. The picture below displays the home window that has different options for users to interact. 21 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense conn.. … • 22 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense • User interface Conn … 23 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense TESTING AND EVALUATIONS … • Developing a knowledge-based system is an incremental process. Therefore, in developing the prototype system, the knowledge engineer at finishing step should test the performance of the system. In our research, we used test cases and visual interactions approaches. The results of this evaluation and test show where the system is weak. Also, the correct and incorrect outcomes are identified by comparing decisions made by domain experts with decisions made by the prototype system. 24 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense • TESTING AND EVALUATIONS … Test Cases – In this section the performance of the system was tested and validated using test cases. The test cases were used to measure the accuracy of the system. For the purpose of validation process a total of twelve cases were selected. To achieve the goal of the system evaluators were purposively selected according to their willingness and specialty. Therefore, the system evaluators were from different computer and network departments in Tigrai ICT Agency office. – As indicated in the table below, the result provided by system evaluators showed that the Rule based system is about 83% accurate in troubleshooting woredaNet device problems. 25 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense Conn…. Problems Total number of problem selected Correct suggestion Incorrect suggestion The accuracy of prototype in % Network cable ADSL connection problem 3 3 0 100 IP address ADSL configuration problem 3 2 1 66.67 Computer power problem 3 3 0 100 Printer Problem 3 2 1 66.67 Total 12 10 2 83% 26 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense • TESTING AND EVALUATIONS … User Acceptance Evaluation – The goal of user acceptance testing is to assess if the system can support day-to-day business, user scenarios and to ensure the system is sufficient and correct for business usage – We used the following formulas to get the average values of the first close-ended user acceptance testing questions – AVP 𝑠𝑣1 ∗ 𝑛𝑟𝑖 𝑡𝑛𝑠 𝑛𝑟1 + 𝑡𝑛𝑠 𝑠𝑣2 ∗ 𝑛𝑟2 𝑡𝑛𝑠 + 𝑠𝑣3 ∗ 𝑛𝑟3 𝑡𝑛𝑠 + 𝑠𝑣4 ∗ 𝑛𝑟4 + 𝑡𝑛𝑠 𝑛 𝑖=0 𝑠𝑣 ∗ + ⋯(1) Where, SV scale value, TNR total number of respondent and NR is number of respondent. To get the result of user acceptance average performance is calculated out 100%. 𝐴𝑣𝑒𝑠 – AVP = ∗100----------(2) Where NS is number of scale and Avp is 𝑁𝑆 average performance 27 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense • TESTING AND EVALUATIONS … User Acceptance Evaluation – The result indicates that about 88.4% of users are satisfied by the performance of the Rule based system. It means that the Rule based system gained about 88.4% of user acceptance. 28 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense USER ACCEPTANCE EVALUATION No Question 1 2 3 4 5 Mean Total Av/perf % 1 Is the WNDTES system is efficient in Time? 0 0 1 4 5 4.4 88 2 What is the accuracy of the system in Troubleshooting woredaNet device Problems? 0 0 1 5 4 4.3 86 3 Does the system incorporate sufficient knowledge to solve Problems? 0 0 0 6 4 4.4 88 4 Does the system provide appropriate Suggestion for the problems? 0 0 1 5 4 4.3 86 5 What is the contribution of the System in the domain area? 0 0 0 3 7 4.7 94 • By:- Alene Girmay Oct 12, 2023 Total average 4.42 MSc Thesis Defense 29 88.4 SUMARY OF KEY FINDING … English, Amharic • As to our findings, and Tigrigna language interfaces helps end-users to know the diagnosis and troubleshooting WoredaNet device process more easily and it is useful to distribute information in their native languages • The accuracy of the prototype system using test cases are calculated as 83% and the user acceptance testing using closeended and open-ended questions average evaluation result is 88%, respectively. • Therefore, the overall accuracy performance of the WNDTES prototype system is 85%, because the system has local language based features. 30 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense CONTIRBUTION TO THE FIELD • primary beneficiaries of our expert system research are computer users or ICT technicians in Tigrai from this Rule Based WNDTES because WoredaNet device problems can be solved easily. • By the help of this system the computer users solve problems occurring in the computer system by their own instead of waiting or calling to the ICT technicians by referring to the recommended solutions from the expert system. • The system fills the skill gap of the ICT technicians and helps them to cope up with the constant change and complexity of the WoredaNet Device system. • Economically, this system reduces the cost of maintenance, increases the efficiency of the work and increased utilization of the woredaNet devices related resources. 31 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense Cont.. • To give advising services for both computer users and ICT technicians. • It gives better advice services where human expert are not Found and limited in number. • The results of this study could easily be applied for the development of full-fledged trilingual expert system (specifically in English, Amharic and Tigrigna languages) in the area of woredaNet device troubleshooting. • This research contributes to successfully implement expert system and achieve relatively competitive advantages over their competitors. Finally, it is also our conviction that this study will generally contribute to the existing body of knowledge pertaining Information Technology. 32 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense RECOMMENDATION FOR FUTURE RESEARCH … • The scope of the knowledge based system should be extended to incorporate other causes occurring in the WoredaNet system such as schoolnet device . • During developing knowledge based system it is difficult to change the English language to local language even the domain expert didn’t know like Tigrigna and Amharic version, then the researcher used direct change the English version to Tigrigna/amharic version. So it is better to design the real the local language version. 33 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense Con… • In this study, an attempt is made to apply rule-based systems. But there are many cases that are resolved differently in WoredaNet device troubleshooting. Rule-based systems solve problems from scratch, while case-based systems use prerecorded scenarios to handle new, similar cases. Therefore, integrating rule-based reasoning with case-based reasoning solves the limitation of representing knowledge as rules if conclusions cannot then be drawn. • Further study is needed to improve user interface of WNDTES systems and to design a system that can update rules of the knowledge base. 34 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense CONCLUSION … • The knowledge engineer to develop local language based KBS for diagnosis and troubleshooting of WoredaNet device performed basic tasks: first the knowledge engineer assessed the problem area and the problem is considered feasible, then a statement of requirements is created and the development process continued as follows, knowledge was acquired using both structured and unstructured interviews with domain experts and from relevant documents by using documents analysis method to get concepts and facts of WoredaNet device 35 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense CONCLUSION … • The acquired knowledge focuses on concepts and facts of WoredaNet device troubleshooting. Then, those extracted facts and concepts were modeled by using decision tree approach and the model has been converted into productive rules and coded by using SWI-Prolog tool to form the knowledge-based system. • Finally, the evaluating and testing result shows that, the overall performance of the WNDTES prototype system registered 85% accurate result 36 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense 37 By:- Alene Girmay Oct 12, 2023 MSc Thesis Defense