Uploaded by Alene Grimay

Alene Girmay

advertisement
LOCAL LANGUAGE BASED COMPUTER TROUBLESHOOTING
APPROACH FOR WOREDANET DEVICES
Advisor Name: Dr. Shishay Welay
Co-advisor Name: Solomon (MSc.)
Student Name: Alene Girmay
Date: Oct 12, 2023
Contents
•
•
•
•
•
•
•
•
•
•
INTRODUCTION
STATEMENT OF THE PROBLEM
OBJECTIVE
REVIEW OF RELATED WORKS
METHODOLOGY
TESTING AND EVALUATIONS
SUMARY OF KEY FINDING
CONTIRBUTION TO THE FIELD
RECOMMENDATION FOR FUTURE RESEARCH
CONCLUSION
2
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
Introduction …
• WoredaNet is a government network connecting more than
1000 Woredas, regional and federal government offices across
the country (the name woredaNet comes from “Woreda”).
• WoredaNet is a terrestrial and satellite-based network designed
with the primary objective to provide ICT services such as video
conferencing, directory, messaging and Voice Over IP, and
Internet connectivity to the Regional and Woreda level
government entities.
3
By:- Alene Girmay
OCT 12, 2023
MSc Thesis Defense
Introduction…
• WoredaNet systems (hardware, software and network ADSL
connection) face problems from time to time and endanger the
functionality of the institutions. These problems need ICT
technicians to be solved.
• The ICT technicians follow traditional (manual) ways of solving
WoredaNet Device problems which is taking long time and high
cost to reach the solution.
4
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
•
STATEMENT OF THE PROBLEM
… locally and internationally on
Several studies were conducted
expert system in order to support reasoning and finding
solutions for certain problems. However, to the best of our
knowledge, the aspect of WoredaNet device diagnosis and
troubleshooting which considers localization has not been given
due attention so far.
• There is a research gap on the implementation and
evaluation of expert system for diagnosis and
troubleshooting of WoredaNet Devices
• our research will tie expert system together with ICT device in
order to solve the woredaNet device troubleshooting. This local
language WoredaNet expert system troubleshooting has the
ability to learn new problems occurring in the WoredaNet Device
to cope up with the technological changes and complexities. 5
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
Objective of the Study
• The main objective of this study is to develop local language
based expert system which enables users to perform WoredaNet
device troubleshooting so as to utilize computer and WoredaNet
device related resources effectively and efficiently
6
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
Specific Objective of the Study
• To acquire the knowledge from the human expert
• Review literatures on concept of knowledge based system that
give deep understanding to conduct this research work
• Model and represent WoredaNet Device troubleshooting using
suitable knowledge representation techniques
• Implement a prototype system that assists for Woredanet device
troubleshooting
• Evaluate the new expert system prototype with the help of
domain experts in Tigrai ICT Agency
7
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
RESEARCH QUESTIONS
…
• At the end, this study will answer the following research questions:
– What type of knowledge is required to design a local language
knowledge-based system?
– What are the suitable approaches to acquired knowledge from experts?
– What are the suitable models, representation techniques and
implementing tools for a local language based knowledgebased system?
– How to model and represent the acquired knowledge to
developing a Local language
based knowledge-based
system?
– How to design and implement learning knowledge-based
system techniques that are automatically updates its
knowledge from experience?
– How to measure the performance of the prototype system.
8
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
LITERATURE REVIEW
• Relevant current research that is close to this study
• Different theories that applied to this research
• Areas of weakness that are currently highlighted
9
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
LITERATURE REVIEW
No
Author
Title
Sector
Research
methodol
ogy
Language
support
Tools
1
Mazlina Md
Mustaffa etal.
(2014)
DIAGNOSIS AND
TROUBLESHOOTI
NG OF
COMPUTER
FAULTS
ICT
Literature
review, data
collection,
purposive
sampling,
production
rules and
evaluation
English
CLIPS
2
Sourav Mandal
etal. (2013)
DIAGNOSIS AND
TROUBLESHOOTI
NG OF
COMPUTER
FAULTS
ICT
LR,DC,PS,PR and
Evalution
English
Turbo
Prolog PL
and SQL
3
Sylvester I. Ele
and Adesola,
W.A (2013)
CFDTS
ICT
LR,DC,PS,PR and
Evalution
English
NetBeans,
Java and
MySQL
4
Youssef Bassil
developed an
expert PC
ICT
LR,DC,PS,P
English
10
ASP.NET,C#
)
By:- Alene(2012
Girmay
Oct 12, 2023
MSc Thesis Defense
METHODOLOGY
…
 The details of the research methodology appeared in the following
•
•
•
•
•
sections and Methodological steps followed for this research are:
Formulation of the problem and its justifications
Knowledge was acquired: Using structural, unstructured interviews
with experts and from existing document
Develop a conceptual design for concept formation using decision
tree and productive rule for rule representations techniques.
Implement a local language prototype system: Architecture for
prototype system and implementation part of the system was
developed based on the conceptual design
Testing and evaluations of the prototype system through visual
interactions and test case were carried out.
11
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
•
CONN..
…
Study Area, Population and Sampling Technique
–
In this study, the necessary knowledge was acquired and elicited
using interviews with the ICT experts, particularly the physicians in the
area of WoredaNet device in which four domain experts were selected
from Tigrai Digita ICT Agency based their professions, educational
qualification level, and years of experience.
– The study area for this research is Tigra ICT agency.. We used
purposive sampling technique to select domain experts for knowledge
acquisitions. The reasons to select four domain experts are to share their
expertise and experience.
12
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
•
CONN..
…
Data Collection Methods and Implantation Tool
–
In this study, the necessary knowledge was acquired and elicited
using interviews with the ICT experts, particularly the physicians in the
area of WoredaNet device in which four domain experts were selected
from Tigrai Digita ICT Agency based their professions, educational
qualification level, and years of experience.
– The interview with experts covered issues like, how woredaNet device
problems are defined from the aspect of ICT technicians, What are the
methods and techniques ICT experts use to identify the causes of
woredaNet device problem, How the ICT technicians identify the unique
characteristics of each problem and What are the common types of
problems that occur in the woredaNet devices.
13
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
•
CONN..
…
Data Collection Methods and Implantation Tool
– A secondary data from documents such as computer books, training
manuals, public or private documents, reports, online materials and
journal woredaNet articles was also assessed. Furthermore,
demonstration and direct observation were considered to acquire the
necessary knowledge
– Prolog language is chosen as implementation tool because it is suitable
for rule based programming, forward chaining execution and pattern
matching
14
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
Knowledge Base
Evaluate
Digital ICT Experts
Literature and
Documented
knowledge
Knowledge
Acquisition
Knowledge
Modeling
Knowledge
Base
user
Knowledge
Representations
Activities of the Knowledge-Base Development
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
15
•
Model
METHODOLOGY
…
– Knowledge is to be modeled at a conceptual level. Typically, a knowledge
model provides formats for writing down both static domain knowledge
(rules, classes, relations) and reasoning strategies. According to (Lidtke,
2003) one of the most extensively applied methods for conceptual
modeling is decision tree.
– Decision tree commonly acts a key role in a knowledge modeling process.
The decision tree structure that has the flow of knowledge in the
diagnosis and troubleshooting of WoredaNet Device.
16
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
con.…
• General Structure of WNDTES
WoredaNet
device
troubleshooting
expert system
Network
Problem
Hardware
problem
video
converenc
e
sound
system
camera
ups
plasma tv
printer
pc
ip
telephon
e
17
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
•
CONN..
…
Knowledge Representation
– In the Previous section knowledge has been acquired and modeled; the
next step is knowledge representation by using appropriate format that is
understandable by inference engine. Knowledge representation is a
means of encoding the human expert knowledge in an appropriate way.
– We used rule-based knowledge representation techniques to represent
the acquired knowledge. All rules that are used in this study are
developed based on the concepts of knowledge modeling approaches. To
setup all rules, production rule Knowledge representation techniques are
used in which knowledge is represented in the form of condition-action
pairs
18
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
•
CONN..
…
Architecture of the Prototype System
– System architecture is a conceptual model that defines the structure and
guidelines of the system.
– The architecture of WoredaNet device troubleshooting and maintenance
expert system consists of Knowledge Base, Inference Engine, Knowledge
Translation, Learning and Memorization Component, Explanation Facility,
User Interface and the End User
– The overall architecture of our system is shown below
19
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
Architecture of the prototype
Learning
memorization
component
User
Interface
english
ትግርኛ
USER
Knowledge
Translation
(UNICODE)
አማርኛ
Inference
Engine
Knowledge
Base
(English,Tigrign
a, and amharic)
Rules
Explanation
facility
Facts
20
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
•
METHODOLOGY
…
User interface
– User interface is used as a bridge between the system and the user for
communication. The interaction of the user and the prototype system is
in English, Amharic and Tigrigna languages
– The user interface of the prototype system allows a non-expert and
physicians users to query (question) the KBS, and to see delivery of
advices. In this prototype, users can interact with the system through
“yes” , እወ ,አዎ”, “no” ,” አይኮንን,“አይ_የለብኝም”, “what”,” እንታይ”, “ምን”,
“why”,” ንምንታይ”, “ለምን” and “how”, “ከመይ”, “እንዴት” responses.
– Based on the user response, the system draws a conclusion and
displayed in the user interface window. The picture below displays the
home window that has different options for users to interact.
21
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
conn..
…
•
22
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
•
User interface
Conn
…
23
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
TESTING AND EVALUATIONS
…
• Developing a knowledge-based
system is an incremental
process. Therefore, in developing the prototype system, the
knowledge engineer at finishing step should test the
performance of the system. In our research, we used test cases
and visual interactions approaches. The results of this
evaluation and test show where the system is weak. Also, the
correct and incorrect outcomes are identified by comparing
decisions made by domain experts with decisions made by the
prototype system.
24
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
•
TESTING AND EVALUATIONS
…
Test Cases
– In this section the performance of the system was tested and validated
using test cases. The test cases were used to measure the accuracy of the
system. For the purpose of validation process a total of twelve cases were
selected. To achieve the goal of the system evaluators were purposively
selected according to their willingness and specialty. Therefore, the
system evaluators were from different computer and network
departments in Tigrai ICT Agency office.
– As indicated in the table below, the result provided by system evaluators
showed that the Rule based system is about 83% accurate in
troubleshooting woredaNet device problems.
25
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
Conn….
Problems
Total number of
problem
selected
Correct
suggestion
Incorrect
suggestion
The accuracy of
prototype in %
Network cable
ADSL
connection
problem
3
3
0
100
IP address ADSL
configuration
problem
3
2
1
66.67
Computer
power problem
3
3
0
100
Printer Problem
3
2
1
66.67
Total
12
10
2
83%
26
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
•
TESTING AND EVALUATIONS
…
User Acceptance Evaluation
– The goal of user acceptance testing is to assess if the system can support
day-to-day business, user scenarios and to ensure the system is sufficient
and correct for business usage
– We used the following formulas to get the average values of the first
close-ended user acceptance testing questions
– AVP

𝑠𝑣1 ∗
𝑛𝑟𝑖
𝑡𝑛𝑠
𝑛𝑟1
+
𝑡𝑛𝑠
𝑠𝑣2 ∗
𝑛𝑟2
𝑡𝑛𝑠
+ 𝑠𝑣3 ∗
𝑛𝑟3
𝑡𝑛𝑠
+ 𝑠𝑣4 ∗
𝑛𝑟4
+
𝑡𝑛𝑠
𝑛
𝑖=0
𝑠𝑣 ∗
+ ⋯(1) Where, SV scale value, TNR total number of respondent and
NR is number of respondent. To get the result of user acceptance average
performance is calculated out 100%.
𝐴𝑣𝑒𝑠
– AVP =
∗100----------(2) Where NS is number of scale and Avp is
𝑁𝑆
average performance
27
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
•
TESTING AND EVALUATIONS
…
User Acceptance Evaluation
– The result indicates that about 88.4% of users are satisfied by the
performance of the Rule based system. It means that the Rule based
system gained about 88.4% of user acceptance.
28
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
USER ACCEPTANCE EVALUATION
No
Question
1
2
3 4
5 Mean
Total
Av/perf
%
1
Is the WNDTES system is efficient in
Time?
0
0
1 4
5 4.4
88
2
What is the accuracy of the system in
Troubleshooting woredaNet device
Problems?
0
0
1 5
4 4.3
86
3
Does the system incorporate
sufficient knowledge to solve
Problems?
0
0
0 6
4 4.4
88
4
Does the system provide appropriate
Suggestion for the problems?
0
0
1 5
4 4.3
86
5
What is the contribution of the
System in the domain area?
0
0
0 3
7 4.7
94
•
By:- Alene Girmay
Oct 12, 2023
Total average
4.42
MSc Thesis Defense
29
88.4
SUMARY OF KEY FINDING
…
English, Amharic
• As to our findings,
and Tigrigna language
interfaces helps end-users to know the diagnosis and
troubleshooting WoredaNet device process more easily and it is
useful to distribute information in their native languages
• The accuracy of the prototype system using test cases are
calculated as 83% and the user acceptance testing using closeended and open-ended questions average evaluation result is
88%, respectively.
• Therefore, the overall accuracy performance of the WNDTES
prototype system is 85%, because the system has local language
based features.
30
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
CONTIRBUTION TO THE FIELD
• primary beneficiaries of our expert system research are
computer users or ICT technicians in Tigrai from this Rule Based
WNDTES because WoredaNet device problems can be solved
easily.
• By the help of this system the computer users solve problems
occurring in the computer system by their own instead of
waiting or calling to the ICT technicians by referring to the
recommended solutions from the expert system.
• The system fills the skill gap of the ICT technicians and helps
them to cope up with the constant change and complexity of the
WoredaNet Device system.
• Economically, this system reduces the cost of maintenance,
increases the efficiency of the work and increased utilization of
the woredaNet devices related resources.
31
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
Cont..
• To give advising services for both computer users and ICT
technicians.
• It gives better advice services where human expert are not
Found and limited in number.
• The results of this study could easily be applied for the
development of full-fledged trilingual expert system (specifically
in English, Amharic and Tigrigna languages) in the area of
woredaNet device troubleshooting.
• This research contributes to successfully implement expert
system and achieve relatively competitive advantages over their
competitors. Finally, it is also our conviction that this study will
generally contribute to the existing body of knowledge
pertaining Information Technology.
32
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
RECOMMENDATION FOR FUTURE RESEARCH
…
• The scope of the knowledge based system should be extended to
incorporate other causes occurring in the WoredaNet system such
as schoolnet device .
• During developing knowledge based system it is difficult to
change the English language to local language even the domain
expert didn’t know like Tigrigna and Amharic version, then the
researcher used direct change the English version to
Tigrigna/amharic version. So it is better to design the real the
local language version.
33
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
Con…
• In this study, an attempt is made to apply rule-based systems.
But there are many cases that are resolved differently in
WoredaNet device troubleshooting. Rule-based systems solve
problems from scratch, while case-based systems use prerecorded scenarios to handle new, similar cases. Therefore,
integrating rule-based reasoning with case-based reasoning
solves the limitation of representing knowledge as rules if
conclusions cannot then be drawn.
• Further study is needed to improve user interface of WNDTES
systems and to design a system that can update rules of the
knowledge base.
34
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
CONCLUSION
…
• The knowledge engineer to develop local language based KBS
for diagnosis and troubleshooting of WoredaNet device
performed basic tasks: first the knowledge engineer assessed
the problem area and the problem is considered feasible, then a
statement of requirements is created and the development
process continued as follows, knowledge was acquired using
both structured and unstructured interviews with domain
experts and from relevant documents by using documents
analysis method to get concepts and facts of WoredaNet device
35
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
CONCLUSION
…
• The acquired knowledge focuses on concepts and facts of
WoredaNet device troubleshooting. Then, those extracted facts
and concepts were modeled by using decision tree approach
and the model has been converted into productive rules and
coded by using SWI-Prolog tool to form the knowledge-based
system.
• Finally, the evaluating and testing result shows that, the overall
performance of the WNDTES prototype system registered 85%
accurate result
36
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
37
By:- Alene Girmay
Oct 12, 2023
MSc Thesis Defense
Download