Uploaded by anu pun

conference-template-a4 (3)

advertisement
Appraisal Evaluation Using Fuzzy Logic
Phambahadur Pun
Department of Computer Science
University of Huddersfield
Huddersfield, United Kingdom
u1976481@unimail.hud.ac.uk
Abstract—This electronic document is a “live” template and
already defines the components of your paper [title, text, heads,
etc.] in its style sheet. *CRITICAL: Do Not Use Symbols, Special
Characters, Footnotes, or Math in Paper Title or Abstract.
(Abstract)
Keywords—component, formatting, style, styling, insert (key
words)
I. PROBLEM STATEMENT
A Dorset-based organisation called Collaborative
Design Team (CDT) has been exploring options to
evaluate its employee’s performance using disruptive
technology of Artificial Intelligence. The company
provides Annual Appraisal Reports (AAR) to evaluate
its employees’ performance which is used for
promotion, posting and performance enhanced bonus
scheme. In the last few years, few disgruntled
employees have raised complaints doubting the
integrity and authenticity of the performance evaluation
process. Upon investigating the complaints, the
following key facts were identified:

Appraisal reports were written subjectively
rather than objectively and contained distinctly
identifiable personal and sensitive information.

The performance evaluation board members
were pooled from the same organisation and
there was a possibility of an unconscious bias.

The grades awarded on AARs were random
and often didn’t marry up with the written
evidence on performance and potential
paragraphs.
II. RESEARCH
A. Structure of AAR
A solution is urgently required to rectify the concerns
raised by CDT’s unhappy employees. The proposed
solution must be trialled and evaluated and certified by
the company administrator before implementing it as a
solution. The AAR format has been broken down into
five sections as shown in fig 1.
Figure 1: Annual Appraisal Report Sample
1) Employee
Detail. This section contains the
employee’s name, Post Identification Number (PID),
current grade and total service years completed. It is
recommended that the service number or randomly
generated number is used for the promotion board for
anonymity.
2) Attributes. This is the most important section of the
AAR which has six attributes in total. These attributes
have three grades: below average, average and high
Qualities
Initiatives
Grades
Below
average,
average
or high
Scores
1-10
Communication
Power
Results
Same as
above
Same as
above
Same as
above
Same as
above
Same as
above
1-10
Leadership
Problem
Solving
Decision
Making
1-10
1-10
1-10
1-10
Remarks
Below
average = 14
Average =
4-8
High = 8-10
Same
as
above.
Same
as
above.
Same
as
above.
Same
as
above.
Same
as
above.
Table 1: Attributes and their Grading Criteria
with numerical grades between 0 and 10 assigned next
to it. These grades will be used as the primary source
of information to evaluate the employees’ performance.
Table 1 shows the classification of grades for each
attribute.
3) Performance. This is a free text section that allows
up to 120 words to describe the performance of an
employee. This should act as an evidence of the grades
awarded to six attributes. For this assignment, this
section won’t be used for evaluation as it requires a
XXX-X-XXXX-XXXX-X/XX/$XX.00 ©20XX IEEE
sophisticated Natural Language Processing (NLP)
algorithm.
4) Potential. This is a free text section that allows up to
120 words to describe the future potential of an
employee. This section is more useful for the allocation
of posting once the candidate is successful on the
promotion board. For this assignment, this section won’t
be used for evaluation as it requires a sophisticated
NLP algorithm.
5) Recommendations. This section allows the
reporting officer to categorically state the candidate’s
promotability and future employment. Future
employment can be either management, human
resources or technical.
III. METHODOLOGY
Figure 3: Mamdani Output Membership Function (MATLAB
2021)
2. Fuzzy operator. Both Mamdani and Sugeno FIS were
used. The Mamdani FIS is the most widely used and it is
easier to set up. The output membership function of Sugeno
is represented by a constant parameter as shown in fig 4.
FIS and ANFIS techniques will be used to predict the
overall score using six attributes as the inputs. It is
recommended that the service number or randomly
generated numbers be used instead of name to
maintain anonymity.
A. FIS using MATLAB
MATLAB’s Fuzzy Logic Designer Toolbox (MATLAB, 2021)
is used to create membership function and rules. Fig 2 shows
that it is using Mamdani and has six inputs and one output.
Figure 4: Sugeno Output Membership Function (MATLAB
2021)
3. Rules. Since there are six inputs with three membership
functions (MFs), it would require (3x3x3x3x3x3) 729 rules in
total. A specific rules can be defined here. For example, the
company doesn’t want to promote people if their performance
is below average in at least one area. The first row of table 2
has an output of 1 because the leadership quality is below
average despite qualifying on the other five attributes.
Figure 2:Fuzzy Logic Designer (MATLAB 2021)
1. Inputs and Outputs. Each input has a range of 0-10 where
0-4 represents below average, 4-8 represents the average
and 8-10 represents high. The output has a range of 0-10
where 0-4, 4-8 and 8-10 represent ‘can’t promote’, ‘could
promote’ and ‘should promote’ respectively as shown in fig 3.
L1
L2
L3
L4
L5
L6
Output
3
2
2
1
3
1
1
3
2
2
2
3
2
2
3
2
3
2
2
3
2
3
3
3
3
3
3
3
3
1
1
2
1
1
Table 2: Example of FIS Rules
1
4. Evaluation. The pattern of Mamdani and Sugeno FIS
outputs were found to be almost identical as demonstrated by
figure 5. Whilst testing with few sample inputs, both FIS
methods produced an accurate output due to 729 rules
defined earlier.
Table 4: ANFIS Error Comparison
Mamdani Vs Sugeno Output
Graph
10
0
2. Evaluation. The plot of sub clustering output against the
checking dataset is shown in fig 6. The epochs figure was
gradually increased to see if it reduced the errors but it didn’t
have any impact.
Mamdadni Output
123 4 5 6
7 8 9 10
11 12
Mamdadni Output
Suzeno Output
Figure 5: Comparison of Mamdani and Sugeno Outputs
ANFIS using MATLAB
Mamdani and Sugeno FIS methods are simple and effective
but they become complicated when input variable and
membership function increase significantly. Adaptive NeuroFuzzy Inference System (ANFIS) is a class of adaptive
networks that incorporate both neural networks and fuzzy
logic principles. A neural network is a supervised learning
algorithm that utilises a historical dataset to predict the future
outcome (Mathur, Glesk, & Buis, 2016). For this assignment,
MATLAB’s Neuro-Fuzzy Designer application is used.
1. Training. The historical training dataset is the most
important element of an ANFIS model because the predicted
outcome relies on it. The company provided a historical
dataset from last year’s promotion board. After analysing the
data, it was evident that the company only penalised
candidates who scored below average in Problem Solving and
Decision Making category. The candidates were given three
grades as shown in table 3.
Attributes
Initiatives
Scores
1-3
Communication
1-3
Power
Results
1-3
Leadership
1-3
Problem Solving
1-3
Decision Making
1-3
Table 3: Input and MFs for ANFIS
Remarks
Below average = 1
Average = 2
High = 3
Same as above.
Same as above.
Same as above.
Same as above.
Same as above.
The training, testing and checking datasets are attached to
annex A, were used to train the ANFIS model using various
configurations as shown in table 4. Sub clustering FIS type
produced the least number of errors.
Input FIS Type
Output
Testing
Testing
(No
MF Type
Error
Error
of
with
with
MFs)
testing
checking
data
data
3 3 3 Grid
trim
1.7759
1.4753
333
partition
Constant
trim inear
1.7759
1.4753
3 3 3 Grid
gbellmf
1.409
1.1471
333
partition
constant
gbellmf
1.4326
1.1933
linear
3 3 3 Grid
constant
1.4326
1.1702
333
partition
linear
1.4442
1.18
0.4254
0.4369
3 3 3 Sub
N/A
333
clustering
Figure 6: ANFIS Sub Clustering Plot (MATLAB 2021)
3. Findings. Although the error rate remains high, the sub
clustering ANFIS model was selected as the solution.
Strangely, It produced 49 membership functions for each input
instead of three. From fig 6, it can be seen that the accuracy
slips as the output increases towards 3. The training dataset
had only 49 records. Ideally, it needs to be bigger than that
and it must include data from multiple years. Both online and
offline version of MATLAB software was found to be very slow
and often crashed during the testing phase. To alleviate this
problem, a script and dashboard were created which
significantly improved the testing experience.
4. MATLAB Dashboard. Script_Mam.m allows data input
through the MATLAB command window without running the
.fis file. The script was further improved by creating a
dashboard using features from Open-Source MATLAB GUI (
SysMat Soft Solutions, 2021). Fig 7 shows a screenshot of the
dashboard which can accept manual data, bulk data, export
results and plot a 3D surface area. It can support Mumdani,
Sugeno and ANFIS model as long as the .fis file is changed
accordingly on the Main.m file.
Times New Roman or the Symbol font (please no other font).
To create multileveled equations, it may be necessary to treat
the equation as a graphic and insert it into the text after your
paper is styled.
Number equations consecutively. Equation numbers,
within parentheses, are to position flush right, as in (1), using
a right tab stop. To make your equations more compact, you
may use the solidus ( / ), the exp function, or appropriate
exponents. Italicize Roman symbols for quantities and
variables, but not Greek symbols. Use a long dash rather than
a hyphen for a minus sign. Punctuate equations with commas
or periods when they are part of a sentence, as in:

Figure 7: MATLAB Dashboard (MATLAB 2021)
Conclusions and Recommendations
Mamdani FIS is the easiest system to design and implement
but requires a complex set of rules. When the inputs and
membership functions are too big and complex, ANFIS is
undoubtedly the better choice. The main advantage of ANFIS
is that it can learn from the historical training dataset and can
adapt constantly to predict an output.
AAR is a complex piece of document which contains attributes
and a comprehensively written narrative on the performance
and potential of an individual. This assignment has not delved
into the evaluation of written narratives which can be analysed
by NLP techniques such as Random Forest.
Although the proposed ANFIS model provides a workable
solution, it needs further investigation before it can be
implemented by the company. It can however be used as a
tool alongside the human performance evaluation board.
IV. REFERENCES
SysMat Soft Solutions. (2021, April 24). Retrieved from Free
Thesis: https://free-thesis.com/product/matlab-guipresentation-for-fuzzy-logic-application/
ab

Note that the equation is centered using a center tab stop.
Be sure that the symbols in your equation have been defined
before or immediately following the equation. Use “(1)”, not
“Eq. (1)” or “equation (1)”, except at the beginning of a
sentence: “Equation (1) is . . .”
B. Some Common Mistakes
 The word “data” is plural, not singular.
 The subscript for the permeability of vacuum 0, and
other common scientific constants, is zero with
subscript formatting, not a lowercase letter “o”.
 In American English, commas, semicolons, periods,
question and exclamation marks are located within
quotation marks only when a complete thought or
name is cited, such as a title or full quotation. When
quotation marks are used, instead of a bold or italic
typeface, to highlight a word or phrase, punctuation
should appear outside of the quotation marks. A
parenthetical phrase or statement at the end of a
sentence is punctuated outside of the closing
parenthesis (like this). (A parenthetical sentence is
punctuated within the parentheses.)
 A graph within a graph is an “inset”, not an “insert”.
The word alternatively is preferred to the word
“alternately” (unless you really mean something that
alternates).
 Do not use the word “essentially” to mean
“approximately” or “effectively”.
Mathur, N., Glesk, I., & Buis, A. (2016). Comparison of
adaptive neuro-fuzzy inference system (ANFIS).
Glasgow: University of Strathclyde.
 In your paper title, if the words “that uses” can
accurately replace the word “using”, capitalize the “u”;
if not, keep using lower-cased.
Mathworks. (2021, February 04). MATLAB R2020b Software.
 Be aware of the different meanings of the homophones
“affect”
and
“effect”,
“complement”
and
“compliment”, “discreet” and “discrete”, “principal”
and “principle”.
MATLAB. (2021, April 25). Adaptive Neuro-Fuzzy Inference
System.
Retrieved
from
https://uk.mathworks.com/help/fuzzy/train-adaptiveneuro-fuzzy-inference-systems-gui.html
 Do not confuse “imply” and “infer”.
 The prefix “non” is not a word; it should be joined to
the word it modifies, usually without a hyphen.
A. Equations
The equations are an exception to the prescribed
specifications of this template. You will need to determine
whether or not your equation should be typed using either the
 There is no period after the “et” in the Latin
abbreviation “et al.”.
 The abbreviation “i.e.” means “that is”, and the
abbreviation “e.g.” means “for example”.
An excellent style manual for science writers is [7].
V. USING THE TEMPLATE
After the text edit has been completed, the paper is ready
for the template. Duplicate the template file by using the Save
As command, and use the naming convention prescribed by
your conference for the name of your paper. In this newly
created file, highlight all of the contents and import your
prepared text file. You are now ready to style your paper; use
the scroll down window on the left of the MS Word
Formatting toolbar.
A. Authors and Affiliations
The template is designed for, but not limited to, six
authors. A minimum of one author is required for all
conference articles. Author names should be listed starting
from left to right and then moving down to the next line. This
is the author sequence that will be used in future citations and
by indexing services. Names should not be listed in columns
nor group by affiliation. Please keep your affiliations as
succinct as possible (for example, do not differentiate among
departments of the same organization).
1) For papers with more than six authors: Add author
names horizontally, moving to a third row if needed for more
than 8 authors.
2) For papers with less than six authors: To change the
default, adjust the template as follows.
a) Selection: Highlight all author and affiliation lines.
b) Change number of columns: Select the Columns
icon from the MS Word Standard toolbar and then select the
correct number of columns from the selection palette.
c) Deletion: Delete the author and affiliation lines for
the extra authors.
B. Identify the Headings
Headings, or heads, are organizational devices that guide
the reader through your paper. There are two types:
component heads and text heads.
Component heads identify the different components of
your paper and are not topically subordinate to each other.
Examples include Acknowledgments and References and, for
these, the correct style to use is “Heading 5”. Use “figure
caption” for your Figure captions, and “table head” for your
table title. Run-in heads, such as “Abstract”, will require you
to apply a style (in this case, italic) in addition to the style
provided by the drop down menu to differentiate the head
from the text.
Text heads organize the topics on a relational, hierarchical
basis. For example, the paper title is the primary text head
because all subsequent material relates and elaborates on this
one topic. If there are two or more sub-topics, the next level
head (uppercase Roman numerals) should be used and,
conversely, if there are not at least two sub-topics, then no
subheads should be introduced. Styles named “Heading 1”,
“Heading 2”, “Heading 3”, and “Heading 4” are prescribed.
C. Figures and Tables
a) Positioning Figures and Tables: Place figures and
tables at the top and bottom of columns. Avoid placing them
in the middle of columns. Large figures and tables may span
across both columns. Figure captions should be below the
figures; table heads should appear above the tables. Insert
figures and tables after they are cited in the text. Use the
abbreviation “Fig. 1”, even at the beginning of a sentence.
TABLE I.
Table
Head
copy
TABLE TYPE STYLES
Table Column Head
Table column subhead
Subhead
Subhead
More table copya
a.
Sample of a Table footnote. (Table footnote)
Fig. 1. Example of a figure caption. (figure caption)
Figure Labels: Use 8 point Times New Roman for Figure
labels. Use words rather than symbols or abbreviations when
writing Figure axis labels to avoid confusing the reader. As an
example, write the quantity “Magnetization”, or
“Magnetization, M”, not just “M”. If including units in the
label, present them within parentheses. Do not label axes only
with units. In the example, write “Magnetization (A/m)” or
“Magnetization {A[m(1)]}”, not just “A/m”. Do not label axes
with a ratio of quantities and units. For example, write
“Temperature (K)”, not “Temperature/K”.
ACKNOWLEDGMENT (Heading 5)
The preferred spelling of the word “acknowledgment” in
America is without an “e” after the “g”. Avoid the stilted
expression “one of us (R. B. G.) thanks ...”. Instead, try “R.
B. G. thanks...”. Put sponsor acknowledgments in the
unnumbered footnote on the first page.
REFERENCES
The template will number citations consecutively within
brackets [1]. The sentence punctuation follows the bracket [2].
Refer simply to the reference number, as in [3]—do not use
“Ref. [3]” or “reference [3]” except at the beginning of a
sentence: “Reference [3] was the first ...”
Number footnotes separately in superscripts. Place the
actual footnote at the bottom of the column in which it was
cited. Do not put footnotes in the abstract or reference list. Use
letters for table footnotes.
Unless there are six authors or more give all authors’
names; do not use “et al.”. Papers that have not been
published, even if they have been submitted for publication,
should be cited as “unpublished” [4]. Papers that have been
accepted for publication should be cited as “in press” [5].
Capitalize only the first word in a paper title, except for proper
nouns and element symbols.
For papers published in translation journals, please give
the English citation first, followed by the original foreignlanguage citation [6].
[1]
[2]
[3]
[4]
[5]
G. Eason, B. Noble, and I. N. Sneddon, “On certain integrals of
Lipschitz-Hankel type involving products of Bessel functions,” Phil.
Trans. Roy. Soc. London, vol. A247, pp. 529–551, April 1955.
(references)
J. Clerk Maxwell, A Treatise on Electricity and Magnetism, 3rd ed.,
vol. 2. Oxford: Clarendon, 1892, pp.68–73.
I. S. Jacobs and C. P. Bean, “Fine particles, thin films and exchange
anisotropy,” in Magnetism, vol. III, G. T. Rado and H. Suhl, Eds. New
York: Academic, 1963, pp. 271–350.
K. Elissa, “Title of paper if known,” unpublished.
R. Nicole, “Title of paper with only first word capitalized,” J. Name
Stand. Abbrev., in press.
[6]
[7]
Y. Yorozu, M. Hirano, K. Oka, and Y. Tagawa, “Electron spectroscopy
studies on magneto-optical media and plastic substrate interface,” IEEE
Transl. J. Magn. Japan, vol. 2, pp. 740–741, August 1987 [Digests 9th
Annual Conf. Magnetics Japan, p. 301, 1982].
M. Young, The Technical Writer’s Handbook. Mill Valley, CA:
University Science, 1989.
We suggest that you use a text box to insert a graphic
(which is ideally a 300 dpi TIFF or EPS file, with all fonts
embedded) because, in an MSW document, this method is
somewhat more stable than directly inserting a picture.
To have non-visible rules on your frame, use the
MSWord “Format” pull-down menu, select Text Box >
Colors and Lines to choose No Fill and No Line.
IEEE conference templates contain guidance text for
composing and formatting conference papers. Please
ensure that all template text is removed from your
conference paper prior to submission to the
conference. Failure to remove template text from
your paper may result in your paper not being
published.
Download