Senior design ECE 461/462 Project Assessment Rubric

advertisement
ECE Department Undergraduate
Assessment Plan
Programs Covered:
BS Electrical Engineering
BS Computer Engineering
Program Objectives:
The objectives are based on the departmental mission and the perceived needs of our constituents, and
consistent with the ABET EC2000.
1. Our graduates will have the ability to apply technical knowledge to analyze and solve practical
electrical and computer engineering problems.
2. Our graduates will have the ability to practice engineering in a professional manner with
effective communication and teamwork skills.
3. Our graduates will have the ability to pursue post-graduate or continuing education
opportunities to acquire the latest knowledge and skills.
4. Our graduates will be able to understand the societal and ethical issues associated with the
engineering profession.
Engineering programs must demonstrate that their students attain the following outcomes:
a) an ability to apply knowledge of mathematics, science, and engineering
b) an ability to design and conduct experiments, as well as to analyze and interpret data
c) an ability to design a system, component, or process to meet desired needs within realistic
constraints such as economic, environmental, social, political, ethical, health and safety,
manufacturability, and sustainability
d) an ability to function on multidisciplinary teams
e) an ability to identify, formulate, and solve engineering problems
f) an understanding of professional and ethical responsibility
g) an ability to communicate effectively
h) the broad education necessary to understand the impact of engineering solutions in a global,
economic, environmental, and societal context
i) a recognition of the need for, and an ability to engage in life-long learning
j) a knowledge of contemporary issues
k) an ability to use the techniques, skills, and modern engineering tools necessary for engineering
practice.
Page 1
Program Outcomes:
4. Our graduates will be able to
understand the societal and ethical
issues associated with the
engineering profession.
3. Our graduates will have the ability to
pursue post-graduate or continuing
education opportunities to acquire
the latest knowledge and skills.
X
X
X
X
X
X
X
X
X
X
X
X
Page 2
a) an ability to apply knowledge of
mathematics, science, and engineering
b) an ability to design and conduct
experiments, as well as to analyze and
interpret data
c) an ability to design a system,
component, or process to meet desired
needs within realistic constraints such
as economic, environmental, social,
political, ethical, health and safety,
manufacturability, and sustainability
d) an ability to function on
multidisciplinary teams
e) an ability to identify, formulate, and
solve engineering problems
f) an understanding of professional and
ethical responsibility
g) an ability to communicate effectively
h) the broad education necessary to
understand the impact of engineering
solutions in a global, economic,
environmental, and societal context
i) a recognition of the need for, and an
ability to engage in life-long learning
j) a knowledge of contemporary issues
k) an ability to use the techniques, skills,
and modern engineering tools
necessary for engineering practice.
2. Our graduates will have the ability to
practice engineering in a
professional manner with effective
communication and teamwork skills.
1. Our graduates will have the ability to
apply technical knowledge to analyze
and solve practical electrical and
computer engineering problems.
Mapping Program Outcomes to Program Objectives:
Mapping of Program Outcomes to ECE Dept. Courses:
a)
101
102
201
202
203
221
301
b)
c)
d)
e)
A
E
A
A
A
A
B, C
B, C
A
311
312 (EE
Only)
322
323
391 (EE
Only)
461/462
Technical
Electives
(4xx
classes)
A
B, C
A
B, C
A
B, C
A
B, C
A
B, C
A
B, C
A
G, H
A, B,
C
A, B,
C
A, B,
C
A, B,
C
A, B,
C
A, B,
C
A, B,
C
f)
F, G,
H
A
A
A
C
g)
C
C
h)
E
i)
E
j)
k)
E
C
C
A
A
A
B, C
B, C
A, C
C
B, C
A, C
C
B, C
A, C
C
B, C
A, C
C
A, B,
C
A, C
C
B, C
A, C
C
B, C
A, C
E
A, C
E
C, D
E
E
E
B, C
E
E
E
B, C
Assessment Method:
A.
B.
C.
D.
E.
F.
G.
H.
Rubric assessment of class assignment/exam.
Rubric assessment of laboratory work (oral)
Rubric assessment of laboratory work/report (written)
Rubric assessment of oral presentation
Rubric assessment of student essay
Documentation provided by student
Teamwork rubric filled out by students
Teamwork rubric filled out by faculty
Page 3
Desired Level of Student Work (based on Bloom’s Taxonomy)
Knowledge or Comprehension
Application or Analysis
Synthesis or Evaluation
Timeline:
Program Outcomes
0708
a) an ability to apply knowledge of mathematics, science, and
engineering
b) an ability to design and conduct experiments, as well as to
analyze and interpret data
c) an ability to design a system, component, or process to meet
desired needs within realistic constraints such as economic,
environmental, social, political, ethical, health and safety,
manufacturability, and sustainability
d) an ability to function on multidisciplinary teams
e) an ability to identify, formulate, and solve engineering
problems
f) an understanding of professional and ethical responsibility
g) an ability to communicate effectively
h) the broad education necessary to understand the impact of
engineering solutions in a global, economic, environmental,
and societal context
i) a recognition of the need for, and an ability to engage in lifelong learning
j) a knowledge of contemporary issues
k) an ability to use the techniques, skills, and modern
engineering tools necessary for engineering practice.
IAC meeting (once a year)
SAC meeting (once a year)
Alumni survey (once a year with different groups of graduates
(alumni))
Employer Survey (once a year different groups of alumni)
0910
Academic Year
10- 11- 1211
12
13
X
1314
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
Rubrics:
Page 4
Rubrics used for the various outcomes are given in the following pages.
Non-technical realistic constraints (Program Outcome C) Rubric
Course: __________________________
Semester: ________________________
Unacceptable
Marginal
Acceptable
Exceptional
(1)
(2)
(3)
(4)
For all non-technical Incorrect analysis
Analysis contains Analysis provides Analysis provides
constraints:
on how this
a mixture of
correct reasons as correct reasons as
constraint affects
correct and
how this
how this constraint
the design of the
incorrect reasons constraint affects
affects the design
system, component, as to how this
the design of the
of the system,
or process.
constraint affects system,
component, or
the design of the component, or
process and
system,
process but
contains in-depth
component, or
contains only a
discussion.
process.
brief discussion.
Environmental
Social
Political
Ethical
Health and Safety
Manufacturability
Sustainability
Examples of relevant questions
- Is a development cost considered?
- Is a production cost considered?
- Does the project use environmentalfriendly products?
- Is the impact of the project to the
environment considered?
- Are resources being used properly and
efficiently?
- Is the impact of the project to the
society considered?
- Does the project follow the
government guidelines or laws?
- Are there any foreseen potential
conflicts with a profession’s Code of
Ethics arising from the development of
the project?
- If the safety issue should be
concerned, does the project discuss
about it?
- Are there relevant health effects that
are affected by this project?
- Can the project be built?
- How can the project be designed to
eliminate manufacturing errors?
- How can the project be designed to
minimize manufacturing costs?
- To what degree over time will the
project be useful and viable?
Score or N/A
1
2
3
4
N/A
1
2
3
4
N/A
1
2
3
4
N/A
1
2
3
4
N/A
1
2
3
4
N/A
1
2
3
4
N/A
1
2
3
4
N/A
1
2
3
4
N/A
Resource:
http://www.biomed.drexel.edu/new04/Content/ug_prog/senior_design/BMESeniorDesignImpactRubric.pdf
Page 5
Non-technical
constraint
Economic
Outcome (h): the broad education necessary to understand the impact of engineering solutions
in a global, economic, environmental, and societal context
Topic (an engineering solution) being discussed: _______________________________
Course _________________________ Semester ___________________________
Unacceptable
(1)
Marginal
(2)
Acceptable
(3)
Exceptional
(4)
Very little
understanding or
discussion on the
impact of
engineering
solutions in a
global, economic,
environmental,
and societal
context is
provided, or
discussion is
incorrect
Some discussion
on the impact of
engineering
solutions in a
global, economic,
environmental,
and societal
context is
provided, but still
missing some
major points.
A student shows
an understanding
on the impact of
engineering
solutions in a
global, economic,
environmental,
and societal
context and
he/she provides a
nearly complete
discussion, but
misses only some
minor points.
A student shows
a complete
understanding on
the impact of
engineering
solutions in a
global, economic,
environmental,
and societal
context and
he/she provides
an in-depth
discussion.
Score
Page 6
Resource: http://www.cse.ohio-state.edu/~neelam/abet/DIRASSMNT/thirdGroup.html
Outcome (j): a knowledge of contemporary issues
Contemporary issue being considered: _______________________________
Course _________________________ Semester ________________________
Unacceptable
Marginal
Acceptable
Exceptional
Score
(1)
(2)
(3)
(4)
or N/A
Little or no
Moderate
understanding (or understanding of
no interest in)
the major points
Good
understanding of
all the relevant
points
Deep understanding
of all the relevant
points; good analysis
of all these issues
Contemporary issues Little or no
Moderate
directly related to the understanding (or understanding of
implementation and/or no interest in)
the major points
use of the system or
component or project,
etc.
Good
understanding of
all the relevant
points
Deep understanding
of all the relevant
points; good analysis
of all these issues
Any engineeringrelated contemporary
issues
Page 7
Resource: http://www.cse.ohio-state.edu/~neelam/abet/DIRASSMNT/thirdGroup.html
Outcome (i): a recognition of the need for, and an ability to engage in life-long learning
Topic (essay topic) being considered: _______________________________
Course _________________________ Semester ___________________________
Recognize the need
for further education
and continuing
professional
development.
Unacceptable
Marginal
Acceptable
Exceptional
Score
(1)
(2)
(3)
(4)
or N/A
Little or no
recognition for
the need in
continuing
education
Moderate
recognition for
the need in
continuing
education
Good recognition Deep understanding
for the need in
for the need in
continuing
continuing education
education
Demonstrate an ability Incapable of
Demonstrate
to engage in life-long doing research on some capabilities
learning
his/her own.
in doing research
on his/her own.
No references or
knowledge of
Demonstrate
previous work
some (but
demonstrated.
inadequate)
references or
knowledge of
previous work.
Capable of doing
research on
his/her own, i.e.
he/she can
research major
points related to
the project
Very capable of
doing research on
his/her own, i.e.
he/she can do a
complete research
related to the project.
Demonstrate that
Demonstrate that he/she familiars with
he/she somewhat previous work
familiars with
previous work
Page 8
Resource: http://www.cse.ohio-state.edu/~neelam/abet/DIRASSMNT/thirdGroup.html
Outcome (f): an understanding of professional and ethical responsibility
Topic (essay topic) being considered: _______________________________
Course _________________________ Semester ___________________________
Understanding
of ethical and
professional
issues
Unacceptable
(1)
Little or no
understanding of
professional/
ethical issues
even where there
are serious
questions
involved
Marginal
(2)
Some
consideration of
professional,
ethical issues
related to the
project, system,
etc.
Acceptable
(3)
Good understanding
of all the essential
issues related to the
project, system, etc.;
reasonable analysis
of the relevant issues
Exceptional
(4)
Deep understanding
of the professional
issues involved and
the ethical
implications of the
project, system, etc.
Score
Page 9
Resource: http://www.cse.ohio-state.edu/~neelam/abet/DIRASSMNT/thirdGroup.html
RUBRIC FOR ASSESSING LAB REPORTS
Semester: ________________________
Unacceptable
(1)
Marginal
(2)
Acceptable
(3)
Exceptional
(4)
Very little objective provided or
information is incorrect
Some objective, but still missing
some major points
Objective is nearly complete,
missing some minor points
Objective complete and well-
Experimental
procedure
Missing several important
experimental details or not
written in paragraph format
Written in paragraph format, still
missing some important
experimental details
Results:
data, figures,
graphs, tables, etc.
Figures, graphs, tables contain
errors or are poorly constructed,
have missing titles, captions or
numbers, units missing or
incorrect, etc.
Very incomplete or incorrect
interpretation of trends and
comparison of data indicating a
lack of understanding of results
Most figures, graphs, tables OK,
some still missing some
important or required features
Written in paragraph format,
important experimental details
are covered, some minor details
missing
All figures, graphs, tables are
correctly drawn, but some have
minor problems or could still be
improved
Objective
Discussion
Conclusions
Conclusions missing or missing
the important points
Spelling, grammar, Frequent grammar and/or
sentence structure spelling errors, writing style is
rough and immature
Appearance and
formatting
Sections out of order, too much
handwritten copy, sloppy
formatting
Some of the results have been
correctly interpreted and
discussed; partial but incomplete
understanding of results is still
evident
Conclusions regarding major
points are drawn, but many are
misstated, indicating a lack of
understanding
Occasional grammar/spelling
errors, generally readable with
some rough spots in writing style
Almost all of the results have
been correctly interpreted and
discussed, only minor
improvements are needed
Sections in order, contains the
minimum allowable amount of
handwritten copy, formatting is
rough but readable
Score
or N/A
written; provides all necessary
background principles for the
experiment
Well-written in paragraph format,
all experimental details are
covered
All figures, graphs, tables are
correctly drawn, are numbered
and contain titles/captions.
All important conclusions have
been drawn, could be better
stated
All important trends and data
comparisons have been
interpreted correctly and
discussed, good understanding of
results is conveyed
All important conclusions have
been clearly made, student shows
good understanding
Less than 3 grammar/spelling
errors, mature, readable style
All grammar/spelling correct and
very well-written
All sections in order, formatting
generally good but could still be
improved
All sections in order, wellformatted, very readable
Page 10
Course: __________________________
Senior design ECE 461/462
Presentation Assessment Rubric
Proposal
Progress report
Final
Unacceptable
(1)
Presentation is missing
several major required
components
Marginal
(2)
Presentation is missing
a few required
components
Acceptable
(3)
Presentation contains
most of required
components
Exceptional
(4)
Presentation contains
all required
components
No reference is made to
literature or theory. The
audience gain no new
insights.
Explanations of
concepts and/or
theories are incomplete.
Little attempt is made
to tie theory to practice.
The audience gains
little from the
presentation.
For the most part,
explanations of
concepts and theories
are complete. Some
helpful applications are
included.
A complete explanation
of major concepts and
theories is provided and
drawn upon relevant
literature. Applications
of theory are included
to illuminate issues.
Audience gain insights.
Content: Accuracy
Content is sufficiently
inaccurate. The
audience may have been
misled.
No significant errors
are made.
Content in the
presentation is
consistently accurate.
Organization
Audience cannot
understand presentation
because there is no
sequence of information.
Enough errors are made
but some information is
accurate. The audience
needs to determine
what information is
reliable.
Audience can follow
presentation with effort.
Some arguments are not
clear. Organization
seems random.
Presentation is
generally clear and well
organized. A few minor
points are confusing.
Presentation is clear,
logical and organized.
Audience can follow
line of reasoning.
Content: Components
(Introduction, Problem
statement, Design,
Schedule, Cost,
Summary)
Content: Depth
Score or
N/A
Page 11
Project Name _____________________________________
Professional Delivery
Presenters read the
information to audience.
Presenters are obviously
anxious and cannot be
heard. The audience is
so distracted by the
presenter’s apparent
difficulty with grammar
and appropriate
vocabulary that they
cannot focus on the
ideas presented.
Professional Visual Aids The presentation is very
much poorly prepared.
unimportant information
is included.
Presenters seem
uncomfortable and can
be heard only if
the audience is very
attentive. Much of the
information is read.
Some grammatical
errors and use of slang
are evident. Some
sentences are
incomplete.
The presenters seem
slightly uncomfortable
at times, and the
audience occasionally
has trouble hearing
him/her. For the most
part, sentences are
complete and
grammatical, and
they flow together
easily.
Presenters are
comfortable in front of
audience and his/her
voice is audible,
No reading from the
notes or presentation.
Sentences are complete
and grammatical, and
they flow together
easily.
The presentation is
poorly prepared.
The presentation is
well prepared.
The presentation is
well prepared.
appropriate for reading
enough to be seen by
all.
information is included.
several misspellings.
information is
included.
many misspellings.
few misspellings.
Personal Appearance
Personal appearance
(clothes, posture, …) is
very inappropriate
Personal appearance
(clothes, posture,…) is
somewhat appropriate
For the most part,
personal appearance
(clothes, posture, … is
appropriate
organized to maximize
audience
understanding.
no misspelling.
Personal appearance
(clothes, posture,…) is
very appropriate
Page 12
Resource: http://www.ctre.iastate.edu/educweb/oralpres.pdf
Senior Design Report Written Rubric
Date __________________
Unacceptable
(1)
Marginal
(2)
Acceptable
(3)
Excellent
(4)
Content
 Errors in technical content in
many places
 Contain little of the project details
 An engineer would not be able to
recreate the project based on the
report.
 Technically correct
 Contain most of the project details
 An engineer might be able to
recreate the project based on the
report.
 Technically correct
 Contain in-depth and complete
details of the project.
 An engineer can recreate the
project based on the report.
Language
(Word
Choice,
Grammar)
 Errors in sentence structure and
grammar frequently distract the
reader and interfere with meaning.
 Unnecessary repetition of the
same words and phrases.
 Overuse of jargon and technical
terms without definition.
 Many misspelled words.
 For the most part, technically
correct
 Contain a fair amount of
technical details but incomplete
 An engineer would have difficult
time recreating the project based
on the report.
 In a few places, errors in
sentence structure and grammar
distract the reader and interfere
with meaning.
 Word choice could be improved.
 Occasionally, technical jargon is
used without definition.
 A few misspelled words.
 Sentences are complete
and grammatical. They
flow together easily
 Words are chosen for their
precise meaning.
 Engineering terms and
jargon are used correctly.
 No misspelled words.
Visual
Format and
Organization
 The document is not visually
appealing.
 There is no apparent ordering of
paragraphs, and thus there is no
progressive flow of ideas.
 Small errors are present
 Within sections, the order
in which ideas are presented is
occasionally confusing.
Numerical
Usage and
Illustrations
• Figures, graphs, charts, and
drawings are of poor quality, and
have numerous inaccuracies and
mislabeling, or may be missing.
• No corresponding explanatory
text for included items.
 Inaccuracies in the equation.
Little or no attempt is made to
make it easy for the reader
to understand the use of an
equation or its derivation.
• In some cases, illustrations do
not convey information clearly.
• While items are labeled,
references to these items are
missing.
 Most equations are accurate. Too
many variables are not defined.
Discussion regarding the
development and usage of the
equation is unclear.
 For the most part, sentences are
complete and grammatical, and
flow together. Any errors are minor
and do not distract the reader.
 Repetition of words and phrases is
mostly avoided.
 For the most part, terms and jargon
are used correctly with some
attempt to define them.
 One or two misspelled words.
 Structuring the content to represent
the logical progression
 The document is organized.
 Use of white space helps the
reader navigate the document,
although the layout could be more
effective.
• For the most part, illustrations are
accurate, consistent with the text,
and of good quality.
• All items are generally labeled and
are referred to in the text.
 Most equations are accurate and
clear. Most variables are defined
and units specified. With some
minor exceptions, adequate
discussion regarding the equation
development and usage is stated.
Use of
references
 Little attempt is made to
acknowledge the work of others.
• Most references included are
inaccurate or unclear.
 On several cases, references are
not stated when appropriate.
• References are not complete.
Resources:
ABET training workshop
 With an occasional oversight, prior
work is acknowledged.
 With some minor exceptions,
references are correct.
 Structuring the content to
represent the logical progression
 The document is visually
appealing and easily navigated.
 Usage of white space is used as
appropriate to separate blocks of
text and add emphasis.
 All figures, graphs, charts,
and drawings are accurate,
consistent with the text, and of
good quality. They enhance
understanding of the text.
 All items are labeled and referred
to in the text.
 All equations are clear, accurate,
and labeled. All variables are
defined and units specified.
Discussion about the equation
development and use is stated.
 Prior work is acknowledged by
referring to sources for theories,
assumptions, quotations, and
findings.
• Correct information for
References.
Score
Page 13
Group ___________________________________
Page 14
www.seattleu.edu/assessment/rubrics/MEGR_489_rubric.doc
http://www.biomed.drexel.edu/new04/Content/ug_prog/senior_design/
Group member evaluation
Course:
Semester:
Lab name:
Name of evaluator:
Name of person being evaluated: ________________________________
Unacceptable
(1)
Role and
Responsibilities
Workload and
time management
skills
Team Dynamics
Marginal
(2)
Acceptable
(3)
Excellent
(4)
Score or
N/A
Motivation
Reliability
Flexibility
Planning
Time management
Contributes to the project
Decision Making
Problem Solving
Technical Knowledge
Written Communications
Oral Communications
Communications
skills
OVERALL*
* OVERALL should represent your assessment of this individual’s overall project performance.
What is (are) his/her strength(s)?
Page 15
In what areas does he/she need the most improvement?
Senior design ECE 461/462 Project Assessment Rubric
Faculty name: ______________________ Project Name ______________________________
Significantly
Below Average
Above Average
Exceptional
below average (1)
(2)
(3)
(4)
Project complexity: (compared to other
senior design projects)
Program Outcomes achievement
Have no idea what
they do with their
project
b) an ability to design and conduct
experiments, as well as to analyze and
interpret data (Quality of design)
Poor design (not
well thought of)
b) an ability to design and conduct
experiments, as well as to analyze and
interpret data (Project implementation)
b) an ability to design and conduct
experiments, as well as to analyze and
interpret data (analyze and interpret
data)
Able to somewhat
apply what they
have learned into
their project.
The design is
adequate but
missing some
major points.
The implementation The
(also problem
implementation
solving) is not
(also problem
systematic and very solving) lacks a
poorly conducted.
systematic
The project is not
approach most of
complete
the time. The
project is
somewhat
complete
Analysis and
Analysis and
interpretation are
interpretation are
badly conducted or conducted but
there is none
contains a few
serious errors
Knowledgeable
and can apply
what they have
learned into their
project.
The project is well
designed with
minor exceptions.
approach.
The
implementation
(also problem
solving)
sometimes lacks a
systematic
approach. The
project is complete
but not well
executed.
Appropriate
analysis and
interpretation with
a few minor
exceptions
Very knowledgeable
and can efficiently
apply what they have
learned into their
project.
The project is well
designed.
The implementation
(also problem
solving) is very
systematic. The
project is very
complete and nicely
finished.
Proper assumptions
made; results are
correctly analyzed
and interpreted.
Page 16
a) Students are able to apply their
knowledge of mathematical, science and
electrical (computer) engineering to their
project.
Score
e) an ability to identify, formulate, and
solve engineering problems
Project goals and
problems are poorly
identified and never
get followed
though. The
solution was chosen
or recommended by
the advisor
k) an ability to use the techniques, skills,
and modern engineering tools necessary
for engineering practice.
Have no idea how
to choose and use
the techniques,
skills, and modern
engineering tools;
just do what they
were told by their
advisor
None or very few
identified system
specifications are
met
c) an ability to design a system, component,
or process to meet desired needs within
realistic constraints such as economic,
environmental, social, political, ethical,
health and safety, manufacturability, and
sustainability
d) an ability to function on multidisciplinary teams
Project goals and
problems are
identified. The
reasonable
solution was
chosen.
Project goals and
problems are clearly
identified. The
chosen solution was
well thought of.
(sometimes) Able
to choose but
appropriately use
the techniques,
skills, and modern
engineering tools
for their project.
Properly choose and
correctly use all the
techniques, skills, and
modern engineering
tools for their project.
The project is
implemented to
satisfy only a few
of the identified
system
specifications
The project is
implemented to
satisfy parts of the
identified system
specifications
The project is
implemented to
satisfy the identified
system specifications
Score comes from an outcome C rubric
Score comes from an outcome d rubric
Page 17
c) an ability to design a system, component,
or process to meet technical desired
needs
Project goals and
problems are
somewhat
identified. The
adequate solution
was chosen but the
better solution was
available and
should have been
considered.
Very limited
knowledge in how
to choose but can
use the techniques,
skills, and modern
engineering tools
for their project.
f) an understanding of professional and
ethical responsibility
Score comes from an outcome f rubric
(essays score)
g) an ability to communicate effectively
Score comes from the presentation and the
written report rubrics
h) the broad education necessary to
understand the impact of engineering
solutions in a global, economic,
environmental, and societal context
Score comes from an outcome h rubric (essay
score)
i) a recognition of the need for, and an
ability to engage in life-long learning
Score comes from an outcome i rubric (essay
score)
j) a knowledge of contemporary issues
Score comes from an outcome j rubric (essay
score)
OVERALL SCORE
Page 18
COMMENTS:
Download