Digital
English
Worksheet
CS410 Blue Team
April 25, 2015
Mentor - Greg Raver-Lampman
2
CS410 Blue Team - April 24, 2015
The Blue Team
3
Kyle
Vernier
John
Mitchell
Ashley
Grimm
Adriana
Vecchio
Keith
Collins
CS410 Blue Team - April 24, 2015
Richard
Evans
English as a Second Language (ESL)
4


International students who are not fluent in English
Need written exercises (worksheets) in addition to
class time
 Worksheets
are text with some of the original text
removed
 Students must fill in the blank with the appropriate
word
CS410 Blue Team - April 24, 2015
Teaching Difficulties
5

ESL teachers lack sufficient time to design
worksheets customized to each individual student’s
coursework



Creating worksheets is very time consuming
ESL teachers have many students
ESL students don’t gain familiarity with English in their
specific field of study
CS410 Blue Team - April 24, 2015
Customer Base
6

ESL teachers at a university level

Other stakeholders and potential customers:
Students
■ ESL teachers at other grade levels
■ Primary school English teachers
■ Teaching assistants
■ Tutors
■
CS410 Blue Team - April 24, 2015
Potential Customers
7
2013-14: 886,052
international students
enrolled in the US
 8.1%
increase from
previous year
 4.2% of total student
enrollment
CS410 Blue Team - April 24, 2015
Top Fields of Study for International
Students
8

Top fields of study use
technical language
CS410 Blue Team - April 24, 2015
Current Workflow for Creating Worksheets
9
CS410 Blue Team - April 24, 2015
Areas Needing Improvement
10
Instructors create worksheets in CESR, manually
selecting words to remove
 Worksheets are printed and handed out in class
 Students fill out worksheets by hand
 Instructor collects worksheets in class
 Instructor grades worksheets manually
 Instructor manually keeps track of student grades

CS410 Blue Team - April 24, 2015
Main Goals
11
Minimize teacher time spent creating worksheets
 Deliver worksheets to students electronically
 Submit worksheets for grading electronically
 Minimize teacher time spent grading
 Customize worksheets for students
 Save created worksheets for use in future semesters

CS410 Blue Team - April 24, 2015
Solution Characteristics
12
Automated worksheet creation
 Digital worksheets
 Automatic grading
 Electronic delivery to/from student/instructor

CS410 Blue Team - April 24, 2015
Top-Level Functions
13

DEW will:
 Create
digital worksheets from text
 Interface with CESR to identify parts of speech from text
 Remove parts of speech identified by instructor
 Grant students access to worksheets
 Grade worksheets
 Store student submissions for instructor access
CS410 Blue Team - April 24, 2015
Workflow Using DEW
14
CS410 Blue Team - April 24, 2015
How Does DEW Work?
15
User inserts text
 User selects one part of speech (e.g. noun, verb,
adverb) to remove from the text
 DEW uses the CESR API to identify the parts of
speech in the text
 DEW stores the original text as the “master” sheet
 DEW removes the text matching the part of speech
chosen by the instructor
 DEW produces a digital worksheet with blanks
where the text has been removed

CS410 Blue Team - April 24, 2015
Hardware/Software Components
16
CS410 Blue Team - April 24, 2015
Hardware Required
17


Most of our requirements are software
Required hardware:
Web Server
CS410 Blue Team - April 24, 2015
Software Required
18
Graphical User
Interface (GUI)
Worksheet API
(DEW)
CS410 Blue Team - April 24, 2015
CESR Interface
Database
Authentication
and Security
Interfaces
19
CS410 Blue Team - April 24, 2015
Additional Components
20
CS410 Blue Team - April 24, 2015
Requirements
21
Graphical User
Interface (GUI)
CS410 Blue Team - April 24, 2015
Database
Web Server
Software Design Requirements
22

Custom APIs to automate:






Identifying parts of speech with CESR
Creating worksheets by removing parts of speech
Automated grading
Delivery to students
Delivery to instructor
Recording of students’ grades
CS410 Blue Team - April 24, 2015
Reduce, Reuse, Recycle
23

DEW stores instructor-created digital worksheets
 Instructors
can add subject tag
 Instructors can reuse worksheets in future semesters
 Instructors can see all worksheets for one particular
subject

Students can submit new worksheets for instructor
review and use
CS410 Blue Team - April 24, 2015
Before and After DEW
24
Upon successful completion of this
course, the student will have
participated in the development of a
set of documents that define a
proposed research solution to a
defined problem supported by formal
presentations.
CS410 Blue Team - April 24, 2015
Accessing Digital Worksheets
25
Created worksheets are stored in DEW to the
creator’s account
 Instructors can grant access to individual students or
a class of students to created worksheets
 Students are notified when they login that they have
a new assigned worksheet
 Students can access the worksheets in their browser
through DEW

CS410 Blue Team - April 24, 2015
Completed Digital Worksheets
26
Allow x attempts (Set by instructor, from 1 to infinite)
 Store data from each submission:

 Original
worksheet
 Student’s name
 Student’s number of attempts (e.g. “Attempt 1/3”)
 Student’s answers
 Date and time submitted
 Number of correct answers
 Number of total blank fields
 Percentage of correct responses
CS410 Blue Team - April 24, 2015
Completed Digital Worksheets
27
Students complete
worksheets in their
browser and submit
when they are finished
 Instructor is notified
when students have
submitted worksheets
 Instructors have access
to all stored data fields

CS410 Blue Team - April 24, 2015
Grading
28
DEW grades digital worksheets based on
percentage of correct responses
 Students can see their calculated grade once a
digital worksheet has been submitted if enabled by
the instructor
 Students may view the correct responses for a
worksheet upon submission if enabled by the
instructor

CS410 Blue Team - April 24, 2015
Instructor Grade Views
29
CS410 Blue Team - April 24, 2015
FERPA Compliance
30

Require authenticated users
 Can

designate “instructor” or “student”
Family Educational Rights and Privacy Act
 Only
authorized users can see student’s activity
 Allows instructors to track student’s progress securely
 Students can access information to which they have a
right
CS410 Blue Team - April 24, 2015
Additional Benefits
31

Save instructor time and reduce costs
 Faster
creation of educational materials
 No printing or copying required
CS410 Blue Team - April 24, 2015
Exclusions
32

The Blue Team solution will NOT:


Be publicly available
Show the student the correct answers until the instructor
criteria are met




e.g. Due date passes
e.g. All submissions received
e.g. Instructor releases digital worksheet
Generate digital worksheets without uploaded text or
previously saved text
CS410 Blue Team - April 24, 2015
Added Benefits
33
Individualized digital worksheets reinforce English in
a particular subject of study
 Reducing time spent creating worksheets allows for
more actual teaching time
 Allows for more worksheets and thus more practice

CS410 Blue Team - April 24, 2015
Software Development Process
34


Agile Development Model
Create database of users
1.
2.
3.
4.
Names
Email addresses
Class assignments
Permissions
CS410 Blue Team - April 24, 2015
Designing User Accounts
35
Administrator creates new account
2. Notify user of new account
3. Authenticate login credentials
4. Update account settings
5. Assign classes
6. Assign class role (administrator,
teacher, user)
7. Assign permissions based on class
role
1.
CS410 Blue Team - April 24, 2015
Designing DEW
36
1.
2.
3.
4.
5.
6.
7.
Create new worksheet
Accept text input
Interface text with CESR API
Accept text parsed by CESR
Accept user choice for part of speech to remove
Remove chosen part of speech from text
Store digital worksheet with blanks and word
bank
CS410 Blue Team - April 24, 2015
Work Breakdown Structure
37
CS410 Blue Team - April 24, 2015
User Interfaces
38

Everyone

 Login
 Create
Worksheet
 Review Worksheet
 Worksheet Settings
 Complete Worksheet
 Log
CS410 Blue Team - April 24, 2015
Teacher & Admin only
 Worksheet

Admin only
 Delete

availability
worksheet
Student only
 Assignment UI
Algorithms – Database Writes
39
CS410 Blue Team - April 24, 2015
Algorithms - Views
40
CS410 Blue Team - April 24, 2015
DEW Login
41
CS410 Blue Team - April 24, 2015
Algorithms – Authenticate Login
42

Authenticate login credentials - Authenticates users
login credentials against the user database
 loginAuth()
 Args:
username, password
 Return: boolean
CS410 Blue Team - April 24, 2015
Algorithms – Authenticate Login
43
CS410 Blue Team - April 24, 2015
Algorithms – Update user notifications
44

Update user notifications - On login, check the
database for new notifications for that user
 updateNotifications()
 Args: userID
 Return: void
CS410 Blue Team - April 24, 2015
Create Worksheet
45
CS410 Blue Team - April 24, 2015
Algorithms – Store New Worksheet
46

Store new worksheet - Write new worksheet data
to the worksheet database
 newWorksheet()
 Args:
worksheetData
 Return: void
CS410 Blue Team - April 24, 2015
Algorithms – Store New Worksheet
47
CS410 Blue Team - April 24, 2015
Algorithms – Store Original Text
48

Store original text - Write the original text for a
worksheet to the database
 storeText()
 Args:
customText
 Return: void
CS410 Blue Team - April 24, 2015
Algorithms – Store Original Text
49
CS410 Blue Team - April 24, 2015
Review Worksheet
50
CS410 Blue Team - April 24, 2015
Algorithms – Remove Part of Speech
51

Remove POS from text - Remove the specified POS
from the original text. Write POS (word bank) for
the worksheet to the database
 removePOS()
 Args:
originalText
 Return: void
CS410 Blue Team - April 24, 2015
Algorithms – Remove Part of Speech
52
CS410 Blue Team - April 24, 2015
Algorithms – Store Modified Text
53

Store modified text - Write the original text with
the specified POS removed to the database
 storeModifiedText()
 Args:
modifiedText
 Return: void
CS410 Blue Team - April 24, 2015
Algorithms – Store Modified Text
54
CS410 Blue Team - April 24, 2015
Teacher & Administrator Settings
55
CS410 Blue Team - April 24, 2015
Student Settings
56
CS410 Blue Team - April 24, 2015
Algorithms – Update Worksheet Settings
57

Update worksheet settings - Overwrite existing
worksheet settings in the database with new userdefined data
 updateWSSettings()
 Args:
worksheetData
 Return: void
CS410 Blue Team - April 24, 2015
Algorithms – Update Worksheet Settings
58
CS410 Blue Team - April 24, 2015
Teacher & Administrator
Worksheet Availability
59
CS410 Blue Team - April 24, 2015
Algorithms – Make Worksheet Available
60

Make worksheet available - Update status of
worksheet. Update specified recipient user
notifications.
 makeAvailable()
 Args:
worksheetData
 Return: void
CS410 Blue Team - April 24, 2015
Algorithms – Collect Worksheet
61

Collect worksheet - Update status of worksheet.
 collectWorksheet()
 Args:
worksheetData
 Return: void
CS410 Blue Team - April 24, 2015
Administrator Logbook
62
CS410 Blue Team - April 24, 2015
Algorithms – Store New Account
63

Store new account - Write new account data to
the database
 newAccount()
 Args: accountData
 Return: void
CS410 Blue Team - April 24, 2015
Algorithms – Store New Account
64
CS410 Blue Team - April 24, 2015
Algorithms – Update Account Settings
65

Update account settings - Overwrite existing
account data in the database with new data
 updateAccSettings()
 Args:
accountData
 Return: void
CS410 Blue Team - April 24, 2015
Algorithms – Update Account Settings
66
CS410 Blue Team - April 24, 2015
Teacher Logbook
67
CS410 Blue Team - April 24, 2015
Algorithms – View Stats
68

View stats - Fetch statistical data from the
database regarding a student’s progress (e.g. %
nouns correctly identified across all worksheets)
 viewStats()
 Args: userID
 Return: userData
CS410 Blue Team - April 24, 2015
Student Logbook
69
CS410 Blue Team - April 24, 2015
Algorithms – View Attempts
70

View Attempts - Fetch data regarding individual
attempts for a worksheet and display it to the
user’s monitor
 viewAttempts()
 Args: worksheetID
 Return: worksheetData
CS410 Blue Team - April 24, 2015
Digital Worksheet
71
CS410 Blue Team - April 24, 2015
Algorithms – View Results
72

View results - Fetch data for a completed and
graded worksheet from the database and display
it to the user’s monitor
 viewResults()
 Args:
worksheetID
 Return: worksheetData
CS410 Blue Team - April 24, 2015
Algorithms – Grade Worksheet
73

Grade worksheet: - Compare text with student
responses with with original text and calculate
percentage of correct responses. Write the grade
for the worksheet to the database
 gradeWorksheet()
 Args:
originalText, newText
 Return: void
CS410 Blue Team - April 24, 2015
Algorithms – Save Worksheet
74

Save worksheet - Overwrite status of worksheet.
Write current responses for worksheet to the
database
 saveWorksheet()
 Args:
worksheetData
 Return: void
CS410 Blue Team - April 24, 2015
Student Assignment
75
CS410 Blue Team - April 24, 2015
Algorithms – Submit Assignment
76

Submit Assignment - Update status of worksheet in
the database
 submitAssignment()
 Args:
worksheetData
 Return: void
CS410 Blue Team - April 24, 2015
COTS/Legacy System
77
CS410 Blue Team - April 24, 2015
Site Map
78
CS410 Blue Team - April 24, 2015
Database Map
79
CS410 Blue Team - April 24, 2015
Customer Risks
80

C1: Customers do not use solution

Mitigation




C2: Difficulty of use

Mitigation



Release demo software to faculty
Develop with mentor input
Use agile development
Develop with mentor input
Enlist beta testers
C3: Users do not like solution

Mitigation


Instructor and student test groups
Use agile development
CS410 Blue Team - April 24, 2015
Technical Risks
81

T1: Security vulnerabilities

Mitigation



T2: Difficulty integrating with
CESR

Mitigation


Implement security checks on
text entries
Limit text field access by user
type
Work with mentor and
previous teams
T3: Incorrect CESR output

Mitigation

Allow teachers to manually
correct digital worksheets
CS410 Blue Team - April 24, 2015
References, 1 of 2
82
■
Cingletree Learning. (1999-2015). Foreword. Retrieved February 8, 2015, from English
Grammer 101 Online:
http://lessons.englishgrammar101.com/EnglishGrammar101/Foreword.aspx.
■
English Grammer. (n.d.). (Edufind, Producer) Retrieved February 8, 2015, from
edufind.com:http://www.edufind.com/english-grammar/english-grammar-guide.
■
Institute of International Education. (2015). Fast Facts. Retrieved February 2015, from Institue
of International Education: http://www.iie.org/Research-and-Publications/OpenDoors/Data/Fast-Facts
■
Language Dynamics. (n.d.). Online English Grammar Book. Retrieved February 8, 2015, from
Englishpage.com:http://www.englishpage.com/grammar/.
■
Ling, G., Wolf, M. K., Cho, Y., & Wang, Y. (2014). English-as-a-Second-Language Programs
for Matriculated Students in the United States: An Exploratory Survey and Some Issues. ETS
Research Reports Series, 2014(2), 1-19.
■
Maftoon, P., Birjandi, P., & Pahlavani, P. (2014). The Impact of Using Computer-aided
Argument Mapping (CAAM) on the Improvement of Writing Achievement of Iranian Learners
of English. Theory & Practice In Language Studies, 4(5), 982-988.
CS410 Blue Team - April 24, 2015
References, 2 of 2
83
■
■
■
■
■
■
Old Dominion University. (n.d.). ELC Programs & Courses. Retrieved February 8,
2015, from ODU:https://www.odu.edu/cepd/esl/courses.
Pin-hsiang, N. W., & Kawamura, M. (2014). Mind and material: The interplay
between computer-related and second language factors in online communication
dialogues. JALT CALL Journal, 10(3), 159-174.
Instructor Greg Raver-Lampman. Mentor.
Saqlain, N., & Mahmood, Z. (2013). English Language Instructors'
Perceptions about Technology-Based Language Learning at Northern Border
University in Saudi Arabia. Turkish Online Journal Of Educational Technology TOJET, 12(2), 106-110.
Savas, P. (2014). Tablet PCs as Instructional Tools in English as a Foreign
Language Education. Turkish Online Journal Of Educational Technology - TOJET,
13(1), 217-222.
The Writing Center at UNC Chapel Hill. (2010-2014). Just Check My Grammar.
Retrieved February 8, 2015, from The Writing Center:
http://writingcenter.unc.edu/faculty-resources/tips-on-teaching-esl-students/justcheck-my-grammar/.
CS410 Blue Team - April 24, 2015
Questions?
84
For more reference material, please visit our
website:
http://www.cs.odu.edu/~410blue
CS410 Blue Team - April 24, 2015