IEEE VSSC/1622
General Meeting
February 4-5, 2015
Registrar-Recorder/County Clerk
County of Los Angeles
VSSC Winter Meeting 2/4-5/2015
VSSC/1622 Meeting Call to Order
•
•
•
•
2
Welcome and goals for the meeting
Agenda overview
VSSC/1622 status report
VSSC/1622 challenges for 2015
VSSC Winter Meeting 2/4-5/2015
Welcome to Our Attendees!
3
VSSC Winter Meeting 2/4-5/2015
Thank You
• A big thank you to Kenneth Bennett and
colleagues who have helped to bring this
event together
• Thank you to our host, Dean Logan
• Thank you to our speakers, Doug Chapin and
Matt Masterson
• And all others present and presenting
4
VSSC Winter Meeting 2/4-5/2015
Goals for this Meeting
• Keep things informal, not dwell on procedureIEEE-eze,
give everyone a chance to talk
• Work for the greater good of elections, not necessarily
what is good for IEEE VSSC
• Let not the pursuit of perfection by thy enemy that
keepeth me from green pastures of the pretty good
• Learn from our colleagues, especially those here for
the 1st time
– Put ourselves in the shoes of state and local election
officials and manufacturers
• Strive to understand better where the VSSC best fits
into the election landscape
5
VSSC Winter Meeting 2/4-5/2015
Agenda – Wednesday, February 4
6
8:05 am
VSSC/1622 MEETING CALL TO ORDER

Agenda and goals for the meeting

VSSC/1622 overview and status
John Wack
8:30 am
Opening Remarks – Day 1
Kenneth Bennett

Introduction
Dean Logan

Welcome to LA County

Remarks by Doug Chapin, Humphrey School of Public Affairs, followed by
discussion as time permits
9:30 am
Opening Business

IEEE call for patents

Roll call

Approval of 2014 VSSC/1622 meeting minutes
10 am
BREAK
10:15 am
1622.2 Election Results Reporting Draft Standard Update

Brief refresher on IEEE standards development process

1622.2 overview

1622.2 balloting results

Summary of comments received

Next steps
12 pm
LUNCH
1:15 pm
Roll Call
1:20 pm
Electronic Pollbooks Standard PAR Discussion

Formation of Standards Study Group

PAR discussion on scope of standard

Vote to approve PAR
2:30 pm
BREAK
2:45 pm
Remarks by Matt Masterson, EAC Commissioner, followed by discussion and/or
commencement of the next session as time permits
4 pm
ADJOURN – Day 1
4:10 pm
Tour of LA County Election Operations
6 pm
DINNER SOCIAL (For Those Interested)
Restaurant location andVSSC
details toWinter
be announced
Meeting
John Wack
Sarah Whitt
John Wack
Jay Bagga
John Dziurlaj
Kenneth Bennett
Kenneth Bennett
2/4-5/2015
Agenda – Thursday, February 5
8:05 am VSSC/1622 MEETING CALL TO ORDER

Roll call

Agenda overview

VSSC officer election results
John Wack
Arthur Keller
Lisa Garcia
8:15 am
Kenneth
Bennett
1622.4 Election Data Modeling Update
10 am
BREAK
10:15
am
1622-3 Event Logging Standard

Review of PAR, model, and schema

Next steps
11 am
Discussion on VSSC current and future strategies
12 pm
LUNCH
James Long
1:15 pm Roll Call
1:20 pm 1622-6 Voting Methods Mathematical Models Update
Lauren MassaLochridge
2:30 pm BREAK
2:45 pm Wrap-up
7
Kenneth
Bennett
John Wack
3 pm
ADJOURN – Day 2
6 pm
CLOSING DINNER SOCIAL (For Those Interested)
Restaurant location and details to be announced
VSSC Winter Meeting 2/4-5/2015
Kenneth
Bennett
VSSC/1622 Committee Overview
IEEE Computer
Society
1622.2
8
VSSC/1622
Other
committees
1622.4
1622.6
VSSC Winter Meeting 2/4-5/2015
e.g.,
LANMAN/802…
VSSC == 1622
• VSSC = Voting System Standards Committee
• 1622 = A number assigned to us by IEEE, stands for
VSSC
• P1622 was a working group under a now retired
sponsoring committee, resumed in 2010 under the
IEEE Standards Activities Board (SAB)
• IEEE SAB approved the VSSC sponsoring committee in
2014 to provide guidance and oversight to its votingrelated standards working groups
• We are under the IEEE Computer Society, thus our
fully qualified name is C/VSSC
• Our working groups are named 1622.X
9
VSSC Winter Meeting 2/4-5/2015
Guiding Principles
• Aim to improve the specification, implementation, testing,
and use of voting systems
• Show no bias towards/against any interest group or political
party
• Focus on the equipment and not on items beyond our
control such as election procedures
• Involve election officials and manufacturers and other
subject matter experts
• Base standards on existing formats as appropriate and
work towards harmonization
• Focus on first creating models and definitions
• Strive for greater interoperability among classes of devices
10
VSSC Winter Meeting 2/4-5/2015
VSSC Structure – Membership
• Officers
– John Wack, chair
– Linda Harley, vice-chair
– Secretary, TBD
• Executive Committee (ExCom)
– Officers
– Chairs of working groups
• Membership
– Grandfathered from those in P1622 who desired
membership
– Others who attended 2/3rds of initial meeting
– Current number of voting members: 25
11
VSSC Winter Meeting 2/4-5/2015
VSSC Working Groups and Chairs
VSSC
John Wack, Chair
1622-3
1622.1 – PAR Only
Voter Registration DB
Event Logging
John Wack
1622.2
1622.4
1622.5 - Inactive
1622.6
Election Results
Reporting
Election Data
Modeling
Election System Usability
& Accessibility
Voting Methods
Mathematical Models
Sarah Whitt
12
Kenneth Bennett
Linda Harley
VSSC Winter Meeting 2/4-5/2015
Lauren MassaLochridge
VSSC/1622 2014 Status Report
• A good initial year…
• 1622.2 – 1st round balloting and public review
– Outstanding interactions with EOs, vendors, others
•
•
•
•
•
1622.4 – active, developing models
1622.5 – did not meet
1622.6 – PAR approved, 1st meeting held 1/28/2014
P1622 – waiting for drafting of initial standard
External recognition of 1622, including:
–
–
–
–
13
IEEE Computer Magazine article
Charles Stewart, MIT, testimony to Congress
Electionline, Election Academy postings
Ohio uses 1622.2 format for 2014 general election
VSSC Winter Meeting 2/4-5/2015
VSSC/1622 Challenges for 2015
• 1622.2:
– Resolve comments, create updated version
– Create worked examples, e.g., using Delaware
– Work with other parties to promote, use the standard
•
•
•
•
•
•
14
Follow-on guide to promote standard IDs?
Complete standard for event logging
Draft standard for electronic pollbooks
Comprehensive data model and glossary for 1622.4?
Guideline from 1622.6?
Adapt to a changing standards environment, determine
where VSSC is relevant, and adapt
VSSC Winter Meeting 2/4-5/2015
Opening Remarks
• Introduction – Kenneth Bennett
• Welcome to LA County – Dean Logan
• Remarks by Doug Chapin
15
VSSC Winter Meeting 2/4-5/2015
Welcome to LA County
Dean Logan
Registrar-Recorder/County Clerk, LA County
16
VSSC Winter Meeting 2/4-5/2015
Discussion
17
VSSC Winter Meeting 2/4-5/2015
Remarks by Doug Chapin
Doug Chapin
Humphrey School of Public Affairs
18
VSSC Winter Meeting 2/4-5/2015
Discussion
19
VSSC Winter Meeting 2/4-5/2015
Opening Business
• IEEE call for Patents
• Roll call
• Approval of 2014 VSSC/1622 meeting minutes
20
VSSC Winter Meeting 2/4-5/2015
Participants, Patents, and Duty to Inform
All participants in this meeting have certain obligations under the IEEE-SA Patent Policy.

Participants [Note: Quoted text excerpted from IEEE-SA Standards Board Bylaws
subclause 6.2]:
 “Shall inform the IEEE (or cause the IEEE to be informed)” of the identity of each
“holder of any potential Essential Patent Claims of which they are personally
aware” if the claims are owned or controlled by the participant or the entity the
participant is from, employed by, or otherwise represents

“Personal awareness” means that the participant “is personally aware that the holder
may have a potential Essential Patent Claim,” even if the participant is not personally
aware of the specific patents or patent claims
“Should inform the IEEE (or cause the IEEE to be informed)” of the identity of
“any other holders of such potential Essential Patent Claims” (that is, third
parties that are not affiliated with the participant, with the participant’s
employer, or with anyone else that the participant is from or otherwise
represents)
The above does not apply if the patent claim is already the subject of an Accepted
Letter of Assurance that applies to the proposed standard(s) under consideration by
this group
Early identification of holders of potential Essential Patent Claims is strongly
encouraged
No duty to perform a patent search




IEEE Mandatory Slide #1
25 March 2008 (updated January 2012)
Patent Related Links
All participants should be familiar with their obligations
under the IEEE-SA Policies & Procedures for standards
development.
Patent Policy is stated in these sources:
IEEE-SA Standards Boards Bylaws
http://standards.ieee.org/develop/policies/bylaws/sect6-7.html#6
IEEE-SA Standards Board Operations Manual
http://standards.ieee.org/develop/policies/opman/sect6.html#6.3
Material about the patent policy is available at
http://standards.ieee.org/about/sasb/patcom/materials.html
If you have questions, contact the IEEE-SA Standards Board Patent Committee
Administrator at patcom@ieee.org or visit
http://standards.ieee.org/about/sasb/patcom/index.html
This slide set is available at
https://development.standards.ieee.org/myproject/Public/mytools/mob/slideset.ppt
IEEE Mandatory Slide #2
25 March 2008 (updated January 2012)
Call for Potentially Essential Patents

If anyone in this meeting is personally aware
of the holder of any patent claims that are
potentially essential to implementation of the
proposed standard(s) under consideration by
this group and that are not already the
subject of an Accepted Letter of Assurance:



Either speak up now or
Provide the chair of this group with the identity of the
holder(s) of any and all such claims as soon as possible or
Cause an LOA to be submitted
IEEE Mandatory Slide #3
25 March 2008 (updated January 2012)
Other Guidelines for IEEE WG Meetings

All IEEE-SA standards meetings shall be conducted in compliance with
all applicable laws, including antitrust and competition laws.


Don’t discuss the interpretation, validity, or essentiality of patents/patent
claims.
Don’t discuss specific license rates, terms, or conditions.

Relative costs, including licensing costs of essential patent claims, of different technical
approaches may be discussed in standards development meetings.


Technical considerations remain primary focus
Don’t discuss or engage in the fixing of product prices, allocation of
customers, or division of sales markets.

Don’t discuss the status or substance of ongoing or threatened litigation.

Don’t be silent if inappropriate topics are discussed … do formally object.
---------------------------------------------------------------
See IEEE-SA Standards Board Operations Manual, clause 5.3.10 and “Promoting Competition and Innovation:
What You Need to Know about the IEEE Standards Association's Antitrust and Competition Policy” for
more details.
IEEE Mandatory Slide #4
25 March 2008 (updated January 2012)
VSSC/1622 2014 Minutes Approval
• Motion and second needed to approve
minutes from February 2014 meeting
• Minutes were posted at
http://grouper.ieee.org/groups/1622/meeting-2014-02-GTRI.html
25
VSSC Winter Meeting 2/4-5/2015
Morning Break
Meeting resumes at 10:15 am PST - 1:15 pm EST
26
VSSC Winter Meeting 2/4-5/2015
Election Results Reporting
VSSC
P1622
1622.2 1622.4 1622.6
27
VSSC Winter Meeting 2/4-5/2015
1622.2 Election Results Reporting
• Sarah Whitt, Wisconsin, Chair
• John Wack, NIST, editor
• First, some brief summaries:
– IEEE standards development process
– 1622.2 draft standard
• 1622.2 balloting results and status
• Comments received
• Next steps
28
VSSC Winter Meeting 2/4-5/2015
IEEE Standards Development Process
IEEE standards are classified as:
• Standards: documents with mandatory requirements.1
• Recommended practices: documents in which procedures
and positions preferred by the IEEE are presented.
• Guides: documents in which alternative approaches to
good practice are suggested but no clear-cut
recommendations are made.
• Trial-Use documents: publications in effect for not more
than two years. They can be any of the categories of
standards publications listed above.
1
Mandatory requirements are generally characterized by use of the verb
"shall," whereas recommended practices normally use the word
"should"
• All require a PAR
29
VSSC Winter Meeting 2/4-5/2015
Steps within VSSC
• Idea for a standards activity is presented to the VSSC
Chair
• VSSC Chair appoints a Standards Study Group (SSG)
to draft the PAR
• SSG approves draft PAR, submits PAR to VSSC
• VSSC approves draft PAR, submits it for consideration
approval to IEEE
30
VSSC Winter Meeting 2/4-5/2015
Steps after IEEE Approval
• VSSC Chair appoints WG Chair
• WG has first organizational meeting, elects
other officers, those in attendance become
members of WG
• WG Chair appoints standard editor
• The WG and editor draft the standard
31
VSSC Winter Meeting 2/4-5/2015
Steps after WG Drafts Standard
• WG votes to release draft standard for public review3
• WG with VSSC approval submits draft standard for
Sponsor Ballot (IEEE’s review process)
• IEEE Ballot Pool (IEEE members who agreed review) votes
to approve or request changes to draft standard
– WG needs to respond to every comment
– WG does not need to make all changes requested
– The WG needs to provide a technical rationale for rejecting a
comment
• WG may revise draft standard and repeat above process
(this is where the 1622.2 draft is currently)
3
VSSC has special permission from IEEE SA to release drafts and publish standards to the public
at no charge
32
VSSC Winter Meeting 2/4-5/2015
Steps after Passing Sponsor Ballot
• Draft standard undergoes reviews:
– Draft is submitted for IEEE review
– WG Chair responds to any comments.
– IEEE approves draft standard and publishes it
• WG disbands or becomes inactive, unless it has
another PAR to work on
• WG becomes active if need to revise standard
33
VSSC Winter Meeting 2/4-5/2015
1622.2 ERR Standard
34
VSSC Winter Meeting 2/4-5/2015
1622.2 ERR Standard
• Started effort in 2012 to provide ENR only;
grew in scope to include
– More detailed results
– Pre-election information
– District – precinct mapping
– Same schema used for 3 use cases
• Pre-election data
• Aggregated election night results
• Highly detailed certified/archive results
35
VSSC Winter Meeting 2/4-5/2015
Basic Requirements – Pre-election
• For reporting jurisdiction, show mapping of
– Precincts/Splits/Combined to jurisdiction
– Districts to precinct types
– Equipment assigned to precincts and usage
– Contests to districts
– Candidates to contests
36
VSSC Winter Meeting 2/4-5/2015
Basic Requirements - ENR
• Aggregated contest results, no additional
detail if not desired
• Addition of further details as desired, e.g.,
– Overvotes/Undervotes
– Counts tagged by equipment type and usage
– Ballot counts per precinct and per contest
37
VSSC Winter Meeting 2/4-5/2015
Basic Requirements – Archive
• Reporting to all precinct and specific device
levels
• Counts tagged by
– Equipment type
– Equipment usage
– Manner of voting, e.g, Absentee, In-person
• Ballot counts, also similarly tagged
38
VSSC Winter Meeting 2/4-5/2015
Schema Generation
• 1622.2 is based on an UML data model that
contains all elements and attributes
• Conveys information of the XML schema, but
in a format-independent way
• Schema is generated directly from the model
with very few modifications
• Tooling is MagicDraw UML
39
VSSC Winter Meeting 2/4-5/2015
ERR Data Model
40
VSSC Winter Meeting 2/4-5/2015
Some issues
• There is a continuum between ENR and
archive that will hopefully accommodate
future, more detailed ENR scenarios
• The flexibility needed to accommodate many
reporting scenarios means that the schema
could also be misused
– This is probably okay
– Nonsensical usage will become evident quickly
41
VSSC Winter Meeting 2/4-5/2015
1622.2 Draft Review
• The 1622.2 draft was reviewed by IEEE members
and the general public
• The IEEE review period went from 12/2/2014 to
1/1/2015
– Vote was 17 in favor, 2 opposed, 1 abstain
• Met 75% response rate requirement
• Met 75% approval rate requirement
– 58 comments, including 4 must-be-satisfied
• Extended Comment Period through 1/15/2015
– 6 sets of comments
42
VSSC Winter Meeting 2/4-5/2015
Comments Breakdown
• Total comments: 171
– General: 41
– Technical: 64
– Editorial: 66
• Most comments are do-able, many of the
technical comments are more editorial in nature
• More complete examples of usage would
probably have reduced the number of comments
43
VSSC Winter Meeting 2/4-5/2015
Some Technical Comments
• Making enumerations modifiable, allowing some
local usage fields
• Making IDs repeatable, with a type enumeration,
e.g., FIPs, OCD-ID, etc.
• Making addresses and names less structured,
more flexible
• Handling multiple languages for items such as
ballot text
• Accommodate international usage if relatively
easy
44
VSSC Winter Meeting 2/4-5/2015
Next Steps
• Respond to all comments
– Meetings with reviewers in some cases
– Will propose resolutions at a future 1622.2 WG meeting
• Resubmit for IEEE Sponsor Ballot and public review
– 10 day voting period for IEEE members, could be extended for public
review
– Comments allowed only based on changes
• RevCom (IEEE SA standards Review Committee)
– Submittal deadline 4/25/2015 for 6/5/2015 meeting
– RevCom sometimes requires edits in review process
• Production and publication
– IEEE 1622.2™-2015 Standard for Election Results Reporting Data
Interchange Format published summer 2015 (assuming approved by
RevCom on 6/5/2015)
45
VSSC Winter Meeting 2/4-5/2015
Creating a Worked Example
• More worked examples are needed to
promote adoption of the standard
• Perhaps model a large area with multiple
types of districts, include precinct-level
results, report on contest counts ballots
broken down by various types of ballots and
machine type
• Suggestion was made to create worked
example using entire state of Delaware
46
VSSC Winter Meeting 2/4-5/2015
Lunch
Meeting resumes at 1:15 pm PST - 4:15 pm EST
47
VSSC Winter Meeting 2/4-5/2015
E-Pollbooks
VSSC
P1622
1622.2
48
1622.4
1622.6
VSSC Winter Meeting 2/4-5/2015
1622.X
E-Pollbooks
A Standard for E-PollBooks
Electronic Interchange Format
• Jay Bagga, Indiana VSTOP
• John Dziurlaj, Ohio SoS
49
VSSC Winter Meeting 2/4-5/2015
Some IEEE Procedure, First
According to our Policies and Procedures:
1. Chair needs to convene a Standards Study Group
(it will consist of those present)
2. SSG studies, makes recommendation on a PAR
back to VSSC (we will do this during this session)
3. VSSC votes on SSG recommendation (since the
SSG == VSSC, this is a formality)
4. If approved, PAR is sent to IEEE for approval
50
VSSC Winter Meeting 2/4-5/2015
A Pollbook for the 21st century
– The Promise
•
•
•
•
Easier and Faster
More Accurate
Integrates well with VRDBs
Handles data updates well
– Vote Centers
51
VSSC Winter Meeting 2/4-5/2015
E-Pollbooks are becoming more
popular
• Used in jurisdictions in thirty states
• Various requirements
– No federal certification
– 5 states require certification: Connecticut, Indiana,
Ohio, Pennsylvania, Virginia
– Ten states have statutes that explicitly authorize
the use of e-poll books: Arizona, Arkansas, Florida,
Iowa, Minnesota, Missouri, North Carolina, South
Dakota, Tennessee, Texas
52
VSSC Winter Meeting 2/4-5/2015
Some Resources
• National Conference of State Legislatures
(NCSL)
• State of Indiana
• State of Wisconsin
53
VSSC Winter Meeting 2/4-5/2015
Data Standard
• More than just a replacement for pen and
paper
• Interfaces with many different systems
– VRDBs
– EMSs
54
VSSC Winter Meeting 2/4-5/2015
High Level Modeling
•
•
•
•
55
Identify the external entities (scope)
Identify supported processes (use-cases)
Identify data flows
Elaborate subprocesses as required (topdown)
VSSC Winter Meeting 2/4-5/2015
High Level Modeling (Example)
56
VSSC Winter Meeting 2/4-5/2015
Data Modeling (Example)
57
VSSC Winter Meeting 2/4-5/2015
End Product
• A data model (UML)
• Data Interchange Format
– XML
– JSON
– Others?
58
VSSC Winter Meeting 2/4-5/2015
PAR - Scope
Scope:
This standard defines a UML data model and a corresponding data
interchange format, e.g., XML, for information created and processed by
electronic pollbooks. The model associates individuals with corresponding
polling place(s) and ballot style(s). It includes information, such as voters’
names and addresses, political party affiliation, eligibility, and other status
and audit information, that can be analyzed so as to show aspects of how an
election was conducted. It includes structures necessary to record that a
voter has participated in an election and information necessary for issuance
of a ballot to a voter. The model also includes structures to facilitate data
exchanges between electronic pollbooks and voter registration databases,
and data between interconnected electronic pollbooks.
The scope does not include operational or security requirements for
electronic pollbooks, other than digital signatures .
59
VSSC Winter Meeting 2/4-5/2015
PAR - Purpose
Purpose:
This standard defines the data elements and attributes outlined in the scope and
how the data is associated with other election data. It facilitates the import and
export, in a common format, of the data outlined in the scope to support
interoperability of an electronic pollbook with voting devices use in polling places
and with voter registration databases.
Need for the Project:
Electronic pollbooks are used increasingly to support functions at polling places,
including to facilitate check-in of voters, determine their appropriate ballot style,
and record their participation in elections. Electronic pollbook interoperability
with other voting devices and voter registration databases is required or desired
by U.S. states. Interoperability is dependent on a common understanding of the
data elements and attributes processed by electronic pollbooks and a common
interchange format for the data elements.
60
VSSC Winter Meeting 2/4-5/2015
PAR – Stakeholders
Stakeholders for this Standard:
• Voters,
• election equipment and software developers,
• federally certified voting equipment testing labs,
• state and local election officials,
• election poll workers,
• election observers and analysts,
• the U.S. Election Assistance Commission,
• and the general public.
61
VSSC Winter Meeting 2/4-5/2015
Discussion
• Discussion period on the PAR
• The assembled SSG may then vote on the PAR
• If approved, VSSC by fiat also approves the
PAR
62
VSSC Winter Meeting 2/4-5/2015
Afternoon Break
Meeting resumes at 2:45 pm PST - 5:45 pm EST
63
VSSC Winter Meeting 2/4-5/2015
Remarks by Matt Masterson
Matt Masterson
Commissioner, Election Assistance Commission
64
VSSC Winter Meeting 2/4-5/2015
Discussion
65
VSSC Winter Meeting 2/4-5/2015
Wednesday Feb 4 Wrap-Up
• These slides will be created during the
meeting
66
VSSC Winter Meeting 2/4-5/2015
Adjourn
• Resume tomorrow 8:00 am PST - 11:00 am EST
• Tour of LA County Election Operations begins
at 4:10 pm PST
• Dinner for those interested – meet in
Doubletree Hotel Lobby at 6 pm
67
VSSC Winter Meeting 2/4-5/2015
VSSC/1622 Meeting Call to Order
• Roll call
• Agenda overview
• VSSC officer election results
68
VSSC Winter Meeting 2/4-5/2015
Agenda – Thursday, February 5
8:05 am VSSC/1622 MEETING CALL TO ORDER

Roll call

Agenda overview

VSSC officer election results
John Wack
Arthur Keller
Lisa Garcia
8:15 am
Kenneth
Bennett
1622.4 Election Data Modeling Update
10 am
BREAK
10:15
am
1622-3 Event Logging Standard

Review of PAR, model, and schema

Next steps
11 am
Discussion on VSSC current and future strategies
12 pm
LUNCH
James Long
1:15 pm Roll Call
1:20 pm 1622-6 Voting Methods Mathematical Models Update
Lauren MassaLochridge
2:30 pm BREAK
2:45 pm Wrap-up
69
Kenneth
Bennett
John Wack
3 pm
ADJOURN – Day 2
6 pm
CLOSING DINNER SOCIAL (For Those Interested)
Restaurant location and details to be announced
VSSC Winter Meeting 2/4-5/2015
Kenneth
Bennett
VSSC Officer Elections
• Positions open:
– Chair (currently John Wack)
– Vice-chair (currently Linda Harley)
– Secretary (currently vacant)
– Treasurer (not necessary)
– Standards Coordinator (currently Arthur Keller)
70
VSSC Winter Meeting 2/4-5/2015
Election Data Modeling
VSSC
P1622
1622.2 1622.4 1622.6
71
VSSC Winter Meeting 2/4-5/2015
Election Data Modeling – 1622.4
• Kenneth Bennett, Chair, LA County
72
VSSC Winter Meeting 2/4-5/2015
Why model elections?
73
VSSC Winter Meeting 2/4-5/2015
Goals of Working Group
• Comprehensive, high
level model of processes
and data
• Framework for more
detailed interoperability
standards
• Election glossary
• Educational tools
VSSC Winter Meeting 2/4-5/2015
74
What did we do?
• Established the
working environment
• Conducted literature
review
• Began modeling
election business
processes
75
VSSC Winter Meeting 2/4-5/2015
Working Environment
• Modeling methodology
– Business Modeling with UML (Eriksson & Penker)
– UML & Data Modeling (David Hay)
• Modeling tools
– MagicDraw
– Explore open source tools or formats?
• IEEE collaboration tools
– Central Desktop
– Join.me
76
VSSC Winter Meeting 2/4-5/2015
Literature Review
• Public search of
published materials
• Formal modeling was
scarce
• Models found were
focused on data objects
77
VSSC Winter Meeting 2/4-5/2015
Modeling Gap
Business Process Narratives
Business Process Models
State, Activity & Data Flows Diagrams
Data Domain Model
78
VSSC Winter Meeting 2/4-5/2015
Process Models – Tier 1
79
VSSC Winter Meeting 2/4-5/2015
Process Models – Tier 2
80
VSSC Winter Meeting 2/4-5/2015
Process Models – Tier 3
81
VSSC Winter Meeting 2/4-5/2015
Process Interactions
82
VSSC Winter Meeting 2/4-5/2015
Process Details
<<Info>>
Contests
and
Candidates
<<Physical>>
Ballot Proofs
<<Info>>
Random
Alpha Draw
<<Info>>
Ballot
Definition
File
Lay Out Ballots
<<Rule>>
Rotation
83
<<System>>
Ballot Layout
VSSC Winter Meeting 2/4-5/2015
Process Interaction Details
<<Info>>
Ballot
Definition
File
Load Ballots in
Voting Devices
Lay Out Ballots
<<System>>
Device
Manager
<<Info>>
Ballot
Definition
File
<<System>>
Ballot Layout
Tally Ballots
<<System>>
Tabulation
84
VSSC Winter Meeting 2/4-5/2015
Next Steps
• Drill down into process
details
• Develop high-level data
model
• Develop elections
glossary
• Calibrate models to
existing works
• Final document (tell the
story)
VSSC Winter Meeting 2/4-5/2015
85
Morning Break
Meeting resumes at 10:05 am PST - 1:05 pm EST
86
VSSC Winter Meeting 2/4-5/2015
Event Logging
VSSC
P1622
1622.2 1622.4 1622.6
87
VSSC Winter Meeting 2/4-5/2015
1622-3 Event Logging Update
• Working group is P1622, which will be retired
post completion of this standard
• 1622-3 PAR and overview – John Wack
• Discussion
88
VSSC Winter Meeting 2/4-5/2015
Purpose
• Spurred by the EAC and NTS (formerly Wyle)
• Many devices log in proprietary formats, difficult
to understand, analyze logs
• Purpose is for devices to export election log files
in a standard format
• Based on requirements in draft VVSG 1.1
• Two schemas:
– Event Log file for containing events
– Documentation file for containing description of event
codes used in Event Log
• Manufacturer would make these files available publicly
89
VSSC Winter Meeting 2/4-5/2015
Current Status
• PAR, model, schemas voted out of P1622
• Assembled VSSC voted approval to
proceed with drafting of standard,
Winter, 2014
• Rough draft developed by NIST
90
VSSC Winter Meeting 2/4-5/2015
1622-3 PAR - Scope
This standard defines common data interchange formats for
event records for voting systems. Voting systems, including
election administration systems, election management
systems, vote capture devices, and tabulation devices,
record events, both human and machine, in the voting
process using the equipment. This standard specifies the
common data elements for event log export, and an
implementation of this standard using OASIS (Organization
for the Advancement of Structured Information Standards)
EML (Election Markup Language) data elements and
structures. This standard will also include the manner in
which codes in event logs for voting systems are described.
91
VSSC Winter Meeting 2/4-5/2015
1622-3 PAR - Purpose
This standard facilitates the import and export, in a
common format, of event data for voting systems. This
data is used by local and state election administrators,
citizens, and press to help verify the integrity of the
voting equipment, and the elections for which the
equipment is used. In addition, it facilitates postelection auditing of elections.
92
VSSC Winter Meeting 2/4-5/2015
Schema - EventLog
<xsd:element name="Event_Log" type="Event_Log"/>
<xsd:complexType name="Event">
<xsd:attribute name="timeStamp" type="xsd:dateTime" use="required"/>
<xsd:attribute name="eventType" type="xsd:string" use="required"/>
<xsd:attribute name="eventSeverity" type="xsd:string"/>
<xsd:attribute name="eventID" type="xsd:string" use="required"/>
<xsd:attribute name="eventDescription" type="xsd:string"/>
<xsd:attribute name="disposition" type="Disposition_Type"/>
<xsd:attribute name="userID" type="xsd:string"/>
<xsd:attribute name="details" type="xsd:string"/>
<xsd:attribute name="deviceID" type="xsd:string"/>
</xsd:complexType>
<xsd:complexType name="Event_Log">
<xsd:sequence>
<xsd:element name=« DigitalSignature" type="ds:SignatureType" minOccurs="0" maxOccurs="1"/>
<xsd:element name="Event" type="Event" minOccurs="1" maxOccurs="unbounded"/>
</xsd:sequence>
<xsd:attribute name="deviceID" type="xsd:string" use="required"/>
<xsd:attribute name="timeStamp" type="xsd:dateTime" use="required"/>
<xsd:attribute name="deviceClass" type="xsd:string"/>
<xsd:attribute name="deviceManufacturer" type="xsd:string"/>
<xsd:attribute name="deviceVersion" type="xsd:string" use="optional"/>
</xsd:complexType>
<xsd:simpleType name="Disposition_Type">
<xsd:restriction base="xsd:string">
<xsd:enumeration value="FAILURE"/>
<xsd:enumeration value="SUCCESS"/>
<xsd:enumeration value="NA"/>
</xsd:restriction>
</xsd:simpleType>
</xsd:schema>
93
VSSC Winter Meeting 2/4-5/2015
EventLog Elements & Attributes
• Attributes:
– deviceID - required, string
• The identifier of the device
– timestamp - required, dateTime
• The time indication
– deviceClass – optional, string
• Type of device
– deviceManufacturer – optional, string
• Maker of device
• Elements:
– DigitalSignature – optional
– Event – required, unbounded
94
VSSC Winter Meeting 2/4-5/2015
Event Attributes
•
timestamp – required, dateTime
–
•
eventType – optional, string
–
•
Vendor-specific
deviceID – optional, string
–
95
User identifier
Details – optional, string
–
•
Disposition of event
userID – optional, string
–
•
Event description
Disposition – optional, Disposition_Type
–
•
The identifier of event
eventDescription – optional, string
–
•
The severity of event
eventID – required, string
–
•
The type of event
eventSeverity – optional, string
–
•
The time indication
Device identifier
VSSC Winter Meeting 2/4-5/2015
Schema - Documentation
<xsd:element name="EventLog_Description" type="EventLog_Description"/>
<xsd:complexType name="EventLog_Description">
<xsd:sequence minOccurs="1" maxOccurs="unbounded">
<xsd:element name="Event" type="Event"/>
</xsd:sequence>
<xsd:attribute name="manufacturer" type="xsd:string" use="required"/>
<xsd:attribute name="deviceID" type="xsd:string" use="required"/>
<xsd:attribute name="deviceClass" type="xsd:string" use="required"/>
<xsd:attribute name="dateTime" type="xsd:dateTime" use="required"/>
</xsd:complexType>
<xsd:complexType name="Event">
<xsd:attribute name="eventID" type="xsd:string" use="required"/>
<xsd:attribute name="eventDescription" type="xsd:string" use="required"/>
</xsd:complexType>
96
VSSC Winter Meeting 2/4-5/2015
VSSC Current and Future Strategies
• What is the current strategy being followed
by the VSSC for producing standards and
guidelines?
• How has the election landscape changed
since 2014?
• Does the VSSC need to do things differently as
a result?
97
VSSC Winter Meeting 2/4-5/2015
Current Strategy
• Produce common data format standards at
endpoints of the voting system and where it
makes sense
– 1622.2 - Election results
– 1622-3 - Event logging
– 1622.X - Electronic pollbooks
• Produce election data models and guidelines in
other areas to aid future system development
– 1622.4 – Election data modeling
– 1622.6 – Voting methods mathematical models
98
VSSC Winter Meeting 2/4-5/2015
Current Strategy (cont)
• Aim our standards/guidelines for use by
– States and counties
– Federal certification efforts
• Manufacturers
• Test labs
• Work towards interoperability of devices
– For component certification
– To open market up to smaller manufacturers
99
VSSC Winter Meeting 2/4-5/2015
Changes in Election Landscape
• The EAC to resume development of federal
standards and certification
– Does the VSSC do anything differently as a result?
• Newer types of voting systems under
development
• Data on elections and election performance
increasingly important
100
VSSC Winter Meeting 2/4-5/2015
New Guidelines/Standards
•
•
•
•
101
Common ids
Registry of common ids
Electronic Cast vote records
Ballot definition files
VSSC Winter Meeting 2/4-5/2015
Lunch
Meeting resumes at 1:15 pm PST - 4:15 pm EST
102
VSSC Winter Meeting 2/4-5/2015
Voting Methods Mathematical Models
VSSC
P1622
1622.2 1622.4 1622.6
103
VSSC Winter Meeting 2/4-5/2015
Voting Methods Mathematical Models
Working Group
IEEE-SA VSSC
(C/VSSC/1622.6/VM-WG)
VM-WG Chair: Lauren Massa-Lochridge
VM-WG Committee Chair: Philip B. Stark
104
VSSC Winter Meeting 2/4-5/2015
Agenda
105

VM-WG Introduction

Project Definition, Scope, Need, Purpose

Road Map

Road Map Q & A

Conclude
VSSC Winter Meeting 2/4-5/2015
Introduction







106
VM-WG producing the IEEE-SA 1622.6 Standard
Project Authorization Request (PAR) for 1622.6 was approved
by IEEE-SA Standards Board (SASB) in fall 2014.
Completed required Kick-off meeting.
Producing 1622.6 IEEE-SA Standard: Recommended Practice
for Voting Methods Mathematical Models
Standard contains reasonable feasible coverage of voting
methods where counting, tabulation or mathematical
evaluation occurs.
Only official government-entity run elections administration
systems of U.S. & democracies.
NOT system implementation! Producing Mathematical Models.
VSSC Winter Meeting 2/4-5/2015
Introduction
IEEE-SA Standard “Recommended Practice” designation
(IEEE-
SA STANDARDS BOARD OPERATIONS MANUAL)

Standard elements as non-mandatory, voluntary guidelines.

No “shall clauses”, instead 'should', 'may', or 'can' clauses.
http://standards.ieee.org/develop/policies/opman/sect6.html#6.4.7





107
6.4.7 Shall, should, may, and can
The word shall indicates mandatory requirements strictly to be followed in order to conform
to the standard and from which no deviation is permitted (shall equals is required to).
The word should indicates that among several possibilities one is recommended as
particularly suitable, without mentioning or excluding others; or that a certain course of
action is preferred but not necessarily required (should equals is recommended that).
The word may is used to indicate a course of action permissible within the limits of the
standard (may equals is permitted to).
The word can is used for statements of possibility and capability, whether material, physical,
or causal (can equals is able to).
VSSC Winter Meeting 2/4-5/2015
Introduction
Well Formed Balanced Group
– Elections officials domain experts
– Global research community, covering subject areas:
• Voting methods and social choice theory, auditability,
verifiability, security, information privacy, reportability, inuse elections administration domain knowledge
– Equipment, software, systems manufacturers / services
domain experts
– Civic organizations, media, public affairs domain experts
– Experienced VSSC members and new VM-WG members
108
VSSC Winter Meeting 2/4-5/2015
Introduction
•At least 28 expected engaged members, Producers (24) &
Observers (4)
•6/28 elections officials domain experts
•10/28 Global research community, covering subject areas:
– Voting methods and social choice theory, auditability,
verifiability, security & information privacy, in-use domain
knowledge, as producers of the mathematical models
•8/28 equipment, software, systems manufacturers / services
domain experts
•4/28 orgs. and public affairs domain experts
• 16 attendees existing VSSC members, 14 voting, 3 observer
• 12 attendees are new to any VSSC or VSSC WG engagement
109
VSSC Winter Meeting 2/4-5/2015
Introduction

IEEE-SA

VSSC Sponsoring Committee

IEEE Computer Society/VSSC/1622-6/VM-WG

Sponsor, Chair, Vice Chair, Secretary (-Treasurer)

110
Subject Area Committees
 Verifiability
 Security & Information Privacy
 Auditability & Risk Management
 Reportability,
 Traceability & logging
 Are there other areas? Some areas may intersect...
VSSC Winter Meeting 2/4-5/2015
Introduction
VM-WG Subject Area Committees:
Philip B. Stark, Prof., Chair Dept. of Statistics UC Berkeley
is Chair of VM-WG Auditability & Risk Management Committee
Anticipate forming additional subject area or task force
committees:
Verifiability, Security & Information Privacy, Reportability,
Traceability & logging...Other Areas?


111
supporting deliberation at depth in certain subject areas,
regional, or certain tasks
efficient and effective
VSSC Winter Meeting 2/4-5/2015
Project
Approved Fall 2014 by IEEE-SA. Clauses of Project Authorization Request (PAR)
Scope clause:
This standard defines voting methods mathematical models that formally and
precisely define voting methods. Voting methods are methods of casting,
tabulating, mathematical evaluation, or counting votes, to determine the
outcome of elections. Examples of voting methods include but are not limited
to plurality voting, plurality with runoff, ranked choice, approval voting,
straight-party voting, and multi-party endorsement.
Elaboration:
Definitions of voting methods that are currently in-use usually reside in a 'plain language algorithm
definition' as legal art, i.e. legislation, which is inherently imprecise for some important uses.
Interpretative plain language definitions based upon existing legislative art also exist in Requests
For Proposals (RFPs) by elections officials to systems and software manufacturers, and other
elections administration documents where specifications of voting methods for counts and tally
may occur.
In contrast, a mathematical model with a unique designator is a precise definition which can be
referenced without ambiguity, used, reused, and understood across the field by a variety of
stakeholders including legislators, elections officials, analysts, systems and software
manufacturers, and for testing and certification.
112
VSSC Winter Meeting 2/4-5/2015
Project
Purpose Clause: The purpose of the Standard for Voting Methods Mathematical
Models is to facilitate elections integrity through a common and precise
definition of voting methods as mathematical models.
This standard defines voting methods selected for mathematical modeling that
government operated Departments of Elections, Elections Officials or jurisdictions of
U.S. Elections and democracies have currently in use or plan to use or may
reasonably be expected to implement a voting method in their elections
administration going forward during the life cycle of the standard (minimum 10 yrs.).
Need Clause: Because each voting method is unambiguously defined as a
mathematical model its specification, characterization and properties are
precisely known in support of accurate and reliable analysis of elections data.
Precisely known mathematical characterization of systems components
enables robust and correct voting systems and facilitates their development,
analysis, and testing.
113
VSSC Winter Meeting 2/4-5/2015
Project
No complete compendium of mathematical models of voting methods of this type exists.
In-use implies currently applicable legislation or elections officials specification, or as
realized in systems that run elections now.
Reference models or formula definitions exist in various contexts including glossary
definitions, RFPs by elections administration to systems and software manufacturers
and systems documentation, and also research works on social choice theory and
voting theory.
Examples of research topic areas where mathematical definitions of voting methods are
presented include research into vote power, voting system criteria*, verifiable voting
systems, auditable voting systems, security, privacy. Models presented in research
publications largely focus on voting system criteria and vote power analysis, and are
often meta models , or higher level and more general models of the actual in-use
voting methods, and therefore do not serve the same purpose that the product of this
working group may.
This working group 's scope does not include defining new voting system criteria nor voting system metrics for use in
evaluation and comparison of voting methods, nor systems implementation of voting methods. Innovation of
entirely new voting methods, promotion of voting methods, are also outside of our scope. UI/UX & ballot design
also out of scope.
114
VSSC Winter Meeting 2/4-5/2015
Road Map
Use Cases For Models:
+ Mathematical models facilitate, support or enable use
cases.
+ Mathematical models are not standards for the use cases.
+ Mathematical models developed with consideration of the
'itability' or 'iability' of the different use cases:
auditability, capacity planning, testing & reportability,
verifiability, information security and privacy, reportability,
traceability & logging... are there others? Certifiability?
115
VSSC Winter Meeting 2/4-5/2015
Road Map
Use Cases cont.:
+ Forms of mathematical models are determined by this WG.
+ There may be multiple forms of model per voting method,
e.g., as appropriate to use case(s) or other factors
+ Potential other factors: categorization, structural e.g.
hierachy?, lattice? partial ordering?, granularity of models ...
Collect and assess plain language/legal art definitions:
+ Voting methods in-use in elections administration,
legislative / legal art definitions, RFP definitions, others?
Deliberate and draft Mathematical Models
Iterate through steps as needed
116
VSSC Winter Meeting 2/4-5/2015
Road Map

Quarterly speakers series

Newsletter & Articles

(Un)Conference (summer 2015?)

Draft Standard Document

117
Time Frame: VM-WG is approved to operate
through 2018, but anticipate 1st draft by within
2016
VSSC Winter Meeting 2/4-5/2015
Road Map Q&A
118
VSSC Winter Meeting 2/4-5/2015
Conclude
Find links about VSSC at http://grouper.ieee.org/groups/1622/index.html
About VM-WG 1622.6 and the other VSSC WG's at:
http://grouper.ieee.org/groups/1622/work-in-progress.html
VM-WG 1622.6 Sponsor & Chair of the VSSC is John P. Wack of NIST:
johnpwack@gmail.com / johnwack@nist.gov
VM-WG Chair:
119
lauren.massa.lochridge.sf@gmail.com / laurloch@ieee.org
VSSC Winter Meeting 2/4-5/2015
Closing Remarks
• Where/when is next meeting
120
VSSC Winter Meeting 2/4-5/2015
Adjourn
• VSSC Officers meeting at 3:15 pm in Room
TBD
• Dinner for those interested – meet in
Doubletree Hotel lobby at 6 pm
• Restaurant TBD
121
VSSC Winter Meeting 2/4-5/2015