Process Stages
of Census Surveys
Richard J. Lang, International Manager
June 2008, Dar es Salaam
© Beta Systems Software AG 2008
1
Agenda
Scanning
Recognition
Verifying
The
Processes
solution
Data
capture
Census
Process internal
Census
data flow
Quality
assurance
© Beta Systems Software AG 2008
2
Scanning
© Beta Systems Software AG 2008
3
Scanning
Simultaneous
creation of up to six images
Optical
lens > 10 mm, sharpness-depth-area 3 mm
Optical
und ultrasonic double feed control
Energy
saving / live cycle extending Mode
Consistent
jam handling:
no document is lost or double captured due to physical jams
cleanness
check program: detects white - and black dirt spots
© Beta Systems Software AG 2008
4
Scanning
 Pockets
2 – 12 why:
 if
the document is scanned skewed or de-skewed
 if
the very important questions are filled / are readable (if OMR) or not
 if
there are fingerprints on the questionnaire or not
 if
the barcode numbers / OCR (not ICR) numbers are in the given range
 if
there are double entries – we check the unique barcode number
 if
there are (colour) copies used
 if
the Batch header and the following questionnaires fit to each other
meaning Batch header for State 1 and following batches for State 2)
 if
there are mismatches in quantity:
Batch header shows 50 and only 40 are scanned

Transport stop can be programmed to clarify the issue
© Beta Systems Software AG 2008
5
Scanning
 Customer:
I
have a printer and print since long my own questionnaire
 …I
learnt from the internet that it is just a matter of software …
 Before
printing we should be consulted
to give best advices, we will test and optimize.
 Single
side printing or higher scaled paper is necessary
(shine through factor = opacity)
 Paper
 Discuss
should be white without any spots inside
different methods before making big investments
© Beta Systems Software AG 2008
6
Scanning
Batch
EA
Doc
Sheet
Page
Side 1
EA
Side
Image Grey
Image
Page
© Beta Systems Software AG 2008
Sheet
Side 2
Doc
Image B/W
7
The Path to Recognition
Analyze
the structure of documents for identification
© Beta Systems Software AG 2008
8
The Path to Recognition
Perform
proper clean-up and image
pre-processing
Analyze
individual page layout
Dynamically
Character
locate fields of interest
recognition
(numeric handwriting, voted)
Compile
results
© Beta Systems Software AG 2008
9
© Beta Systems Software AG 2008
10
Recognition – Image Pre-processing
Skewed
document ...
…after alignment
© Beta Systems Software AG 2008
811 1
Recognition: Noise and box removal
© Beta Systems Software AG 2008
12
Verifying Processes
Unique
Number – double Scan check
Double
feed check
Check
Trace
if Copy
of all editing work
Logical
checks
Completeness
checks
Reports
© Beta Systems Software AG 2008
13
The Solution: SC80HC + FC Census
FC Census
recognition
Data +
Images
Preparation:
cut & jogg
Work
Data
Storage
VSAT
Batch
Header
Archive
Paper
Archiv
e
Data
Storage
TAPE
Formx
Editing
© Beta Systems Software AG 2008
CSPro
Local reports
14
Data capture
7
locations
Peak
period 3 shifts, average 1-2 shifts
Local
operators trained by our supervisors
Supervisors
Central
support from Lab
Training
Help
local
& documentation realised in advance
to design the documents
© Beta Systems Software AG 2008
15
Census Process internal
Form Type
Analysis
Structure
Analysis
ICR voting
Command
Processing
ICR 1
ICR 2
Editing
Output
Assembly
© Beta Systems Software AG 2008
Logical
Result
Analysis
ICR Result
Analysis
16
Census data flow
Process
Station 1
Process
Station 3
Process
Station 2
Process
Station “n”
Server
logical Network.
„outside world“
© Beta Systems Software AG 2008
Process flow
controlled via
process queues.
17
Quality assurance
Form
design with scanning quality check
Before
delivery of paper scanning quality check
Confirm
Make
the quantity of forms
use of Trial Census experience
Establish
Make
As
checks for essential criteria only
day to day checks during the running Census
soon as possible check the results and verify
Back
up / Reporting
National
/ International Supervisors
© Beta Systems Software AG 2008
18
Thank you!
We
are prepared for your Census
© Beta Systems Software AG 2008
19