Activity 1.1 - TAE10 LLN Quals Working Group

advertisement
TAE70110 Vocational Graduate Certificate in Adult
Language, Literacy and Numeracy practice
TAELLN705A Design and Conduct pre-training
assessment of adult language, literacy and
numeracy skills
Learner Guide
D:\106755531.doc
Page 1 of 80
TABLE OF CONTENTS
About this guide ...................................................................................................................................................... 3
Assessment ............................................................................................................................................................ 5
Topic 1 Design a pre-training assessment process to analyse adult language, literacy and numeracy skills ......... 9
Topic 2 Conduct the assessment .......................................................................................................................... 38
Topic 3 Analyse data to establish candidate’s language, literacy and numeracy skills ......................................... 58
Topic 4 Provide effective advice on suitable program options .............................................................................. 62
Topic 5 Report outcome of assessment................................................................................................................ 66
Topic 6 Evaluate the process ................................................................................................................................ 76
Appendix ............................................................................................................................................................... 80
D:\106755531.doc
Page 2 of 80
TAELN705A Design and conduct pre-training assessment of adult language, literacy and/or numeracy skills
About this guide
This Guide is a resource for TAELLN705A design and conduct pre-training assessment of adult language,
literacy and numeracy skills. It acknowledges that pre-training assessment of adult LLN occurs in a diverse
range of VET contexts.
This guide contains suggested readings and activities. It has been designed to address the learning needs of a
diverse cohort of participants, acknowledging in its design that participants may have different backgrounds and
experience of LLN delivery and have achieved a range of professional qualifications in teaching and training.
Candidates are encouraged to contextualise the activities to their own work and study environments.
The document is not a definitive training manual. Its content, readings, activities and assessments may need to
be customized to suit the needs of candidates in a range of locations and training environments.
Candidates are encouraged to negotiate activities and assessment tasks with their supervisors, as appropriate.
Introduction
This Unit is an elective unit in the accredited course: TAELLN705A Graduate Certificate of English Language,
Literacy and Numeracy Practice in VET. It specifies the skills and knowledge required to place people in adult
language, literacy and/or numeracy programs appropriately, to make referrals to other suitable programs and to
complete reporting requirements
Language Literacy and Numeracy (LLN) training in the VET system is offered in a range of delivery contexts and
modes of provision. It is offered in accredited stand alone courses or as integrated components of training
packages. Adult LLN is also provided to support individuals or groups of learners undertaking vocational training
at an RTO or in the workplace, and to support the LLN development of individuals through informal courses in
community settings.
Successful placement of learners in an LLN program draws on a diverse range of assessor skills and knowledge.
Assessors need to be aware of not only the range of programs and the nature of delivery of a particular area of
provision, but of the wider issues of policy, funding and target groups within the LLN field. Topic 1 introduces
participants to the contexts of LLN delivery and balances this knowledge with an exploration of the nature of
adult learners and their needs, and the implications of this knowledge to training and assessment. It also
addresses the knowledge and skills to use the Australian Core skills Framework (ACSF) and/or The International
Second Language Proficiency Rating Scales (ISLPR).
Effective assessment of adult LLN proficiency skills often relies on a one to one interview. The interview process
enables the individual’s LLN needs to be understood in a holistic way and consideration to be given to the
individual’s learning goals and experience and learning preferences because these factors are important to
appropriate placement. Topics 2, 3 and 4 focus on LLN assessment within an interview setting, analysis of data
gained during the interview and feedback about placement options.
Assessors of LLN also need to develop skills in communicating the findings of the assessment to other parties
through activities such as making referrals to suitable programs, and fulfilling reporting requirements and
completing relevant documentation. These skills are supported by Topics 5 and 6, Record, report, review.
D:\106755531.doc
Page 3 of 80
The structure of the unit
The unit is comprised of six major topics which correspond to the elements in the unit of competency. Each topic
is broken into a number of sections which are supported by readings relevant to the sections’ learning activities.
Each Topic Guide contains suggested:
Reading content, references and web links mapped to the Unit elements
Learning activities that can be contextualized
Key references
The main measurement tools used for assessing adult Language, Literacy and Numeracy proficiency are:
The Australian Core skills framework (ACSF)
and
The International Second Language Proficiency Rating Scales (ISLPR).
It is assumed that candidates will have a working knowledge/expertise of these benchmarking tools. It is not
within the scope of this unit to train candidates in their use. Candidates can access training in the relevant tool at
RTOs.
Training in the ISLPR can be sought from the designers of the tool: ISLPR
The ACSF is downloadable from the website: ACSF
The ISLPR must be ordered from: International Second Language Proficiency Ratings (ISLPR®)
It is essential that candidates access hard copies of these LLN benchmarking tools.
D:\106755531.doc
Page 4 of 80
Assessment
To complete this Unit you need to identify an LLN training and assessment environment where you can access
resources, mentoring and learners and apply the skills you are developing. This ‘setting’ is called ‘the practice
environment’ in this guide.
Formative assessment tasks have been developed for each topic. These tasks support assessment for the unit
overall, and some participants may wish to use this as evidence for their completion of the summative
assessment for the Unit.
Integration of assessment for the qualification is strongly recommended. Candidates should incorporate relevant
evidence collected in support of other Units of Competency in the Qualification in addressing assessment for this
unit. It is recommended that candidates read the overview of assessment requirements which can be found in
the Unit overview for all other units in which they are concurrently enrolled.
Assessment Task: TAELLN705A: Design and conduct pre-training assessment of adult Language,
literacy and/or numeracy skills
Rationale
Course participants will undertake practical workplace experience in this course. This practical experience will
provide the context and source of the materials and activities required for this assessment task.
The assessment activities developed for this unit acknowledge the need for flexibility in order to accommodate
the needs of participants with a range of professional experience in delivering and assessing LLN. Candidates
may negotiate aspects of the assessment task with the course facilitator, as appropriate.
Participants may negotiate with facilitators to adapt these tasks as appropriate or to undergo an RPL process.
The critical aspects of evidence in this unit state that participants must be able to provide evidence that they can:

outline the assessment process, including own role

develop a pre-training assessment kit that:
 is consistent with AQTF requirements
 is customized to meet the needs of particular learner group, funding body, industry and
workplace
 demonstrates significant knowledge of:
 range of social, psychological, physical and cultural factors that influence
language, literacy and numeracy development in learners
 how these issues have been considered in the design of the assessment process
provide records of assessment (confidentiality protected)
provide current information about the range of adult LLN options available to learners
provide records of evaluations of the process and the assessment kit
provide evidence of changes made to the assessment process as a result of feedback.




D:\106755531.doc
Page 5 of 80
As part of the Assessment for this unit, complete all tasks listed below:
1. Develop strategies and enact processes which support appropriate placement in an adult LLN
program. All stages of the task must be documented.
Task A: Describe the LLN workplace/training environment that you will design a placement process to support.
You should include:
 The cultural and economic context in which the provider operates e.g. urban/rural/remote:
perceived areas of LLN need within the geographic location served by the provider
 The range of LLN programs offered
 The funding bodies which support this provision
 The target group of learners for this provision
 The particular initial assessment and reporting requirements
 The range of placement options available within this provision
 Referral process for external training options
2. Develop an assessment toolkit
Develop a series of assessment tasks (and/or adapt available materials) to support the identification of LLN
needs for a particular group of learners within this provision; for example, trainees in a particular certified course,
apprentices in a particular trade, language learners who are recent arrivals or long term residents; overseas
students with a particular vocational or training goal.
Identify the assessment framework, reporting framework; competency based certificate or rating system used to
locate the LLN performance levels of learners. Explain why this choice was made.
•
•
•
•
•
•
•
•
•
•
Locate the critical LLN levels required for training by either:
•
unpacking the LLN requirements of a particular training package
•
using the mapping of an accredited course to the ISLPR or the ACSF
Develop and describe interactive strategies to support learner’s self assessment and to broadly locate
levels on performance, so that further assessment is initiated at the appropriate level
Select texts and activities to locate learner performance in reading, taking into account the LLN contexts
of provision and learning. Participants should develop tasks enabling location of performance across at
least three levels of the ACSF focusing on those pertinent to the identified learner group.
Develop a process whereby a range of evidence from writing tasks may be collected
Develop numeracy tasks allowing identification of numeracy performance across at least three levels
as/if appropriate to the learning context
Develop and document interactive strategies to locate oral communication performance, including
specific listening activities if appropriate.
Develop and document strategies for collecting evidence of performance in learning strategies, e.g.
interactive, self assessment, and observational strategies.
All tasks should enable performance at a particular level to be clearly identified and to allow movement
into the next level of performance.
The conditions of assessment - the level of support and familiarity of the context should be factored in to
the design of the tasks
Integrated assessment tasks may be used where appropriate
Review the assessment toolkit with a nominated mentor, for example, a supervising teacher at placement. Note
comments and suggestions for changes in strategy and changes to tasks, stating why these suggestions were
D:\106755531.doc
Page 6 of 80
made. Make any changes to the assessment toolkit you deem necessary, explaining why you have made these
changes.
For submission

A description of the context for this assessment ( part 1 of this task)

Your assessment tasks toolkit, documenting suggestions and recommendations made to you by your
supervisor

An accompanying commentary which explains your rationale for task development. Do the tasks allow
specific levels of LLN to be identified? Do the tasks allow learners to be assessed to their ceiling
performance? Have you considered how familiarity of context, level of support and assessment contexts
may influence expected performance levels? Do the tasks meet the requirements for tasks to be valid,
reliable, flexible and fair? Are the tasks grounded in relevant and meaningful contexts for the learner?
Do the tasks contain authentic / real life elements? Were integrated tasks appropriate to this
assessment?

Your modifications and the reasons for them.

A reflection on the process of task development. What have you learnt from this process? What would
you do differently?
Task B: Carry out an initial assessment interview for placement in an LLN program
Participants will need to arrange placement with a particular provider. Arrange for an assessor from this provider
to observe the interview that you conduct.
The assessor will note:
 support given to the learner throughout the interview and particularly in the initial phase
 the information you provide about the assessment process and its purpose
 the interactive strategies you used to support the learner in self identifying LLN levels in the early stages
of the interview
 the interactive strategies you use to gain a holistic picture of the learner’s stated needs, goals
educational background and learning strategies, styles and barriers.
 reactions to stated and unstated feedback given to you by the learner
 the appropriate choice of tasks you use with the learner to refine understanding of LLN levels
 the appropriate level of support you offer to the learner in completing tasks
 the feedback you give to the learner about their LLN levels
 the interactive strategies you use to support learners in negotiating their placement options and
developing a training plan
3. Reporting information.
Report the results of the assessment using the appropriate documentation and submit a copy with this task,
making sure that all identifying information about the learner has been removed.
4. Debrief with the assessor /facilitator who observed your assessment practice
Discuss the observer’s report of your performance asking for clarification of the response. Submit a copy of the
observer’s report with your task response, commenting on the feedback you received. What aspects of the
assessment interview are you happy with? Where would you like to improve?
D:\106755531.doc
Page 7 of 80
5. Review the assessment process
For submission
Submit all written tasks for evaluation, including the observer’s report and your written reflection on the interview
process.
Note: Your course facilitator will inform you about requirements related to submitting your responses to Readings
and Activities listed in the Topic Guides for this Unit.
D:\106755531.doc
Page 8 of 80
Topic 1 Design a pre-training assessment process to analyse adult
language, literacy and numeracy skills
Topic Overview
This topic outlines various forms of pre-training assessment and explores what constitutes initial assessment of
Language Literacy and Numeracy (LLN) skills for placement and support of learners in Vocational Education and
Training (VET) courses. Factors which underpin assessment procedures are identified and their influence on
shaping assessment discussed. A number of readings are included, inviting candidates to consider the
contextual issues affecting the practice of adult literacy assessment.
This topic has four sections:

Design processes within an assessment framework

Contextualise assessment processes within organisational, policy and legislative framework of
assessment in VET and program funding profile

Create a pre-training assessment kit that provides opportunity for candidates to demonstrate their range
of language, literacy and numeracy skills

Select the location for pre-training assessment that meets the needs of candidate and assessor
Design processes within an assessment framework
Principles of assessment
Assessors need to be aware of the underlying principles guiding all LLN assessment practices. These principles
and their application to pre-training assessment practices are also addressed in the core units of this
qualification.
Competency Based Training (CBT)
Competency Based Training (CBT) underpins LLN training and assessment in the VET sector. The following
topic provides orientation to the use of assessment tools and instruments in a competency based training
system. Its goal is to familiarise candidates with assessment and LLN rating systems, explore methods of
locating LLN in training packages and accredited courses and support candidates in developing/compiling a prtraining assessment tool kit appropriate to their work/placement context. Assessment principles underlying the
development of all assessment tasks and practices are also discussed.
Identifying LLN skills using curriculum and reporting frameworks – Measurement rating
systems for adult Language Literacy and Numeracy skills
In the adult LLN field, pre-training assessment of learners’ LLN proficiency is primarily assessed using the
Australian Core Skills Framework (ACSF). The International Second Language Proficiency Ratings are used to
identify levels of development in learners with English as a second language. The International English language
testing System (IELTS) is an additional rating scale used in assessing language skills in tertiary education
contexts.
D:\106755531.doc
Page 9 of 80
The Australian Core Skills Framework
Australian Core Skills Framework
The ACSF is based on the National Reporting System (NRS), a mechanism for reporting outcomes of adult
English language, literacy and numeracy provision.
While the NRS was primarily designed as a reporting tool, the ACSF has been designed as a framework with
applications for a range of contexts. For example, it provides benchmarks against which performance can be
described in detail in each of the core skills and can also be used to describe the core skills needed in a
particular context, such as the workplace, or to map curricula.
The Australian Core Skills Framework has been developed in Australia for use as a central reference for
assessing and reporting adult LLN skills in a wide range of VET contexts. It is used extensively to identify LLN
competency as expressed in VET training packages, accredited curricula and units of competency. It is used to
assess and report the LLN performance of adult learners in VET across diverse settings, including accredited
training and other formal and non formal training in both educational institutions and workplace settings.
The ACSF is also used by curriculum and training package developers to guide the formulation of appropriate
course structure and content. Because it is such a useful reference for assessors of LLN, it is the key document
to support activities in this unit.
You can access the ACSF using the following link:
www.deewr.gov.au/Skills/Programs/LitandNum/ACSF/Pages/download.aspx
The International Second Language Proficiency Ratings
International Second Language Proficiency Ratings
The International Second Language Proficiency Rating: general proficiency version for English (ISLPR) is used
extensively for initial placement of adult language learners in VET programs. If you can access the ISLPR using
the following link: www.islpr.org
The full ISLPR is copyright protected. A copy can be purchased at the above website. The Cost at time of writing
is $38.
LLN in training packages
A Training Package is a set of nationally endorsed competency standards, assessment guidelines and
qualifications. The LLN skills intrinsic to vocational training packages can be identified or “unpacked” and form a
set of LLN criteria to identify training needs of learners. This section describes how assessors can identify the
LLN components of training packages and use these to develop assessment tasks. Training Packages can be
accessed on the National Training Information System website: NTIS
Accredited Courses
Accredited courses are formally recognised in accordance with the Australian Quality Training Framework
(AQTF). These courses address the skill requirements of industry, enterprises and the community where they are
not covered in nationally endorsed Training Packages. Training Packages can be accessed on the national
Training Information System (NTIS).
D:\106755531.doc
Page 10 of 80
Contextualise assessment processes within organisational, policy and legislative framework of
assessment in VET and program funding profile
Registered Training Organisations
Australia’s economic and social development is supported by the national training system. It is instrumental in
determining the design, content and modes of delivery of VET training. National and state governments have
worked with industry representatives to develop the national training system. RTOs provide vocational education
and training throughout Australia. They are from both private and public sectors.
The Australian Quality Training Framework
The Australian Quality Training Framework is a set of nationally recognised standards, which ensures that
consistent, high quality training and assessment procedures are implemented for participants in vocational
education and training. It is overseen and monitored by the National Quality Council (NQC).
Ethical and legislative requirements of assessment
Registered Training Organisations have an obligation to integrate these standards within their assessment
processes. LLN assessors need to be aware of the AQTF standards and the requirements of the various acts
that apply to their role and to be
Create a pre-training assessment kit that provides opportunity for candidates to demonstrate
their range of language, literacy and numeracy skills
In the following guide, models of assessment kits are referred to and samples provided for your consideration. It
is assumed that you will have access to locally developed pre-training assessment tools available in the LLN
settings in which you are working and/or undertaking placement for this course.
Activities in this topic will guide you to create an assessment kit that responds to the needs of the learner groups
in your work and study context.
Select the location for pre-training assessment that meets the needs of candidate and assessor
The main pre-training assessment event is the assessment interview. The location and setting of the interview
will directly affect the outcome of the assessment process.
D:\106755531.doc
Page 11 of 80
Topic 1 Readings and Activities
Work your way through the following readings and activities.
Reading 1 for Activity 1.1 Views of assessment
Below are some broad descriptions of assessment:
A. Assessment is the process of collecting evidence and making judgements on whether
competency has been achieved.
(Booth, Clayton, House & Roy, 2002)
B. Assessment is a process of assessors ‘sitting beside’ learners to get information about
proficiencies, backgrounds and goals, and in doing so immerse themselves in the lives of their
students.
(San Pietro, 1994)
C. Assessment involves measuring appropriate evidence against a standard or scale, which could be:
•
Another group of people
•
An established set of performance benchmarks
•
Individual past performance
(Ecclestone, 1994)
D. Assessment of student learning begins with educational values. Assessment is not an end in itself but a
vehicle for educational improvement. Its effective practice, then, begins with and enacts a vision of the
kinds of learning we most value for students strive to help them achieve. Educational values should
drive not only what we choose to assess, but how we choose to do so. Where questions about
educational mission and values are skipped over, assessment threatens to be an exercise in measuring
what’s easy rather than a process of improving what we really care about
(Banta, 2002)
D. The Overall purpose of assessment is to improve standards, not merely to measure them. Assessment
which is specifically designed to promote learning is the single most powerful tool we have for both
raising standards and empowering lifelong learners
(Derrick, 2004)
Facilitator Guide to the Four Core Units The Advanced Diploma LLN Practice in VET, 2007.
Handouts and Resources, DEST.
D:\106755531.doc
Page 12 of 80
Reading 2 for Activity 1.1 Locating initial assessment within the learning cycle
Initial assessment
May be:
•
Predictive refers to the application of LLN indicator tools which
give a broad picture of the learner’s LLN skill levels so that
appropriate diagnostic tools can be used, or so that provisional
training can be planned for and implemented.
•
Diagnostic refers to procedures used to gather information so
that learners’ needs, goals and preferences can be identified
and they can be placed in appropriate learning/training
programs. It establishes,”the performance gap between where
learner is and where they want to be”. While some contexts
place more emphasis on one or the other of these forms of
initial assessment, they are often blended into a holistic
assessment process.
Ongoing (format) assessment is the process of
gathering of information to demonstrate how
learners have progressed in their learning. It is
called formative assessment since it helps
students form the knowledge, skills and
understanding that will eventually be needed to
demonstrate competence. Assessment a
practical guide DEET.
Exit (summative) assessment is the process of gathering of
information to demonstrate the extent to which learners have met
their needs and goals at the end of the programme. Assessment a
practical guide DEET.
Facilitator Guide to the Four Core Units The Advanced Diploma LLN Practice in VET, 2007.
Handouts and Resources, DEST.
D:\106755531.doc
Page 13 of 80
Reading 3 for Activity 1.1 Rowntree’s five questions for assessors
Watts (1996, p.8) cites the work of Rowntree (1991) who suggests that, ‘there are five different mental
activities among people who undertake assessment and these activities relate to the following five questions:
1
Why Assess? What are the affects or outcomes assessment is expected to produce?
2
What to assess? How to decide, realise or otherwise come to an awareness of what we are
looking for or remarking upon in the people being assessed?
3
How to assess? To select, from all the means we have at our disposal for learning about
people, those we regard as the most truthful and fair for various sorts of valued knowledge
4
How to interpret? When we have the outcome of the assessment what does it mean?
5
How to respond? What are we going to do with the assessment outcome?’
Other stakeholders in initial assessment processes
The answers to the questions above and the roles that they suggest occur in relation to key stakeholders in
the assessment process. Their needs are important in shaping assessors’ roles.
Assessment is a decision making tool for key stakeholders:
Stakeholder
Outcome
The individual being assessed
gain an understanding of own strengths and needs
and form goals in relation to training
The teacher/trainer
The education and training provider
The funding bodies supporting
provision
D:\106755531.doc
Page 14 of 80
design and delivery of appropriate learning in relation
to the learner’s needs and goals
plan resources and programs to meet learning and
training needs
allocate appropriate resources to develop the skills of
learners for work or further training
Reading 4 for Activity 1.1: Initial assessment and the tasks of the assessor
Understand the contexts within which the assessment is to take place
These contexts include the goals of the learner, the performance criteria to be used, the purpose of the
assessment, the particular LLN requirements of an accredited LLN course or a workplace/training package
Develop an understanding of assessment frameworks.
Develop the assessment tasks appropriate to the assessment framework and the learning context.
Prepare for and conduct the interview. Collect the evidence using non formal assessment methods and then
select further the assessment tasks appropriate to the assessment context
Report the evidence against the reporting instrument
Evaluate the evidence against the performance criteria
Place the learner in an appropriate programme
D:\106755531.doc
Page 15 of 80
Activity 1.1
What view of learners and assessment is implicit in the preceding readings? What do you see as the particular
challenges for assessors at initial assessment? Consider Rowntree’s (1991) Five Questions for Assessors in
Reading 3 in your response. How will the pre-training assessment process be influenced by the placement
choices available to the learner? How will the process be influenced by the other stakeholders involved?
What is missing from / could be added to the description of principles of assessment in the preceding readings?
Research the topic further using the following key terms:







diagnostic assessment
achievement assessment
assessment based on adult learning principles
holistic assessment
contextualised assessment
conditions of assessment
adult learning principles and assessment
D:\106755531.doc
Page 16 of 80
Reading for Activity 1.2
Competency Based Training and Assessment Practices
The advent of competency based curricula and training
Competency based training (CBT) is well established as the definitive rationale underpinning provision in
the VET sector.
The concept of competency has been adapted and applied to the identification of LLN skills in accredited courses
which sequence the progressive acquisition of LLN performance, and through the identification of LLN skills in
training packages.
‘Assessment is given a prominent role in this system. Credentials are directly linked to workplace competency…. The
quality of training is controlled through assessment (McKenna)
Assessment in a competency based system is a process of:
“…collecting evidence and making judgements on the nature and extent of progress towards the performance
requirements set out in a standard, or learning outcome, and, at a particular point, making judgements about whether
competence has been met.”
Assessment, a Practical Guide, (1994). DEET, Commonwealth of Australia ( p.4)
LLN assessment in competency based training enables the identification of a particular skill, or progress toward that skill,
based on predetermined criteria. Evidence is gathered which identifies what learners can do and then this is linked to
specific criteria which describe levels of performance. The way evidence is collected can be customised to be contextually
and culturally appropriate to specific learners and their needs. Accurately locating this evidence using the suggested
criteria facilitates reliability in measuring and reporting individual learner performance.
This process is used in a wide range of vocational, technical and LLN contexts to identify training needs and deliver design
and appropriate training programs. Learners, teachers, assessors and employers can gain a mutual understanding of
learners achievements and needs through the sharing of a common set of performance standards.
Initial assessment of LLN in competency based curricula and training packages will involve:
•
Understanding competency based curriculum and reporting documents by developing a strong understanding of
the rules of evidence and of LLN learning outcomes/ performance criteria as they are expressed sequentially in the
chosen curriculum / reporting system / training package
•
Collecting evidence that is valid, authentic, current and sufficient
•
Understanding and implementing fair, valid, reliable and flexible assessment
•
Measuring the evidence against specified criteria for a particular performance area
•
Confidently locating performance from the evidence in relation to the performance criteria and considering factors
such as the level of support required and the assessment context
•
Making a judgement about whether the performance has been met.
D:\106755531.doc
Page 17 of 80
Identification of LLN Performance and adult learning principles:
There is debate among LLN practitioners about assessing learners’ LLN needs using competency based assessment.
Some assessors feel that the focus on identifying performance takes precedence over the needs of the learner (See
Pauline O’Maley’s article cited below. Another view is that competency based assessment is compatible with adult
learning principles if it:
•
Focuses assessment on describing the learners’ achievements by identifying what individual learners can actually
do.
•
Is focussed on the individual learner, rather than a competitive cohort
•
Takes learners’ goals into account and identifies gaps in performance from this perspective.
•
Involves learners in the assessment process through self - assessment, goal setting and RPL.
•
Allows for the use of a variety of assessment activities and fosters a holistic approach to understanding learners
and their needs.
Facilitator Guide to the Four Core Units The Advanced Diploma LLN Practice in VET, 2007.
Handouts and Resources, DEST.
Activity 1.2
Discuss the points raised in this reading about competency based training for initial assessment of LLN skills with
an experienced LLN practitioner.
Based on your discussion and considering the types of provision with which you are most familiar, what do you
see as the main implications of competency based training principles for initial assessment processes?
D:\106755531.doc
Page 18 of 80
Reading for Activity 1.3 The Australian Core skills Framework (ACSF)
http://www.deewr.gov.au/Skills/Programs/LitandNum/ACSF/Pages/download.aspx
Note: it is assumed that you are familiar with the assessment benchmarking tools used in the following activities.
These include ACSF, ISLPR, and Units of Competency in Training Packages and Accredited Courses
Activity 1.3
Read the concise summary of the ACSF and answer the following questions







Briefly explain the purpose and features of the ACSF
List the applications/uses and adult Vet training contexts for which the ACSF is designed
What core skills are addressed by the ACSF?
What distinguishes the 5 levels of performance in each of the core skills?
What factors will influence an individual’s performance?
Read the scenarios. How does the ACSF identify a learner’s strengths and weaknesses?
In the ACSF, what are the ‘Aspects of Communication”? Why is so much emphasis placed on these
aspects when considering assessment practices?
The ACSF is informed by a broad range of theoretical understandings including theories of adult learning,
language, literacy and mathematical development. The benchmarking scale relies on theories of task and text
complexity. Make notes on the following issues:


Briefly comment on what theories of language literacy and mathematical development are apparent in
the design of the ACSF. Your studies in the core units for this qualification will be relevant here.
How do notions of ‘text’ in the ACSF correspond to ONE current theoretical principle underpinning
theories of language, literacy or numeracy that you have studied in a core unit of competency in this
qualification?
Reading for Activity 1.4 Introducing the ISLPR
International Second Language Proficiency Ratings (ISLPR®)

ISLPR testing takes the form of an interview in speaking, listening and reading, reflecting the dynamic
nature of these.

Developed by David Ingram and Elaine Wylie in 1980/81, it was originally known as the Australian
Second Language Proficiency Rating (ASLPR) until it was modified for international used and renamed
in ISLPR in 1997. The ISLPR is not a test, but a rating system for second language learners.

What is the ISLPR? The International Second Language Proficiency Rating (ISLPR) is a 12-level scale
that describes the development of second language proficiency. Learners are rated on speaking,
listening, reading and writing on a scale from 0 to 5; 5 is considered to be native speaker proficiency.
There are some intermediate grades of + or – eg 1+ is between 1 and 2. The ISLPR is commonly used
in Australia when doing initial testing of learners who are to be placed in an English language class.

What is the rationale behind the development of the ISLPR? The ISLPR draws on linguistics,
psycholinguistics and socio linguistics to describe the progressive development of language as it is used
in real life, in social settings and domains relevant to the learner or “end-user” (eg. employer or
registration board)
D:\106755531.doc
Page 19 of 80

Uses of the ISLPR
o Assessing the proficiency of individual learners
o Research and policy making
o Providing a framework for curriculum development

How do the skill levels operate in relation to each other? The four skill areas (subscales) are
conceptually related but learners may develop at different rates and be at different levels in the four
areas. Each of the levels can be seen as a band extending above and below the point described.
Therefore, learners may progress in their language, but not change in their location on the scale.
Learners are assessed against each of the four macroskills (speaking, listening, reading and writing) but
it is not appropriate to aggregate the scores and report an overall score.

The term false beginner is also used to describe someone who has some background in learning
English, but really needs to start again

ISLPR reporting is in the form of a profile
More information can be found at:
www.islpr.org/overview
http://www.griffith.edu.au/centre/call/frameset4.html
Wylie, E (2002). An overview of International English Language Testing System (ISLPR) Centre for Applied
Linguistics and Languages (CALL) Griffith University.
http://www.griffith.edu.au/centre/call/ISLPRoverview.pdf
.
D:\106755531.doc
Page 20 of 80
Reading 2 for Activity 1.4: An interpretative summary of the ISLPR descriptors
Note: The following table is an interpretation of the ISLPR intended to provide participants with an introductory,
accessible summary “map” of the levels. It is not intended to replace use of the ISLPR. Facilitators are
encouraged to access the entire document as appropriate to their participant group.
ISLPR
0 Zero proficiency
Unable to communicate in
the language
0+ Formulaic
proficiency Able to
perform in a very limited
capacity within most
immediate, predictable
areas of own need, using
essentially formulaic
language
1- Minimum ‘creative’
proficiency Able to
satisfy own immediate,
predictable needs, using
predominantly formulaic
language
1 Basic transactional
proficiency Able to
satisfy own basic
transactional needs
1+ Transactional
proficiency able to
satisfy own simple,
everyday transactional
needs and limited social
needs
2 Basic Social
proficiency Able to
satisfy basic social needs,
and the requirements of
routine situations pertinent
to own everyday
commerce and recreation
and to linguistically
undemanding vocational
fields
Listening
Speaking
Reading
Writing
Unable understand
anything at all in
English.
Unable to
communicate in
English; may have
some formulaic
language.
Uses formulaic
language to
communicate simple,
basic information e.g.
greetings, simple
personal information.
Unable to understand
anything in written
English.
Unable to
communicate
anything by writing
in English.
Uses formulaic
language to recognise
simple personal
information; e.g.
name date of birth,
danger signs.
Uses formulaic
language to write
simple basic
information e.g.
personal details
on proformas;
copies short,
needed phrases.
Communicates
simple, predictable
personal information
makes simple
purchases and
requests.
Pronunciation strongly
influenced by L1
Makes basic
transactions in shops,
holds simple
conversation
Recognises names of
everyday objects, ,
signs, basic forms,
requests
Writes short
original sentence/s
to convey simple
information,
instruction,
Able to understand
short, simple texts,
E.g. read a simple
form, lists, street and
shop signs, short,
clear instructions
Understands short
simple texts on limited
range of familiar
topics
Writes simple
message, simple
recount or
instruction
Reads simple
personal letters, work
bulletins, news stories
in routine situations
vocational fields
Fills in forms,
writes memos,
messages, simple
personal letters,
informal memos
and simple
informal reports
Uses formulaic
language to
understand limited
range of short,
utterances.
Understands
simple predictable
requests for
personal
information,
questions or
statements
Understands
enough to
participate in
simple
conversations
Understands
simple information
on the phone, short
simple face to face
texts beyond
survival needs.
Initiates and sustains
simple conversations
on limited range of
familiar topics.
Participates
effectively in social
conversations on
everyday topics.
Understands clear
simple messages
on answering
machine
Sustains basic
everyday social and
transactional
conversations. E.g.
can describe and
comment on everyday
events
2+ Social proficiency
Behaviour is significantly
better than 2 but not yet at
3
D:\106755531.doc
Page 21 of 80
Writes simple
letters to friends
e.g. invitation to
party, notes to
school e.g.
absence note
3 Basic vocational
proficiency Able to
perform effectively in a
wide range of formal and
informal situations
pertinent to social and
community life and
everyday commerce and
recreation, and in
situations which are not
linguistically demanding in
own vocational fields
3+ Basic vocational
proficiency plus
Significantly better than
3 but not yet at 4
4 Vocational
proficiency Able to
perform very effectively in
almost all situations
pertinent to social and
community life and
everyday commerce and
recreation, and generally
in almost all situations
pertinent to own
vocational fields
4+ Advanced
vocational
proficiency Level 4+ is
significantly better than
4 but has not reached
5
5 Native like
proficiency Proficiency
equivalent to that of a
native speaker of the
same sociocultural variety
Participates with
ease in a wide
range of informal
and formal
conversations.
Readily takes
information in by
phone, gets gist of
news stories on
abstract topics
Has control of
discourse and can
convey sufficiently
precise meaning to
enter, participate and
exit most
conversations about
social and community
life.
Reads and gets gist
of articles in popular
magazines, most
news stories for
general readership in
daily papers
Write effectively in
wide range of
situations Writes
letter to Editor,
simple discussion
essay, short report
Understands
conversations at
fast rates of
utterance, most
complex
documentaries
Copes with all spoken
aspects of vocational
roles e.g. makes
presentations,
responds in depth to
technical questions
Understand wide
range of written
material including
formal
correspondence
relating to complex
issues; complex
technical writing;
range of literary forms
Writes complex
correspondence,
expository essays;
reports
Has same degree
of understanding of
spoken language in
all its features as
do native speakers
Learner’s speech is
indistinguishable from
native speaking
peers. No limitation
attributable to L2
Appreciates texts
involving subtle and
covert meanings as
do native speakers.
Even in complex
demanding
situations, writing
needs no more
editing than that of
native speakers.
Activity 1. 4

In the ISLPR what emphasis is placed on tracking the acquisition of language through its social
function?

What criteria are used for determining progression in language skills?

How do + and – ratings serve in locating learner performance?

Research an accredited adult English language course delivered by an RTO. How is the ISLPR used in
the design of the course?

The ISLPR does not address numeracy competencies. How will you address this issue if required?
Note: The ACSF, ISLPR and International English Language Testing System (IELTS) rating scales are aligned
in the following initial English language and literacy assessment kit:
English Language and Literacy Assessment (ELLA) 2010. Adult Migrant English Program. Section 2 Alignment
of widely used assessment scales. http://www.ames.edu.au/content/publicationitem.aspx?pid=191&pcid=1
D:\106755531.doc
Page 22 of 80
LLN in Training Packages
What is a Training Package?


An integrated set of nationally endorsed competency standards, assessment guidelines and Australian
Qualification Framework (AQF) qualifications for a specific industry, industry sector or enterprise.
A Training Package describes the skills and knowledge needed to perform effectively in the workplace
Reading for Activity 1.5 Built in not bolted on (ANTA publication revised edition 2000)
Activity 1.5
Read Chapters 2, 3 and 4 of ‘Built in not bolted on’.
Answer questions for Chapter 4
Chapter 4: Recognising language, literacy & numeracy issues in a Training Package









Locating language, literacy and numeracy information in Training Packages
Checklist for literacy practitioners, trainers and assessors
Is language, literacy or numeracy activity a discrete unit of competence or an element of
a competency?
Are there language, literacy and numeracy ‘signals’ in the performance criteria?
Is language, literacy and numeracy information given in the range of variables or in the
evidence guide?
Using the ACSF to identify language, literacy and numeracy skills levels
What is the centrality of a language, literacy and numeracy skill?
What degree of independence is required in the language, literacy or numeracy
component of a task?
What supporting materials are available?
Accredited Curricula
Accredited courses address skill requirements for industry, enterprises and the community where these are not
covered in nationally endorsed Training Packages. Accreditation means formal recognition of a course by a
course accrediting body in accordance with the Australian Quality Training Framework (AQTF) Standards for
State and Territory Accrediting Bodies and the AQTF Standards for Accredited Courses.
Activity 1.6




Research an accredited LLN curriculum for a course delivered in your workplace or practice teaching
environment. What is the focus of the course?
Who are the intended participants in the training offered by the course?
What RTOs offer the course in your local area?
What assessment benchmarking tool is used to determine entry and exit LLN proficiency levels in the
stages of the course?
D:\106755531.doc
Page 23 of 80
Readings for Activity 1.7 Legislative Frameworks
Frequently asked questions are available from the Australian Human Rights Commission:
http://www.hreoc.gov.au/disability_rights/faq/faq.html
Working with Diversity:
1. A guide to equity in the AQTF
2. Quality training for people with a disability
3. Quality training for indigenous Australians [ANTA 2004]]
www.voced.edu.au/td/alnp_86.05
AQTF Standards
www.training.com.au
Click on “publications”, then “Users’ Guide to Essential Conditions and Standards for Continuing Registration”
(PDF document)
AQTF Standard 2 relates to Access and Equity
AQTF Standard 1 relates to Quality Training and Assessment & also to minimum training and assessment
competencies required by the trainers and assessors.
Following is an extract from the information:
Access and Equity
• Equity principles must be incorporated in the delivery and assessment of all qualifications to ensure that
vocational education and training are responsive to the individual needs of clients whose age, gender,
cultural or ethnic background, disability, sexuality, language skills, literacy or numeracy level,
unemployment, imprisonment or remote location may present a barrier to access, participation and the
achievement of suitable outcomes.
• These principles recognise the need for equitable participation for people from all backgrounds including
Aboriginal and Torres Strait Islander people, people with disabilities, women, people from a language
background other than English, youth and people from low socio-economic backgrounds.
• Where RTOs have specialised equity staff (for example Disabilities Teacher Consultants, Aboriginal
Coordinators, Multicultural Coordinators) they may be consulted for further advice.
Reasonable Adjustment
• Reasonable adjustment is designed to ensure that all people are treated equally in the Assessment
Process. This means that, wherever possible, "reasonable", adjustments are made to the assessment
process to meet the individual needs of students.
• Adjustments can be made to the way in which evidence of candidate performance can be collected.
• Whilst reasonable adjustments can be made in terms of the way in which evidence of performance is
gathered, the evidence criteria for making competent/not yet competent decisions (and/or awarding
grades) should not be altered in any way.
• That is, the standards expected should be the same irrespective of the group and/or individual being
assessed; otherwise comparability of standards will be compromised.
The DET Internet has both Commonwealth as well as NSW State Govt. Legislation
www.det.nsw.edu.au/policies
D:\106755531.doc
Page 24 of 80
Activity 1.7
Read the overview of the policy and legislative requirements for the AQTF in the User Guide and complete the
following activities
Discuss one of the relevant elements from the listed AQTF standards or a key legislative area in more detail, with
an experienced LLN practitioner.
Take notes about how this information relates to your responsibilities as an assessor.
Share your understanding of the key information in discussion with 2-3 other course participants.
Present your findings to the whole group and explain your understanding.
D:\106755531.doc
Page 25 of 80
Reading 1 for Activity 1.8
Provision of LLN Program funding
LLN assessment in VET takes place in range of different learning and training program contexts which
reflect government policy and funding commitments.
In terms of initial assessment, funding bodies may provide criteria for course entry and prescribe particular
LLN performance levels to support effective delivery of provision and the enactment of broader social and
economic goals.
The policy contexts for LLN provision and funding
‘While teachers generally focus on progress in language, literacy and numeracy and basic education,
governments fund programs to achieve broader social, political and economic goals. These goals include
providing English language training to assist the settlement process for immigrants with a language
background other than English; to remove barriers to employment; to improve occupational health and safety
and workplace change; to reduce recidivism in prison populations, etc.’
‘ The range of provision of language, literacy and numeracy in Australia reflects the differing pedagogical
aspirations of teacher and the range of social policy goals articulated by vocational education and training
systems.’ (McKenna 1998)
LLN Provision in VET 2011
Commonwealth Provision
The Workplace English language and Literacy (WELL) Program provides workers with English language
and literacy skills sufficient to meet the demands of their current and future employment and training needs.
The program caters for approximately 300 workplace projects. In 2008-9 the program had a budget of
approximately $14.9million. $11.5million was spent on Training projects and $3.4million on Resource and
Strategic projects. The total number of WELL participants was 12 180 (Department of Education, Employment
and Workplace Relations 2009a, pp.105, 341). The number of WELL participants has gradually decreased from
23 217 in 2003–04 (Department of Education, Employment and Workplace Relations 2006).
Enterprises are required to make a cash contribution to the provision of WELL training, at least 25% in the first
year, and 50% in the second or third yearThe WELL program requires providers to be RTOs and compliant
with the AQTF.
In the 2010 federal Budget, the Australian Government announced, as part of its Foundation Skills Package,
that it will invest $15.7 million over four years to improve the skills of workers with low language, literacy and
numeracy skills. This will pay for an additional 9500 places over four years (Department of Education,
Employment and Workplace Relations 2010b).
The Language, Literacy and Numeracy (LLNP) Program provides up to 400 hours of basic language, literacy
and numeracy training, which is designed to lead to a measurable improvement in the language, literacy and
numeracy competencies of participants. $$67.7million was allocated in 2008-09 to assist approximately 15,710
participants. This figure is well below the 24 000 estimate (Department of Education, Employment and
Workplace Relations 2009a, pp.105, 341). The number of LLNP participants has gradually decreased from 25
454 in 2004–05 (Department of Education, Employment and Workplace Relations 2006). The Australian
Government has committed $294.8 million to the LLNP from 2009 to 2013.
D:\106755531.doc
Page 26 of 80
In the 2010 Federal Budget, the Australian Government announced, as part of its Foundation Skills Package,
that it will invest $67 million over four years to strengthen the LLNP, with the intention of assisting 70 000 job
seekers to improve their language, literacy and numeracy skills. The investment will pay for an additional 55
hours of training per client. This equates to a 25% increase in average client hours (Department of Education,
Employment and Workplace Relations 2009b, 2010a).
LLNP participants come to initial assessment with a Centrelink referral, identifying them as learners who would
benefit from LLN tuition. Because measurable improvement is a key feature of this training, initial assessment
provides a reference against which gains in learning can be measured.
The Adult Migrant English (AMEP) Program provides up to 510 hours of basic English language tuition to
migrants and refugees from non – English speaking backgrounds to help newly arrived migrants and refugees
settle in Australia. In 2008–09 AMEP expenditure was $174.5 million and the program provided English
language tuition to 52 720 clients. AMEP participation numbers have been growing steadily since 2003–04
(Department of Immigration and Citizenship 2010).
Eligible migrants are referred to the AMEP by their sponsor, settlement provider or Centrelink. Clients may also
hear about the program and contact enrolment centres themselves. Migrants are required to register for the
AMEP within three months of arrival, or visa grant if onshore, and commence classes within 12 months. Prior to
commencement of tuition, AMEP service providers conduct an assessment of each individual’s English
language skill (Department of Immigration and Citizenship 2010).
Updated information from “Building the foundations: outcomes
from the adult language, literacy and numeracy search conference”, NCVER, 2011
Provision of LLN Program funding (continued)
States and Territories
States and Territories use a percentage of their VET recurrent funding and their own contributions to deliver
language, literacy and numeracy programs within their communities or fund special initiatives that support
essential skills development (DEST literacynet). These courses are categorised as General Education.
Enrolments in General Education are estimated to make up 21.5 per cent of all VET enrolments (AVETMISS,
2000).
An ANTA adult literacy grant of $7m was distributed to the States and Territories to support community-based
programs in 2003. There is no accountability required for this funding in terms of reports on courses, student
contract hours or products.
Stand alone adult English language, literacy and numeracy courses
Enrolments in language, literacy and numeracy accredited courses make up over 70 per cent of General
Education enrolments (Shreeve, 2002). Each state and territory has developed or uses accredited courses
offering variable hours of training to achieve variable outcomes including Certificates at Levels I, II, and III.
D:\106755531.doc
Page 27 of 80
Integrated provision in vocational education and training
Adult English language, literacy and numeracy has been built into Training Packages so that the literacy and
numeracy practices used in work and described in the standards for assessment and training can be taught
and assessed along with technical skills. In most Training Packages there are mandatory and core units that
cover generic skills like communication.
Adapted from ‘Appendix One: Adult English language, literacy and numeracy provision in VET, 2003’, Department of
Further Education, Employment, Science and Technology (SA) 2005, Advanced Diploma of Language, Literacy and
Numeracy Practice In VET, Adelaide.
Reading 2 for Activity 1.8
Further information about Language, Literacy and Numeracy Provision
‘Stand alone’ delivery as well as integrated approaches to LLN in VET are described in further detail in McKenna
(1998) Chapter 2. The following is a summary of key points in this description:
Stand alone provision refers to delivery of programs which have language skills development as the main
learning focus. Described as preparatory, pre vocational bridging or access courses, they are usually conducted
prior to participation in other forms of education. Stand alone provision meets number of societal needs. ESL
provision supports the needs of learners for immigrant resettlement; labour market language literacy and
numeracy programs. Labour market language, literacy and numeracy programs aim to address barriers prior to
the learner accessing employment or further training.
Stand alone course can be offered as formal accredited courses subject to accreditation system and curriculum
policy of state and territory VET systems.
Formal Provision - Accredited courses come with a prescribed structure, such as that delivered in States and
Territories using range of accredited curricula, and may be linked to Commonwealth funded programs such as
the LLNP. Initial assessment means understanding student needs in relation to the learning outcomes of the
curriculum offered to channel learners into appropriate placement in the program. Some formal provision
specifies targets groups and learning outcomes, with stipulated assessment criteria and conditions of
performance to be taken into account at initial assessment.
Non formal refers to LLN provision which does not lead to a formally recognised statement of attainment. Non
formal provision may mean a tutor working voluntarily with a learner, or funded programs which are non formal
only to the extent that the learner will not issued with a formally recognised award.
McKenna (1998) notes: ‘The ethos of non-formal programs is generally one of responsiveness to the adult
learner’s stated need. Many of these programs have elaborate procedures for interviewing and assessing the
learner’s needs. The [initial] assessment processes in such programs range from an informal chat with the
student to elaborate literacy assessment tasks or tests…diagnosis is then passed on to the volunteer tutor or
teacher to assist in the development of the learners’ program.’
‘Some non formal provision attracts considerable government support. It is non-formal only to the extent that the
D:\106755531.doc
Page 28 of 80
provision does not issue formally recognised awards. Funding agencies may have quite sophisticated
information requirements on the outcomes of such courses.’
For out comes to be meaningfully reported, initial assessment needs to establish a learning pathway based on a
sound understanding of learner needs and goals.
‘As the outcomes from such provision can be mapped to the ACSF so that learner pathways are created, there is
a need for practitioners to attend to the assessment process as part of the overall planning and evaluation.’
Facilitator Guide to the Four Core Units The Advanced Diploma LLN Practice in VET, 2007.
Handouts and Resources, DEST.
Note: For some learners formal LLN training is not appropriate and referral to more suitable programs is
warranted. The following websites provides additional information about a range of community LLN programs.
”Community adult Language literacy and Numeracy Provision in Australia: Diverse approaches and
outcomes, Darryl Dymock, 2007, www.ncver.edu.au/publications/1796.html)
http://www.deewr.gov.au/SKILLS/PROGRAMS/LITANDNUM/LITERACYNET/Pages/default.aspx
D:\106755531.doc
Page 29 of 80
Activity 1.8
Research a range of LLN provision in your local area. Using the following grid, summarise your findings. Note the funding models and settings in which the range
of accredited LLN training is delivered.
Where and how is adult English language, literacy and numeracy provision delivered?
Adult literacy and numeracy courses, both accredited and non-accredited (sometimes referred to as informal), are delivered in a range of education providers and in a range of
ways. The table below indicates
TAFE Institute
– in general
education
course
TAFE Institute
– in vocational
course
Workplace
Community
house or
centre with
education
program
Community
house or
centre social
or welfare
focus
Library
Nonaccredited
Accredited
Page 30 of 80
Home
Nonaccredited
D:\106755531.doc
School
Accredited
Other
institution
Nonaccredited
Blended
learning –
face to face
& online &/
or distance
Correctional
Accredited
Distance
Ed. – print
based &
phone
support
Nonaccredited
Online
Accredited
Class/
group
Nonaccredited
Accredited
Nonaccredited
Accredited
Nonaccredited
Accredited
Nonaccredited
Accredited
Nonaccredited
Accredited
Nonaccredited
Accredited
One to one
Private
training
organisation
OR
Alternative Activity 1.8
Write a brief summary report on one example of adult LLN provision in VET that you have experience of or have
researched. Use the following questions to guide your report:








What is the target group for this provision?
Is there a particular LLN focus? i.e. low level literacy / ESL etc
In what physical environment is this provision delivered?
Is provision linked to an accredited curriculum/ training package?
What impact does this have on what is taught and the way it is taught?
What funding profiles support provision in these programs?
What pre-requisites do prospective learners need to meet to be eligible to enrol in the course?
What impact does this have on assessment practices?
OR
Alternative Activity 1.8
Interview an experienced teacher/ trainer with a background in LLN delivery or the manager of an LLN program
to find out about the provision offered. Participants with particular experience in one form of LLN provision may
choose to research a different area; e.g., those involved in industry based LLN may choose to research a strand
of community provision or vice versa.
Research should cover:





The range of learners that their provision serves.
How assessment processes accommodate the needs of these learners.
The funding bodies supporting the provision offered.
The requirements this places on initial assessment.
How the results of the assessment are reported. To what extent is reporting shaped by funding body
requirements?
Broadly, how the approach to initial assessment procedures builds on adult learning principles? Give examples.

How are the following requirements built into the initial assessment procedure? Give examples for each.
o
o
o
o
o
Privacy and confidentiality
AQTF requirements
OH&S needs
Assessment for learners with special needs
Equal opportunity and anti discrimination
Submit a short written report of your research findings using the dot points as a guide to structuring your work.
Include a paragraph reflecting on the provision you researched compared with that described by other
participants.
D:\106755531.doc
Page 31 of 80
Readings for Activity 1.9
Workplace English Language and Literacy Program
Language, Literacy and Numeracy Program
Activity 1.9
Access the websites for these Programs and familiarize yourself with the key features of the programs:


Summarise the purpose and focus of one of the programs.
Summarise the eligibility of candidates for this training programs
.
D:\106755531.doc
Page 32 of 80
Design a pre-training assessment kit
Note that it is assumed that you will have a working knowledge/expertise to enable you to use Australian Core
Skills Framework and/or International Second Language Proficiency Ratings (ISLPR®) as the benchmarking
measurement tools to design your pre- assessment kit.
Reading 1 for Activity 1.10 Pre-training assessment kit for CESOL TAFENSW
Cipollone, J. Sample Placement Test - See Appendix.
This Sample Placement Test is designed to assess the language skills of learners for placement in accredited
English language courses at Certificate 1 and 11. The courses are benchmarked to the ISLPR.
Reading 2 for Activity 1.10
Learner profile: MARY
Mary is a 32-year old migrant from Sudan; she has been in Australia for 18 months. She has four children and is
pregnant with number 5. If she comes to class, the government will pay for the childcare for her children; she
likes the idea of having a break from looking after them. She seems friendly and outgoing. Her oral skills are
much stronger than her other skills. She has a job cleaning for three hours once a fortnight. She had very little
education in Sudan and so is unable to read or write in either English or her first language. There is a strong
Sudanese community at the local church which Mary attends and many of them also attend classes at the
regional TAFE.
Mary struggled with the reading task of matching key words to symbols, eg police. She copied her name and
address from her Centrelink card however, her script is ungainly and she does not have a good control of a pen.
She was unable to complete any writing without highly supportive modelling. Her poor reading skills also inhibit
her maths and numeracy although she can complete some maths tasks when using hands-on material. This
includes simple fractions and division with counters or lollies.
Throughout the assessment Mary needed much encouragement and support to complete reading, writing and
numeracy tasks. She is not able to identify any particular goals that she would like to achieve in her education.
She would prefer to be in a class with some of her friends. Due to her other commitments she feels she would
only be able to attend a couple of times per week, for a few hours at a time.
Initial assessment:
Reading
Not yet achieved ACSF 1
Writing
Not yet achieved ACSF 1
Numeracy
ACSF 1
Oral Communication
ACSF 3
Learning Strategies
ACSF 1
Include later – Mary is easily distracted in class; she often comes late and likes to have long breaks to talk to
other students. Classes are more important to Mary as a social outlet and something to do rather than be at
D:\106755531.doc
Page 33 of 80
home with her small children. She has made little progress in the six months she has been in class; in part
because she will not take any risks, i.e., will not write a word unless someone tells her how to do it.
Activity 1.10







What context of provision is the focus of this pre-training assessment resource?
What accredited training is referred to?
Who are the target students?
How is the ISLPR used as a framework for the pre-training assessment resource?
How do the placement options influence the design of the pre-training assessment kit?
What rationale informs the design the materials?
Would the tasks and texts be suitable to assess Mary in a range of Vet Training contexts? Give
reasons.
Reading for Activity 1.11 Precision Consultancy Resource: ACSF assessment
tasks
Precision Consultancy
Activity 1.11
The assessment kit design by Precision Consultancy has been developed for use in the workplace English
language and literacy context. It uses the ACSF as the organizing framework for the benchmarking of the
resources and tasks. Explore the ACSF assessment kit provided in the Precision Assessment Resource.

Describe briefly the background to the development of this resource and its intended use

Describe the context of your own LLN workplace or the practice environment in which you intend to
conduct pre-training assessment of adult LLN. How relevant is this resource to your situation?

Choose an assessment task from the Precision ACSF bank of assessment tasks to address one of the
Core Macro skills. Critically review the task to determine its suitability to assess a learner in the context
you have nominated

Adapt the task to make it suitable to assess the learner

Design an alternative task contextualised to a learner of your choosing.
Reconsider the learner profile for Mary in Activity 1.14

Select the most suitable tasks from the bank of tasks and materials in the Precision materials that you
would have chosen to assess Mary’s LLN skills.

How would you adapt the interview form to include questions to elicit information on Mary’s educational
history and issues that may affect her learning?
D:\106755531.doc
Page 34 of 80


Which sample questions would you use to:
- assess oral communication
- identify learning strategies or styles
- identify the candidate’s purpose in attending assessment
What modifications, if any would you make? Give reasons.

Are any of the numeracy tasks suitable to assess Mary’s numeracy skills? Can you suggest alternative
texts and tasks?

Which reading samples would be most familiar to the candidate, and drawn from the candidate’s
immediate, social or training environment? Suggest an alternative text and task?

Which writing tasks and associated materials would you use to assess Mary’s reading proficiency? Give
your reasons.
Activity 1.12
Apply your understanding of relevant assessment frameworks / benchmarking tools and the range of contexts of
LLN provision in VET to outline the processes you would follow to design a pre-assessment kit? Use the
research you have conducted to specify and describe the training context and learner profile.
In your outline make reference to how you would align your materials to the ACSF or ISLPR. Describe the
processes you would follow to:








select and/or adapt existing model assessment kits and resources or develop your own assessment tool kit
develop interview and/or self-assessment questions to elicit information on learner’s background and issues
that may have affected learning?
develop and/or adapt available resources and materials to assess reading and writing skills
develop and/or adapt available resources and materials to assess oral communication skills
develop and/or adapt available resources and materials to identify learning strategies or styles
develop and/or adapt available resources and materials to identify the candidate’s purposes in attending
assessment
submit your pre-assessment kit as part of your major assessment task
develop and/or adapt available resources and materials to assess numeracy
Note: the ISLPR does not address numeracy skills. You will need to use an alternative measurement scale
for this macroskill
Note: Additional models of Pre-Training and diagnostic assessment of adult LLN skills include:

English Language and Literacy Assessment Kit (ELLA) 2010, Adult Migrant Education
Service http://www.ames.edu.au/content/publicationitem.aspx?pid=191&pcid=1
This language assessment kit provides comprehensive initial assessment tasks for assessing
the language skills of learners for placement in the Certificate in Spoken and Written English.
The tasks are mapped to the ISLPR. An introductory guide to assessors is a useful introduction
to the initial assessment process.

Guidance for Assessment and Learning, Quality Improvement Agency, Britain.
www.sflip.excellencegateway.org.uk/assessmentguidance
D:\106755531.doc
Page 35 of 80
Preparing for the Pre-training Assessment Interview - LOCATION
Reading for Activity 1.13
Preparing for the interview
The following information has been derived from knowledge of stand alone LLN provision in formal and non
formal contexts. Participants familiar with other training contexts may wish to compare this information with
processes appropriate to their workplace.
Times
Initial assessment interviews vary greatly according to the variables of the assessment context. Many LLN
teachers such as those involved in the LLNP program report interview times as being up to an hour, whereas
other placement contexts, for example where a worker is known and their needs are specific to particular
training, may involve significantly less time.
It can be a useful point of contact for the assessor to confirm the time for the interview with the learner. It
provides the assessor with an opportunity to personally explain the assessment process to learners who may be
feeling some anxiety about what will be required of them. Often appointments are made through provider
administration, and although it is not always possible for the assessor to make contact with the learner before the
interview; in this case it is important for the assessor to have good communication with the liaison / administrative
officer who will perform this role.
The interview space
The interview area should be set up in advance of the learners’ arrival. It is important that this space:

Be welcoming and non-threatening. This may be the learner’s first step into learning after many years
absence and entering LLN premises may evoke negative memories about past learning or anxiety
about future learning. The interview space can send a message to learners confirming or challenging
these negative feelings. It is not easy to be prescriptive about this space: having knowledge of your
client/learner groups will help you select and arrange this space appropriately. The some cultural groups
may find entering a large multi storey building, or a building with an institutional feel, an intimidating
experience. Selecting a space which is not too “buried” architecturally, has external windows, and is
close to external exits can be important. For some learners, it may be more appropriate to conduct at
least the preliminary part of the interview in an environment which is more familiar to them

Allow for learners’ right to privacy and confidentiality to be maintained. When larger providers have
intake days involving many learners and assessors, initial interviews are sometimes conducted in larger
areas allowing for several interviews to be conducted at the same time. Care needs to be taken to give
each learner enough personal space for their conversation not to be easily overheard by others.
Learners should feel that their conversation is just between the assessor and themselves. It is rare to be
able to have a permanent, dedicated interview space, so assessors should make sure that for the time
of the interview they will not be interrupted by other users of the room.

Be easily accessible. LLN sites make provision for access of learners’ with disabilities, for example,
those with mobility issues. This need should be kept in mind when selecting a particular interview
space. It’s also important to consider cultural accessibility, such as provision for prayer space.
Directions explaining where the interview is to be held need to be clear and user friendly. For example
finding ‘Building F, Room 221’ is a literacy task in itself. Assessors may need to arrange to meet the
learner in the reception area, and walk through to the interview space together.
D:\106755531.doc
Page 36 of 80

Makes the learner feel that they are the focus of the interview experience. A telephone in the room can
be useful for getting further necessary details on the spot e.g. contacting Centrelink or the employer, but
care needs to be taken not to make the learner feel like the third party in the process. Having the phone
ring during the interview can be very distracting to both the learner and the assessor and should be
avoided.

Complies with the OH&S, Equity and Access, Anti discrimination requirements and the AQTF standards
Facilitator Guide to the Four Core Units The Advanced Diploma LLN Practice in VET, 2007.
Handouts and Resources, DEST.
Activity 1.13
Review this information in the light of your own experience of LLN assessment/delivery. What could be added to,
altered, or deleted to make this a better resource sheet for assessors setting up an interview space?
Draw on your own workplace experience as well as interviewing another participant or experienced LLN
assessor about the provision of interview space at their workplace. Respond to the following questions.

To what extent could the interview space used to assess learners affect the initial interview process?

How are processes influenced by the nature of the learners, the provision offered, notions of literacy?
What are the strengths and weaknesses of the placement processes with specific reference to interview
space?

Compare your findings with those of others. Discuss the variations and similarities in assessment
processes and modes of assessment.
Write a summary of your findings and include a paragraph noting comparison with at least one other provider.
(word length at discretion of facilitator – 400 words approx)
References
‘Appendix One: Adult English language, literacy and numeracy provision in VET, 2003’, in Department of Further
Education, Employment, Science and Technology (SA) 2005, Advanced Diploma of Language, Literacy and
Numeracy Practice In VET, Department of Further Education, Employment, Science and Technology, Adelaide.
Banta, T.W.,2002. Building a scholarship of assessment. Jossey Bass Press, San Francisco.
Booth, R., Clayton, B., House, R., & Roy, S. 2002, Maximising confidence in assessment decision-making:
Resource kit for assessors, Report, NCVAC
Dymock, D. 2007 Community adult LLN provision in Australia: diverse approaches and outcomes.
www.ncver.edu.au/publications/1796.html
Ecclestone,K. 1994. Understanding assessment. National Institute of Adult Continuing Education, Leicester,
D:\106755531.doc
Page 37 of 80
England
English Language and Literacy Assessment (ELLA) Kit, 2010. Adult Migrant English Program. Surry Hills NSW.
http://www.ames.edu.au/content/publicationitem.aspx?pid=191&pcid=1
Facilitator Guide to the Four Core Units The Advanced Diploma LLN Practice in VET, 2007. Handouts
and Resources ,DEST.
Falk and Millar, 2001, Review of research: literacy and numeracy in vocational education and training, NCVER,
Review of research: literacy and numeracy in vocational education and training See Policy, practice and
research in VET p 28-52
Ministry of Education and Training Ontario. 1997. Goal Directed Assessment : An Initial Assessment Process.
Toronto.
Jay, D 2004. Making the grade ; assessment in adult literacy, numeracy and language testing, NIACE
Literacynet http://www.deewr.gov.au/SKILLS/PROGRAMS/LITANDNUM/LITERACYNET/Pages/default.aspx
Lonsdale, M and Mc Curry D, 2004, Literacy in the New Millennium, NCVER
www.ncver.edu.au/publications/1490.html
Mc Kenna NSW AMES, 2010. NCVER 2011, Discussion Paper: Building the foundations: Outcomes from the
adult language, literacy and Numeracy Conference. http://www.ncver.edu.au/publications/2345
NCVER 2006, Australian vocational education and training statistics: Adult literacy and numeracy courses 200204, NCVER, Adelaide. www.ncver.edu.au/publications/1697.html
Rowntree, D., (1991). Assessing Students: How shall we know them? New York, Nichols
Santopietro,K and J. Kreeft-Peyton, 1991. Assessing the literacy needs of adult learners of ESL. ERIC Digest.
Watts, M, (1996). How Do Power Relationships, Within an Adult Literacy Initial Assessment for CES Referred
Clients, Influence the Assessment Discourse? http://www.ncver.edu.au
Wignell, L & Oldfield, J, 2006, VETASSESS, Address language, literacy and numeracy within learning and
assessment practice. TAALLN401A, Learner Guide, Commonwealth of Australia
D:\106755531.doc
Page 38 of 80
Topic 2 Conduct the assessment
Topic Overview
This topic focuses on conducting pre-training LLN assessment. Learners will apply the knowledge of assessment
frameworks and use the LLN pre-training assessment kit developed as part of requirements of Topic 1.
Placement in LLN courses generally relies on an assessment interview process. In reality, some training contexts
do not allow for thorough initial assessments and interviews; however, all assessors need to be able to enact
effective initial placement processes and to draw on interview skills when required.
This Topic has six sections






Clarify the assessment process with the candidate – context and purpose
Note and record the conditions of the assessment
Tailor assessment processes to meet individual needs of the candidate and assessor
Select and use questioning and self-assessment strategies to assess oral communication and learning.
Select and use questioning and self-assessment strategies to assess reading and writing
Select and use a range of numeracy tasks for assessment purposes
Clarify the assessment process with the candidate – context and purpose
Considered preparation is required to conduct effective assessment interviews. Assessors must effectively
manage the stages of the interview to respond to the needs of the candidate and to elicit evidence to assess LLN
skills.
Power and the perception of who has power is part of the subtext of the assessment interview process. It is
essential for assessors to consider the social dynamics of the learner /assessor relationship and how the nature
of the dialogue may foster positive interaction. This will not only involve responding sensitively to the needs of
the candidate but also ensuring that the rights of the candidate are protected. It is a requirement of assessors
that they follow confidentiality conventions and inform candidates about the nature/extent of information which
may be disclosed to third parties such as employers, government agencies and RTOs.
The assessor is also required to ensure that candidates are given support as required. The assessment
interview is an opportunity to provide meaningful feedback with options for the candidate’s consideration.
Assessment processes should focus on identifying achievements in responses to assessment tasks as well as
diagnosing areas that require training. Emphasis should be placed on what learners can do in relation to their
goals and the requirements of the course/ training. Gaps will be identified and a range of training plan discussed.
Note and record the conditions of the assessment
During the assessment process, the assessor will need to make careful record of the conditions of assessment.
Conditions of assessment include a range of factors that influence the performance of the candidate in
demonstrating their LLN skills. They include factors such as the degree and nature of support available, the
familiarity with the context, and the complexity of texts.
Sensitivity to learners’ needs and adopting strategies to make the assessment a positive experience will require
the assessor to be flexible and responsive in the administering of tasks. This process needs to be documented in
order to provide accurate data in order to analyse the candidate’s performance and skills.
D:\106755531.doc
Page 39 of 80
Tailor assessment processes to meet individual needs of the candidate and assessor
Learners will have differences in communication styles, preferences and levels of confidence. The assessor will
need to allow sufficient time and adapt to the pace required by candidate to complete tasks and respond. It is
essential to select materials at appropriate level that are relevant to the learner’s experience. Culturally
appropriate processes are needed when assessing candidates. Assessors face challenges in responding to
these needs. There are constraints of time and resources that the assessor must negotiate.
Self assessment
Adult learners have a great capacity to reflect on their own strengths and needs in LLN. Much of the interview is
devoted to supporting LLN learners self identify their LLN usage and goals.
Assessors need to guide learners through this process with skilled and sensitive questioning. It is essential that
learners complete the interview with an enhanced understanding of themselves as LLN learners. Assessors can
use this information to guide their selection of LLN assessment tasks and to give the learner further support in
refining their training and vocational needs.
Select and use questioning and self-assessment strategies to assess oral communication and
learning.
Language literacy and numeracy are interrelated skills and assessment of these skills should be integrated and
grounded within learners LLN practices and personal circumstances. Understanding the learner as an individual
is important to LLN placement.
Learners’ needs, goals and background give meaning to the identification of LLN levels and authenticity to the
assessment process. Assessment of oral communication skills can take place as the discussion of the learners
background, needs and goals unfolds and this discussion can help assessors select appropriate reading, writing
and numeracy tasks.
Pre-training assessment of spoken English of people from language backgrounds other than English is more
appropriately assessed using the International Second Language Proficiency Rating Scale (ISLPR). This
benchmarking tool is used as the assessment framework in National and State adult English language curricula.
The Australian Core Skills Framework (ACSF) is also used to assess language skills of people from language
backgrounds other than English as well as native speakers in a wide range of VET contexts. However it is
essential to be aware that the ISLPR more accurately describes language proficiency levels of learners from
Language backgrounds other than English.
Select and use questioning and self-assessment strategies to assess reading and writing
LLN measurement scales use the organising principle of text complexity to differentiate skills. The ACSF and the
ISLPR list the level of difficulty of texts and reading/writing tasks. Current principles of language and literacy
focus on whole texts that fulfil real purposes in relevant contexts. Assessors select and use an appropriate range
of contextualised reading and writing tasks. Reading and writing processes are underpinned by a range of
identifiable strategies. These strategies must also be assessed.
Select and use a range of numeracy tasks for assessment purposes
Numeracy tasks selected for assessment purposes should also reflect the range of strategies and knowledge
reflected in the ACSF measurement scale.
D:\106755531.doc
Page 40 of 80
Topic 2 Readings and Activities
Work your way through the following readings and activities.
Reading 1 for Activity 2.1 Interview practices and assessment
The placement interview ideally:

Puts the learner at the centre of the interview process so that their learning needs can be understood in
a holistic way. Personal history, present circumstances, experience of learning, attitudes to learning can
be identified.

Allows for contextualization of assessment to the needs of the learner and for integrated assessment of
LLN performance.

Is flexible and allows the assessor to move between semi formal and non formal modes of assessment
as appropriate to the situation.

Enables the assessor to select the assessment tools to allow for the most accurate assessment of the
LLN needs of the individual.

Allows for confidentiality and privacy to be maintained.

Enables learners to be an active part of the assessment process by providing them with the opportunity
to participate in self assessment, to question aspects of the assessment and to clarify their own and the
assessors understanding.

Gives learners and assessors the opportunity to establish a sense of trust and initiate a positive learning
partnership which learners can carry into placement in an LLN course.
Reading 2 for Activity 2.1 Non formal, semi formal and formal assessment and
interview practices
Note: The following notes have been adapted from the work of Wignell and Oldfield, McKenna and Watts. See
references for this section.
The interview is a medium through which a range of assessment modes can be expressed. The three modes
described here are not mutually exclusive, and assessors may use the three modes within the one interview.
Much of the material here about semi formal assessment relates to section A2.1 Using assessment frameworks,
but is included here because it is relevant to understanding interview processes.
Non formal assessment
‘During the initial stages the informal mode consists of talking with the client in a participatory role to discover the
social contexts that are important to the client. Through discussion , it is possible to clarify with the client his/her
reading habits, uses of writing, uses of numeracy through shopping budgeting gardening etc., educational
background, interests, fears of failure in front of a group, situation at home which may impact on training, etc’.
Watts, 1996 (p10)
D:\106755531.doc
Page 41 of 80
The term ‘non formal’ is used to describe assessment that does not rely on a formal test. Unlike its everyday
meaning, in a language literacy and numeracy setting, this term does not imply a casual or ad hoc approach.
Non formal assessment demands a high degree of professionalism from the assessor because it places the onus
for the successful unfolding of the rest of the interview on the assessor’s judgement. Through a one to one
interview process, the assessor draws on a range of varied assessment tools, modes and strategies to complete
a holistic picture of learners. The interview process allows information from one skill area to be related to other
skills and experiences of the learner. Connections between past experiences, present needs and future goals
can be made. Non formal assessment allows a picture of the learners as individuals to emerge, and sees their
literacy needs within the context of their own history, circumstances, beliefs and goals. Non formal assessment
techniques provide the stem from which more formal assessment may be undertaken and from which successful
placement is achieved.
Through the interview process, non formal assessment can integrate a wide variety of information gathering
modes. These may include:





Observation
Dialogue
Learner self assessment .This may be prompted through oral questioning, check lists
Selected assessment tasks as appropriate to the learner and other factors of the assessment context.
See semi formal assessment (below)
It is flexible and can integrate information gained from formal assessment if required
‘The informal discussion process enables me to obtain mental checklists of tasks that would be appropriate to
attempt during the more formal skills sampling stage. The client is then presented with tasks to choose to read
write or problem solve and if the first, informal stage of assessment has been successful it will be possible for the
client to complete almost all of the tasks so that he/she feels successful.’
Semi-formal assessment
This refers to the process of learners engaging in a range of LLN tasks which allow evidence of skill levels or
performance to be identified in relation to a given set of performance standards, such as an assessment
framework.
Evidence is gathered which identifies what learners can do and then links this to specific criteria which define
levels of performance. The way evidence is collected, and the evidence itself, can be customised to be
contextually and culturally appropriate to specific learners and their needs. Learner’s language, literacy and
numeracy skills can be identified by taking into account their particular needs and circumstances, and reported in
a consistent and systematic way
Semi formal assessment allows for both flexibility in evidence gathering, and reliability in measuring and
reporting performance through the use of a recognised performance framework. Learners, teachers, assessors
and employers can gain a mutual understanding of learners achievements and needs through the sharing of a
common set of performance standards. Because this process focuses on what a learner can do, the experience
can foster a positive sense of learner identity.
To locate learner performance in this way, the assessor will need to:

Select tasks carefully, based on information gained from the initial stages of the interview. Tasks which
are below the learners’ level of development may be demeaning to a learner and not reveal the
learners’ true level of performance. Conversely, tasks beyond the learners’ capacity will be discouraging
and will only show what the learner cannot do.
D:\106755531.doc
Page 42 of 80

Tasks should allow the learner to demonstrate their skills to their “ceiling” level of performance. This
does not mean starting at a very low level of LLN and moving steadily forward until the ceiling is
reached. The ideal starting point is a task which shows what learners can comfortably do, and which
then moves them a little beyond that.

Allow support to the learner to complete the task if it is required. The level of support required then
becomes useful information in locating the learners’ level of performance. For example, a writing task
may be to complete an enrolment form writing down name and address. Some learners may complete
this task copying down their name and address from their healthcare card. This should be noted by the
assessor and used to help locate the learner’s writing levels.

Observation of the way the learner completes the task. For example the time taken the amount of
clarification required, the degree of care and confidence applied to the task.

Select tasks which are culturally and contextually accessible to the learner.

Confidently locating performance from the evidence provided by the tasks. To do this the assessor
needs to understand the performance levels and the underpinning learning outcomes/ performance
criteria as they are expressed sequentially in the chosen assessment framework/ competency based
curriculum / reporting system
Formal assessment
Formal assessment refers to the application of professionally constructed commercially available literacy and
numeracy tests such as those which are sometimes used to establish levels of performance in school education.
Other formal tests are used as screening devices for particular cohorts of learners such as language learners
seeking to study or gain employment status in Australia. They are usually not appropriate for direct use in LLN
initial assessment, especially for learners at the lower level of performance. Because they are designed to apply
to large groups, they do not allow for the contextualization of performance, nor in themselves do they enable the
integrated holistic assessment so crucial to the LLN initial assessment interview. Learners at all levels can find
them confronting and their use could undermine the assessment process.
Adapting formal tests
In some circumstances formal tests may be adapted to the needs of particular courses. For example, some VET
courses may have particular LLN entry requirements and a formal test may be developed expressly to select or
exclude learners from a pool of applicants. Such a test needs professional input from test development
specialists and those who understand the particular LLN requirements of the course.
Facilitator Guide to the Four Core Units The Advanced Diploma LLN Practice in VET, 2007.
Handouts and Resources,DEST.
D:\106755531.doc
Page 43 of 80
Reading 3 for Activity 2.1 Stages in the interview process
The first guideline for good practice in the initial interview is to remember that the process must remain flexible
and develop according to the contexts in which learners and assessors operate.
The initial interview process can be broken into several stages which reflect a range of purposes and provide
scaffolding for assessors’ engagement in good practice. The stages are fluid and may need to be revisited as the
interview progresses.
The focus stages of the interview are:


Support learner’s immediate confidence and ease anxiety they may experience
Establish connection and rapport
Exchange of basic information
 Give learners some broad information about the learning programs and provision offered
Comfort and connection – setting the tone
 Confirm the identity of the learner and gather basic personal details
 Describe what will happen in the interview process and answer any questions
 Explain the confidential nature of the assessment and interview
 Through these exchanges begin to gather evidence about the LLN skills of the learner and their
approach to learning
Understand the learner’s LLN contexts
 Explore the learner’s goals in regard to LLN – short and long term
 Gather information about the LLN history of the learner
 Gather further information about the learner’s approach to learning
 Establish possible barriers to learning
 Use this information to provide evidence of performance in listening, speaking and learning
 Use this information to predict broad LLN levels in reading, writing and numeracy
Gather further evidence to establish LLN levels
 Select LLN tasks based on predictive information and knowledge of learner’s LLN contexts
 Use a bank of materials ranging from simple to complex
 Check with the learner that these tasks are appropriate. Make sure the learner understands the
reason for the assessment and the purpose of the task.
 Provide support to the learner as appropriate
 Record conditions of assessment
 Allow learners time and space to complete the task, monitoring progress as appropriate
Identify learners’ performance in specific LLN areas
 Analyse responses to the assessment tasks
 Identify levels of performance using an assessment framework
 Discuss assessment task responses with the learners in relation to LLN achievements and
needs
D:\106755531.doc
Page 44 of 80
Recommend Placement



Review the learner’s goals
Wok with the learner to negoatiate a training plan
Recommend an initial placement to enact the plan
Collect recorded data for reporting to other relevant stakeholders
Facilitator Guide to the Four Core Units The Advanced Diploma LLN Practice in VET, 2007.
Handouts and Resources,DEST.
Activity 2.1
Summarise the range of assessment processes listed in the preceding readings.
What is the role of the interview in relation to assessment practices?




Are there situations where an interview would not be appropriate?
Could all these assessment practices be integrated into the interview process?
What could be added to this list of assessment practices?
What is the role of non-formal, semiformal and formal assessment practices in an area of
provision that you are familiar with?
Reading for Activity 2.2 Power Relationships Within an Adult Literacy Interview
Watts M, 1996). How Do Power Relationships, Within an Adult Literacy Initial Assessment for CES Referred
Clients, Influence the Assessment Discourse?
Falk I, and Penson M, (1996). Literacy, Adults and Diversity, Literacy and Learning Series, No 1, National
Languages and Literacy Institute of Australia (Available from VOCED Plus, NCVER, www.voced.edu.au)
Activity 2.2









What are the rights of the candidate at interview?
What essential information/explanation should be communicated to the candidate before commencing
the interview?
Outline ways that you would clarify the assessment process with the candidate – its context and
purpose.
How would you reassure the candidate about confidentiality conventions and the nature and extent of
information which may be disclosed to third parties?
How will you provide feedback to the candidate during and after the interview?
Consult the policy and/or guidelines for placement into an LLN program you have researched. What
communication support is available to candidates? These may include interlocutors/support people.
Candidates may also be able to use translators and calculators during assessment.
How would you ensure that these supports were available if required?
What are the implications of having a support person/interpreter at the initial interview?
Write brief notes on these issues in preparation for your major assignment.
D:\106755531.doc
Page 45 of 80
Reading 1 for Activity 2.3 Factors in an adult learner’s background that may affect
learning
EDUCATION BACKGROUND
Literacy, numeracy and ESL classes include learners with no formal school through to those with tertiary
education.
Literacy learners traditionally have had negative experiences in secondary schools; they may have had
interrupted schooling or were early school leavers. Many of them were alienated by the school system, so it is
important to make their adult learning a positive experience. Some learners may be well educated but have
specific needs to enable them to move on in their career, or have problems due to an accident or stroke.
Numeracy learners may come from a wide range of educational backgrounds. They may have had negative
school experiences, they may be ESL learners whose main problem is the language of maths or they may also
be tertiary educated with qualifications in the arts area, but with poor numeracy skills. Obviously putting learners
from this variety of backgrounds into one class puts extra demands on a teacher/trainer.
ESL learners also come from a wide variety of education backgrounds. They may have had no formal schooling,
but they may also be tertiary educated, or anywhere in between. This variety has implications in the classroom.
Learners with more education in their first language often progress rapidly, so this has implications for
administration and classroom management.
PERSONAL/FAMILY CIRCUMSTANCES
This group of issues is very broad, it covers everyday issues such as childcare and other family responsibilities,
financial issues and other life events. If any of these are causing the learner a problem then they are likely to
interfere with their learning.
More traumatic events such as a death in the family, drug/alcohol/sexual abuse, time in a refugee camp or
migrating from a country at war would all have profound effects on a learner. These learners need to be treated
with understanding. Often the most important thing that a teacher/trainer can do is to provide a stable positive
learning environment for the learner to come to terms with the events in their past.
AGE
Literacy and ESL learners include people from their teens through to aged pensioners. The teenagers are often
those who have had negative experiences in traditional secondary schools, this may be because of their poor
English skills, social or family issues or learning difficulties.
Mature age learners are likely to have more time to devote to their study and have often made a determined
effort to return to study. They are often dedicated learners but they may struggle with learning new concepts or
an unstructured classroom, which may be very different from their school experiences.
GENDER
Male and female learners face different challenges in society and in literacy education this can manifest itself in a
range of ways. For example, women with children are more likely to have to take time off if the children are sick
and some non-English speaking background women may come from cultures where education for women is not
valued.
The data from the International Adult Literacy Survey tells us that men and women are likely to be better at
reading different text types.
D:\106755531.doc
Page 46 of 80
CULTURE, ETHNICITY and RELIGION
An understanding of other cultures and a sensitivity to these issues may enhance the learning process by
fostering a positive attitude in the learner (Willing, 1988). Issues such as dress code, religious events, female or
male teachers/trainers, responsibility for family and previous classroom experience, may all impact on a learner’s
ability to attend class, to concentrate, to complete homework and to participate in activities. Craig (2001)
suggests that language and culture as intermeshed so where learners are from a language other than English
background it is important for the teacher/trainer to address the issue of culture in the practices of the classroom.
This may be as simple as acknowledging that different cultural or ethnic groups may value different text types
and writing styles.
ABILITY AND INTELLIGENCE
Everyone learns at different rates and in different ways and it is very difficult to separate innate ability from
environmental factors. McCormack and Pancini (1990) suggest that teachers “need to debunk the idea that
intelligence is a fixed attribute of a person”. They argue that “intelligence is an attribute of actions, not of people;
therefore its primary use is as an adverb – “intelligently”” and that you can do things stupidly or intelligently. They
do recognise, however, that ability may be influenced by biological factors such as a learning disorder, memory
loss, short term memory problem and suggest ways to work around these problems.
In relation to second language learning Lightbown & Spada (1999) have found that it seems that intelligence is
important in learning language analysis and rules, while it is less important when “instruction focuses more on
communication and interaction” (p53).
DISABILITIES
There are many different disabilities that may affect a learner, the main ones being visual, hearing physical,
mental, intellectual and learning disabilities. The disabilities may be congenital or they have been acquired as a
result of an accident, illness or drug abuse. All these learners should be treated, as much as possible, the same
as any other learners. It is important for a teacher/trainer to have some understanding of the disability and issues
that may arise to assist the learner to attain their full potential.






Visual impairment can be assisted with a wide variety of aids from guide dogs to computers which
enlarge text or software which provides an audible reading of the text on the screen. White boards can
be adapted so that information on a white board can be seen enlarged on a learner’s computer.
Hearing impairment may be accommodated as simply as the learner sitting in a specific place in the
classroom, or the teacher/trainer facing the learner when speaking. Other electronic aids can also be
used.
Physical disabilities can be accommodated by having lifts, ramps, wide doorways and computers and
other electronic aids.
Mental health issues – it is important for a teacher/trainer to understand learner’s mental health issues
so there is no undue pressure put on the learner.
Intellectual disabilities – all learners should be encouraged to reach their full potential, but it is also
important not to ask a learner to engage with tasks that they are not able to do. Many of these learners
have had a history of failure and it is important not to repeat this.
Learning disabilities can often be accommodated by different means such as using a calculator or other
technologies. Some disabilities will come with labels such as ADHD or dyslexia, but all learners will
require the teacher/trainer to have patience and understanding.
Facilitator Guide to the Four Core Units The Advanced Diploma LLN Practice in VET, 2007.
Handouts and Resources, DEST.
D:\106755531.doc
Page 47 of 80
Reading 2 for Activity 2.3 The socioeconomic context of LLN provision
Dropping off The Edge: the Distribution of Disadvantage in Australia, by Tony Vinson
http://www.australiandisadvantage.org.au
The Vinson Report presents evidence that demonstrates that there are pockets of extreme disadvantage in
Australia, tied to place or region. He recommends a concerted, strategic and targeted approach by all
governments and services to address the causes of social disadvantage in particular communities, as a matter of
priority.
Reading 3 for Activity 2.3 Adult learning styles
Learning styles can be described in many different ways, one of the simplest suggests that each learner has a
preferred learning style which is either visual, auditory or kinaesthetic. These styles relate to how a learner best
takes in information. No-one uses one of the styles exclusively, but most have a preferred style. If you are aware
of your preferred learning style, it is thought that you can enhance the other (non-preferred) styles to your
advantage. It is also useful, as a teacher/trainer, to be aware that learners do learn in different ways that we
need to cater for a variety of learning styles.
Visual Learners
Visual learners relate most effectively to written information, notes, diagrams and pictures. Typically they will be
unhappy with a presentation where they are unable to take detailed notes -to an extent, information does not
exist for visual learners unless it has been seen written down. This is why some visual learners will take notes
even when they have printed course notes on the desk in front of them. Visual learners will tend to be most
effective in written communication, symbol manipulation etc.
Visual learners make up around 65% of the population.
Auditory Learners
Auditory learners relate most effectively to the spoken word. They will tend to listen to a lecture, and then take
notes afterwards, or rely on printed notes. Often information written down will have little meaning until it has been
heard -it may help auditory learners to read written information aloud. Auditory learners may be sophisticated
speakers, and may specialise effectively in subjects like law or politics.
Auditory learners make up about 30% of the population.
Kinaesthetic Learners
Kinaesthetic Learners learn effectively through touch and movement and space, and learn skills by imitation and
practice. Information is normally not presented in a manner that suits their learning style and as a result these
learners may be perceived as having a learning disability. Kinaesthetic learners make up around 5% of the
population.
Facilitator Guide to the Four Core Units The Advanced Diploma LLN Practice in VET, 2007
Handouts and Resources, DEST.
D:\106755531.doc
Page 48 of 80
Reading 4 for Activity 2.3
Smith, Peter, J. & Dalton, Jennifer. (2005) Getting to grips with learning styles. http://www.ncver.edu.au
Activity 2.3
1. Write a summary report in response to the following issues and questions.



Which factors such as age, gender, culture, and ethnicity may create barriers, shape preferences and
influence goals and pathways for learners?
Why is it important to consider an individual's learning styles and preferences in relation to placement?
Discuss, drawing on your own experience as appropriate.
2. Based on you reading of the Vinson report: Dropping off The Edge: the Distribution of Disadvantage in
Australia, summarise socioeconomic factors in your local area that may have an impact on learners and create
barriers to achievement of their goals?
3. Identify and interview a learner you have encountered in your workplace or placement environment:






Describe the background of the learner.
What information can be identified about the student’s learning styles and strategies?
What barriers to learning could be identified?
How might this information influence your selection tasks for assessment of the student’s language,
literacy and numeracy?
How might this information influence placement?
What issues influence placement for the learner you have selected?
Use the bullet points above to write up your discussion of these learners
Keep your notes as a reference for use in the next topics of this unit.
Reading for activity 2.4
Literacy support for Indigenous VET students: good practice guide www.ncver.edu.au/publications/1714.html
Activity 2.4
Based on your reading, what factors would you take into consideration when preparing to for initial assessment
of LLN skills of indigenous learners/
D:\106755531.doc
Page 49 of 80
Conditions of Assessment
Reading for Activity 2.5
Precision Consultancy Resource ACSF Assessment Tasks User Guide (Precision Consultancy ) p. 7-8
This resource assumes that those who use it have a sound understanding of the ACSF document and of the
levels of performance indicated at each level, for each core skill. But users should always remember the factors
that may influence a person’s performance at each level (in each core skill). These are:

the degree and nature of support available

the familiarity with the context

the complexity of text

the complexity of the task.
The level of skill demonstrated by a candidate can be changed by any of these factors. For example, if significant
support is given to a candidate completing a level 3 task, the outcome of the assessment could be that the
candidate is at exit level 2.
Activity 2.5
How does your definition of ‘assessment conditions’ relate to the terminology used in the ACSF: ‘support’ and
‘context’.
Consider ways in which support given to the candidate will affect their performance during the assessment. How
will you indicate the level of support that has been given?
What other conditions will affect candidate performance?
Activity 2.6
Predicting appropriate assessment tasks.
Reliable initial assessment does not mean that assessors need to progress through all the levels until
performance ceiling is reached. This would be tedious, time consuming and a negative experience for both the
assessor and the learner. Experienced assessors usually can predict an appropriate starting point for
assessment tasks.
What strategies could you use to predict an appropriate level to begin the assessment?
D:\106755531.doc
Page 50 of 80
Assessing the oral communication skills of language learners
Resource for Activity 2.7:
Check One, Two - Using the National reporting System (NRS) to assess the spoken English of people from
language backgrounds other than English, 2002, Access Division, TAFE NSW, Summerhill Media, DEST,
Commonwealth of Australia.
Note: Although the ACSF has replaced the NRS, the pre-training samples of assessment tasks and interview
techniques used in this resource provide excellent models of ways to interview learners from language
backgrounds other than English.
Activity 2.7



View the DVD and/or read the dialogue transcript: Interview with Jenny in Check One, Two.
What issues are revealed in this interview process?
Evaluate the strengths of the interviewer?
Supporting Self assessment
Reading 1 for Activity 2.8
Precision Tools Self assessment -There are a number of checklists available to prompt learners in locating their
strengths and needs Precision Consultancy
Activity 2.8
Checklists can be useful as a prompt to guide both learners and assessors in the self assessment process but
do not replace the careful interaction between the assessor and learner.





What are the advantages and disadvantages of presenting self assessment in check list format?
In which assessment contexts would written checklists be extremely useful? How could they be
developed?
Consider an assessment context that you have some knowledge of
Would a formal self assessment checklist be appropriate? Why/ why not?
If a formal checklist is appropriate, construct your own for the context you identified, If not, what
strategies would you utilise to support self assessment? Describe processes. Make notes about
your approach.
Select appropriate tasks from the assessment kit that you developed for Topic 1 to assess reading, writing and
numeracy. Give reasons for your choice. Include the results in your major assignment.
D:\106755531.doc
Page 51 of 80
Reading for Activity 2.9
That first interview – literacy assessment, mutual obligation and performativity
Excerpts from Fine Print Article by Pauline O’Maley (2003)
This article looks critically at the impact that government programs such as the LLNP have on notions of literacy,
adult learning and assessment practices at initial interview. Participants are encouraged to access and read the
entire article. In the future it will be available from the Fine Print website:
www.valbec.org.au/05/fineprint/archive/2003%20folder/03-spFP-body.pdf
or by going to www.valbec.org.au, and click on Fineprint Journal, then Archive, then Spring 2003.
The following extracts are provided to stimulate discussion of interview and assessment practices and the
degree to which funding body requirements can influence interview practices and purposes.
“The initial assessment interview-especially for those with no choice about attending classes-offers prospective
students the chance to re-engage with education. However, both possibility and choice are compromised under
the present system.”
“The discourse of mutual obligation, with its emphasis on compliance and accountability, is at odds with beliefs
articulated by assessors that the initial assessment interview should be low key and student focused. The impact
of the new discourse of literacy and literacy assessment under mutual obligation has been felt by students and
assessors.”
“Assessors are under pressure to do more in less time. Accountability requirements are foregrounded in
assessments. There has been no evaluation of the interview process and purpose. As a result, the assessment
interviews have lengthened from the one hour allotted (the average time taken was one and half hours-I sat
through several that were two hours long). The interviews have two distinct phases that sit uncomfortably
together.
– the informal relaxed part of the interview and the formal process where the assessment takes place. Assessors
feel increasingly under surveillance as a result of the verification process and the needs of the prospective
student inevitably become a secondary focus. Further, the new accountability requirements have impacted on
the amount of paperwork that needs to be completed and this in turn impacts on all aspects of assessors
practice as time becomes an increasing constraint.”
“For prospective students, choice has also been eroded. They must attend an interview if directed by Centrelink
to do so, or face financial penalties. Many are baffled by the process and the part they must play in it. They
understand the need to be compliant and go along with what they are expected to do. Only one student resisted
the position of deficit subject. This is a position that is hard to avoid, because the narrow conceptualisation of
both literacy and assessment does not allow room for prospective students to show their literacy repertoires in
the initial assessment interviews, given the interview structure.
“Under these circumstances, assessment becomes a vehicle for control and a tool for performativity, where
measurable outputs are the only indicators of success.”
Pauline O'Maley, P 2003 That first interview-literacy assessment, mutual obligation and performativity in Fine
Print, Volume 26 No. 3, Spring, VALBEC, Page 8
D:\106755531.doc
Page 52 of 80
Activity 2.9
What challenges face assessors who are conducting pre-training assessment? Suggest strategies to respond to
these challenges. Discuss these issues with colleagues in your workplace or your placement setting.
Do O’Maley’s concerns apply to all assessment contexts? Is it possible for her concerns to be addressed within
the interview process?
Reading for Activity 2.10 Learner Profile for Deng
David (Chinese name Deng) has been in Australia for 18 months. He has a wife who attends English classes at
the local neighbourhood centre and one young child. David has completed his 510 hours of English and is now
working in factory but needs to improve his language skills to get on in his work. In China, he completed nine
years of formal education before going to work in his family shop which sold household and kitchen items. He
has been working at the factory for 12 months, but his supervisor has suggested that he do some English
classes to help him with reading signs and completing work related forms. Eventually David would like to have
his own business or shop, but initially he needs to have enough English to allow him to progress in the factory.
David needs to improve all skill areas. His priority however is his pronunciation.
Initial assessment:
Reading
ACSF 2
Writing
ACSF 1
Numeracy
ACSF 2
Oral Communication
ACSF 1
Learning Strategies
ACSF 1
Activity 2.10
From your knowledge of Deng’s backgrounds and goal:

how would you elicit responses which identify his listening and speaking skills?

describe appropriate task/s to identify Deng’s writing levels

describe appropriate texts to elicit a reading level.

Explain your choice of tasks to other participants
D:\106755531.doc
Page 53 of 80
Reading for Activity 2.11 Learner Profile Mary
Mary is a 32-year old migrant from Sudan; she has been in Australia for 18 months. She has four children and is
pregnant with number 5. If she comes to class, the government will pay for the childcare for her children; she
likes the idea of having a break from looking after them. She seems friendly and outgoing. Her oral skills are
much stronger than her other skills. She has a job cleaning for three hours once a fortnight. She had very little
education in Sudan and so is unable to read or write in either English or her first language. There is a strong
Sudanese community at the local church which Mary attends and many of them also attend classes at the
regional TAFE.
Mary struggled with the reading task of matching key words to symbols, eg police. She copied her name and
address from her Centrelink card however, her script is ungainly and she does not have a good control of a pen.
She was unable to complete any writing without highly supportive modelling. Her poor reading skills also inhibit
her maths and numeracy although she can complete some maths tasks when using hands-on material. This
includes simple fractions and division with counters or lollies.
Throughout the assessment Mary needed much encouragement and support to complete reading, writing and
numeracy tasks. She is not able to identify any particular goals that she would like to achieve in her education.
She would prefer to be in a class with some of her friends. Due to her other commitments she feels she would
only be able to attend a couple of times per week, for a few hours at a time.
Initial assessment:
Reading
Not yet achieved ACSF 1
Writing
Not yet achieved ACSF 1
Numeracy
ACSF 1
Oral Communication
ACSF 3
Learning Strategies
ACSF 1
Include later – Mary is easily distracted in class; she often comes late and likes to have long breaks to talk to
other students. Classes are more important to Mary as a social outlet and something to do rather than be at
home with her small children. She has made little progress in the six months she has been in class; in part
because she will not take any risks, ie, will not write a word unless someone tells her how to do it.
Activity 2.11
Read the learner profile of Mary. Mary has an ACSF spiky profile ranging from NYA (i.e., not yet achieved level
one) to 3 across the macroskills. How might this be reflected in her ISLPR ratings in reading, writing, speaking
and listening?
Imagine you are the assessor interviewing Mary for the first time re placement in a new class. You have already
found out about her listening and speaking skills, but you are not sure about her reading and writing
What assessment tasks and processes would you use to find out more about her reading and writing skills?
Consider information in her learner profile to inform your choice.
Explain your choice of tasks.
D:\106755531.doc
Page 54 of 80
Reading for 2.12 Challenges faced by the assessor at interview
Following the placement interview, a variety of factors may leave assessors feeling uncertain about some
aspects of their placement .The interview process will not always yield the information required for levels to be
confidently obtained. It is important to remember that the placement interview is a snapshot of performance on
the day. Anxiety, medication, tiredness may all play a part obscuring learners’ skills and weakening the accuracy
of the assessment process.
(i)Time constraints
It is generally acknowledged that reliable assessment in LLN will use a variety of assessment tools and
activities for each skill area being assessed. This is often not appropriate at the placement interview, with
its accepted time frame of 1 – 11/2 hours.
(ii) Issues in numeracy assessment
Time problems may be particularly evident in numeracy assessment which is often the last part of the
assessment to be completed. Numeracy can be neglected and numeracy teachers may be given very little
information about their prospective students.
Marr, Helme and Tout suggest‘ in this situation, the numeracy teacher may decide to use the first few sessions to
gain an appreciation of student’s knowledge and skill levels before finalising classes or enrolment details’.
In addition, LLN assessors may not have a numeracy background and not be sensitive to the issues of
numeracy assessment, preferring to revert to pages of sums as a quick assessment. This is not a good
introduction to numeracy. In these situations it is advisable to call on and involve a numeracy teacher in the
placement process.
Another issue for numeracy assessment can be the English language level of learners. Because numeracy is
embedded in language, it can be difficult to ascertain levels of numeracy in learners with low language levels.
(iii) Accompanying third party at interview
Learners may be accompanied by others whose assistance may be valuable or necessary to complete the
interview, such as an interpreter, carer, welfare worker or supportive family member. It is important that all those
attending the interview understand their role and that they do not corrupt the authenticity of the assessment
process. For example, well intentioned accompanying friends or family members may obscure the learners’
abilities by speaking on their behalf, by adding to written information to an enrolment form, or by adding their
view to the learners’ self assessment.
This can become particularly problematic when the learner relies on a friend or family member to act as an
interpreter on their behalf.
Accompanying young children may mean that it is difficult for a learner to focus on the assessment if the learner
is torn between completing assessment and caring for the immediate needs of children.
(iv) Lack of engagement in the interview process
Accurate assessment relies on positive learner engagement in the interview. However, some learners may not
engage fully in the interview process for a variety of reasons. While the majority of learners referred to LNN
programs by funding agents see this as an opportunity to further their skills, some may feel hostile to the idea of
D:\106755531.doc
Page 55 of 80
studying and express this through minimal engagement in the assessment process. Others may use hostility and
or disengagement as a mask to protect anxiety about their learning and achievement.
(v) The subjectivity of the assessor’s judgment
Assessors generally work with learners on a one to one basis during the interview and the interview process
places great responsibility on the accuracy of their judgement. Assessors develop judgement schema based on
professional knowledge of language literacy and numeracy development, adult learners and learning, LLN
competency curricula and reporting frameworks and the learning culture of the proposed placement. Assessors
are also individuals who bring their own personal schema -beliefs, value systems, biases and preferences -to the
interview process. For example some assessors may value learners whose learning style is similar to their own.
The interview is a social medium and its text is jointly constructed by the assessor and the learner. Assessors
are not immune to social and emotional triggers intrinsic to this process. It is important to acknowledge that
professional expertise cannot entirely eliminate subjectivity from the assessment process.
Session 4 of this unit examines the processes of moderation and evaluation which provide opportunities
assessors to evaluate their assessment processes and judgement.
(vi) When to write
Assessors are often torn between the need to record information in the interview and the need to listen, observe
and respond to the learner. Some feel it is disrespectful or intimidating to take notes during the interview. This
will vary from situation to situation. There are generally pockets of space in the interview for some note taking,
e.g. when the learner is completing a written assessment task and needs to be given some space to complete
the task. Some note taking is better to be left to the end of the interview when the assessor has time to reflect
holistically on the learner’s needs and skills.
In many instances notes can be collaboratively constructed with the learner giving input as the interview unfolds.
Learners should always have the opportunity to read or listen to the notes that you have taken. This can be a
learning experience and a useful method of summing up where you have progressed to in each stage of the
interview.
Facilitator Guide to the Four Core Units The Advanced Diploma LLN Practice in VET, 2007.
Handouts and Resources, DEST.
Activity 2.12
Review the challenges faced by assessors outlined in the preceding reading.
 Are there other issues that could impact on the interview process?
 Suggest strategies that you could implement to respond to these issues/challenges.
 How important is it to discuss these issues with colleagues and supervisors/line managers?
 How could you build these concerns into the overall pre-training assessment review process?
D:\106755531.doc
Page 56 of 80
References
Check One, Two - Using the National reporting System (NRS) to assess the spoken English of people from
language backgrounds other than English, (2002). Access Division, TAFE NSW, Summerhill Media, DEST,
Commonwealth of Australia
Vinson, T, (2007). Dropping off The Edge: the Distribution of Disadvantage in Australia,
www.australiandisadvantage.org.au
Facilitator Guide to the Four Core Units The Advanced Diploma LLN Practice in VET, (2007). Handouts and
Resources, DEST.
Falk I, and Penson M, (1996). Literacy, Adults and Diversity. Literacy and Learning Series, No 1, National
Languages and Literacy Institute of Australia (Available from VOCED Plus, NCVER, www.voced.edu.au)
Learning Strategies Resource supplement, (2006). DEST, Commonwealth of Australia access
www.literacynet.dest.gov.au/key_nat_tools_resources/
O’Maley, P, (2003). That first interview-literacy assessment, mutual obligation and performativity. Fine Print,
Volume 26 No. 3, Spring, VALBEC Rumsey D, 1994, Assessment Practical Guide, DEET, Commonwealth of
Australia
Smith, P,J. & Dalton, J, (2005) Getting to grips with learning styles. http://www.ncver.edu.au
Watts, M, (1996). How Do Power Relationships, Within an Adult Literacy Initial Assessment for CES Referred
Clients, Influence the Assessment Discourse? http://www.ncver.edu.au
Wignell, L & Oldfield, J, 2006, VETASSESS, Address language, literacy and numeracy within learning and
assessment practice. TAALLN401A, Learner Guide, Commonwealth of Australia
D:\106755531.doc
Page 57 of 80
Topic 3 Analyse data to establish candidate’s language, literacy and numeracy
skills
Topic Overview
The analysis of evidence gathered at pre-training assessment will use the ACSF as the benchmarking tool. This
tool addresses 5 macro skills including numeracy. The process of analysing data gathered at pre-training
assessment needs to be systematic.

Compare responses to interview questions with benchmarks in relevant frameworks to analyse oral
communication and learning

Compare responses to reading material with text features and performance strategies to analyse
reading skills

Compare responses to candidate’s writing with text features and performance strategies to analyse
writing skills

Compare responses to numeracy tasks with numeracy features and performance strategies to analyse
numeracy skills
Reading and Activities for Topic 3
Work your way through the following Readings and Activities
Australian Core Skills Framework
Activity 3.1
Familiarise yourself with the layout and structure of the Australian Core Skills Framework
Summarise the framework of the ACSF LLN ratings using the following focus questions
What are the key components of the ACSF that you will use to analyse data?
What key features/factors differentiate performance at different levels of The ACSF?
Use candidate’s responses to the oral communication, learning strategies, reading, writing, and numeracy
assessment tasks from the assessment you conducted. How did you ensure that you assessed to the
candidate’s upper limit of performance in these macro skills?
Use the ACSF to assign an appropriate level.
Use a reporting pro forma or template to record your analysis and relevant comments. You may use sample
templates from your workplace or placement setting. Templates are also available in kits such as Precision
Consultancy ACSF assessment kit. Include all relevant information and observations.
D:\106755531.doc
Page 58 of 80
Activity 3.2
Review your research and reading from previous topics in this unit.
Develop a learner profile for a specified student. You may use the learner profile from the previous topic or
choose a learner from your workplace or placement environment. .
Select an appropriate reporting pro-forma or design your own.
Using the assessment kit that you developed for Topic 1, conduct the pre-training assessment for oral
communication and learning, reading and writing, and numeracy
Analyse the responses to the assessment session using a specified benchmark – ASCF and/or ISLPR.
Locate information about the range of local training options available to the student.
Summarise Course Information relevant to placement of the candidate into training. This could include:
The range of provision available to meet the needs of the learning and training needs of the candidate. You will
need to consider:



the purpose and structure of available courses
the benchmarking criteria used to determine entry and exit points of Training (ISLPR, ACSF)
pre-requisites / eligibility criteria for enrolment
Activity 3.3
“Spiky profiles”
It is usual for learners to display uneven development across the macroskills or even within the aspects of a
particular macro skill; this uneven development is referred to as a “spiky profile
Review the Precision Assessment tools: Precision Consultancy
Look at the section on educational history and self assessment. What could be altered or added to in order to
find out something about preferred modes of learning, barriers to learning and motivation and goals?
Conditions of assessment will affect the outcome of the assessment process. The level of support required to
complete tasks is crucial to determining ACSF performance levels. Do the tasks clearly indicate the level of
support allowable to achieve a certain level? For example, if the reading tasks were completed with/ without
support, how might this alter the level of performance? How important is it to note the level of support within the
tasks and tasks responses?
Look at the numeracy tasks. What do you consider the strengths of these tasks? ACSF numeracy also
encompasses skills measurement, location, data, in charts and tables. Should these be reflected in the
numeracy tasks?
• “…the initial indicator tool may be used by a range of employees with limited training, it should be short and
easy to use, and the manner of data collection should be straight forward.” Overall, what onus does the indicator
D:\106755531.doc
Page 59 of 80
tool place on the assessor being experienced at LLN assessment in order to give an accurate “snapshot” of LLN
skills?
Is it appropriate to collect more evidence about performance in learning strategies and oral communication? If
so, how could this be achieved?
Could this kit be adapted for use in other contexts? Explain what changes you would make to the tasks for use in
a context which is relevant to you.
Reading for Activity 3.4
Fitzpatrick, L. Mckenna, R and Wignell, L. 1999, Assessment and Placement Resource for the Literacy and
numeracy program, DEST, Commonwealth of Australia Assessment and Placement Resource for the Literacy
and Numeracy Program http://www.labyrinth.net.au/commet/assessresource.pdf and click publications to
access this document.
Activity 3.4
Access Fitzpatrick, Wignell and McKenna (1999). The Assessment and Placement resource for the literacy and
numeracy Program (refer to pp. 28 – 31).
Discuss the following points and take notes as necessary.

The sample assessment task – Writing on page 29 may elicit performance levels at 1 and 2 in writing
and reading and also part of numeracy performance at level 1.

This is an example of an integrated task. What are the advantages of using integrated tasks?
Disadvantages?

The task can be described as authentic to the situation. What is meant by this term?

Identify which parts of the form relate to particular levels. What are the advantages of using an
assessment task with the potential to elicit a range of performances at the initial stages of the
assessment?

The task does not define performance, but elicits it. How do performance context and assessment
context influence levels of performance? ( See page 30 of the Fitzpatrick, Wignell and McKenna
resource, and also refer to resource A in this section)

Look at the learner response to the assessment task (page 31). It refers to NYA (not yet achieved).
What does this term mean?
Note: unlike training package performance criteria, the performance features are a guide to the level, they do not
define the level. Therefore, not all of these features need to be elicited by the task for performance to be
achieved. They are to support assessors’ understanding of the level.
D:\106755531.doc
Page 60 of 80
Activity 3.5
Choose a task from the Precision Consultancy bank of assessment tasks: Precision Consultancy
Reflect on this task and consider:
What aspect does this task most strongly relate to?
Could the task elicit performance in more than one macroskill area?
Could the task elicit a number of macroskill levels? What factors (e.g. complexity of response; support/ time
required for completion; context would determine performance level? Refer to resource A when considering
these factors.
If the task was confidently completed by the learner, what further tasks could be used to establish the learner’s
performance level in the macro skill?
Compare your task with those of others in your group. Explain why it is located at the particular macroskill level
and Aspect. Discuss the questions above in relation to your task.
References
Fitzpatrick, L. Mckenna, R and Wignell, L. (1999). Assessment and Placement Resource for the Literacy and
numeracy program. DEST, Commonwealth of Australia Assessment and Placement Resource for the Literacy
and Numeracy Program http://www.labyrinth.net.au/commet/assessresource.pdf
D:\106755531.doc
Page 61 of 80
Topic 4 Provide effective advice on suitable program options
Topic Overview
This topic explores ways assessors and candidates negotiate a final agreement on placement and/or referral to
an appropriate LLN program.
This topic has 4 sections:

Provide feedback to the candidate on assessment outcomes emphasising strengths and positive
strategies

Apply knowledge of VET provision in discussions with candidate

Apply knowledge of options suiting the specific needs of the candidate

Provide feedback to the candidate on assessment outcomes emphasising strengths and positive
strategies
Feedback is an integral part of process and can provide learners with information about their individual
performance in the assessment process and can be a positive tool for training and career development.
Assessment processes focus on identifying achievements in responses to assessment tasks. Emphasis on what
learner can do in relation to their goals and the requirements of the course/ training. Gaps identified. Training
plan discussed
An important goal of the pre-training assessment process is to discuss with the candidate their strengths and to
focus on positive outcomes. The assessor can use the feedback provided to the candidate as a learning
opportunity. The learner will need to know their current skills and to identify any gaps between these skills and
those required to achieve vocational and educational goals.
It is therefore essential to allow plenty of time for discussion with the candidate and to ensure that the candidate
is confident to ask questions.
Apply knowledge of VET provision in discussions with candidate
The pre-training assessor is required to discuss the training programs that are available that will best meet the
learner’s needs. This will include identifying programs at appropriate skill levels that will provide training
pathways to meet achievable learner goals. The eligibility pre-requisites of a range of courses will also need to
be investigated to ensure that the candidate is referred to the most suitable program.
The pre-training assessment process is conducted within the context of an understanding of the range of LLN
training options that are available to each candidate. Assessors need to have comprehensive knowledge of:






D:\106755531.doc
the range of accredited adult LLN course
program involving adult literacy and numeracy mentoring
vocational program with LLN components and/or LLN support
referral to other services to assist the candidate
referral to other RTOs offering more appropriate LLN courses or courses with a different focus
workplace LLN training options
Page 62 of 80
Apply knowledge of options suiting the specific needs of the candidate
Decisions about placement and referral into appropriate training must take into account the full scope of
information about the candidate gathered at interview. The needs and circumstances of the learner, including
awareness of any real or potential barriers to entry and successful participation are essential factors in
negotiating appropriate placement. Full and meaningful discussion of options is required.
Topic 4 Readings and Activities
Work your way through the following readings and activities.
Provide Feedback
Reading for Activity 4.1: Goal directed assessment
Goal Directed Assessment, 1998, Ministry for Education and Training Literacy and Basic skills Section, Ontario,
Canada pp 7 -14 www.edu.gov.on.ca/eng/training/literacy/goal/goal. Alternatively use search engine Google and
type in Goal Directed Assessment-Canada
Activity 4.1
Developing a training plan
Access the Individual Training Plan in Appendix 1, Goal Directed Assessment, pp 145-7. This is a LLN
training plan used for initial assessment of adults in Ontario, Canada. Discuss using the following points
as a guide:





What are the benefits of using a training plan at initial placement?
What do you consider to be the strengths/weaknesses of this training plan?
What educational values are reflected in this training plan?
Could it be adapted to LLN placement in Australian contexts? What would you change to suit a context
that you are familiar with?
Develop a training plan format which could be used in a particular context e.g. workplace training,
vocational language learning access education.
D:\106755531.doc
Page 63 of 80
Reading for Activity 4.2: Learner Profiles learners Suzanna and Deng
Suzanna is a 20-year old student from an Anglo-Saxon background who has vision impairment. She would like
to study Cert III in Disability Work but needs to improve her writing and numeracy before she can undertake the
course. She completed year 8 at school and has tried adult education previously, however, she did not like
having an aid to help her with her work. She says that the aid did not allow her to do her own work, so she
wants to try studying without an aide. She has enough vision to move around unaided and uses public transport.
She can read 18 point font and can read from the board if she is allowed to go up very close and look at it.
When studying a novel it would be necessary to get a large print version from Vision Australia. It is sometimes
possible to get a computer which enlarges the print or one which read the information that the teacher writes on
the board, but this technology is expensive and not always available.
Suzanna is a cheerful student who is eager to learn. She has done a little voluntary work in the disability area
which she enjoyed. She has a disability pension and lives with her mother.
Initial assessment:
Reading
ACSF 3
Writing
ACSF 3
Numeracy
ACSF 2
Oral Communication
ACSF 3
Learning Strategies
ACSF 3
David (Chinese name Deng) has been in Australia for 18 months. He has a wife who attends English classes at
the local neighbourhood centre and one young child. David has completed his 510 hours of English and is now
working in factory but needs to improve his language skills to get on in his work. In China, he completed nine
years of formal education before going to work in his family shop which sold household and kitchen items. He
has been working at the factory for 12 months, but his supervisor has suggested that he do some English
classes to help him with reading signs and completing work related forms. Eventually David would like to have
his own business or shop, but initially he needs to have enough English to allow him to progress in the factory.
David needs to improve all skill areas. His priority however is his pronunciation.
Initial assessment:
Reading
ACSF 2
Writing
ACSF 1
Numeracy
ACSF 2
Oral Communication
ACSF 1
Learning Strategies
ACSF 1
D:\106755531.doc
Page 64 of 80
Activity 4.2
Outline strategies you would use to explore placement options with each of the selected learners.
This should include:

Giving feedback about the learners’ LLN, (use the ascribed ACSF levels in the Learner Profile Resource
and ISLPR ratings if appropriate) in relation to their goals and other factors influencing their identities as
learners.

Providing information to the learner about their LLN which identifies what the learner has achieved and
the areas where further training is recommended in order to fulfil identified goals.

Opportunities for the learner to explore and respond to the feedback including, revisiting and clarifying
information as necessary.

Exploration of training options available which could meet the learner’s identified needs. If suitable
training is not available within the assessor’s organisation/area/workplace, referrals to external/further
provision should be discussed.
References
Goal Directed Assessment, 1998, Ministry for Education and Training Literacy and Basic skills Section, Ontario,
Canada pp 7 -14 www.edu.gov.on.ca/eng/training/literacy/goal/goal. Alternatively use search engine Google and
type in Goal Directed Assessment-Canada
D:\106755531.doc
Page 65 of 80
Topic 5 Report outcome of assessment
Topic Overview
This topic outlines post interview assessment processes. The function of these processes is to facilitate effective
communication of the information collected, to ensure that access to and storage of the information address
privacy and confidentiality issues.
To maximise the pre-training placement interview as an effective resource for ongoing use by other stakeholders,
thorough and appropriate documentation needs to be completed by the assessor. As well as recording levels
within a reporting or assessment framework, assessors need to document a mix of primary evidence (learner
responses to tasks) and secondary evidence (assessor comment on the conditions of performance and
assessment).
Assessors also need to report other information relevant to placement. Assessors need to be aware of the
different audiences for the initial assessment file and of the ethical and practical challenges assessors
sometimes face in completing documentation, In addition, in a funding environment where payment is often
based on outcomes, the recording and documentation of performance at initial assessment becomes crucial in
establishing evidence of a learner’s baseline performance against which further development can be measured.
This information may be used to evaluate programs.
This topic has two sections
 maintain records of assessment process, evidence collected and outcome according to policies and
procedures of the training organisation and funding body
 report outcomes of assessment process to relevant parties in required format and manner in line with
confidentially requirements.
Notes:
In order to complete the activities for this section, participants will need to access the:
1. Assessment and Placement Resource for the Literacy and Numeracy program
This resource was designed to be used within the framework of the NRS which has been superseded by the
ACSF. The materials are still appropriate and relevant to this topic. The following sections of the resource are
relevant and useful.
Assessment tasks cover sheet with guide questions p40.
 The completed assessment tasks coversheets for Rosie (page 48), and Quon (page 52)
 Interview form (page 58)
 Self assessment form (page 60)
 Reporting the assessment (page 45)
2. Precision Consultancy ACSF Assessment Resource
Maintain records of assessment process, evidence collected and outcome according to policies and procedures
of the training organization and/or funding body.
Reporting and documenting information
D:\106755531.doc
Page 66 of 80
The interview assessment can be an effective resource for ongoing use by other stakeholders if thorough and
appropriate documentation is completed by the assessor. Assessors need to be aware of the different audiences
for the initial assessment file and of the ethical and practical challenges assessors sometimes face in completing
documentation.
Creating and storing files
The information collected and recorded at placement interview enters the provider’s record keeping system.
Information in the file needs to be stored in such a way that relevant personnel can readily access the
information, the integrity of the file is maintained, and each learner’s personal details remain confidential and
secure.
Communicating relevant information
Information in the placement file is used to meet the needs of different audiences and purposes. At program
delivery level, this may include the LLN teachers and trainers delivering the designated program, and other
training professionals. Select data from the file is also used for broader long term planning of training provision at
state and national level. All providers in the VET sector are required to report particular information through the
AVETMISS system. In addition, there is an obligation to meet the particular reporting requirements of various
funding bodies.
Readings and Activities Topic 5
Reporting performance - Completing the task coversheets
Reading for Activity 5.1
Fitzpatrick, L McKenna, R and Wignell, L. (1999). Assessment and Placement Resource for the Literacy and
Numeracy program. DEST, Commonwealth of Australia Assessment and Placement Resource for the Literacy
and Numeracy Programme http://www.labyrinth.net.au/commet/assessresource.pdf and click publications to
access this document
Activity 5.1
Review the following document in Fitzpatrick, McKenna, and Wignell (1999). (See access details in reference
below.) The assessment task coversheets for Rosie and Quon (page 48 and 52) are used to report LLN
performance. The left hand column gives prompts for the assessor notes explaining the performance outcomes
identified (top left hand side). The assessor’s notes on performance and conditions of assessment are displayed
in the right hand column (blue writing).




Assuming the trainer/teacher has a good knowledge of the LLN benchmarking tool, why are the notes,
as opposed to simply the identified levels, still important to understanding learner performance?
Why is it important to note the conditions of assessment in the report?
For these learners, the interview has been treated as a holistic assessment task across the macroskills
and the notes are adequate for placement for these learners in this context. Describe situations where
more detailed notes addressing learner performance would be required eg. specific training contexts,
learners completing a range of reading, writing and numeracy tasks.
The LLN tool’s conditions of performance include identifying the level of support required, the familiarity
of the task. Are these conditions adequately identified in the notes?
D:\106755531.doc
Page 67 of 80

What further documentation could be presented in the files of both learners to:
o provide further first hand evidence of performance? And
o help address the learner’s training needs?
OR
Alternative Activity 5.1
Review the documents identified in Fitzpatrick, McKenna, and Wignell (1999).
What changes, if any, could be made to the forms to more accurately reflect the needs of other training contexts?
Summarise your comments in note form.
Issues in completing documentation
Information about learner’s training goals, educational background and other factors related to future learning will
be documented in the learner file. Assessors using the ACSF have the opportunity to report this information
when completing a report on the learning strategies macroskill, however this may not be the case for other
frameworks. Assessors need to be mindful that the file is not only a receptacle of information but a
communication tool for a range of different audiences.
Reading for Activity 5.2 Guidelines for reporting and recording information:
The files of individual learners contain personal information which is sometimes of a sensitive nature. This
information may include:
 Personally identifying details – addresses phone numbers, family contacts etc
 Completed tasks and comments on LLN performance, including located levels in the NRS/ ASCF,
ISLPR ratings
 Training plan
 Details of placement destination
The audience for the information
The provider
The provider will need information about learners so that effective programs can be planned for and delivered. All
providers will rely on filed information in the file to enter AVETMISS data. See A4.3
The funding body
The funding body will have specific reporting requirements which will draw on the information in the file.
Government funding of LLN provision in the VET sector is contingent upon meeting particular reporting
requirements. The requirements vary according to the various funding profiles, however all requirements must be
AQTF compliant. See A4.3
Other non LLN professionals
This may include Non LLN vocational trainers, support workers such as counsellors, agency representatives
such as Centrelink personnel. In these cases, direct access to the file will not be appropriate, however, the
assessor may need to communicate relevant information contained in the file.
Learner /assessor collaboration
Information in the file will have been collected during the interview in collaboration with the learner. It follows that
D:\106755531.doc
Page 68 of 80
information should be recorded with learner’s knowledge and agreement. Learners may contribute directly to
building the written record of file information through recording their personal details, completing written
assessment tasks, and providing other documentation for photocopying. They also contribute to the written
record through oral exchanges with the assessor by providing information, reflecting on their learning
background, preferences and goals The assessor contributes directly to the written record through descriptions
of LLN performance, and other information from the oral exchange relevant to placement and learning, such as
information about learning barriers and goals. This information will rarely be recorded verbatim from the learner
(unless it is the recording of basic details) and will usually be the product of the assessor’s professional
interpretation.
Recording and checking
It is useful for assessors to check all information with learners as it is recorded during the interview process and
to revisit this information as appropriate during the closing stages of the interview. This allows for learners and
assessors to clarify or elaborate on information as the file is being constructed. Learners are supported in
reflecting on their own learning and in the awareness of factors influencing their training needs. It also means
that learners have an opportunity to affirm the accuracy of the information and assessors can be assured that
they have collected and recorded information with the consent of the learner.
It is important that assessors inform learners of the way that the information will be used, including who will have
access to this information.
Flexibility and timing
Assessors may find that a mix of recording information during the interview process and completing a more
thorough write up at completion of the interview results in the most effective documentation, balancing the need
for accuracy with the need for reflection and judgement.
Some assessors have strong views that note taking sabotages the collaborative nature of the interview as it is
unduly cumbersome, creating a barrier between the assessor and the learner which is detrimental to the
assessment process. Some interview situations mean that it is difficult or inappropriate for assessor notes to be
taken during the interview or for only minimal notes to be taken. In these situations the assessor needs to make
notes as soon as possible after the interview and to let the learner know that they can access the written record
and discuss the placement and training plan at a follow up meeting when the learner feels comfortable with the
process.
Reporting LLN levels
Competency based assessments focus on learners’ achievements – what the learners can do as identified
through the assessment tool. This creates a positive perspective from which to report the assessment to all
parties and to discuss and identify further training needs.
Using pro formas
Most providers have pro formas which allow for information to be set down consistently and which prompt
assessors to include relevant details. The assessment kit will contain not only tasks but have provision for
learner responses and assessor notes on performance. There should also be space within the forms for
assessors to make notes about individual responses to the assessment tasks which explain the rating given.
This is particularly important when considering the assessment context, the level of support required, the time
taken and any other observations about the way the learner has completed the tasks such as their degree of
confidence, their strategies for self checking organising and completing the task. It is important that these factors
are documented so that those not present at the interview can understand the judgements made by the
D:\106755531.doc
Page 69 of 80
assessor.
Some examples of pro formas can be found in:
 Fitzpatrick, McKenna, and Wignell (1999) resource (see reference section of A4.1),
 Assessment task cover sheet ( page 40)
 Interview form ( page 58)
 Self assessment form (page 60)
Although these have been developed for reporting NRS performance for the DEST funded LLN Programme, they
are examples of good practice which could be adapted to other assessment contexts.
Use the preceding guidelines for recording information. Now read and respond to the following activities:
Scenario 1
During the course of an interview with ‘John,’ you discuss his education and training history. He discloses that his
study has been intermittent because of mental health issues for which he must take daily medication. When you
revisit the information with him towards the end of the interview, he asks you not to record his illness or
medication details as he believes others have judged him unfairly in the past because of his illness.
Outline your response to his request.
Scenario 2
‘Jill’ has been sent by Centrelink for assessment regarding suitability for an LLN training program. She has had a
negative educational experience in the past and is suspicious of those she regards as authority figures. You
have worked very hard to establish rapport in the early phase of the interview. She is reluctant to complete any
written assessment tasks, but in discussion with her, you are gaining a good picture of her skills through carefully
supporting her self assessment. This leaves little time to record information and you are afraid that you will lose
her engagement if you stop to write notes.
Write down the strategies you would use to maintain the positive connection yet not “lose” the valuable
information that she is communicating?
References
Fitzpatrick, L McKenna, R and Wignell, L. (1999). Assessment and Placement Resource for the Literacy and
Numeracy program. DEST, Commonwealth of Australia Assessment and Placement Resource for the Literacy
and Numeracy Programme http://www.labyrinth.net.au/commet/assessresource.pdf and click publications to
access this document.
Creating and storing files
Information in the file needs to be stored in such a way that relevant personnel can readily access the
information, the integrity of the file is maintained, and each learner’s personal details remain confidential and
secure. AQTF guidelines stipulate responsibilities for meeting access, confidentiality and privacy requirements.
For this reason, you may need to return to resources related to the AQTF which were accessed in the topic
‘Approaches to Assessment.’
D:\106755531.doc
Page 70 of 80
Reading for Activity 5.3 The National Privacy Principle
National Privacy Principle (NPP)4.1provides that an organisation must take reasonable steps to protect the
personal information it holds from misuse and loss and from unauthorised access, modification or disclosure.
Data security is an important way of ensuring that personal information is only used for permissible purposes. In
general, personal information should be treated as confidential and sensitive information as highly confidential.
The key to effective compliance with NPP is developing an organisational culture that respects privacy.
Organisations need to ensure that management and staff have a good understanding of their responsibilities in
protecting personal information from misuse, loss, corruption or disclosure
Activity 5.3
Discuss with your Line Manager the guidelines for storage and access of learner files at your place of work or
work placement setting. You should make notes about:
 Guidelines for personnel accessing the files
 Storage of hardcopy data
 Storage of and access to electronic data
 The rights of the learner
Report outcomes of assessment process to relevant parties in required format
and manner and in line with confidentiality requirements.
It is important for assessors to be aware that information in the file may be collected not only for those directly
involved in the LLN placement but for a range of other purposes. Quite specific data is required for the
AVETMISS system and for various other funding bodies. In addition, the file may be accessed directly by other
relevant LLN deliverers, and may be used to support communication of information to non LLN professionals.
Reading 1 for Activity 5.4 AVETMISSP: The Standard for VET Providers
All RTOs in the VET sector are required to collect and report specific data about students and enrolments as part
of their obligations under the AQTF. This data is non identifying. The data provided must conform to the
Australian Vocational Education and Training Management Information and Statistical Standard (AVETMISS)
and is reported to the relevant state or territory training authority in which the RTO operates. AVETMISS, “
ensures accurate and consistent vocational education and training (VET) measurements by providing a common
language for the collection of data on training delivery. It enables comparison and analysis at all levels of the
training system, nationally and within each state and territory. AVETMISS data must be submitted annually.” See
Training .com below
”The Standard for VET Providers offers a nationally consistent standard for the collection, reporting and analysis
of publicly funded vocational education and training information throughout Australia. It forms part of the
Australian Vocational Education and Training Management Information Statistical Standard (AVETMISS). The
standards have been developed and refined over a number of years through consultations with major
stakeholders. The current set of standards was developed in accordance with the National VET Statistical
Implementation Strategy. Data collections made under the standards will be used as the basis for reporting the
key performance measures for the VET sector which were developed by the Performance Review Committee of
D:\106755531.doc
Page 71 of 80
the ANTA Board. Both the National VET Statistical Information Strategy and the new key performance measures
have been endorsed by the ANTA Ministerial Council.” (See NCVER link below)
AVETMISS includes details about the enrolling students such as their age and gender and information about the
courses that they are enrolled in.
“The information gathered is used at a national, state and territory level to:
 develop a picture of the vocational education and training sector in Australia
 inform policy decisions
 enable reporting of what has been achieved with public funds”
 assist future planning.
Each state or territory has different reporting requirements because:
 they may collect supplementary data along with AVETMISS information
 they may use different software programs or formats.
AVETMISS: The standard for VET Providers gives comprehensive support to providers required to submit
AVETMISS data and is available online. Further information can be found at:
http://www.ncver.edu.au/vetstandard/publications/872.html#Summary_information
http://www.dest.gov.au/sectors/training_skills/policy_issues_reviews/key_issues/nts/a qtf/reporting.htm
www.training.com.au/portal/site/public/menuitem.4fe93908f3097880f9fa5a1017a62dbc
Reading 2 for Activity 5.3 Programs with specific reporting requirements
Particular reporting requirements are required by specific programs and Funding bodies, such as the LLNP and
WELL
1. The DEEWR Language Literacy and Numeracy Programme LLNP
Language, Literacy and Numeracy Program
Reporting requirements
The LLNP programme requires providers to report information to DEST about participants’ LLN on a periodic
basis, using the National Reporting System to report the achievements of learners. This information is used to:
•
•
report on outcomes from the Literacy and Numeracy Training programme; and
evaluate the cost effectiveness of the Literacy and Numeracy Training programme
The placement interview provides baseline data in of the learners’ performance in reading, writing, speaking and
listening numeracy and learning strategies. Individual learners (jobseekers) are identified and their progress is
then tracked throughout the training period. Data is submitted electronically and is protected by a high level of
security and restricted access.
Because accurate reporting of learner performance is crucial to this process, learner files must be available for
verification of reported levels of LLN achievement for each round of training. Therefore evidence of performance,
including assessment tasks, responses and assessor notes on performance, must be available in the learner file
for the verification process.
D:\106755531.doc
Page 72 of 80
The workplace English language and literacy programme (WELL)
Workplace English Language and Literacy Program
WELL also uses the ACSF to report the achievements of learners, but has different reporting requirements.
Learner files in the WELL programme are also subject to independent verification. The following information is
taken from the WELL website:
WELL The guidelines for reporting on the WELL programme stipulate that individual ACSF reports on each
worker are not required. What the funding body (Department of Education, Science and Training) wants is an
aggregated report from each WELL-funded project about the ACSF outcomes achieved within that project. This
means that the language and literacy outcomes for all participants within a project must be combined to create
aggregated data.
In other words, they want to know what language, literacy and numeracy outcomes were achieved by the
workers who participated in WELL training. To establish aggregated outcomes, you will obviously have to track
individual progress. Depending on the structure of your programme this may be fairly straightforward or it could
be quite complex. The important point is that outcomes for all workers trained within the programme must be
recorded and form part of the aggregated data recorded on the WELL report. Outcomes are required for every
participant.
Additional information such as improvements in participation in workplace training, participation in workplace
teams and meetings, and improvements in job flexibility and promotion are also part of the reporting process.
If you have a programme that focuses on supporting the carrying out of a fixed set of workplace tasks and roles,
for example oral skills for housekeeping staff, then your ACSF report will reflect the aggregate achievement of
the staff in developing such skills. You will have to map the skills against the ACSF but not report on the other
skill levels of the staff.
If, however, the programme is more individually focused, for example a group of production staff with different
levels of responsibility and work tasks, you will have to develop individual programmes. Your report on the
language, literacy and numeracy outcomes will probably be across a wider range of levels, a wider range of
aspects and a wider range of indicators of competence.
Activity 5.4
What influence do you think the reporting requirements of various programs would have on your record keeping?
If you have had experience delivering programmes with different funding profiles (eg. LLNP, WELL) reflect on
this experience and list the positives and negatives of reporting within this program.
Interpreting results for other professionals
It is important for assessors to be aware that information in the file may be needed by non-LLN training
personnel who may not be familiar with LLN assessment tools and frameworks. Such personnel may include
vocational trainers, support workers, counsellors and others.
D:\106755531.doc
Page 73 of 80
Reading for Activity 5.5 Case studies of Boris and Len
Len is employed in a transport and distribution company. He left school early and has been working in the
industry for many years. He is a native speaker of English but his reading and writing skills are extremely limited.
The company is aware of the language difficulties of some of its employees and wants to ensure that they all get
their forklift licences. Because of the communication skills required in the Evidence Guide of the Competency
Standard ‘Operate a Forklift’, they have to ensure the language of the training program is accessible to the
employees. The vocational trainer and the language trainer from the local TAFE Institute meet to plan the
program. The language teacher conducts individual language assessments before the course starts to
find out about any communications problems. They reassure employees of the confidential nature of this
process. Each week the two teachers meet before the lesson to plan the material they will deliver to the class.
This involves some rewriting of the training materials.
Boris is a process worker at a polymer product manufacturing company. The company is in the process of
developing a training program for its employees. Most of the employees undertaking the Unit Maintain and
Organise Workplace Records have been in Australia for 20 years or more and have incomplete secondary
schooling in their own country. The communication skills/language teacher assesses them before starting
the training to ascertain their levels of English, particularly their reading and writing skills. She then
designs the training, taking account of their language needs as well as the competencies of the Maintain and
Organise Workplace Records Unit. The training is customised to the particular language needs of this group of
employees using the documents required in this workplace. At the end of the Unit, the employees are assessed
against the Performance Criteria
Activity 5.5
The audience for this text are trainers who are not LLN experts, however it provides an understanding of the way
LLN and non LLN professionals can work together to deliver training which meets the needs of individual
learners and an insight into what the vocational trainer can expect from the LLN professional.
Consider the following scenario: You have provided LLN assessments for Boris and Len at the request of their
workplace trainers. Now you need to communicate the results of the assessments. How will this be different from
the way you communicate this information to an LLN teacher? Consider this in terms of the goals of training, the
way the information about the assessment is communicated, and the specific purpose of the assessment.
Consider other professionals for whom results may need to be interpreted. Where possible, draw on your own
professional experience in your response.


What are the issues which may arise? For example, consider the clarity of the information, danger of
misinformation, confidentiality requirements
Should formalised guidelines be implemented to ensure the safe and effective communication of this
information? If so, suggest advice to new LLN practitioners.
References
Goal Directed Assessment, (1998). Ministry for Education and Training Literacy and Basic skills Section, Ontario,
Canada pp 7 -14 www.edu.gov.on.ca/eng/training/literacy/goal/goal Alternatively use search engine Google and
type in Goal Directed Assessment-Canada
Fitzpatrick, L McKenna, R and Wignell, L. (1999). Assessment and Placement Resource for the Literacy and
Numeracy program. DEST, Commonwealth of Australia Assessment and Placement Resource for the Literacy
D:\106755531.doc
Page 74 of 80
and Numeracy Programme http://www.labyrinth.net.au/commet/assessresource.pdf click publications to
access this document
D:\106755531.doc
Page 75 of 80
Topic 6 Evaluate the process
Topic Overview
The concept of continuous improvement has been widely adapted to processes of assessment in the VET
sector. While much of the focus has been on summative and formative assessment processes, the principles
and processes associated with this concept can also be applied to the initial placement and is relevant to both
accredited course and vocational training contexts.
In addition accredited courses such as the CGEA have well established review and moderation processes which
are directly relevant to initial placement assessment. This section describes established processes for review of
placement, including collecting feedback about the placement and engaging in moderation and validation
processes.
There are two sections to this Topic:


Collect feedback on the pre-training assessment process from relevant parties.
Improving assessment processes in response to evaluation.
The initial placement process can be said to be under continuous review. The first and most direct way of
checking that the assessment and placement process is working well is to see that it is fulfilling its function in
placing learners in appropriate programs which are meeting their needs and from which they are deriving benefit.
Where possible, this may be done informally through checks with the receiving trainer/tutor and the learner in the
early weeks of placement. In some cases, for example where the learner’s needs are difficult to meet or where it
is difficult to ascertain performance levels at interview, this needs to be followed up more formally.
Towards the end of the training cycle is another point at which the placement process can be checked.
Establishing good communication links with trainers and tutors is vital to this process.
Readings and Activities for Topic 6
Activity 6.1
Feedback about placement in different settings
Because of the wide variety of LLN delivery settings – from neighbourhood houses with one or two teachers, to
large further education environments with many staff members, or workplace environments with integrated LLN –
the process for gaining feedback needs to be flexible.
List some methods of getting quality feedback about placement in a range of LLN settings. Where
possible, draw on your own experiences in LLN settings.
Early checks on placement
Look at the following scenario: ‘James’ had difficulty in participating in the initial interview, was distracted and
somewhat unresponsive. He was able to complete the enrolment form independently but was reluctant to
D:\106755531.doc
Page 76 of 80
engage in any further activities. Most of his oral responses were monosyllabic although he did tell you that he
enjoyed maths at school. You are unsure about appropriate placement and have placed him conservatively in a
lower level literacy class.
What will you do to ensure that his receiving teachers are aware that there is a placement issue?
How will you follow up on the placement?
How will you find out if the placement is appropriate?
Activity 6.2
Collecting information about the placement
Respond to the following questions:
What are some possible problems related to the placement process? Problems could relate to:





interview processes
assessment tasks
understanding of performance in relation to assessment tools
failure to understand the needs of the learner in a more holistic way.
practical considerations related to location, timing, personal circumstances, record keeping?
Suggest other potential problem areas.
Problems may be reflected in the learner’s engagement in training.
End of course review is also an essential point at which to collect feedback about the placement.
What questions would you ask of teachers, trainers and learners to ascertain that the placement process was
effective?
Devise a short questionnaire for learners or teachers/trainers which could be used to collect this information.
What changes would you make in response to this feedback?
D:\106755531.doc
Page 77 of 80
Assessment validation
Reading for Activity 6.3 AQTF Assessment Validation Standards
AQTF Standards
http://www.ddaedustandards.info/index.php
Activity 6.3
What is assessment validation?
What obligation is there for RTOs to conduct validation as part of AQTF Guidelines?
How does validation contribute to pre-training assessment evaluation processes?
Review your assessment tool kit with a nominated mentor eg. A supervising teacher at placement.
Note comments and suggestions for changes in processes you used and or changes to tasks. In collaboration
with your supervisor make any changes to the assessment tool kit that you decide are necessary.
References
Booth, R., Clayton, B., House, R & Roy, S., (2002). Maximising confidence in assessment decision-making:
Resource kit for assessors. Report, NCVAC.
Fitzpatrick, L McKenna, R and Wignell, L, (1999). Assessment and Placement Resource for the Literacy and
Numeracy program. DEST, Commonwealth of Australia CGEA home page.
http://www.staff.vu.edu.au/cgea/principles.html from Teaching 4 Learning CDU
http://learnline.cdu.edu.au/t4/teachinglearning/assessment.html
http://www.vetinfonet.det.wa.edu.au/progDev/resources.aspx?menu+4&menultem+4#Contl
Rowntree, D., (1991). Assessing Students: How shall we know them? New York, Nichols
D:\106755531.doc
Page 78 of 80
Useful hyperlinks
Australian Core Skills Framework
ACSF
ISLPR
International Second Language Proficiency Ratings (ISLPR®)
AQTF (Home Page)
AQTF (Standards)
Precision Consultancy
DEEWR
DEEWR Assessment Guidelines
NTIS
Built in not bolted on (ANTA publication revised edition 2000)
‘Built in not bolted on’ Wignall, L
http://www.voced.edu.au/td/tnc_82.462
VET funding table
LiteracyNet
WELL
Workplace English Language and Literacy Program (WELL)
Language, Literacy and Numeracy Program
LLNP
D:\106755531.doc
Page 79 of 80
Appendix
Sample Placement Test
D:\106755531.doc
Page 80 of 80
Download