the poster - Educational Engineering

advertisement

The linguistic and structural properties of two major physics textbooks are compared. The structure of each textbook is measured and differences in the amount of space, words, and mathematics devoted to different parts of the text are reported.

The linguistic richness of each text and each textual part is measured using LEX. The readability of each textbook is characterized using standard readability formulas. A new readability formula that corrects for mathematics is proposed.

The evolution of one of the textbooks over a fifteen year (four versions of the text) time span is also investigated. The reading difficulty of the textbook increased by approximately one-half a grade level over fifteen years. The lexical richness of the textbook also increased over the same period.

APS Meeting – April 2008 – St. Louis, Missouri Jennifer Campbell

 to quantitatively analyze the evolution of specific textbook features from an early edition to a more recent edition

 to study the similarities and differences of textbooks published at approximately the same time by different publishers

 to compare the linguistic properties of different texts

 to develop a mathematical readability formula to complement textual readability formulae already developed

APS Meeting – April 2008 – St. Louis, Missouri Jennifer Campbell

Only the chapters pertaining to Newton’s Laws as they apply to forces were studied.

These chapters relate to the Newtonian Force Concep measured by the Force Concept Inventory

David Hestenes, The Physics Teacher (1992)

 Chapters 1-6 in Fundamentals of Physics

 Chapters 1-5 in University Physics

APS Meeting – April 2008 – St. Louis, Missouri Jennifer Campbell

 Selection based on popularity of text – top two bestselling calculus-based physics textbooks on Amazon.com © at inception of project

 Fundamentals of Physics 3 rd Edition

Halliday Resnick – published 1988

 Fundamentals of Physics 7 th Edition

Halliday Resnick Walker – published 2004

 University Physics 11 th Edition

Young Freedman – published 2003

APS Meeting – April 2008 – St. Louis, Missouri Jennifer Campbell

 software was created to analyze features in a text passage

(occurrences, area, sentences, mathematical difficulty, etc.)

 textbook pages were converted to TeX format to be compatible with software

 tags were added to text as required by LEX software and counting software

 a twelve – point validation procedure was developed to check for any errors in the text files and software

 method resulted in high statistics study

(50,000 words – 1,000 equations – 60,000 cm 2 of page area)

APS Meeting – April 2008 – St. Louis, Missouri Jennifer Campbell

 a text with mostly common words is easier to read than a text composed of mostly rare words

 lexical richness is characterized by a LEX value developed by

Donald Hayes

 possible LEX values range from -123 to +85

 LEX value of 0.0, (the LEX value of common newspapers) is consistent since the year 1600

 texts with higher LEX values are more difficult to read than texts with lower LEX values

 common words include the 10,000 most common words in the English language – other words are considered rare

 if a rare word is used more than 6 times in a text, the word is no longer considered rare

APS Meeting – April 2008 – St. Louis, Missouri Jennifer Campbell

Text Source

Nature—main research articles

Popular Science Articles

Newspapers

National Geographic – articles

New Yorker - articles

Fundamentals of Physics 7 th Edition

University Physics 11 th Edition

Fundamentals of Physics 3 rd Edition

Sports Illustrated – articles

TV – primetime shows

Dairy farmer talking to cows

APS Meeting – April 2008 – St. Louis, Missouri

LEX Score

34.7

4.6

0.0

-0.6

-3.9

-3.91

-5.11

-6.2

-10.3

-36.4

-56.0

Jennifer Campbell

APS Meeting – April 2008 – St. Louis, Missouri

Donald Hayes, Nature (1992)

Jennifer Campbell

Fundamentals of Physics 3 rd

-6.2

Edition

Chapter Text Examples Review

-6.84

-6.39

4.29

Fundamentals of Physics 7 th Edition

-3.91

Chapter Text Examples Review

-4.48

-5.09

9.02

University Physics 11 th

-5.11

Edition

Chapter Text Examples Review

-4.22

-6.22

6.18

APS Meeting – April 2008 – St. Louis, Missouri

Technical terms such as vector, gravity, and inertia were discarded because they occurred frequently. This accounts for the low LEX score of the texts.

The review sections have a large amount of technical terms in a small amount of text. This accounts for the high LEX value of these sections.

The error of the LEX value is

0.63.

Jennifer Campbell

The textbook pages were subdivided into three basic types of blocks:

 text – includes all text found in chapter text, examples, and text specific sections

 figures – includes all figures, tables, and their captions

 blank space – includes white space inside text and margin – does not include page borders

APS Meeting – April 2008 – St. Louis, Missouri Jennifer Campbell

The page was also subdivided into sub-blocks that were identified by the authors:

 Chapter Text – text that is part of the main exposition, not part of one of the blocks below

 Examples

 End of Chapter Questions and Problems

 and Other –

Fundamentals of Physics 3 rd Edition: Hints and Review sections

Fundamentals of Physics 7 th Edition: Checkpoints and Review sections

University Physics 11 th Edition: Test Your Understanding,

Problem Solving Strategies, and Review sections

APS Meeting – April 2008 – St. Louis, Missouri Jennifer Campbell

A comparison of the allocation of page area to the text blocks, figure blocks, and blank area.

Fundamentals of

Physics 3 rd Edition

4%

19%

77%

Fundamentals of

Physics 7 th Edition

12%

7%

81%

University Physics

11 th Edition

10%

17%

73%

Text Figures Blank Space

APS Meeting – April 2008 – St. Louis, Missouri Jennifer Campbell

University Physics

11 th Edition

Fundamentals of

Physics 7 th Edition

Fundamentals of

Physics 3 rd Edition

0 20000

Text

Figures

Blank Space

Fundamentals of

Physics 3 [cm 2 ]

36575.36

9258.33

Fundamentals of

Physics 7 [cm 2 ]

University Physics 11

[cm 2 ]

47352.22

57521.18

7293.642

13006.5

2003.8

4104.92

7708.288

APS Meeting – April 2008 – St. Louis, Missouri

40000 cm 2

60000 80000

Text Figures Blank Space

Jennifer Campbell

40%

30%

20%

10%

0%

Chapter Text Examples Problems

Fundamentals of Physics 3rd Edition

Fundamentals of Physics 7th Edition

University Physics 11th Edition

Other

APS Meeting – April 2008 – St. Louis, Missouri Jennifer Campbell

To study the mathematical presentation of the text, a measure of the density of the mathematics was developed. Mathematic expressions were converted to simple English sentences.

For example:

3x + 2y = 10 would read

“three multiply x add two multiply y equals ten”

The number of words in the expression is a measure of the complexity of the expression. This expression has nine “math words.” The number of math words in a passage was then compared to the number of total words (math + text) to yield the mathematical density.

APS Meeting – April 2008 – St. Louis, Missouri Jennifer Campbell

0.35

0.3

0.25

0.2

0.15

0.1

0.05

0

Overall Chapter Text Examples

Fundamentals of Physics 3rd Edition

Fundamentals of Physics 7th Edition

University Physics 11th Edition

Other

APS Meeting – April 2008 – St. Louis, Missouri Jennifer Campbell

Textual Readability formulae do not account for mathematics in text – a complimentary readability formula was needed to measure the readability of the mathematics.

 Scientific passages including various amounts and levels of mathematics were given to University Physics I and II students at the University of Arkansas to read.

 Students were asked to recall 10 missing words/numbers/equations from the passages.

 Their answers were combined with the statistics from the passage and statistical analysis software (SAS) was used to determine a mathematical readability formula by a multiple linear regression.

APS Meeting – April 2008 – St. Louis, Missouri Jennifer Campbell

Math Readability = 0.6113 – 5.9074 + 5.9886 - 0.8993

= inline math objects per total objects

= math objects per total objects

= math words per total words

The mathematical readability score gives the projected fraction of questions students will answer correctly for a given passage.

APS Meeting – April 2008 – St. Louis, Missouri Jennifer Campbell

Math objects include a count of the number of equations, numbers, and symbols in a passage.

Inline math objects are in the flow of the text, not set aside.

Possible scores range from 0 to 1

Texts with scores closer to 0 are more difficult to read.

Texts with scores closer to 1 are easier to read.

A larger amount of math set apart from the text usually leads to a higher mathematical readability score.

APS Meeting – April 2008 – St. Louis, Missouri Jennifer Campbell

0.51

0.5

0.49

0.48

0.47

0.46

0.45

0.44

0.43

0.42

0.509

0.456

0.459

Fundamentals of Physics 3rd

Edition

Fundamentals of Physics 7th

Edition

University

Physics 11th

Edition

A higher score signifies an easier to read passage.

APS Meeting – April 2008 – St. Louis, Missouri Jennifer Campbell

 Designed to determine the comprehension difficulty of a passage.

 Higher scores are easier to read

 Lower scores are harder to read

90-100 – understandable by 11 year old

60-70 – understandable by 13-15 year old

0-30 – understandable by college graduates

Flesch Reading Ease Score:

206.835 – 1.015(words per sentence) – 84.6(syllables per word)

Rudolf Flesch, Journal of Applied Psychology ( 1948)

APS Meeting – April 2008 – St. Louis, Missouri Jennifer Campbell

Fundamentals of Physics 3 rd Edition

61.9

Chapter Text Examples Other

57.7

70.4

59.0

Fundamentals of Physics 7 th

58.2

Edition

Chapter Text Examples

55.9

62.7

Other

54.4

University Physics 11 th

57.7

Edition

Chapter Text Examples

53.8

62.4

Other

58.2

APS Meeting – April 2008 – St. Louis, Missouri Jennifer Campbell

Between the 3 rd and 7 th editions of Fund. of Physics, the total page area increased by ~ 23%. In the same time frame, the blank area increased by 104%. (That equates to about 5 extra blank pages for every 5-6 chapters in the text.)

The textual and mathematical readability tests reveal the difficulty of Fundamentals of Physics has increased over the 16 year period. They also reveal that texts published in approximately the same year yield similar readability scores.

Over the same time, the mathematics also became somewhat less readable. This is due in part to an increase in the amount of math imbedded in the text.

APS Meeting – April 2008 – St. Louis, Missouri Jennifer Campbell

The mathematical readability will continue to be studied.

The mathematical expressions (previously treated as proper names for LEX) will be translated into English sentences and analyzed with LEX software.

APS Meeting – April 2008 – St. Louis, Missouri Jennifer Campbell

Textbooks

Halliday, Resnick, Fundamentals of Physics 3 rd Edition, Wiley Publishing. 1988

Halliday, Resnick, Walker, Fundamentals of Physics 7 th Edition, Wiley Publishing. 2004

Young, Freedman, University Physics 11 th Edition, Addison Wesley Publishing. 2003

LEX

Donald P. Hayes, "The Growing Inaccessibility of Science", Nature, (1992) 356, pp 739-40.

Jonathan Knight, “Scientific Literacy: Clear as Mud”, Nature, (2003) 423, pp 376-78.

Flesch Reading Ease

Rudolf Flesch ,A new readability yardstick, Journal of Applied Psychology, Vol. 32, (1948) pp. 221-233

Force Concept Inventory

David Hestenes, Gregg Swackhamer, and Malcolm Wells. Force concept inventory. The

Physics Teacher, 30:141–158, 1992.

APS Meeting – April 2008 – St. Louis, Missouri Jennifer Campbell

Download