N350 Research in Nursing: Ferris State University
L. Ford, PhD, RN, CNP
Semester: Spring 2011
Student name: Kathy LaPonsie
Research Article Critique Matrix and Analysis
In order to critique a research article, you will need to read the article with some questions in mind. The
following table offers you questions to ponder as you review the qualitative and quantitative articles. The
table is also set up in a side by side format to further develop your understanding of how these two major
types of research methodology differ. Recall from the assignment that both the matrix and the analysis are
due for full points. The grading rubric is per the course syllabus.
Research Article Critique Matrix:
Quantitative Research Evaluation
Article: Rogers, A. E., Hwang, W., Scott, L.,
Aiken, L. H., & Dinges, D. F. (2004). The
Working Hours of Hospital Staff Nurses and
Patient Safety. Health Affairs, 23(4), 202-212.
doi: 10.13770/hlthaff.23.4.2002.
Introduction
Is the purpose of the study presented? Yes
Is the significance (importance) of the problem
discussed? Yes
Does the investigator provide a sense of what
he or she is doing and why? Yes
Problem Statement
Is the problem statement clear? Yes, but is
address as the purpose of the paper.
Does the investigator identify key research
questions and variables to be examined? Yes
Does the study have the potential to help solve
a problem that is currently faced in clinical
practice? Yes
Literature Review
Does the literature review follow a logical
sequence leading to a critical review of
supporting and conflicting prior work? Yes
Is the relationship of the study to previous
research clear? Yes
Does the investigator describe gaps in the
literature and support the necessity of the
present study? Yes
Theoretical framework and hypothesis
Is a rational stated for the theoretical/
Qualitative Research Evaluation
Article: Aitken, M. E., Mele, N., & Bennett, K.
W. (2004). Recovery of Injured Children:
Parent Perspective on Family Needs. Archives
of Physical Medicine and Rehabilitation. 85(4),
567-573. doi: 10.1016/j.apmr.2003.06.018.
Statement of the phenomenon of interest
Is the phenomenon of interest clearly
identified? Yes
Has the researcher identified why the
phenomenon requires a qualitative format? Yes
Has the researcher described the philosophic
underpinnings of the research? No
Purpose
Has the researcher made explicit the purpose of
conducting the research? Yes, “to study the
broader impact of emotional and financial
burdens of injury in children on their families,
along with solutions to these problems”
(Aitken, Mele, & Barrett, 2004, p. 567).
Does the researcher describe the projected
significance of the work to nursing? Researcher
describes significances for all healthcare
professionals including nurses.
N350 Research in Nursing: Ferris State University
L. Ford, PhD, RN, CNP
Semester: Spring 2011
Student name: Kathy LaPonsie
conceptual framework? No, this is not stated.
Does the investigator clearly state the
theoretical basis for hypothesis formulation?
No
Is the hypothesis stated precisely and in a form
that permits it to be tested? No, it is not stated
precisely, but it can be tested. Rogers, Hwang,
Scott, Aiken, & Dinges (2004) states that
studies have not been conducted regarding the
long hours nurses work in relationship to
patient safety. The hypothesis is does the long
work hours of nurses have an adverse effect on
patient safety (Rogers et al., 2004).
Methodology
Are the relevant variables and concepts clearly
and operationally defined? Yes
Is the design appropriate for the research
questions or hypotheses? Yes
Are methods of data collection sufficiently
described? Yes
What are the identified and potential threats to
internal and external validity that were present
in the study? Fatigue, increased work intensity,
or combination of both could also contribute to
errors and near errors (Rogers et al., 2004) thus
threatening internal validity. Information for
study was obtained from self-reporting
methods from small sample of hospital staff
nurses with a lower than usual response rate
(Rogers et al., 2004). Demographic
characteristics of the sample were found to be
consistent with other studies though (Rogers et
al., 2004).
If there was more than one data collector, was
inter-rater reliability adequate? The number of
data collectors was not discussed in the study.
Steps were taken to standardize responses by
coding errors and near errors into categories
and clearly defining work patterns of nurses.
Sample
Are the subjects and sampling methods
described? Yes
Is the sample of sufficient size for the study,
given the number of variables and design? Yes
Is there adequate assurance that the rights of
human subjects were protected? Yes, implied
but not described
Instruments
Method
Is the method used to collect data compatible
with the purpose of the research? Yes, the
qualitative approach using focus groups or case
study method was decided to be used for this
study. Researchers had conducted a quantitative
cohort study and then wanted to seek a deeper
understanding of families’ experience (Aitken,
Mele, & Berrett, 2004).
Is the method adequate to address the
phenomenon of interest? Yes
If a particular approach is used to guide the
inquiry, does the researcher complete the study
according to the processes described? Yes
Sampling
Does the researcher describe the selection of
participants? Yes
Is purposive sampling used? Yes
Are the informants who were chosen
appropriate to inform the research? Yes
Data Collection
N350 Research in Nursing: Ferris State University
L. Ford, PhD, RN, CNP
Semester: Spring 2011
Student name: Kathy LaPonsie
Are appropriate instruments for data collection
used? Yes
Are reliability and validity of the measurement
instruments adequate? Yes, there is a good
discussion on use of logbooks. Logbooks have
also been pilot-tested before use in study
(Rogers et al., 2004).
Data Analysis
Are the statistical tests used identified and the
values reported? Yes
Are appropriate statistics used, according the
level of measurement, sample size, sampling
method, and hypotheses/ research questions?
Yes
Results
Are the results for each hypothesis clearly and
objectively presented?
Do the figures and tables illuminate the
presentation of results? Yes
Are results described in light of the theoretical
framework and supporting literature? They are
not described in light of theoretical framework,
but supporting literature is discussed.
Conclusions/ discussion
Are conclusions based on the results and
related to the hypotheses? Yes
Are study limitations identified? Yes
Is data collection focused on human
experience? Yes
Does the researcher describe data collection
strategies (i.e. interview, observation, field
notes)? Yes, focus groups were conducted.
Is protection of human participants addressed?
Not specifically, informed consent was
obtained.
Is saturation of the data described? Yes, but not
in detail
Has the researcher made explicit the procedures
for collecting data? Yes
Data analysis
Does the researcher describe the strategies used
to analyze the data? Yes
Has the researcher remained true to the data?
Yes
Does the reader understand the procedures used
to analyze the data? Yes
Does the researcher address the credibility,
auditability, and fittingness of the data? Yes
Credibility: Do the participants recognize the
experience as their own? Yes
Auditability: Can the reader follow the
researcher’s thinking? Yes for the most part
Does the researcher document the research
process? Yes
Fittingness: Can the findings be applicable
outside the study situation? Yes Are the results
meaningful to individuals not involved in the
research? Yes.
Is the strategy used for analysis compatible
with the purpose of the study? Yes
Findings
Are the findings presented within a context?
Yes
Is the reader able to grasp the essence of the
experience from the report of the findings? Yes
Are the researcher’s conceptualizations true to
the data? Yes
Does the researcher place the report in the
context of what already is known about the
phenomenon? No, the research did not refer to
past literature on this this phenomenon often.
Conclusion, implications, and
recommendations
Do the conclusions, implications, and
recommendations give the reader a context in
N350 Research in Nursing: Ferris State University
L. Ford, PhD, RN, CNP
Semester: Spring 2011
Student name: Kathy LaPonsie
Are generalizations made within the scope of
the findings? Yes
Are implications of findings discussed (i.e. for
practice, education, and research)? Yes
Are recommendations for further research
stated? Yes
which to use the findings? Yes, but could have
been expanded upon.
Do the conclusions reflect the study findings?
yes
Does the researcher offer recommendations for
future study? No
Has the researcher made explicit the
significance of the study to nursing? Researcher
has taken findings and implemented changes in
facility where study occurred and gave
recommendations for other facility. Results can
be used by all health care providers.
Research utilization implications
Is the study of sufficient quality to meet the
criterion of scientific merit? Yes
Does the study meet the criterion of
replicability? Yes
Is the study of relevance to practice? Yes
Is the study feasible for nurses to implement?
Yes
Do the benefits of the study outweigh the
risks? Yes
Research Article Critique Analysis:
Your ‘paper’ segment of this assignment is the analysis – which allows you to demonstrate your critical
thinking skills and assimilation of the course learning objectives. It is the most significant portion of the
assignment, and will be graded with an emphasis on your ability to present an objective critique. The
whole idea of a critique is to determine a study’s strengths and weaknesses, not to merely parrot the
findings of the study. Your analysis needs to include a supported statement that the research is
strong enough or not to be used in Evidence Based Nursing Practice. Each article is expected to be
accompanied by the completed research article critique matrix form and your analysis.
Article: Rogers, A. E., Hwang, W., Scott, L., Aiken, L. H., & Dinges, D. F. (2004). The working hours
of hospital staff nurses and patient safety. Health Affairs, 23(4), 202-212.doi:
10.13770/hlthaff.23.4.2002.
Quantitative Research Article Analysis
Ethical Aspects: The ethical aspects were not directly address in the article. It is implied that the ethical
aspects were taken into consideration. This study was approved by the Institutional Review Board at the
University of Pennsylvania.
Problem Statement: The problem statement is written as a purpose statement. “The purpose of this
paper is to examine the work patterns of hospital staff nurses and to determine if there is a relationship
between hours worked and the frequency of errors” (Rogers et al, 2004, p. 203).
Literature Review: A review was conducted and found that studies have not been completed that
addressed the long hours that nurses worked and patient safety in the hospital.
N350 Research in Nursing: Ferris State University
L. Ford, PhD, RN, CNP
Semester: Spring 2011
Student name: Kathy LaPonsie
Study Framework: There is no theoretical framework stated.
Hypotheses and Research Questions: There is not a clearly stated hypothesis in this study. This could be
due to the fact that information had not been previously obtained (Rogers et al., 2004). It is implied that
the long hours worked by nurses could “have an adverse effect on patient safety in hospitals” (Rogers et
al., 2004, p. 203).
Quantitative Research Designs: This is a nonexperimental descriptive study where information is
obtained through the use of a logbook which is a form of a survey. This is an appropriate research design
for this study.
Qualitative Research Designs: Not applicable to this article.
Sampling Procedure: A random convenience sample from members of the American Nurses Association
was conducted. The author explains how nurses where contacted and then criteria for eligibility. Return
rate of logbooks and departure from expected return of 2 logbooks discussed. Compensation for
participation noted. Discussion of nurses right to voluntary complete logbook not discussed but is
implied. Sampling methods showed demographic characteristics of nurses and hours worked in this
sample compared to results from other studies (Rogers et al, 2004).
Data Collection Procedures: Logbooks were used to collect data. Their contents were clearly described
and piloted tested before used in study. Rational for this collection method was discussed and supported
by research. Demographic data gathered and discussed sufficiently in article for generalizability of
study. Disadvantages with this collection method also discussed in study limitations.
Data Collection Methods: Logbooks were collected and then analyzed. Classification of data and
statistical analysis explained in depth. Who analyzed the data was not discussed.
Descriptive Statistics: Descriptive statistics were described clearly in narrative and table format. Tables
were clearly labeled and referred to in narration.
Inferential Statistics: This study used logistic regression models, odds ratio, multivariate analyses and
two sided significance tests for evaluating variables. Discussion of how statistics were obtained and used
was clearly described. Inferential statistics were discussed in narration and in table format.
Presentation of Study Findings: Study findings were discussed in length in a clear and understandable
format. Strengths and limitations of study clearly presented. Study found that there is a correlation
between the long hours that nurses work and the number of errors and near errors. Based on study
finding changes in working hours of nurses recommend by authors. Ideas of additional research also
presented.
Your ANALYSIS: The information from this article made me question the safety of working twelve
hour shifts and overtime. I feel that the study was well constructed and easy to understand. The authors
stated that this is the first study to address this subject. Further research needs to be done to validate
these findings before this this study could be used in Evidenced Based Nursing Practice. I think that
replicate studies need to be performed and other variables need to be examined. This study alone is not
strong enough in my opinion to influence such large practice changes in nursing. There are many factors
that contribute to the working conditions of nurses. The two main factors being lack of staff and cost
saving measures. Studies like this one will be helpful to changing working conditions of nurses when
paired with studies that can show how important nurses are to patient safety, satisfaction, and outcomes.
Article:
Aitken, M. E., Mele, N., & Bennett, K. W. (2004). Recovery of Injured Children: Parent Perspective on
Family Needs. Archives of Physical Medicine and Rehabilitation. 85(4), 567-573. doi:
10.1016/j.apmr.2003.06.018.
N350 Research in Nursing: Ferris State University
L. Ford, PhD, RN, CNP
Semester: Spring 2011
Student name: Kathy LaPonsie
Qualitative Research Article Analysis
Ethical Aspects: The ethical aspects are not discussed in this article. It is implied that ethical
consideration has been considered. This study has been approved by the local institutional review board
and informed consent was obtained (Aitken et al., 2004).
Statement of the phenomenon of interest: The phenomenon of interest is the needs of families of injured
children. Researchers clearly explained the phenomenon in the introduction of the article and used
appropriate supporting research.
Purpose: The author does not have a clear purpose statement to guide research, but purpose can be
clearly understood. “Children and their families experience substantial stress and measurable
deterioration in health status after injury” (Aitken et al., 2004). Understanding the factors that cause
them stress can help to find solutions.
Method: A focus group method was used in this study. The researchers obtained rich descriptions from
attendees of group. The benefit of this method is that group interviews can encourage conversation and
increase recall of parents. Disadvantages are that parents may alter responses to be more positive or
negative based on group dynamics. Single personal interview may not have been feasible to conduct, but
may have let to different results.
Qualitative Research Design: The type of qualitative research design is not clearly defined. A case study
design appears to be used with focus groups being conducted. Parents of injured children are the group
of interest and content analysis is performed. This design is appropriate for the purpose of the study.
Sampling: The sample for this study was already in place. A longitudinal cohort quantitative study had
been conducted that caused the researcher to seek a better understanding of the families experiences
(Aitken et al., 2004). Rationale for continued use of this sample clearly explained. A description of
sampling to the quantitative study not discussed in this article.
Sampling Procedure: Researchers explained “mothers of children in the cohort study were invited to
participate in 1 of 3 focus groups using a purposive, typical case sampling strategy” (Aitken et al., 2004,
p. 568). The number of mothers invited to the focus groups was not mentioned, but 16 mothers
participated. The response rate was not mentioned and is not obtainable in data presented.
Data Collection: The article clearly described the training of the moderator and assistant moderator.
Methods of obtaining data clearly described with two separate methods used to collect data. Structured
interview guide was piloted for effectiveness before use.
Data Analysis: Clearly described and appropriate for study. Data was coded and then analyzed for
differences and similarities within the group and across groups (Aitkens et al., 2004). Multiple checks
were done to ensure data true to participants’ intend. Article noted that termination of data was done
when saturation reached. There is no further mention of saturation.
Findings: The author used many quotes from the focus group. This allowed the reader insight into the
feelings and experiences of the family member. The researchers allowed for difference perspectives to
be viewed under each area of concern. Parental needs and potential responses of interventions to meet
the parent’s needs were discussed. Interventions were effectively communicated in narration and in table
format. The article discussed how interventions were already implemented at the study institution. This
addition was a bit awkward as worded, and a more generalized approach could be more effective. The
limitations of this study were clearly described. Findings were not compared with past study findings.
Conclusion, Implications, and recommendations: The study’s conclusion was two sentences. The
N350 Research in Nursing: Ferris State University
L. Ford, PhD, RN, CNP
Semester: Spring 2011
Student name: Kathy LaPonsie
researchers did not address recommendations for further research or implications of the study in the
conclusion.
Your ANALYSIS: This article was interesting to me as a parent of an injured child and nurse. The
article was informative. This article did not refer often to past research on this topic. It would be
interesting to see how these parents’ experience compare to others. This article gave some simple
interventions that could be easily incorporated into nurses teaching and would require little or no
finances to complete. The study institution had implemented the recommended interventions. A study of
effectiveness of the interventions would be interesting. I would support the use of this article in
Evidence Based Nursing Practice with the understanding that a further search of available literature on
this topic be completed. I also think that each institution may have different needs, so recommended
interventions would have to be tailored to each facility. I do not feel that this study is strong enough to
be used by itself, but it gives valuable insight into the complex needs of families with injured children.
Excellent analyses – it has been a pleasure to see your skills with nursing research grow this semester.
References:
Aitken, M. E., Mele, N., & Bennett, K. W. (2004). Recovery of Injured Children: Parent
Perspective on Family Needs. Archives of Physical Medicine and Rehabilitation. 85(4),
567-573. doi: 10.1016/j.apmr.2003.06.018.
Arslanian, C. (2000) Taking the mystery out of research: How to read a nursing research article.
Orthopaedic Nursing, 19(1), 43-44.
Brucker, M.C. (2005). Providing evidence-based care: You can understand research and use it in
practice. AWHONN Lifelines, 9(1), 46-55.
Gross-Cohn, E., Jia, H., & Larson, E. (2009). Evaluation of statistical approaches in quantitative
nursing research. Clinical Nursing Research, 19(3), 223-241. doi:
10.1177/0154773809336096
Kamm-Steigelman, L. (2009) Making a quick study of research articles. Critical Care Nurse,
4(1). 17-18. doi: 10.1097/01.CCN.0000343229.79201.ec
Katrak, P., Bialocerkowski, A.E., Massy-Westropp, N., Kumar, V.S.S., Grimmer, K.A. (2004).
A systematic review of the content of critical appraisal tools. BMC Medical Research
Methodology, 4(22), doi: 10.1186/1471-2288-4-22. Retrieved 26 August 2010 from
http://www.biomedcentral.com.proxy.lib.umich.edu/1471-2288/4/22.
Kiss, T., O’Malley, M., Hendrix, T. (2010). Self-efficacy based training for research literature
appraisal: A competency for evidence-based practice. Journal for Nurses in Staff
Development, 26(4), 170-177 doi: 10.1097/NND.0b013e31819aa142
Lanoe, N. (2002) Ogier’s Reading Research: How To Make Research More Approachable, 3rd
Ed., London: Elsevier.
Rankin, M. & Esteves, M.D. (1996). How to assess a research study. American Journal of
Nursing, 96 (12), 32-36.
Riley, J.K. (2002). Understanding research articles. Tar Heel Nurse, 64(3), 15.
Robinson, J.H. (2001) Mastering research critique and statistical interpretation: Guidelines and
golden rules. Nurse Educator, 26 (3), 136 – 141.
N350 Research in Nursing: Ferris State University
L. Ford, PhD, RN, CNP
Semester: Spring 2011
Student name: Kathy LaPonsie
Rogers, A. E., Hwang, W., Scott, L., Aiken, L. H., & Dinges, D. F. (2004). The Working Hours
of Hospital Staff Nurses and Patient Safety. Health Affairs, 23(4), 202-212. doi:
10.13770/hlthaff.23.4.2002.
Thompson, C. & Dowding, D. (2002) Clinical Decision – Making and Judgment in Nursing
Mosby Publishing
Thompson, D.S., Estabrooks, C.A., Scott-Findley, A., Moore, K., & Wallin, L. (2007).
Interventions aimed at increasing research use in nursing: A systematic review.
Implementation Science, 2(15), 1 – 16. doi: 10.1186/1748-5908-2-15. Retrieved 26
August 2010 from http://www.implementationscience.com/content/pdf/1748-5908-215.pdf
Valente, S. M. (2010). Three practical approaches to EBP. Nursing Management, 41(3), 10-13.
doi: 10.1097/01.NUMA.0000369490.46556.28
Vitale, A., (2003) Nursing research article critiques made easy. New Jersey Nurse, 2(1).11-1