CriteriaforgradingpapersinTDDB84
A value<3isafail.
Independence
1. ThepaperisonlybasedonmaterialfromtheGoF bookandtheFreeColcode
base, withnoindependentlyselectedmaterialonsoftwarequalityorsoftwaredesign.
3. Thepaperisbasedoncoursematerialsuchasonlinelecturematerial, thecourse
book, andreferencesonthecourseweb. Hasselectedabasictopic.
4. Thepapergeneralizesfromthecoursematerialandusesseveralownreferences
topapers. Hasselectedabasictopic.
5. Thepaperusesmostlysourcesnotprovidedbythecourse, andhasselectedan
advancedtopic(A).
Topic
Thepapershouldincludeaquestionatthebeginningontheform howdoestheimplementationofX inY affectZ asmeasuredbyW?1 .
1. ThepaperisvagueonthedefinitionofthequalityZ,oronhowthequalitymay
bemeasuredusingW,orwhyitisreasonabletobelievethattheuseofdesign
patternX wouldaffectthisquality.
3. ThepaperdescribeshowtoimplementX inY,andjustifieswhythiswouldaffect
Z asmeasuredbyW.Thetopicisabasictopic.
4. ThepaperclearlydescribeshowtoimplementX inY,andjustifieswhythiswould
affectZ asmeasuredbyW.Thetopicisadvanced(A).
5. ThepaperclearlydescribeshowtoimplementX inY,andjustifieswhythiswould
affectZ asmeasuredbyW.Thetopicisadvanced(A).Y isjustifiedbyrelatingto
X andZ.Thetopicisofgeneralinterest, andtheconnectionsbetweenX,Y,Z
andW arewellpresented.
1 X isaDesignPattern, Y is, dependingonthemaintopic, oneortwoapplications, languages, paradigms
orframeworks, Z isasoftwarequality, andW isaconcreteinstrumentthatmaybeusedtoevaluateZ.
1
Languageandform
1. Thetextcontainsspellingorgrammaticalerrorsthatmakesitdifficulttounderstandthecontentofthepaper. Therearefigures, tablesorcodeexamplesthat
aredifficulttoread, thatarenotreferencedorillegallycopiedverbatimfromother
sources.
3. The text is for the most part without errors related to spelling, grammar, formattingorstructure. Somepartsofthetextmaybehardtoread, containlong
sentences, unclearreferencesorunexplainedterms. Thetextisreasonablycoherent.
4. Thetextcontainsalmostnoerrorsrelatedtospelling, grammarorform, hasclear
referencesandiseasytoread. Sometermsmaybeintroducedwithoutexplanation, ortheremaybeinformallanguageinthetext. Allconceptsintroducedare
usedinlaterpartsofthereport. Thestructureofthereportissuchthatitiseasy
tofollowthepaper. Termsandconceptsaredescribedusingcrispandclearlanguage.
5. Thetextcontainsnoerrorsrelatedtospelling, grammarorform, hasclearreferencesandiseasytoread. Thestyleofthetextissimilartothatofaresearch
paper, andalltermsaresufficientlyexplained. Allconceptsintroducedareused
inlaterpartsofthereport.
Sourcemanagement
1. Claimsaretoalargeextentnotjustifiedbyappropriatesources. Sourcesusedare
predominantlyblogs, corporatewebsitesorWikipediaentries. Theirreliability
isnotdiscussed. Thelistofreferencesisnotformattedaccordingtostandards,
andpreventsreadersfromretrievingtheoriginalsourcesandverifyclaims.
3. Mostclaimsarecorrectlyjustifiedbythecorrectuseofsources. Thelistofreferencesisconsistenlyformattedwithallrelevantmetadata. Thevalidityofthe
sourcesusedisdiscussedtosomeextend, butmayinsufficientlydifferentiatebetweenpeer-reviewedsourcesandothers. Someclaimsmaylacksources, orbe
basedontoogeneralortoospecificsourcestobeconsideredtrustworthy.
4. Allclaimsarecorrectlyjustifiedbythecorrectuseofsources. Thelistofreferencesisconsistenlyformattedwithallrelevantmetadata. Sourcesarespecificto
theclaimsmade, andusedcorrectly, andaretosomedegreeevaluated. Many
sourcesmaybenon-peer-reviewed. Somesourcesusedarewell-citedorsurvey
articles.
5. Allclaimsarecorrectlyjustifiedbythecorrectuseofsources. Thelistofreferencesisconsistenlyformattedwithallrelevantmetadata. Sourcesarespecificto
theclaimsmade, usedcorrectly, andevaluatedwithrespecttotheirreliabilityand
relevance. Mostsourcesarepeer-reviewedpapers, andarewell-cited. Thereare
atleasttwosurveypapersamongthereferences.
2
Analysis
1. Theanalysisusesvaguereasoning, analogiesorotherwiseill-foundedclaimsabout
thepropertiesofthechosenapplication. Theanalysisdoesprovideclearanswers
tothatwhichwastheinitialquestionofthepaper. Thedistinctionbetweenthe
applicationofadesignpattern(X),thatwhichcanbemeasuredinacodebase
whereitoccurs(W),andthequalitywemaybeinterestedinimproving(Z) is
unclear, ormissing.
3. Theevaluationisclearlyrelatedtothemainsubject, butmaybelimitedinscope
orvalidity. TheanalysisarebasedonacomparisonbetweenoneimplementationofdesignpatternX inY andsomeotherimplementationtojustifyclaims.
Theanalysisiscoherentandprovidesareasonableanswertothequestion. The
analysisusespeer-reviewedreferencestoatleastsomeextent.
4. Theevaluationisclearlyrelatedtothemainsubject, andisofsomegeneralinterest. Theanalysisisbasedonacomparison, andclearlylinksW toZ,anddescribes
howthatwhichismeasured(W) givesindicationsofthequalitythatweareinterestedin(Z).Theanalysismostlyusespeer-reviewedreferencestosupportclaims.
5. Theevaluationisclearlyrelatedtothemainsubject, andisofgeneralinterest.
Theanalysiscombinesathoroughliteratureoverviewwithanempiricalcomparison of implementations of design patterns. The analysis only uses well-cited,
peer-reviewedscientificreferencestosupportclaimsthataremade.
3