TRINITY COLLEGE DUBLIN Lecture 13 Research Methods in Economics Karol Jan Borowiecki Schedule for this Morning 1) Getting Started 2) Writing 3) Publishing and Career Development 4) Electronic Resources 5) Citation and Referencing 6) Concluding Remarks TRINITY COLLEGE DUBLIN Part I Getting Started TRINITY COLLEGE DUBLIN Getting Started There are no golden rules for how to do research but there are some common mistakes. Don’t spend too much time reading other people’s research, waiting for inspiration to strike you. • Reading research should be a regular part of any economist’s routine. But it is not a substitute for doing your own Don’t set the bar too high. But don’t set the bar too low! • Be wary of picking a topic that is of interest to a small number of people (e.g. you and your adviser) TRINITY COLLEGE DUBLIN Empirical Work – Thinking About Ideas “Scientific” Model Formulate Hypothesis Get Data Test Hypothesis Report Results TRINITY COLLEGE DUBLIN Four good ways to start an empirical paper 1) Get some data and start playing with it. • Sometimes, this throws up an interesting pattern • Write a paper exploring/explaining this pattern 2) Read a paper that you found interesting. • Get their dataset and replicate their results • Maybe try it out on a new dataset • A good way to learn the area, but may also lead you to follow-up questions. For example, would you have done the analysis differently, or could it be applied to another example? TRINITY COLLEGE DUBLIN Four good ways to start an empirical paper 3) Read about something interesting in the popular press or blogs? • Analyse the statements with some data. Be critical to everything you read. 4) Study something that interests you. • Thinking outside the box (Freakonomics) TRINITY COLLEGE DUBLIN Part II Writing TRINITY COLLEGE DUBLIN Keep it Short “I am sorry to have wearied you with so long a letter but I did not have time to write you a short one.” Blaise Pascal TRINITY COLLEGE DUBLIN Keep it Short “I am sorry to have wearied you with so long a letter but I did not have time to write you a short one.” Blaise Pascal People have limited time and most of us are impatient. Try to keep papers to no more than 20 pages of text. If you have a lot more material, maybe it should be two papers (are there two ideas in the paper?). Use Appendixes for less important parts. Try limit introductions to 2 or 3 pages. TRINITY COLLEGE DUBLIN Keep it Short Don’t litter your paper with lots of footnotes. Don’t be repetitive. Body of the paper: Get to the central result as fast as possible. The theory must be the minimum required for the reader to understand the empirical results. TRINITY COLLEGE DUBLIN Writing Skills More important than you think! Your ideas and results will not sell themselves. Many economists think of themselves as primarily experts in technical methods: Econometrics, economic theory, data expertise. This “white coat” mentality—that we are mainly scientists who then do a write-up of our results—is deeply wrong. Writing is an essential part of the research process, not a last-minute thing to be rushed. Advice: Imitate skillful writers, imitate their words and phrases, and modify them to suit your purpose. TRINITY COLLEGE DUBLIN Selling Your Paper Most people are busy. There are lots of other papers they could read. There’s lots of bad research out there. So, there’s good reason for people to approach your work with a sceptical attitude. Your paper needs to make a quick case for itself. How? TITLE, ABSTRACT, INTRODUCTION TRINITY COLLEGE DUBLIN Preparing, Writing, Reviewing, Referencing and Publishing of Working Papers in the Field of Economics Research Methods in Economics How to be a Successful Economist? Research Methods How to be a Successful Economist? Research Methods Karol Jan Borowiecki Trinity College Dublin The Abstract Put the punch line right up front. Your research is not a “joke” or a “novel”. Readers want quick information! Your abstract will be read by ten or twenty times as many people as will any other words in the article. Don’t display your copious bibliographic knowledge in the abstract. Usually the length is limited to 100 words. TRINITY COLLEGE DUBLIN The Abstract “We study how drinking affects car crashes.” or “We present a methodology for measuring the risks posed by drinking drivers that relies solely on readily available data on fatal crashes.” TRINITY COLLEGE DUBLIN The Abstract “Drinking alcohol increases the risk of car accidents.” or “Drivers with alcohol in their blood are seven times more likely to cause a fatal crash; legally drunk drivers pose a risk 13 times greater than sober drivers.” TRINITY COLLEGE DUBLIN The Introduction How to do it? Quickly explain two things: 1) Why is the topic of your paper interesting? 2) What did YOU do? What is YOUR contribution? A new question? An existing question but new methodology? Existing question, existing methodology, new data (e.g. no previous Irish application)? Because of its importance, spend a high fraction of your time on the introduction. Start writing the introduction as soon as you have some results and then keep adjusting it as the paper evolves. TRINITY COLLEGE DUBLIN The Introduction Class Exercise: Read Introduction and label each paragraph in: Miguel E., S. Satyanath, E. Sergenti. (2004). Economic Shocks and Civil Conflict: An Instrumental Variable Approach. Journal of Political Economy, 112(4), 725753. TRINITY COLLEGE DUBLIN Literature Review You need to explain the relationship to other work. This will probably require discussion of previous studies in this area. But the purpose is to set up your contribution, and distinguish it from previous work. Do not do a boring “literature review” mindlessly listing various weakly related studies (set your paper off against the 2 or 3 closest current papers). Sometimes, this can be done in the introduction. Cite strategic. TRINITY COLLEGE DUBLIN Describing Your Empirical Results Start with the main result. People don’t care about the 100 variations on the base regression. People tend to skim papers, so charts and tables should essentially speak for themselves. Don’t put too many numbers in tables, and don’t have too many tables or charts. Space out your paper. Short paragraphs, regular section. Appendices are a great tool! Don’t over-do technique: Are there simple ways to summarise or explain the results? TRINITY COLLEGE DUBLIN Other Practical Tips Use footnotes only for things that the typical reader can skip but a few readers might want to look at: • • • Long list of references Simple bits of algebra Other documentation Tables should have a self-contained caption. Use the correct number of significant digits, not whatever the statistical program displays (4.56783 with a standard error of 0.6789 should be 4.6 with standard error 0.7). Good figures communicate patterns in the data much better than big tables. When you use Greek letters give them the name too and repeat the name: “Price elasticity equals -0.5”, not just “ equals -0.5”. TRINITY COLLEGE DUBLIN Conclusions Conclusions should be short. If you did good job of explaining your contribution in the introduction and then documenting those claims in the body of the paper, then saying it all over again is pointless. Do not restate all of your findings. You can include a short paragraph or two acknowledging limitations, suggesting implications for future research. TRINITY COLLEGE DUBLIN Presentation - Be Professional A well-written good-looking paper helps convince serious readers that you too are serious, and that your paper is worth the time. Read, re-read, edit, and re-edit: This can correct most of the common errors of style, grammar, and spelling that occur in the writing process. Read your stuff aloud. Does it sound right? Are you writing proper sentences? Are you over-using jargon or certain particular phrases? Get your references right. TRINITY COLLEGE DUBLIN Part III Publishing and Career Development TRINITY COLLEGE DUBLIN The Publication Process Don’t hide your work away “perfecting” it. Get it out, get feedback, get rejected ..... start learning the process. Develop a thick skin if you want to get published. The process is unfair and biased towards experienced and well-connected people. Referees and editors are rarely as careful as you would like. Don’t bother raging against “stupid” referees or writing back to editors. Do background research: Who edits the journal? Have they published similar before? Editors care about impact factors. Be strategic in citations. Journal success has a large random element. Best strategy: Write a lot of papers. TRINITY COLLEGE DUBLIN Success and Failure You get a revise-and-resubmit? Get excited. • Acceptance rates on these are higher than you think. But only if you know how to deal with them. • Be meticulous in responding to editors and referees. Provide detailed point-by-point responses. You get rejection letters? • It happens to everyone. The chance that a typical paper of average quality will get a favorable recommendation from both referees is about 11%. • Don’t worry too much about the criticisms. • Only make suggested changes that strike you as improving the paper. • Then send it out again quickly. TRINITY COLLEGE DUBLIN Developing Your Research Career Keep developing your thesis material but don’t fall in love with it! What else can you work on? Your next research project will probably be better. Specialisation: Expertise in one sub-field is required. But once this is achieved, there are great benefits to becoming an expert in another. Some sub-fields go together (macro and time series.) Keep multiple projects going at the same time and work with co-authors. One publication in a top journal will do more for you than many publications in lower-tier ones. So be ambitious when thinking about what to work on, how to market your work, and where you’re sending it. TRINITY COLLEGE DUBLIN Part IV Electronic Resources TRINITY COLLEGE DUBLIN Access to Electronic Resources It’s Research not Google Search. Know and use available resources. Trinity College Library website is a good starting point. Off-campus access also available. TRINITY COLLEGE DUBLIN Online Databases with Journal Articles JSTOR EconLit Econ Papers (both working papers and journal articles) SpringerLink Oxford University Press Many other available TCD Library has also access to popular press archives (Time Magazine, The Economist etc.) Easy Access through Trinity College Library. TRINITY COLLEGE DUBLIN Trinity College Library: Electronic Databases Datastream Advance - Historical financial database Thomson Datastream is an historical financial numerical database, covering an breadth of financial instruments, equity and fixed-income securities and indicators for over 175 countries and 60 markets worldwide. World Development Indicators Online (WDI) Provides direct access to more than 700 development indicators, with time series for 208 countries and 18 country groups from 1960 to 2006, where data are available. International Financial Statistics Approximately 32,000 time series covering more than 200 countries starting in 1948. Includes exchange rates, fund accounts and the main global and country economic indicators. TRINITY COLLEGE DUBLIN Data Sets We Have Used in Lab Classes EUROSTAT http://epp.eurostat.ec.europa.eu CSO Office Ireland www.cso.ie Central Bank www.centralbank.ie ISEQ index data www.ise.ie Bureau of Labor Statistics www.bls.gov/bls/inflation.htm TRINITY COLLEGE DUBLIN Other Electronic Statistical Databases Presentations and Links from Data Session Karl Whelan's presentation on macro data. Greg Connor's presentation on finance datasets. Pedro Vicente's presentation on development and experimental data. James McBride's presentation on the Irish Social Science Data Archive Orla Doyle and Colm Harmon's presentation on UK microdata and cohort data. Paul Devereux's presentation on US microdata and European register data TRINITY COLLEGE DUBLIN Part V Citation and Referencing TRINITY COLLEGE DUBLIN Academic Style Guides Good referencing enables readers to find any publication referred to in your document quickly and easily – which gives you credibility. If you don't do it, your work is immediately downgraded in value. If you do it badly, you lose respect (and easy marks). During research keep record of all the sources you use (and know where to find them if needed). TRINITY COLLEGE DUBLIN Referring to an Author's Viewpoint in Text If the author's surname fits naturally into the text, the year follows in round brackets. Gaskell (1992) notes that girls’ skills are not visible to others. If not, insert the name and year in round brackets immediately after the viewpoint. Girls’ skills are not visible to others (Gaskell, 1992) Direct (Exact) Citation: you will often be referring to a specific point in the text. In that case you must add the page(s). Thompson (2005, pp.37-38) states that “…” or Thompson (2005, p.37) states that “…” TRINITY COLLEGE DUBLIN More than One Author Cited in Text If the authors’ surnames fit naturally into the text, the year follows in round brackets. Furlong (1985) and McManus (1989) note that girls are considered to create fewer problems than boys. If not, insert the names and years in round brackets Girls are considered to create fewer problems than boys (Furlong, 1985; McManus, 1989). TRINITY COLLEGE DUBLIN More Authors for the Same Work When there are two authors for a work they should both be noted in the text: White and Brown (1964) in their recent research paper found … Or indirectly, using an ampersand (and) or (&) : Earlier research (White & Brown, 1966) demonstrated that the presence of certain chemicals would lead to … When there are three or more authors, give the first surname followed by et al. (in italics) meaning ‘and others’: Green et al. (1995) found that the majority … Or indirectly (Green et al., 1995) TRINITY COLLEGE DUBLIN Compiling the Reference List - Books Author, Initials/First name., Year. Title of book. Edition. Place of publication: Publisher. Baron, David P., 2008. Business and the organisation. 6th ed. Chester (CT): Pearson. or Arya, C. (2003). Design of structural elements. 2nd ed., London: Spon Press. Books with two, three or four authors Barker, R., Kirk, J., & Munday, R.J., 1988. Narrative analysis. 3rd ed. Bloomington: Indiana University Press. or Silvertown, J. & Charlesworth, D. (2001). Introduction to plant population biology. 4th ed., Oxford: Blackwell Science. TRINITY COLLEGE DUBLIN Compiling the Reference List - Books Books with more than four authors Grace, B. et al., 1988. A history of the world. Princeton, NJ: Princeton University Press. Books which are edited Keene, E. ed., 1988. Natural language. Cambridge: University of Cambridge Press. Chapters of edited books Whittaker, K.A., 1990. Dictionaries. in Lea, P.W. and Day, A. (eds.) Printed reference material. London: Library Association Publishing, pp.11-23. TRINITY COLLEGE DUBLIN Compiling the Reference List - Journal Articles Author, Initials., Year. Title of article. Full Title of Journal, Volume number (Issue/Part number), Page numbers. Boughton, J.M., 2002. The Bretton Woods proposal: an in depth look. Political Science Quarterly, 42 (6), pp.564-78. or Moore, T. (1966). The demand for broadway theatre tickets. The Review of Economics and Statistics, 48 (1), 79–87. Articles with two, three or four authors Bowlin, W.F., Renner, C.J., and Rives, J.M., 2003. A DEA study of gender equity in executive compensation. Journal of the Operation Research Society, 54 (7), pp.751-7. or Stock, J., & Watson, M. (2008). Heteroskedasticity-Robust standard errors for fixed-effects panel-data regression. Econometrica, 76, 155–174. TRINITY COLLEGE DUBLIN More Referencing Rules – Useful links http://libweb.anglia.ac.uk/referencing/harvard.htm http://www2.wlv.ac.uk/lib/Tipsheets/Harvard2008.doc AER (American Economic Review) Style Guide http://www.aeaweb.org/AER/styleguide.html Important rule: be consistent in your work! TRINITY COLLEGE DUBLIN Part VI Concluding Remarks TRINITY COLLEGE DUBLIN Plenty of Good Advice Available 1) Tips for Preparing and Publishing Research Papers, by Karl Whelan, www.karlwhelan.com 2) Kwan Choi (How to Publish in Top Journals): Hard-bitten, cynical, very, very useful. From a man who edits a journal, so knows the deal. www.roie.org/how.htm 3) John Cochrane (Writing Tips for PhD Students): A master technician and one of the smartest persons in the profession gives his (admittedly idiosyncratic) tips on how to write. Ignore at your peril. http://faculty.chicagobooth.edu/john.cochrane/research/Papers 4) Dan Hamermesh (Texas) has an advice page with tips on writing and other matters. http://webspace.utexas.edu/hamermes/www/AdviceforEconomists.html TRINITY COLLEGE DUBLIN Key Points 1) Good questions are more than good answers 2) Good questions are more than good data 3) There is always more data 4) Begin with one question 5) Pick research question that interest you 6) Survey literature after you start research 7) Spend enough time on writing 8) Keep research portfolio broad 9) Avoid any distractions 10) Diversify your daily tasks 11) Do not listen to more experienced researchers TRINITY COLLEGE DUBLIN Thank you! Karol Jan Borowiecki Department of Economics Room 3022, Arts Building Trinity College Dublin Dublin 2 Office: 00353-1-8961083 Mobile: 00353-867943281 E-Mail: Borowiek@tcd.ie TRINITY COLLEGE DUBLIN