Technical Program, Peer Review &
Quality 学术委员会，同行评议与质量
R10 Conference Organizer Workshop
22 October 2013
Xian, China
1
10/24/2013
Agenda 议题
The Technical Program 学术委员会
The Review Process 审查程序
The Technical Program Time-line 时间表
Plagiarism 剽窃
2
10/24/2013
Overall Structure 整体结构
Technical
Program
Chair
程序委员会主席
Technical
Program
Committee
程序委员会
Reviewers
评审专家
3
10/24/2013
The Technical Program Chair’s Role
技术程序委员会主席职责
The Technical Program Chair is responsible for
delivering a well-balanced and high-quality
technical program at the conference. (技术委员会主
席在会议上负责提供一个健全和高质量的技术方案）
The Technical Program Committee oversees the
submission and review of papers and organizes
the presentations delivered at the conference.（技
术程序委员会统管论文的提交和审查，并组织会上讨论）
4
10/24/2013
What is the Technical Program?
什么是学术委员会
It is a series of presentations delivered at the conference that cover a range
of scientific areas directly related to the technical scope of the conference.
会议包括一系列的报告，涵盖了与本次会议相关的技术范围的科学领域。
The presentations should generate scholarly dialogue amongst attendees
regarding the technical merit of the paper.
这些报告应激发起会议代表之间有关该论文的学术讨论
– Oral presentation, Keynote speakers 口头报告，主讲嘉宾
– Poster sessions 海报张贴
– Workshops and tutorials 培训及讲座
Technical papers published as the proceedings of the event and often
included in a digital repository, such as IEEE Xplore 会议论文将以论文集形式出
版，论文集通常会被收录到数字资源中，例如IEEE Xplore
– Peer-reviewed 同行评议
Often sub-divided into tracks and sessions based on topical areas 通常会按照
专业领域被细分为多个分会场
5
What is Review? 什么是评议
A process by which a scholarly work is checked by a group of
experts in the same field to make sure it meets the
necessary standards before it is published or accepted. 学术
检查的工作是由一组在同一领域的专家进行，以确保论文在发表前符
合必要的标准。
Common types of review processes 评议过程的一般种类
Blind Review 盲评
– The reviewer’s name is hidden from the author 隐藏评审专家的姓名
Double Blind 双盲评
– The reviewer’s name is hidden from the author and the author’s name is
unknown to the reviewer 论文作者与审稿专家互相不告知姓名
– The double-blind review process is a way to prevent bias or the
perception of bias towards any author. 双盲选评议方式是避免任何偏见以及针
对某一作者的偏激观念
6
10/24/2013
Why Review Technical Content?
为什么要对技术内容进行评议？
Determine suitability of material for conference
为会议决定适宜的资料
Determine quality of suitable material
确保会议的质量
Provide a potential filter for plagiarism
过滤剽窃行为
Organize material into groupings to target
interests of the attendees
将资料有组织地分组给具有不同兴趣的与会者
Build up the reputation of the conference
建立会议的声誉
Find people to chair sessions 找出能够主持会议的人
Ongoing Challenges in Reviews
评议过程中可能会遇到的问题
Getting enough high quality papers by the submission
deadline 提交期限前以获得足够多的高质量论文
Finding enough experts to provide quality reviews by
the deadline 在最后期限前找到了足够多的能够提供有质量评
议的专家
Managing conflict of interest. To remove concerns
about favoritism, a reviewer should not review a paper
if they cannot be objective (e.g., from authors in their
research group). 避免同行冲突。评审专家认识论文作者时，
评审专家应自行避嫌（如作者来自他的研究组）
Improving conference quality and reputation will help
with all of these issues 提高会议质量和声誉可以帮助解决这
些问题。
8
10/24/2013
Technical Program 学术委员会
Timeline 时间表
Establish TP
Committee
成立学术委员
会
10-12
Months月*
Recruit
Reviewers
Plan Key
Dates
评审专家、制
定重要日期
9-10
Months 月*
Call for
Papers
论文征集通知
6-8
Months*
* Prior to conference start date
9
10/24/2013
Abstract or
full paper
submission
deadline
摘要或全文递
交日期
4-6 Months*
Peer Review
Process
同行评议（审
稿）
2-6 months*
Notice of
acceptances
sent out
(final paper)
to authors
接受通知
8-10 weeks*
Form a Technical Program Committee
学术委员会构成
Technical Program Chairs establishes a TP Committee by
recruiting peers in the appropriate field of interest, typically
though personal contact
学术委员会主席负责创建学术委员会，委
员会的创建通常通过个人关系招募适当领域的人员
The Technical Program chair may find subject matter experts in
the sponsoring OUs. 学术委员会主席要优先从主办单位中选相关论题的
专家
Another source of subject matter experts may be local
colleagues (e.g., people at your institution) 招募当地论题专家 （比
如你研究院的同事）
Develop tracks if there are multiple significant topics within the
overarching conference scope. You could assign a track chair if it
warrants one. 如果会议的范围包含了多个重要议题时，可以发展几个分
会场。根据需要指定分会主席。
If this is not a first-time conference, previous reviewers may
serve as TPC members 如果不是首次会议，之前的评审专家可以充当学
术委员会成员履行职能
10
10/24/2013
Establish TP
Committee
成立学术委员
会
10-12
Months
Form a Technical Program Committee
学术委员会构成
(continued)
Considerations 考虑
How many members where on the committee last
year/conference? 去年/上次会议程序委员会有多少成员？
Have a discussion with the last Technical Program
Chair 和上一届程序委员会主席讨论
– What challenges were encountered? 遇到过什么挑战
– Were the peer review tools effective? 同行评议发挥有效性
了么
– Which key contacts would you recommend for this
conference’s TPC? 对本次会议的学术委员会人选有什么建议？
11
10/24/2013
Establish TP
Committee
成立学术委员
会
10-12
Months
Develop Overall Plan and Timeline
发展总体计划和时间表
TPC
Review previous conference history (if
available) 回顾之前的会议的历史（如果可能的话）
Determine the number of reviewers
required based on:评审专家的数量取决于：
– the expected number of papers submitted
预期的论文提交数量
– the number of reviews per paper (2 minimum, 3 best
practice)每篇论文的评审专家数量（2个最少，3个为最佳）
– establish a maximum threshold for number of papers
that can be assigned to a reviewer (suggested,
12 max for full paper, abstract only 20 max)
设立每位专家评审文章的最大数量（建议：全文最多12篇，
摘要20篇）
12
10/24/2013
Recruit
Reviewers
Plan Key
Dates
评审专家、制
定重要日期
9-10
Months*
Develop Overall Plan and Timeline
TPC (continued) 总体规划和时间表 学术委员会主席（续）
Develop the timeline for submission and review (working
backwards from the conference dates) 为论文的提交和评议制定时间表（会
议时间倒推）
– Proceedings ready for distribution at conference 会议分发论文集
– Event program prepared 准备会议程序
– Final paper collection 论文的最后收集
– Paper acceptance 论文选取
– Review time 评审时间
– Submission deadlines 提交最后期限
– Reviewer pool development 评议组的发展
– Call for Papers 征集论文
Work with the organizing committee to ensure all parties are
aligned 与组织委员会一起工作以确保各方均衡协调
Recruit
Reviewers
Plan Key
Dates
评审专家、制
定重要日期
9-10 Months
Develop Overall Plan and Timeline
TPC (continued)总体规划和时间表
Recruit reviewers in the appropriate field of interest, typically
though personal contact 委员会的创建通常通过个人关系招募适当领域的
人员
– Outreach begins to OUs’ members and sponsoring OUs within a
similar field of interest 人员拓展从相关组织成员和主办方中具有相似
Recruit
Reviewers
领域的同行中选取
– Recruit local appropriate subject matter experts 招募当地适当的论
Plan Key
Dates
题专家
– Consider diversity of reviewer pool (example: not all from one
评审专家和时
间表
school) 考虑多样性的评审组（例如：所有人员不来自同一所学校）
9-10
Develop track chairs if there are significant multiple topics within
Months*
the overarching conference scope如果会议的范围包含了多个重要议题
时，可以发展几个分会场。根据需要指定分会主席
Select a Peer Review/paper management system 选取一个同行评议/
论文管理体系
– Key consideration is conference size and complexity 主要考虑会议
的规模和复杂性
Develop agreed upon non-presented paper policy 制定针对“不出现”
文章的政策
14
10/24/2013
Develop Overall Plan and Timeline
TPC - Scoring Paper Guidelines (continued)总体规划和时间表
学术委员会-论文评分指导方针（续）
Establish criteria that reviewers will apply when scoring papers
that are within the scope of the conference. 在会议范围内建立评审
专家普遍接受的评分标准
Reviewers should focus on two essential criteria for a
recommendation of acceptance for publication 评审专家对于可建议
发表的文章要着眼于两个基本标准
1.
2.
15
Technical or Scientific Novelty: new or innovative methods or
approaches to a problem (or its examination) in a given subject
area that is within the conference’s scope 技术或科学的新奇：在会
议范围内给出的学科领域提出崭新或创新方法或解决问题的方式（或者它
的考察方式）
Quality: of research, science and readability - a presentation
that delivers its information in sufficient written English quality
to enable readers to follow the narrative easily, and which can
be used by the appropriate audiences to further their
knowledge or research 研究，科学和可读性的质量:报告所表达的信息
要以符合质量的英文书写，以保证能让读者很容易地跟进讲述内容且听众
可以用这些信息促进他们将来的知识学习或研究。
10/24/2013
Recruit
Reviewers
Plan Key
Dates
评审专家和时
间表
9-10 Months
Example of Paper Scoring with Feedback
There are Many Different Scoring Scales or Approaches
举例说明论文评分及意见反馈-具有多种不同的评分范围或方法
16
10/24/2013
Example of Paper Scoring with Feedback
There are Many Different Scoring Scales or Approaches举
例说明论文评分及意见反馈-具有多种不同的评分范围或方法
17
10/24/2013
Call for Papers 征集论文
Develop a list of potential attendees 制定潜在与会者名单
– Invite all previous attendees and authors 邀请所有之前的与会者
和听众
– Invite appropriate co-sponsor lists 邀请适合的主办方
– IEEE member list IEEE会员名单
Distribute via email the call for papers timeline to all prospective
authors 通过电子邮件向所有潜在作者发征文通知
Note call for papers timeline on the conference website在会议网站
上标注论文时间表
Call for papers includes 论文征集通知包括
– Conference scope 会议范围
– Conference dates and location 会议时间和地点
– Submission requirements (format, length, abstract, written in
English) 提交要求（格式，长度，摘要，英文书写）
– Review timeline 时间表
– Author notification date 通知作者日期
– Non-presented paper policy “不出现”论文政策
18
10/24/2013
Call for
Papers
论文征集
6-8 Months
Full paper/abstract are submitted
全文/摘要提交后
19
The peer review process begins 同行评议进程开始
Utilize the peer review tool to log all submissions and
reviewer assignments 利用同行评议工具记录并分配工作给评
审专家
Distribute submitted papers to reviewers via peer review
system 通过同行评议制度分发论文
– monitor quantity by reviewer 由评审专家监测数量
Reviewers provide feedback to authors 评审专家为作者提供
意见反馈
Each reviewer ultimately provides a final score for the
paper and sends it back to the TPC, who then make a
final decision 评审专家最终提供最终分数，并发给程序委员会做
最后决定
– The TPC often takes extra steps to resolve large
differences of opinion between reviewers, sometimes
by assigning the paper to additional reviewers 学术委员
会需更多步骤解决同一文章的不同意见，通常是将争议文章发送
10/24/2013
其他专家再审
Abstract or
full paper
submission
deadline
摘要全文提交
期限
4-6 months
Peer Review Process 同行评议过程
All paper assignments are managed in a peer review system
managed by the Technical Program Chair 程序委员会主席负责通过同
行评议制度分配所有的论文
TPC monitors and communicates number of accepted
papers/acceptance rates to the Conference Chair through out
process 学术委员会主席监控和沟通被选论文/录取率给会议主席
Considerations during process 过程中要思考
– Do I have enough submissions? Do I need more promotion? 我有
足够多的论文吗？我是否需要再宣传？
– Do I have an acceptable amount of accepted papers? 我是否有一
个可接受的论文数量？
TPC validates all reviews occurred and develops three groupings of
papers 学术委员会主席根据评议的发生和发展将论文分为三组
– Reject 拒绝接收
– Accept 接受
– Maybe accept 可能接受
20
10/24/2013
Peer Review
Process
同行评议
2-6 months
Preparing for the Final Review and
Selection 准备最后评议和选择
Final Step, acceptance and notification 最后一步，接受和通知
Spend time in the TPC meeting discussing the “Maybe Accept” 在会
议上花费时间讨论“可能接受”的部分
– Try to understand the reviewers concerns, does the paper have
fatal flaws? 尝试理解评审专家的关注点，论文是否有致命缺陷
– Look at whether the paper would make a nice contribution to a
session – help round out a session 验证论文是否能够为讲座做出贡献帮助完成讲座
– How many papers are needed? 需要多少论文
– If too many papers have been submitted for the number of
available slots some “Maybe” papers will be rejected 如果提交的
论文数量过多，“可能”的论文将会被驳回
– Can the paper be placed in a poster session? 论文是否可以放置在
海报张贴单元
Submit papers for plagiarism checking 提交论文的剽窃检查
Peer Review
Process
同行评议程序
2-6 months
Accept/Reject Notifications
接受/驳回通知
Communicate to authors with results of review
process, any next steps 与作者联系告知评审结果，
以及下一步
Requirements for presentation at the
conference 会议上口头报告的要求
Final paper submission dates 最后论文提交期限
Final paper formatting 最后论文格式
22
10/24/2013
Notice of
acceptances
sent out
(final paper)
to authors
接受通知
8-10 weeks
Technical Program Development
Publish on Conference Website 技术委员会的发展 在会议网站上
发布
Developing the overall program flow and content 建立总
体会议程序
Tracks and sessions (oral and poster) 跟踪与评议会议
（口头或者海报张贴）
Scope of content 内容范围
Allocating schedule time for all accepted papers 为所有
被选论文分配时间计划
Assigning space to meet anticipated interest 分配空间以
满足预期目的
Building the program 确立会议程序
Communication with Publication’s Chair on Event
program 在会议进程中联系出版主任
– Proceedings development 论文集
23
10/24/2013
Plagiarism
CrossCheck
剽窃
查重软件
24
10/24/2013
What is CrossCheck? 什么是
CrossCheck （查重）
CrossCheck compares submitted manuscripts against a very large
database of published technical papers (as well as over 6 billion Web
pages) CrossCheck将投稿论文与一个庞大的已发表论文数据库中的论文进行
比较 （约有超过600万文章）
CrossCheck provides technical program chairs with a summary report
that highlights a paper’s similarity to previously published work
CrossCheck为程序委员会主席提供总结报告，指出某篇论文与之前发表过的的
相似度
– If similarities are found, conference organizer review is needed to separate “allowable”
duplication (e.g., the author re-using a description of apparatus that they wrote in a
previous paper) from plagiarism (large sections of text copied from other author’s
papers).如果发现相似之处，会议组织者审查是需要单独检查重复部分是否合理（如：有些作者重
复使用自己以前文章中的内容）或不合理（例如，大量内容来自其他作者的文章）。
– If plagiarism is identified, IEEE Publications should be notified and the paper should be
excluded from the proceedings， and not included with the delivered final papers 认定
剽窃后，应通知IEEE出版部门，且这些论文不应出现在最后送检论文集中
– Staff is available to assist with this process 工作人员可以在此过程中协助工作
The TP chair can then follow up to isolate and review the high-scoring
papers as necessary 学术委员会主席有必要跟进隔离和评议高分论文
25
10/24/2013
CrossCheck: Helpful Hints
CrossCheck：小贴士
Conference organizers are encouraged to use
CrossCheck as early as possible during the manuscript
review process鼓励会议组织者在论文评审过程中尽早使用
CrossCheck
Because CrossCheck detects similar content that may
turn out to be problematic, IEEE encourages organizers
to screen their authors’ submissions prior to publishing
the proceedings 由于CrossCheck检测出的相似论文可能引
发问题，IEEE鼓励组织者在发表论文之前应用该程序
– This will allow organizers to take any necessary editorial actions
without delaying the publication of the proceedings, and more
importantly, the posting of the proceedings in Xplore 这将允许组织
者在延迟出版论文集，尤其是论文集发布在Xplore上前采取任何必要的编辑
措施
26
10/24/2013
Two Ways Conferences Can Integrate
CrossCheck Into Your Peer Review Process
两个方式整合CrossCheck和同行评议
1. Choose a paper management vendor that includes
CrossCheck screening in its suite of services 选择一个包含
查重功能和服务的论文管理供应商
Some of the major vendors have integrated CrossCheck
into their systems: 有些主要供应商的系统中包含查重功能
– EDAS
– PaperPlaza
– MIRA
CrossCheck is Available at No Cost To the Conference
该软件免费
27
10/24/2013
Two Ways Conferences Can Integrate
CrossCheck Into Your Peer Review Process
两个方式整合CrossCheck和同行评议
2. Sign up to use the CrossCheck Portal
-
-
注册使用CrossCheck门户
For technical program chairs who prefer to use
their own processes for manuscript submission,
IEEE offers a standalone CrossCheck application
对于喜欢使用它们自己的程序来管理论文提交程序委员会主席，IEEE
提供一个独立的CrossCheck程序
The CrossCheck Portal offers a simple, streamlined
interface, as well as a direct connection to IEEE
staff who can help flag problematic papers
CrossCheck网站提供一个简单、简化的界面，以及一个可以直接与之
联系的IEEE工作人员，其将帮助你标示问题论文
28
10/24/2013
Get Information on the IEEE
CrossCheck Portal
在IEEE CrossCheck网站上获得信息
http://www.ieee.org/publications_standards/publications/
rights/crosscheckportal.html
29
10/24/2013