Software Projects You need to deliver the following things: • • • • • Project Agreement (already completed) Documentation Code Demonstration for Client Presentation in Class April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 1 Software Projects Documentation: • Describes the capabilities of the software product • Explains to the end user how to use the software • Describes to other developers the most important classes, their members and methods. • Due by May 14. • It is recommended to write at least a rough draft of the documentation before writing the code. April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 2 Software Projects Code: • Programming language: C++ • Operating system: Linux (software must be demonstrated on campus) • Object-oriented design • Comments • Due by May 14 (e-mail) April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 3 Software Projects Demonstration for Client: • Demonstration in Unix Lab, PC Lab, Visual Attention Lab or client’s office • Can be done on a team member’s laptop • Customer will play around with the software and try to crash it • Code review: Every project participant will be asked questions about her/his code and why she/he chose that particular implementation. • Due by May 14 April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 4 Software Projects Presentation in Class: • Duration for each team’s presentation: 20 minutes • Every team member has to speak • One person (team leader) provides overview of the system • Others present their part of the system, algorithms and data structures they used, issues they encountered, how they were resolved, etc. • Will take place on May 1, 6, and 8. April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 5 Software Projects Rules: • Each team member must implement a clearly defined part of the software. • No re-use of any code unless explicitly allowed by the customer. • It is recommended to schedule at least one meeting with the customer during the development process. • Team members will evaluate each other after project completion. April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 6 Rationale Management Rationale: • What is it? • Why should you care? Rationale methods: • Representing rationale • Authoring rationale • Accessing rationale State of practice & research Summary April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 7 An Aircraft Example A320: • First fly-by-wire passenger aircraft • 150 seats, short to medium haul A319 & A321: • Derivatives of A320 • Same handling as A320 Rationale: • Reduce pilot training & maintenance costs • Increase flexibility for airline April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 8 An Aircraft Example A330 & A340: • Long haul and ultra long haul • 2x seats, 3x range • Similar handling as A320 family Rationale: • With minimum cross training, A320 pilots can be certified to fly A330 and A340 airplanes Consequence: • Any change in these five airplanes must maintain this similarity April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 9 What is Rationale? Rationale is the reasoning that lead to the system. Rationale includes: Issues that were addressed, Alternatives that were considered, Decisions that were made to resolve the issues, Criteria that were used to guide decisions, and Debate developers went through to reach a decision. April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 10 Why Rationale? Software systems are similar to passenger airplanes: They result from a large number of decisions taken over an extended period of time. • Evolving assumptions • Legacy decisions • Conflicting criteria High maintenance cost Loss & rediscovery of information April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 11 Rationale Helps Deal with Change Improve maintenance support: • Provide maintainers with design context Improve learning: • New staff can learn the design by replaying the decisions that produced it Improve analysis and design: • Avoid duplicate evaluation of poor alternatives • Make consistent and explicit trade-off April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 12 Levels of Rationale No rationale captured: • Rationale is only present in memos, online communication, developers’ memory Rationale reconstruction: • Rationale is documented in a document justifying the final design Rationale capture: • Rationale is documented during design as it is developed Rationale integration: • Rationale drives the design April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 13 Example: Centralized Traffic Control Trains S2 T1291> Signals S3 Track circuits Switches SW1 SW2 S1 <T1515 S4 • CTC systems enable dispatchers to monitor and control trains remotely, • CTC allows the planning of routes and re-planning in case of problems. April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 14 Centralized Traffic Control CTC systems are ideal examples of rationale capture: Long lived systems (some systems include relays installed last century) • Extended maintenance life cycle Downtime is expensive (although not safety critical) • Low tolerance for bugs • Transition to mature technology Initial developers are not available April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 15 Issues • Issues are concrete problems which usually do not have a unique, correct solution. • Issues are phrased as questions. display?:Issue How should track sections be displayed? April 17, 2014 input?:Issue How should the dispatcher input commands? CS410 – Software Engineering Lecture #18: Rationale Management 16 Proposals • Proposals are possible alternatives to issues. • One proposal can be shared across multiple issues. display?:Issue addressed by addressed by text-based:Proposal The display used by the dispatcher can be a text only display with graphic characters to represent track segments. April 17, 2014 input?:Issue addressed by point&click:Proposal The interface for the dispatcher could be realized with a point & click interface. CS410 – Software Engineering Lecture #18: Rationale Management 17 Consequent Issues • Consequent issues are issues raised by the introduction of a proposal. display?:Issue input?:Issue addressed by addressed by text-based:Proposal addressed by point&click:Proposal raises terminal?:Issue Which terminal emulation should be used for the display? April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 18 Criteria • A criterion represent a goodness measure. • Criteria are often design goals or nonfunctional requirements. display?:Issue input?:Issue addressed by addressed by text-based:Proposal point&click:Proposal meets raises addressed by meets fails fails terminal?:Issue usability$:Criterion The time to input commands should be less than two seconds. April 17, 2014 availability$:Criterion The CTC system should have at least a 99% availability. CS410 – Software Engineering Lecture #18: Rationale Management 19 Arguments • Arguments represent the debate developers went through to arrive to resolve the issue. • Arguments can support or oppose any other part of the rationale. • Arguments constitute the largest part of the rationale. April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 20 Arguments display?:Issue input?:Issue addressed by addressed by text-based:Proposal point&click:Proposal meets raises addressed by meets fails fails is opposed by terminal?:Issue usability$:Criterion availability$:Criterion is supported by availability-first!:Argument Point&click interfaces are more complex to implement than text-based interfaces. Hence, they are also more difficult to test. The point&click interface risks introducing fatal errors in the system that would offset any usability benefit the interface would provide. April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 21 Resolutions • Resolutions represent decisions. • A resolution summarizes the selected alternative and the supporting argument. • A resolved issue is said to be closed. • A resolved issue can be re-opened if necessary, in which case the resolution is demoted. April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 22 Resolutions text-based&keyboard :Resolution resolves resolves display?:Issue input?:Issue addressed by addressed by text-based:Proposal point&click:Proposal meets raises addressed by meets fails fails is opposed by terminal?:Issue usability$:Criterion availability$:Criterion is supported by availability-first!:Argument April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 23 Representing Rationale: Issue Models resolves Resolution. Issue? is a consequence responds Proposal meets + Criterion$ fails supports + objects to - supports + objects to Argument! April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 24 Representing Rationale Many issue models have been proposed: • IBIS, QOC, DRL, WinWin • Similar in their essence • Differ in the amount of detail that can be captured Challenges: • Require tool support for capture and access • Require integration with project management tools • Require integration with methodology April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 25 Authoring Rationale Approaches: • Reconstruction • Record-and-replay • Byproduct of development methodology Challenges: • Lot of information to capture • Disruptive for developers • Formalizing knowledge is expensive April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 26 Accessing Rationale Browse & search: • Full text search allows to identify interesting nodes • Issue model links allow the browsing of related issues quickly Passive & active design critique: • Rationale can be used by knowledge based critiques to evaluate a design Challenges: • Evolving terminology • Navigation through a large flat space April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 27 State of the Practice Standalone issue based tools: • QuestMap Problem management tools: • Work flow application tracking problems and resolutions • Integrated with configuration management • Some tools (e.g., ClearQuest) allow schema to be customized RequisitePro: • Requirements management • Integrated with configuration management • Explicitly captures rationale behind change April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 28 An example of issue database (LN IBIS database template in Domino Lotus Notes). April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 29 State of Research Many solutions for representation exist and can be tailored to a specific problem. Progress in natural language search and in hypertext technology make access a less critical issue. Current challenges: • Integration with methodology • Integration with tools • Overhead April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 30 Open Issues Formalizing knowledge is costly: • Maintaining a consistent design model is expensive. • Capturing and maintaining its rationale is worse. The benefits of rationale are not perceived by current developers: • If the person who does the work is not the one who benefits from it, the work will have lower priority. • 40-90% of off-the-shelf software projects are terminated before the product ships. Capturing rationale is usually disruptive. Current approaches do not scale to real problems. April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 31 Why Software Configuration Management? The problem: • Multiple people have to work on software that is changing • More than one version of the software has to be supported: Released systems Custom configured systems (different functionality) System(s) under development • Software must run on different machines and operating systems Need for coordination Software Configuration Management • manages evolving software systems • controls the costs involved in making changes to a system April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 32 What is Software Configuration Management? Definition: • A set of management disciplines within the software engineering process to develop a baseline. Description: • Software Configuration Management encompasses the disciplines and techniques of initiating, evaluating and controlling change to software products during and after the software engineering process. Standards (approved by ANSI): • IEEE 828: Software Configuration Management Plans • IEEE 1042: Guide to Software Configuration Management April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 33 SCM Activities Configuration item identification • is the modeling of the system as a set of evolving components Promotion management • is the creation of versions for other developers Release management • is the creation of versions for the clients and users Branch management • is the management of concurrent development Variant management • is the management of versions intended to coexist Change management • is the handling, approval and tracking of change requests April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 34 SCM Roles Configuration Manager: • Responsible for identifying configuration items. The configuration manager can also be responsible for defining the procedures for creating promotions and releases Change control board member: • Responsible for approving or rejecting change requests Developer: • Creates promotions triggered by change requests or the normal activities of development. The developer checks in changes and resolves conflicts Auditor: • Responsible for the selection and evaluation of promotions for release and for ensuring the consistency and completeness of this release April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 35 Terminology and Methodology What are • Configuration Items, • Baselines, • SCM Directories, • Versions, Revisions and Releases? The usage of the terminology presented here is not strict but varies for different configuration management systems. April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 36 Terminology: Configuration Item “An aggregation of hardware, software, or both, that is designated for configuration management and treated as a single entity in the configuration management process.” Software configuration items are not only program code segments but all type of documents that are produced during development, e.g.: • • • • • all types of code files drivers for tests analysis or design documents user or developer manuals system configurations (e.g. version of compiler used) In some systems, not only software but also hardware configuration items (CPUs, bus speed frequencies) exist! April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 37 Terminology: Baseline “A specification or product that has been formally reviewed and agreed to by responsible management, that thereafter serves as the basis for further development, and can be changed only through formal change control procedures.” Examples: • Baseline A: The API of a program is completely defined; the bodies of the methods are empty. • Baseline B: All data access methods are implemented and tested; programming of the GUI can start. • Baseline C: GUI is implemented, test-phase can start. April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 38 More on Baselines Many naming schemes for baselines exist (1.0, 6.01a, ...). 3 digit scheme: 7.5.5 Release (Customer) April 17, 2014 Version (Developer) CS410 – Software Engineering Lecture #18: Rationale Management Revision (Developer) 39 Baselines in SCM Baseline A (developmental) All changes relative to baseline A Baseline B (functional) All changes relative to baseline B Baseline C (beta test) All changes relative to baseline C Official Release April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 40 Standard SCM Directories Programmer’s Directory • (IEEE Std: “Dynamic Library”) • Completely under control of one programmer. Master Directory • (IEEE Std: “Controlled Library”) • Central directory of all promotions. Software Repository • (IEEE Std: “Static Library”) • Externally released baselines. April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management Promotion Central source code archive Release Foo’95 Foo’98 41 Change Management Change management is the handling of change requests. • A change request leads to the creation of a new release. General change process: • The change is requested (this can be done by anyone including users and developers). • The change request is assessed against project goals. • Following the assessment, the change is accepted or rejected. • If it is accepted, the change is assigned to a developer and implemented. • The implemented change is audited. April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 42 Change Management The complexity of the change management process varies with the project: • Small projects can perform change requests informally and fast. • Complex projects require detailed change request forms and the official approval by one or more managers. April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 43 Controlling Changes Two types of controlling change: • Promotion: The internal development state of a software is changed. • Release: A set of promotions is distributed outside the development organization. Promote Policy Programmer Promotion April 17, 2014 Release Policy Master Directory Software Repository User Release CS410 – Software Engineering Lecture #18: Rationale Management 44 Change Policies Approaches for controlling change to libraries (Change Policies): • Informal (good for research type environments) • Formal approach (good for externally developed CIs and for releases) April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 45 Change Policies • Whenever a promotion or a release is performed, one or more policies apply. • The purpose of change policies is to guarantee that each version, revision or release (see next slide) conforms to commonly accepted criteria. Examples for change policies: • “No developer is allowed to promote source code which cannot be compiled without errors and warnings.” • “No baseline can be released without having been beta-tested by at least 500 external persons.” April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 46 Version vs. Revision vs. Release Version: • An initial release or re-release of a configuration item associated with a complete compilation or recompilation of the item. Different versions have different functionality. Revision: • Change to a version that corrects only errors in the design/code, but does not affect the documented functionality. Release: • The formal distribution of an approved version. April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 47 Tools for SCM Software configuration management is normally supported by tools with different functionality. Examples: • RCS: very old but still in use; only version control system • CVS: based on RCS, allows concurrent working without locking • Perforce: repository server; keeps track of developer’s activities • ClearCase: multiple servers, process modeling, policy check mechanisms April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 48 Tasks for the Configuration Managers SCMP following the IEEE 828-1990 standard Define configuration items Define promote /release policies Define responsibilities Set up configuration management system April 17, 2014 CS410 – Software Engineering Lecture #18: Rationale Management 49