WHAT’S NEW IN SAS 9.4 C op yr i g h t © 2 0 1 2 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . AGENDA SAS PLATFORM UPDATE • SAS 9.4 major release themes • Top 10 highlights • How to get there C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . SAS 9.4 CORE THEMES Enable Simplify Provide quick, precise answers; reduce time to value Remove complexity; reduce risk, ensure continuity Innovate Make analytics approachable and easy to integrate; support collaboration -> More value from your SAS investment! C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . De pl oym e nt Choi c e s -On-premises -Hosted -Cloud WHAT WAS RELEASED ON JULY 10TH July 10 2013 July 2013 August 2013 September 2013 Base & Platform Data Management, Storage • • • • • • • • • • • • • • • • • • • • • • • • • • • Base SAS 9.4 SAS/ASSIST 9.4 SAS/EIS 9.4 SAS/GRAPH 9.4 SAS/Connect 9.4 SAS/AF 9.4 SAS Grid Manager 9.4 SAS/Secure 9.4 SAS Audit Performance Measurement 9.4 SAS Environment Manager 2.1 SAS Management Console 9.4 SAS Search Interface to SAS Content 3.1 SAS Integration Technologies 9.4 • • • • Web Application Server Web Server Workflow Studio 1.3 Workflow Administrator 1.3 SAS Data Management 2.4 bundles SAS/ACCESS to Aster SAS/ACCESS to DB2 SAS/ACCESS to Greenplum SAS/ACCESS to Hadoop SAS/ACCESS to Netezza SAS/ACCESS to OLEDB SAS/ACCESS to ODBC SAS/ACCESS to Oracle SAS/ACCESS to Postgres SAS/ACCESS to Teradata SAS/ACCESS to Vertica SAS Federation Server 3.2 SPDS 4.8 October 2013 Visual Analytics, Business Intelligence • • • • • SAS Add-in 6.1 for MS Office SAS AppDev Studio 4.4 SAS Enterprise Guide 6.1 SAS (Enterprise) BI Server 4.4 SAS Visual Analytics 6.2 • • • • • • • • Visual Analytics Administrator Visual Analytics Explorer Visual Analytics Designer Visual Analytics Hub Visual Analytics Data Builder Visual Analytics Report Viewer LASR Analytic Server 2.1 Information Retrieval Studio 1.5 Solutions • • • • • • • November 2013 SAS Applied Visual Analytics: All Payer Claims Database SAS Banking Analytics Architecture 4.7 SAS Conversation Center 3.1 SAS Inventory Replenishment Planning 2.3 SAS High Performance Risk 3.1 SAS Strategy Management 5.5 SAS Risk Dimensions 6.1 C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . December 2013 Analytics • • • • • • • • • • • • • • • • SAS Enterprise Miner 12.3 SAS Forecast Server 12.3 SAS Forecasting for Desktop 12.3 SAS High Performance 12.3 • SAS HP Data Mining • SAS HP Statistics • SAS HP Econometrics • SAS HP Optimization • SAS HP Forecasting • SAS HP Text Mining SAS Model Manager 12.3 SAS In-Database Code Accelerator for Teradata and Greenplum SAS Scoring Accelerator for Netezza and Oracle SAS Text Miner 12.3 SAS/IML Studio 12.3 SAS/STAT 12.3 SAS/QC 12.3 SAS/HPF 12.3 SAS/OR 12.3 SAS/IML 12.3 SAS/ETS 12.3 SAS/Simulation Studio 12.3 TOP 10 OF PLATFORM 10. Security C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . SAS 9.4 BASE SAS SECURITY Lock-down • Restrict access to only those host paths and files that are included in that server’s list of permitted resources Metadata-bound libraries • Universally enforce metadata-layer permission requirements for physical tables—regardless of how a user requests access from SAS SAS/SECURE • Automatically delivered with Base SAS at no additional cost* Advanced Encryption Standard (AES) with SAS/SECURE • Encrypt SAS data on disks * United States export regulations on encryption software restrict access to SAS/SECURE software and related technical data. http://sww.sas.com/pub/OnlineDoc/v8-0/prod/sashtml/shr/z0354312.htm C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . TOP 10 OF PLATFORM 10. Security 9. New ODS output formats C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . SAS 9.4 BASE SAS NEW OUTPUT DELIVERY SYSTEM (ODS) - DESTINATIONS ODS EPUB - Create SAS reports as e-books that can be read with Apple iBooks e-book reader on iPad and iPhone. ODS POWERPOINT – Create Microsoft PowerPoint slides that combine text and SAS reports. ODS HTML5 – Create HTML5 output for SAS reports to support delivery to any web browser that is HTML5-compatible. C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . TOP 10 OF PLATFORM 10. Security 9. New ODS output formats 8. New programming languages C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . SAS 9.4 BASE SAS NEW ADDITIONAL SAS PROGRAMMING LANGUAGES DS2 - New SAS proprietary programming language for advanced data manipulation and applications • • • Plans – bring SAS processing to any platform Aka. Data Step 2 – by no means replacement to SAS Data Step – think of it as Data Step on Steroids! Runs currently – Base SAS (PROC DS2), In-Database (via SAS Code Accelerator – current Teradata only), HPA (via HPDS2) FedSQL - SAS proprietary implementation of ANSI SQL:1999 core standard • • • C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . Scalable, threaded, high-performance way to access, manage, and share relational data in multiple data sources Common SQL syntax across all data sources Runs on SAS Federation Server TOP 10 OF PLATFORM 10. Security 9. New ODS output formats 8. New languages 7. Hadoop C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . HADOOP INCREASINGLY A PART OF THE SAS ECOSYSTEM • In 9.3 we already had: • SAS/ACCESS to Hadoop (interact with HIVE tables like any other data source) • PROC HADOOP (run HDFS commands, run MapReduce and Pig code from SAS) • SAS Data Integration Studio transformations for Hadoop (Hive and file) load and extract • New PROC HDMD brings support for more file formats • Enables generation of metadata for tables or files that are not registered in Hive • SAS Scoring Accelerator and SAS Code Accelerator available for Hadoop in SAS 9.4 timescale • Strategic partnership with Cloudera – the leading Hadoop distributor C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . TOP 10 OF PLATFORM 10. Security 9. New ODS output formats 8. New languages 7. Hadoop 6. HP procedures C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . HPA NEWS COMPLEX BUT NO LONGER OUT OF REACH • HP Analytics Server is now split in 6 packages • HP procedures available in Base SAS versions (SMP mode) and will only require additional licensing for MPP mode • LASR will be leveraged for other in-memory purposes • • SAS Visual Analytics is but one of the clients utilizing the LASR Server in the future) Asymmetric Mode will provide better integration between MPP Database Appliances and the LASR server • No need to replicate data from data nodes to compute nodes! C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . SAS® ANALYTICS ADDITION OF HP ANALYTICS PROCEDURES TO SAS® (SAS® 9.4) ANALYTICS RUNNING ON SINGLE SERVER (SMP) SAS/STAT HPLOGISTIC HPREG HPLMIXED HPNLIN HPSPLIT HPGENSELECT SAS/ETS HPCOUNTREG HPSEVERITY HPQLIM SAS/OR HPLSO Select features in OPTMILP OPTLP OPTMODEL SAS Enterprise Miner HPREDUCE HPNEURAL HPFOREST HP4SCORE HPDECIDE SAS Text Miner SAS Forecast Server (SAS/ETS included) HPTMINE HPTMSCORE HPFORECAST Common Set to all (HPDS2, HPDMDB, HPSAMPLE, HPSUMMARY, HPIMPUTE, HPBIN, HPCORR) • New in SAS 9.4 • Common set of HP procedures will be included in each of the individual SAS Analytics products • SAS recommends that customers desiring to run these procedures on more than 16 cores should move to an MPP architecture (diminishing performance returns on adding additional cores) C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . TOP 10 OF PLATFORM 10. Security 9. New ODS output formats 8. New languages 7. Hadoop 6. HP procedures 5. Clustering of SAS Metadata Server C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . CLUSTER WHAT IS A METADATA SERVER CLUSTER? • Coordinated set of 3 or more metadata servers • Appears as a regular metadata server to SAS clients • Provides failure recovery for high availability • Provides scalable performance for large deployments C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . CLUSTER HOW DOES THE CLUSTER WORK? • A cluster is three or more metadata server nodes • Each node is a full metadata server with a complete copy of all metadata • One node is designated the master to coordinate the cluster • All other nodes are slave nodes • Clients connect to slave nodes • Once connected it looks like a normal server to the client C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . CLUSTER THREE NODE METADATA SERVER CLUSTER MASTER NODE2 SHARED BACKUP SLAVE SLAVE NODE1 NODE3 C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . CLUSTER HOW DO CLIENTS CONNECT? MASTER CLIENT1 NODE2 CLIENT2 REDIRECT SLAVE SLAVE NODE1 NODE3 C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . CLUSTER WHAT HAPPENS WHEN A SLAVE NODE FAILS? MASTER NODE2 CLIENT1 SLAVE SLAVE NODE1 NODE3 C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . CLUSTER WHAT HAPPENS WHEN A MASTER NODE FAILS? MASTER NODE2 CLIENT1 SLAVE to MASTER SLAVE NODE1 NODE3 C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . CLUSTER REQUIREMENTS • Three similar machines (same platform, similar performance characteristics) • Same hardware requirements as for standalone server • • Network shared storage is required for backups • • 8 GB, quad core, adequate I/O and network performance Does not require high performance storage Virtual machines / logical partitions possible • Continuity concerns – don’t put all eggs in one single basket! (ie. all 3 virtual machines in the same physical environment) C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . TOP 10 OF PLATFORM 10. Security 9. New ODS output formats 8. New languages 7. Hadoop 6. HP procedures 5. Clustering of SAS Metadata Server 4. Web clients C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . SAS 9.4 MORE WEB CLIENTS • SAS Studio is already released to academic community (US) • Next foxus on Enterprise Guide and Enterprise Miner follows soon • Customer Intelligence Studio already replaced by a Web Client • Look and feel follows SAS Visual Analytics Why: • No more software depots, Citrix, Remote Desktop connections etc. • Maintenance and upgrades of clients are instantaneous and easy • Platform independence/flexibility • Virtualisation and cloud ready => Enterprise focus C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . TOP 10 OF PLATFORM 10. Security 9. New ODS output formats 8. New languages 7. Hadoop 6. HP procedures 5. Clustering of SAS Metadata Server 4. Web clients 3. Environment Manager C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . SAS ENVIRONMENT OVERVIEW MANAGER C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . SAS ENVIRONMENT MANAGER ARCHITECTURE Platform 1 ( machine ) Management Server Tc Mid-Tier Servers Agent Object Spawner GUI Administration, Provisioning, Groups, Metrics, Alerts, Events, Logs, Agents CLI Open API RESTful Web GUI Dashboard Control Center Platform Server 1 2 ( machine 2 ) tc Server S tctcServer Metadata Instance 1 tc Server Instance 1 server Instance 1 Spring Object Spring Spring Spawner Agent Agent CMDB Service Database Inventory, Events, alerts C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . Upgradeable via XML and JAVA agent plugins SAS 9.4 SAS ENVIRONMENT MANAGER (EV) • Will detect and monitor all SAS relevant resources • Can be configured for advanced alerting • Will co-exist with and eventually consume the functionality of the SAS Management Console and RTM (for SAS Grid) sometime during the SAS 9.4 release cycle • Web based (HTML5) C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . TOP 10 OF PLATFORM 10. Security 9. New ODS output formats 8. New languages 7. Hadoop 6. HP procedures 5. Clustering of SAS Metadata Server 4. Web clients 3. Environment Manager 2. Cloud – AppCentral C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . SELF-SERVICE CLOUDS SAS App Central Administration • • • SAS vApp SAS vApp SAS vApp SAS vApp MANAGEMENT APPLICATIONS INFRASTRUCTURE VMware C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . End User Access Virtualization Environment Amazon ... Workgroup Enterprise 1 vApp=1-2 VMs 1 vApp=n VMs DNS (networing) SAS Metadata Server Data Store SAS Software Cluster File System Management SAS Software Application Server LDAP DNS (networking) Data Store HTTP Server HTTP Server Front Door SAS Software Application Server Operating System Middle tier (clustered) SAS Software Cluster File System Operating System Compute tiers (load balanced) SAS Metadata Server Operating System Operating System C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . …. …. Metadata (Clustered) Management VAPP TOPOLOGIES ALIGN WITH USAGE MODELS LDAP SAS VAPPS CLOUD GRADUAL ROLL-OUT • Focus is on creating vApps • Creating flexibility in deployment and elasticity in capacity • Provide new ways of licensing and distributing SAS software • Provides easier/faster provisioning of new SAS capabilities • Easier software maintenance and version control • Current • SAS Licensing for Amazon already exists • SAS Visual Analytics will be the first vApp offered – already available in the US! C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . TOP 10 OF PLATFORM 10. Security 9. New ODS output formats 8. New languages 7. Hadoop 6. HP procedures 5. Clustering of SAS Metadata Server 4. Web clients 3. Environment Manager 2. Cloud – AppCentral 1. New mid-tier servers C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . SAS 9.4 NEW MIDDLE TIER SOFTWARE • SAS Web Application Server based on VMWare vFabric TC Server • SAS Web Server based on VMWare vFabric Web Server • Active MQ messaging engine C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . SAS WEB APPLICATION WHAT IS IT SERVER Apache Tomcat VMware TC Server Web Application Server Tomcat Spring Container – Non EJB Workload Enterprise Capabilities Operations Management Diagnostics Module Enterprise support C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . SAS Web Application Server TC Server SAS MidTier Operations Management SAS EV Plugins for Monitoring Security Integration Enterprise support from SAS SAS 9.4 WHAT DOES THE NEW MIDDLE TIER MEAN? • No reliance on and cost of third party software like Websphere and WebLogic • Easier installation and maintenance/upgrade of software • One stop application support • More robust (=enterprise class) installations due to clustering of middle tier and meta data server (fault tolerance and scalability) C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . TOP 10 OF PLATFORM 10. Security 9. New ODS output formats 8. New languages 7. Hadoop 6. HP procedures 5. Clustering of SAS Metadata Server 4. Web clients 3. Environment Manager 2. Cloud – AppCentral 1. New mid-tier servers 0. How to get there? C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . SAS 9.4 UPGRADING TO 9.4 FOR EXISTING CUSTOMERS Many types of upgrade transitions to consider! Metadata-based deployments 1. ARCHITECTURE, DEPLOYMENT and OPERATIONS C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . a. Continued support for metadata-based SAS Migration Utility aka. SMU b. Metadata export / import process still a valid option c. Expanded support for “cross-version connectivity” , mainly EG and AMO d. Impact of product packaging changes 2. BASE SAS, just install 9.4 binaries 3. SAS dataset format remains the same 9.4 PLATFORM 1. Continued use of proven processes • • 2. Migration Supports new middle tier, clustering • ARCHITECTURE, DEPLOYMENT and OPERATIONS C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . • 3. • Create a new deployment Use tools to migrate a metadata-based deployment Process automatically uses embedded middle tier Cluster nodes can be created during a migration (for metadata and middle tier) Constraints for Metadata migration, promotion tools Minimum platform baseline is 9.2 • Specific products have additional version baselines SCREENSHOTS C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . SAS STUDIO C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . SAS ODS EPUB Output SAS Reports to eBook format to be viewed on iPad & iPhone C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . SAS ODS POWERPOINT C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . SAS ODS POWERPOINT C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d . SAS ODS POWERPOINT TwoContent layout C op yr i g h t © 2 0 1 3 , S A S I n s t i t u t e I n c . A l l r i g h t s r es er v e d .