ONTAP® 9 Release Notes
Updated for ONTAP 9.13.1
NetApp
September 15, 2023
Table of Contents
About the ONTAP 9 Release Notes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
About ONTAP 9 documentation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
About Cloud Volumes ONTAP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
About ONTAP Select . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
ONTAP System Manager functions in BlueXP. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
What’s new by ONTAP 9 release . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Changes in ONTAP 9.13.1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Changes in ONTAP 9.12.1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
Changes in ONTAP 9.12.0 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
Changes in ONTAP 9.11.1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
Changes in ONTAP 9.11.0 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
Changes in ONTAP 9.10.1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
Changes in ONTAP 9.10.0 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
Changes in ONTAP 9.9.1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
Changes in ONTAP 9.9.0 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
Changes in ONTAP 9.8 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
Changes in ONTAP 9.7 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
Changes in ONTAP 9.6 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
Changes in ONTAP 9.5 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
Changes in ONTAP 9.4 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
What’s new by ONTAP 9 feature area . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
CLI (command-line interface) updates . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
Data protection enhancements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
File access protocol enhancements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
Hardware support updates. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
MetroCluster configuration enhancements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
Networking and security protocol enhancements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45
S3 object storage enhancements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50
SAN enhancements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
Security enhancements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
Storage efficiency enhancements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
Storage resource management enhancements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
SVM management enhancements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
System Manager enhancements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
Transition enhancements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79
Upgrade enhancements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79
API changes in ONTAP 9 releases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83
Migrate from ONTAPI to the ONTAP REST API. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83
Support for an ONTAP REST API . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83
Changes to the ONTAP REST API. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 84
Support for performance metrics in the ONTAP REST API . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 89
Using the NetApp Manageability SDK . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91
Changes to ONTAP limits and defaults . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 92
Upgrade cautions in ONTAP 9 releases. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94
Upgrade cautions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94
Revert and downgrade cautions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97
End of support and deprecation in ONTAP 9 releases. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98
Features no longer supported . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98
Legacy hardware no longer supported. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100
Deprecated commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 101
Known problems and limitations in ONTAP 9 releases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102
7-Mode transition issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102
Data protection issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102
File access and protocols issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102
Management interface issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103
MetroCluster configuration issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104
Networking and security protocol issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 105
Storage resource management issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 108
System Manager issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110
Changes to published ONTAP 9 documentation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112
New home for ONTAP product documentation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112
Azure Key Vault commands are not supported with ONTAP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112
ONTAP platform mixing rules included in Hardware Universe . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112
Where to find product documentation and other information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113
About the ONTAP 9 Release Notes
These release notes describe new features, enhancements, and known issues for all
ONTAP 9 releases since ONTAP 9.5. These release notes also provides additional
information related to running each of these releases on specific storage systems.
These release notes apply to ONTAP 9.5 and all later releases (ONTAP 9.14.0, ONTAP 9.13.1, ONTAP 9.13.0,
ONTAP 9.12.1, ONTAP 9.12.0, ONTAP 9.11.1, ONTAP 9.11.0, ONTAP 9.10.1, ONTAP 9.10.0, ONTAP 9.9.1,
ONTAP 9.9.0, ONTAP 9.8, ONTAP 9.7, ONTAP 9.6, and ONTAP 9.5).
Release Notes documentation for ONTAP 9.4 and earlier releases is available here.
ONTAP 9.14.0, ONTAP 9.13.0, ONTAP 9.12.0, ONTAP 9.11.0, ONTAP 9.10.0 and 9.9.0 are
cloud-only releases with features applicable to Cloud Volumes ONTAP and managed cloud file
storage offerings, such as Cloud Volumes Service for Google Cloud, Azure NetApp Files, and
Amazon FSx for NetApp. ONTAP 9.13.1, ONTAP 9.12.1, ONTAP 9.11.1, ONTAP 9.10.1 and
9.9.1 releases can be installed on both on-premises and Cloud Volumes ONTAP systems.
If you’re upgrading your ONTAP clusters, you should familiarize yourself with relevant topics before upgrading
to any ONTAP 9 release.
For a complete list of functionality changes and unsupported features in each of these releases, see the
following sections:
• What’s new by ONTAP 9 release
• What’s new by ONTAP 9 feature area
• Features no longer supported
About ONTAP 9 documentation
The ONTAP 9 documentation is a cumulative library that covers all ONTAP 9 releases. Any functional
differences across ONTAP 9 versions are noted in context.
About Cloud Volumes ONTAP
Cloud Volumes ONTAP is a software-only storage appliance that runs ONTAP software. It provides secure,
proven NFS, CIFS, and iSCSI data management for the cloud.
NetApp cloud documentation
About ONTAP Select
ONTAP Select enables you to deploy ONTAP software on your choice of commodity hardware to deliver
enterprise-class storage services with cloud-like agility.
ONTAP Select documentation
1
ONTAP System Manager functions in BlueXP
ONTAP System Manager functions are available in BlueXP when users select Advanced View.
Advanced View in BlueXP
2
What’s new by ONTAP 9 release
Each version of ONTAP 9 release includes a number of changes, including new and
changed features. The following sections summarize the key changes in each ONTAP 9
release starting with ONTAP 9.5. More information about each feature area is provided in
What’s new by ONTAP 9 feature area.
All ONTAP 9.5 and later releases also include bug fixes. For more information, including a list of bugs fixed in
different releases, see Bugs Online on the NetApp Support Site.
Changes in ONTAP 9.13.1
New features and enhancements
Data protection enhancements
• Support for multi-admin verification
• Enhanced support for managing consistency groups including volume move and geometry
• Support for NDMP restore with SnapMirror Synchronous
• Support for NDMP and non-disruptive consistency group expansion with SnapMirror Business Continuity
• Support for Asynchronous SnapMirror with single consistency groups
File access protocol enhancements
• Support for managing NFSv4.x storepool resources
Hardware support updates
• Support for FAS2820
• ASA platform name change for existing ASA platforms
• Support for ASA A150 and ASA A900 platforms
• Support for DC power supplies
MetroCluster configuration enhancements
• Support for nondisruptive transitions from an eight-node MetroCluster FC configuration to a MetroCluster
IP configuration
• Support for four-node MetroCluster IP configuration upgrades using switchover and switchback
• Support for Mediator-assisted automatic unplanned switchover during environmental shutdown
• Support for eight-node MetroCluster IP configurations
• Support for MetroCluster IP configuration conversion to a shared storage MetroCluster switch configuration
Networking and security protocol enhancements
• Increased data LIF limits
• Support for using X.509 certificates with SSH public keys
3
• Support for IPv6 during cluster setup on the A800 and FAS8700 platforms
• Support for SSH public key authentication with Active Directory
• Support for multifactor authentication with TOTP (time-based one-time passwords)
• Support for FPolicy file access failure notification
S3 object storage enhancements
• Support for S3 bucket lifecycle management
SAN enhancements
• Support for NVMe/FC on AIX hosts
Security enhancements
• Support for Multi-admin verify functionality with Autonomous Ransomware Protection
• Support for automatic transition from learning to active mode with Autonomous Ransomware Protection
• Support for Autonomous Ransomware Protection of FlexGroup volumes
Storage Efficiency enhancements
• Change in reporting of primary data reduction ratio in System Manager
• Support for temperature-sensitive storage efficiency
• Support for logical space enforcement
• Support for storage VM capacity limits support
Storage resource management enhancements
• Increase in maximum number of inodes
• Support for specifying a SnapLock type during FlexClone creation
• Support for enabling File System Analytics by default
• Support for SVM DR fanout relationships with FlexGroup volumes
• Support for single FlexGroup rebalancing
• Improved sequential read performance using FabricPool
• Support for SVM-wide throughput floor enforcement
SVM enhancements
• Support for migrating SVMs containing up to 200 volumes
• Support for recreating missing SVM directories
System Manager enhancements
• Support to view visual depictions of additional hardware devices
• Change in reporting of primary data reduction ratio
• Support for Tamperproof Snapshot copy locking
• Support for external key managers
4
Upgrade enhancements
• Support for upgrading ONTAP and firmware from BlueXP
• Support for automatic ONTAP time zone database updates
API changes in ONTAP 9 releases
• Changes to the ONTAP REST API in ONTAP 9.13.1
New cautions
Upgrade cautions
• ARP auto-switch to active mode
Revert and downgrade cautions
• ARP auto-switch to active mode
Changes in ONTAP 9.12.1
New features and enhancements
Data protection enhancements
• Support for larger FlexVol volumes
• Support for larger file and LUN sizes
• Enhanced consistency group functionality
• SnapMirror Synchronous NDO
• SnapLock for SnapVault support for FlexGroup volumes
• ONTAP Mediator 1.5 support for SM-BC
• SnapMirror Business Continuity (SM-BC) support
• Data warehouse rebuild indicator for SnapMirror asynchronous
• SnapLock option to set minimum retention time "unspecified" absolute retention time
• Tamperproof Snapshot copies
• System Manager support for SnapLock
File access protocol enhancements
• NFS extended attributes
• Disable weak encryption types for Kerberos communication
• S3 client access to NAS data
• NFS over RDMA support in System Manager
Hardware support updates
• Support for AFF C250, AFF C400, AFF C800, and AFF A150 platforms
5
• NVIDIA IP SN2100 switch support
MetroCluster configuration enhancements
• ONTAP Mediator 1.5 support in a MetroCluster IP configuration
• Front-end host protocol IPsec support in MetroCluster IP configurations
• MetroCluster automatic forced switchover feature in a MetroCluster IP configuration
• S3 on an SVM on an unmirrored aggregate in a MetroCluster IP configuration
Networking and security protocol enhancements
• LIF service
• System Manager networking enhancements
S3 object storage enhancements
• Additional support for S3 actions
SAN enhancements
• Increased maximum LUN size for AFF and FAS platforms
• NVMe limits increase
• NVMe/TCP support for secure authentication
• MCC-IP support for NVMe
Security enhancements
• Ransomware protection interoperability enhancements
• MFA support for SSH with FIDO2 and PIV
• Tamper-proof logging
• Support for TLS transport for EMS events
Storage Efficiency enhancements
• Temperature-sensitive storage efficiency support on new AFF C250, AFF C400, AFF C800 platforms
• Increase in usable aggregate space
• File System Analytics: Top directories by size
Storage resource management enhancements
• FlexGroup rebalancing support
• SnapLock for SnapVault support for FlexGroup volumes
SVM enhancements
• SVM data mobility enhancements
System Manager enhancements
6
• Hardware visualization of cabling
• System display themes
• Improvements to local tier capacity details
• Improved searching
• Volume provisioning improvements
• Volume resizing enhancements
• Storage pool and Flash Pool management
• SnapLock management
API changes in ONTAP 9 releases
• Changes to the ONTAP REST API in ONTAP 9.12.1
New cautions
Upgrade cautions
• SnapMirror DP-type relationships are no longer supported
End of support and deprecation in ONTAP 9 releases
• HTTP transport of AutoSupport
• SnapMirror DP-type relationships
• Legacy hardware no longer supported
Changes in ONTAP 9.12.0
New features and enhancements
System Manager enhancements
• System Manager networking enhancements
Changes in ONTAP 9.11.1
New features and enhancements
Data protection enhancements
• SnapMirror Cloud single directory restore
• AIX host support with SM-BC
• Cluster external key servers
• SnapLock support for FlexGroup volumes
• SVM-DR quick resync support
• SVM-DR support in MetroCluster configuration
7
• SM-BC supports single-file SnapRestore
• Two-phase consistency group Snapshot copy creation
File access protocol enhancements
• LDAP fast bind support
Hardware support updates
• Sustaining changes for DS224C, DS212C and DS460C shelves
MetroCluster configuration enhancements
• ONTAP Mediator 1.4 support in MetroCluster IP configuration
• Consistency groups support in MetroCluster configurations
• Transitioning from a FC configuration to an AFF A250 or FAS500f MetroCluster IP configuration
Networking and security protocol enhancements
• TLSv1.3 support
• Link Layer Discovery Protocol (LLDP) supports
• LIF services
S3 object storage enhancements
• Additional support for S3 object actions
SAN enhancements
• iSCSI LIF failover
• Non-destructive migration from LUN to NVMe namespace and vice versa
Security enhancements
• Multi-admin verification
• Ransomware protection enhancements
Storage Efficiency enhancements
• View physical footprint savings
Storage resource management enhancements
• Enable file access time updates
• File System Analytics: Activity Tracking at SVM level
• Asynchronous directory delete
• SnapLock support for FlexGroup volumes
SVM enhancements
• SVM data mobility support
8
System Manager enhancements
• Hardware visualization
• System Analytics - Insights
• Usability enhancements
• Advanced local tier (aggregate) operations in System Manager
• SnapMirror Async policy support in System Manager
• Manage audit logging with System Manager
Upgrade enhancements
• Additional upgrade path options
API changes in ONTAP 9 releases
• Changes to the ONTAP REST API in ONTAP 9.11.1
Changes in ONTAP 9.11.0
New features and enhancements
System Manager enhancements
• Gain insights to improve the capacity and security compliance of your system
Changes in ONTAP 9.10.1
New features and enhancements
Data protection enhancements
• Consistency groups support
• Public cloud data archiving of backups
• Setting SnapLock retention up to 100 years
• Ability to create SnapLock and non-SnapLock volumes on the same aggregate
File access protocol enhancements
• NFS over RDMA (NVIDIA only) support
• AES support for secure Netlogon channel communication
• Kerberos for SMB domain-tunnel authentication
• Channel binding for increased LDAP communication security
Hardware support updates
• Sustaining changes for DS224C, DS212C and DS460C shelves
• Support for AFF A900
9
• NVIDIA IP SN2100 switch (X190006) support
MetroCluster configuration enhancements
• AFF A900 support in MetroCluster IP and FC configurations
• Configuration of layer 3 MetroCluster IP address in MetroCluster IP configurations
• Simplified controller upgrade of nodes in a MetroCluster FC configuration
Networking and security protocol enhancements
• RDMA cluster interconnect support
• Confirmation is required before setting status admin to down for a LIF in a system SVM
• Automatic detection and repair recommendations for network wiring issues
• Internet Protocol security (IPsec) certificates
• LIF Service policies
S3 object storage enhancements
• S3 SnapMirror backup and disaster recovery protection
• S3 audit functionality
SAN enhancements
• NVMe namespace
• NVME protocol support for TCP
Security enhancements
• Encryption key management
• Ransomware protection
Storage Efficiency enhancements
• Temperature-sensitive storage efficiency
Storage resource management enhancements
• Activity tracking for hot objects with File System Analytics (FSA)
• Global file read locking
• NFSv4 support with FlexCache volumes
• Convert a FlexVol to a FlexGroup in an SVM-DR source
• Create clones from existing FlexGroup volumes
SVM enhancements
• Ability to non-disruptively move SVMs between clusters
System Manager enhancements
10
• Enable performance telemetry logging in System Manager logs
• Simplified licensing with NetApp License Files (NLFs)
• Update firmware automatically using System Manager
• Review risk mitigation recommendations and acknowledge the risks reported by Active IQ using System
Manager
• Configure how EMS event notifications are sent to administrator using System Manager
• Manage security certificates using System Manager
• Display of capacity units in System Manager has changed
• View historical use of capacity and predict future capacity needs using System Manager
• Back up data to StorageGRID using the Cloud Backup Service
• Usability enhancements
API changes in ONTAP 9 releases
• Changes to the ONTAP REST API in ONTAP 9.10.1
New cautions
Revert and downgrade cautions
• Retention capability for SnapLock
New known problems and limitations
File access protocols issues
• Mellanox RDMA gARP delays
• RDMA support with NFS is limited to NFSv4.0
• Mount size limitation in NFS over RDMA
• NFS over RDMA limited to node-local traffic
MetroCluster configuration issues
• Allow user to proceed with NSO based controller replacement if the cluster has unmirrored aggregates
Storage resource management issues
• Auto adaptive compression undo on certain volumes might leave incorrect versioning for indirect blocks
Changes in ONTAP 9.10.0
New features and enhancements
System Manager enhancements
• System Manager displays risks reported by Active IQ
11
Changes in ONTAP 9.9.1
New features and enhancements
Data protection enhancements
• Support for configuring different Snapshot policies on SVM DR source and destination
• Storage efficiency support on SnapLock volumes and aggregates
• System Manager support for SnapMirror Cloud
File access protocol enhancements
• NFSv4.x versions enabled by default
• LDAP referral chasing support with LDAP signing and sealing, encrypted TLS connections, and
communications over LDAPS
• Mandatory Access Control (MAC) labeled NFS is supported when NFSv4.2 is enabled
Hardware support updates
• Sustaining changes for DS224C, DS212C and DS460C shelves
• Cisco Nexus 9336C-FX2 support
MetroCluster configuration enhancements
• MetroCluster IP support for IP-routed (layer 3) backend connections
• MetroCluster IP support for 8-node configurations
Networking and security protocol enhancements
• Cluster resiliency and diagnostic improvements
• VIP Extension
Object storage enhancements
• S3 metadata and tags support
SAN enhancements
• Foreign LUN Import using IMT
• NVMe-oF Protocol Remote IO Feature Expansion
• Support for 12-node clusters on ASAs
• NVMe-oF protocol on ASAs
• Support for 8-node MCC-IP on ASAs
• Igroup enhancements
• Single LUN performance improvement
Storage resource management enhancements
12
• File System Analytics (FSA) management enhancements in System Manager
• Number of files can be set to maximum for volume
• Negative lookup cache support
• FlexCache disaster recovery support
• SnapMirror cascade and fanout support for FlexGroup volumes
• SVM DR support for FlexGroup volumes
• Logical space reporting and enforcement support for FlexGroup volumes
• SMB access support in qtrees
System Manager enhancements
• Manual assignment of local tier with System Manager
• Fast directory delete with System Manager
• Ansible Playbooks support with System Manager
• Hardware Visualization support in System Manager
• Active IQ Integration in System Manager
• Cloud Agent support with System Manager
• Cloud Manager integration in System Manager
• Enhancements to workflow when provisioning data protection in System Manager
• Enhanced network port management in System Manager
• System management enhancements in System Manager
• Enhanced display in System Manager of information about Snapshot copies
• Enhanced display in System Manager about capacity and location information for storage tiers
• Display in System Manager of EMS emergency alerts and other errors and warnings
API changes in ONTAP 9 releases
• Changes to the ONTAP REST API in ONTAP 9.9.1
New cautions
Upgrade cautions in ONTAP 9 releases
• An automated cluster image update will pause until the keys are available
End of support and deprecation in ONTAP 9 releases
Legacy hardware no longer supported
• FAS80xx, AFF80xx, and FAS25xx are no longer supported
New changes to published documentation
• Azure Key Vault commands are not supported with ONTAP
13
Changes in ONTAP 9.9.0
New features and enhancements
System Manager enhancements
• Cloud Agent support with System Manager
Changes in ONTAP 9.8
New features and enhancements
Data protection enhancements
• NVE support for root volume encryption to protect root volume
• Support for moving a SnapLock volume to a destination aggregate of the same type, either Enterprise to
Enterprise, or Compliance to Compliance
• New unspecified retention period for the volume
• SnapMirror Cloud using qualified vendor applications
• Increased concurrent SnapMirror transfer limits
File access protocol enhancements
• ONTAP Auditing Schema Reference
• Support for SHA-2 LDAP password hashes
• Encryption support between ONTAP and domain controllers
• Improved NFSv4.1 performance with nconnect support
• Support for NFSv4.2
Hardware support updates
• Sustaining changes for DS224C, DS212C and DS460C shelves
• Expanded platform support for NS224 drive shelves
• Support for the AFF A250 platform
• Support for the FAS500f platform
• Support for the ASA AFF A800 platform
• Support for the Nexus 3232C 100 GbE switch (X190100 and X190100R) as a storage switch to connect
NS224 NVMe drive shelves to additional platforms.
MetroCluster configuration enhancements
• Brocade FC switches: G720, G620-1, G630-1
• AFF A250 is supported in MetroCluster IP configurations
• Cisco IP switch: 9336C
• Simplified interface to manage MetroCluster operations
14
• IP MetroCluster switchover and switchback with System Manager
• Unmirrored aggregates
Networking and security protocol enhancements
• Auto port placement
• Switch CLI simplification
• Virtual IP (VIP) expansion allows to configure two additional Border Gateway Protocol attributes for Virtual
IP
• IPv6 variable length range has increased from 64 to 1 through 127 bits
• Internet Protocol security (IPsec) over wire encryption (not available in ONTAP 9.8 RC)
S3 object storage enhancements
• S3 object storage support
SAN enhancements
• SnapMirror Business Continuity (SMBC) is a new business continuity solution available in public preview
• Persistent ports are enabled by default on all All SAN Arrays (ASA)
• NVMe protocol co-existence
• Increased size limitations for ASA configurations
Storage efficiency enhancements
• Temperature sensitive storage efficiency
Storage resource management enhancements
• ONTAP File System Analytics for FlexGroup and FlexVol volumes
• Logical space reporting for SnapMirror destination volumes
• FlexCache volumes support SMB protocol
• SnapMirror secondary volume as FlexCache volume
• FlexCache volume prepopulation
• SnapMirror single file restore of FlexGroup volumes
• Support for converting volumes transitioned from 7-Mode systems to FlexGroup volumes
• Fast Directory Delete
• Volumes that are part of application provisioning are supported
• Support for restoring preconversion Snapshot copies
• Tiering to ONTAP S3 object storage
• Cloud migration control enables you to change a volume’s default tiering policy for controlling user data
retrieval
• 183 day cooling period is the maximum colling period
• Object tagging enables use of user-created custom tags
• Promotion of the data to the performance tier
15
• FabricPool tiering from HDD
• QoS support for Qtrees
• QoS support for SVM administrator
• Metrics for throughput floors
System Manager enhancements
• Term “quiesce” has been changed to “pause” in System Manager
• View active NFS clients with System Manager
• QoS enabled by default with System Manager
• Viewing and managing your network with System Manager
• Troubleshoot hardware problems with System Manager
Upgrade enhancements
• Hardware upgrade enhancements
• MAINT Start/Stop AutoSupport message for ANDU
• Simplified hardware upgrade procedure
• Upgrade both clusters in a MetroCluster configuration
API changes in ONTAP 9 releases
• Changes to the ONTAP REST API in ONTAP 9.8
• Support for performance metrics in the ONTAP REST API
New cautions
Upgrade cautions in ONTAP 9 releases
• EMS messages not delivered
• SSH fails to connect or prompt for a password after upgrading from 9.7 or an earlier release of ONTAP
• SSH fails to connect to filer after upgrade from ONTAP 9.1 to any release due to presence of hmac-ripemd
MAC algorithms
• SSH connection to Storage
End of support and deprecation in ONTAP 9 releases
Features no longer supported
• The System Manager legacy UI, based on ONTAPI, is no longer available due to the transition from
ONTAPI to REST APIs.
Legacy hardware no longer supported
• ATTO FibreBridge 6500N FC-to-SAS bridge
16
New known problems and limitations
Management interface issues
• System Manager Volume Move dialog might not show accurate revised used capacity
Networking issues
• A250 e0a/e0b ports might randomly negotiate 1GB speed when connected to a switch
• Controller disruption might occur after upgrading to ONTAP 9.8
Storage resource management issues
• ONTAP 9.8 netapp-ontap library fails to compute URL for resource with integer key in its path
New changes to published documentation
• Azure Key Vault commands are not supported with ONTAP
Changes in ONTAP 9.7
New features and enhancements
Data protection enhancements
• Data at rest encryption by default
• SnapMirror Synchronous enhancements
File access protocol enhancements
• Keytab files for SVM authentication with Active Directory (AD) servers
• Encryption and signing performance improvements
Hardware support updates
• Sustaining changes for DS224C, DS212C and DS460C shelves
• Hot-adding 12Gb SAS shelves to 6Gb SAS storage stacks
• FAS8300
• FAS8700
• AFF A400
• ASA AFF A220
• ASA AFF A700
MetroCluster configuration enhancements
• MetroCluster FC configuration platform support
• ONTAP Mediator is supported in MetroCluster IP configurations
• FabricPool mirrors on MetroCluster configurations
17
• MetroCluster compliant switches
• AFF A320 platform is supported on Broadcom switches
Networking and security protocol enhancements
• Caching for NIS netgroup-by-host searches
S3 object storage enhancements
• S3 object storage support
SAN enhancements
• Symmetric Active-Active host access
• Support for large I/O
Storage resource management enhancements
• Throughput flooring enhancements
• FlexVol volumes limit
• FlexCache volumes enhancements
• FlexGroup volumes enhancements
• QoS floors
• FabricPool mirror
• FabricPool mirrors on MetroCluster configurations
• Non transparent HTTP and HTTPS proxy
System Manager enhancements
• ONTAP System Manager is the next generation in ONTAP simplicity
Transition enhancements
Upgrade enhancements
• Upgrade from ONTAP 9.3 directly to 9.7
API changes in ONTAP 9 releases
• Changes to the ONTAP REST API in ONTAP 9.7
• Support for performance metrics in the ONTAP REST API
Changes in ONTAP 9.6
New features and enhancements
API changes in ONTAP 9 releases
• Support for an ONTAP REST API
18
Data protection enhancements
• SnapMirror Synchronous enhancements
• DPO licensing enhancements
• Maximum supported FlexVol volumes increases for secondary or data protection targets
• Default cluster peering encryption
• SnapLock volume
• Self Encrypting Drives (SED) locking support
• Key management at the SVM scope
• NetApp Aggregate Encryption
Hardware support updates
• Hot-adding 12Gb SAS shelves to 6Gb SAS storage stacks
• AFF C190 platform
• AFF A320 platform
• NS224 shelf
MetroCluster configuration enhancements
• Brocade G630 FC switches support
• Broadcom IP switches Quanta IX8 support
• Private layer 2 network sharing
• MetroCluster switchover and switchback
• AFF A220 and FAS2750 platforms supported with MetroCluster IP configurations
SAN enhancements
• Limited volume mobility support for the NVMe protocol
System Manager enhancements
• System Manager and Unified Manager name changes
• ONTAP System Manager is the next generation in ONTAP simplicity
Transition enhancements
API changes in ONTAP 9 releases
• Changes to the ONTAP REST API in ONTAP 9.6
New known problems and limitations
System Manager issues
19
Changes in ONTAP 9.5
New features and enhancements
Data protection enhancements
• SnapMirror synchronous technology
File access protocol enhancements
• LDAP referral chasing
• LDAP over SSL support
• 4-byte UTF-8 encoded characters
• Windows machine accounts can be mapped to users other than the default UNIX user
Hardware support updates
• Hot-adding 12Gb SAS shelves to 6Gb SAS storage stacks
MetroCluster configuration enhancements
• SnapMirror SVM disaster recovery supported in a MetroCluster configuration
• Cluster update with ONTAP System Manager
• AFF A300 and FAS8200 platforms
Networking and security protocol enhancements
• NTPv3 symmetric authentication
• SSH login security alerts
• LIF service policies
• Virtual IP (VIP) LIFs and border gateway protocol (BGP) support
• Multipath routing support
Storage resource management enhancements
• Logical space enforcement for FlexVol volumes
• FabricPool functionality
• FlexCache volumes support
• FlexGroup volumes enhancements
• Adaptive QoS enhancements
System Manager enhancements
• AutoSupport configuration on all nodes by default
New cautions
Upgrade cautions in ONTAP 9 releases
20
• Upgrading ONTAP 9.5 or later with NetApp Volume Encryption
New known problems and limitations
7-Mode transition issues
Storage resource management issues
Changes in ONTAP 9.4
Changes to ONTAP 9.4 and earlier releases are documented in ONTAP 9.0 to 9.4 Release Notes
21
What’s new by ONTAP 9 feature area
ONTAP features and functional areas evolve over the course of ONTAP 9 releases. The
following tables list many of the changes that have been implemented in key feature
areas since the ONTAP 9.5 release.
Some new and changed features in a given release might have been introduced in a maintenance release of
an earlier version of the software. Before upgrading to a release, consult with your NetApp representative
about the new ONTAP release to determine the best solutions for your business needs.
For a comparison of the bugs that were fixed in different releases, see Bugs Online—Release Comparison.
CLI (command-line interface) updates
Changes to the command-line interface (CLI) commands are listed on the NetApp
Support Site.
Related information
NetApp CLI Comparison: New and changed commands in ONTAP
Data protection enhancements
Cluster and SVM peering support
Functionality
Description and where to learn more
Available
beginning
Default cluster
peering encryption
Cluster peering encryption is enabled by default on all newly created
cluster peering relationships. Cluster peering encryption must be
enabled manually for cluster peering relationships created in ONTAP
9.5 or earlier.
ONTAP 9.6
Enabling cluster peering encryption on an existing peer relationship
Encryption of data at rest support
Functionality
Description and where to learn more
Cluster external key Clustered external key management servers support is added for
servers
NetApp partners who provide a clustered KMIP server solution. This
allows primary and secondary KMIP servers to be added preventing
duplication of encryption key data. For supported partners, see the
Interoperability Matrix Tool.
Configure clustered external key servers
NetApp Interoperability Matrix Tool
22
Available
beginning
ONTAP 9.11.1
Functionality
Description and where to learn more
Available
beginning
NVE support for root You can use NetApp Volume Encryption to protect your root volume.
volume encryption
Enabling root volume encryption
ONTAP 9.8
Data at rest
Whenever an external or onboard key manager is configured, new
encryption by default aggregates will have NetApp Aggregate Encryption (NAE) enabled by
default. New volumes that are not part of an NAE aggregate will have
NetApp Volume Encryption (NVE) enabled by default.
ONTAP 9.7
Configuring NetApp Volume Encryption
Self Encrypting
You can assign a data authentication key to a FIPS drive or SED.
Drives (SED) locking Cluster nodes use this key to lock or unlock encrypted data on the
support
drive.
ONTAP 9.6
Assigning a data authentication key to a FIPS drive or SED (external
key management)
Key management at You can configure external key management for a named SVM in the
the SVM scope
cluster. That is best for multitenant environments in which each tenant
uses a different SVM (or set of SVMs) to serve data.
ONTAP 9.6
Enabling external key management in ONTAP 9.6 and later (NVE)
NetApp Aggregate
Encryption
To enable aggregate deduplication, you can use aggregate-level
encryption to assign keys to the containing aggregate for the volumes
to be encrypted. Volumes you create in the aggregate are encrypted
by default.
ONTAP 9.6
Enabling aggregate-level encryption
Replace security
certificates without
removing the key
server
If you are using the same private/public key pair as was used in the
original certificate, you can install a new security certificate without
removing the key server. Use the security certificate
install command to install a new security certificate without
removing the key server.
ONTAP 9.5P9
Replacing SSL certificates
NVE support for
Cloud Volumes
ONTAP
NVE supports Cloud Volumes ONTAP.
ONTAP 9.5
Configuring NetApp Volume Encryption
NVE support for
NVE supports encryption of the fingerprint database created by
fingerprint database background deduplication operations.
encryption
ONTAP 9.5
23
SnapLock archiving and compliance support
Functionality
Description and where to learn more
Available
beginning
Support for multiadmin verification
Cluster administrator can explicitly enable multi-admin verification on a ONTAP 9.13.1
cluster to require quorum approval before some SnapLock operations
are executed.
What SnapLock is
System Manager
support for
SnapLock
SnapLock operations, including Compliance Clock initialization,
SnapLock volume creation, and WORM file mirroring are supported in
System Manager.
ONTAP 9.12.1
SnapLock support
for FlexGroup
volumes
SnapLock includes support for data stored on FlexGroup volumes.
FlexGroup volumes support is available with SnapLock Compliance
and SnapLock Enterprise modes. SnapLock does not support the
following operations on FlexGroup volumes: SnapLock for SnapVault,
event-based retention, and Legal Hold.
ONTAP 9.11.1
What SnapLock is
Set SnapLock
retention up to 100
years
In releases earlier than ONTAP 9.10.1, the maximum supported
retention time is January 19, 2071. Beginning with ONTAP 9.10.1
SnapLock Enterprise and Compliance support a retention time up to
October 26, 3058 and a retention period up to 100 years. Older
policies are automatically converted when you extend retention dates.
ONTAP 9.10.1
SnapLock retention period
Ability to create
SnapLock and nonSnapLock volumes
on the same
aggregate
Beginning with ONTAP 9.10.1, SnapLock and non-SnapLock volumes ONTAP 9.10.1
can exist on the same aggregate, so it is no longer necessary to create
a separate SnapLock aggregate for SnapLock volumes.
Storage efficiency
support on
SnapLock volumes
and aggregates
Storage efficiency capabilities for SnapLock volumes and aggregates
have been extended to include data compaction, cross-volumededuplication, adaptive compression, and TSSE (Temperature
Sensitive Storage Efficiency), allowing for greater space savings for
WORM data.
Create SnapLock aggregate
ONTAP 9.9.1
What SnapLock is
Support for moving
a SnapLock volume
to a destination
aggregate
You can use the volume move command to move a SnapLock volume
to a destination aggregate of the same type, either Enterprise to
Enterprise, or Compliance to Compliance.
Moving a SnapLock volume
24
ONTAP 9.8
Functionality
Description and where to learn more
Available
beginning
New unspecified
retention period
You can set the retention time for a file explicitly, or you can use the
default retention period for the volume to derive the retention time.
Unless you set the retention time explicitly, SnapLock uses the default
retention period to calculate the retention time.
ONTAP 9.8
Setting the retention time
XDP support for
WORM files
You can replicate WORM files with the XDP (extended data protection) ONTAP 9.5
type rather than the DP (data protection) type. XDP mode is ONTAP
version-independent and is able to differentiate files stored in the same
block, making it much easier to resync replicated Compliance-mode
volumes.
Mirroring WORM files
SnapMirror data protection support
Functionality
Description and where to learn more
Available
beginning
Consistency group
enhancements:
modify consistency
group geometry
You can move volumes between consistency groups, modify the
ONTAP 9.13.1
geometry of hierarchical consistency groups, and gain capacity
insights into consistency groups. System Manager supports creating a
consistency group with new NAS volumes or NVME namespaces.
Consistency groups overview
SnapMirror
Synchronous
NDMP restore is supported with SnapMirror synchronous.
ONTAP 9.13.1
SnapMirror Synchronous disaster recovery basic
SnapMirror
You can non-disruptively add volumes to a consistency group with an
Business Continuity: active SM-BC relationship and utilize NDMP restore with SM-BC.
NDMP support and
SM-BC overview
non-disruptive
consistency group
expansion
Asynchronous
SnapMirror support
for single
consistency groups
ONTAP 9.13.1
Consistency groups support Asynchronous SnapMirror configurations, ONTAP 9.13.1
allowing vaulting of SnapMirror backups for single consistency groups.
Protect a consistency group
25
Functionality
Description and where to learn more
Available
beginning
Support for larger
FlexVol volumes
The maximum FlexVol volume size supported in SnapMirror
Synchronous configurations has increased from 100 TB to 300 TB.
Both the source and destination clusters must be running ONTAP
9.12.1P2 or later.
ONTAP
9.12.1P2
SnapMirror Synchronous disaster recovery basics
Support for larger
file and LUN sizes
The maximum file and LUN size supported in SnapMirror Synchronous ONTAP
configurations has increased from 16 TB to 128 TB. Both the source
9.12.1P2
and destination clusters must be running ONTAP 9.12.1 P2 or later.
SnapMirror Synchronous disaster recovery basics
Enhanced
consistency group
functionality
• You can add and remove volumes from a consistency group, clone ONTAP 9.12.1
a consistency group (including from a Snapshot copy).
• Consistency groups support application tagging to streamline data
protection and management processes.
• The ONTAP REST API has new support for configuring
consistency groups with NFS/SMB volumes or NVMe
namespaces.
Consistency groups overview
SnapMirror
Synchronous NDO
SnapMirror Synchronous supports non-disruptive operations (NDO) of ONTAP 9.12.1
HA takeover and giveback, volume move, and other maintenancerelated operations. This feature is available only on AFF/ASA
platforms.
SnapLock for
SnapVault support
for FlexGroup
volumes
SnapLock for SnapVault is supported on FlexGroup volumes.
ONTAP Mediator 1.5 ONTAP Mediator 1.5 is available for monitoring SnapMirror Business
support for SM-BC
Continuity (SM-BC) relationships.
ONTAP 9.12.1
ONTAP 9.12.1
SM-BC
enhancements
SnapMirror Business Continuity (SM-BC) supports partial LUN restore ONTAP 9.12.1
from Snapshots. Additionally, SM-BC extends QoS to volumes not in
the SM-BC relationship.
Data warehouse
rebuild indicator for
SnapMirror
asynchronous
SnapMirror asynchronous provides an indicator showing how long a
data warehouse rebuild will take after a disaster recovery (DR)
rehearsal by displaying the percentage complete.
26
ONTAP 9.12.1
Functionality
Description and where to learn more
Available
beginning
SnapLock option to
set minimum
retention time
"unspecified"
absolute retention
time
SnapLock includes an option to set a minimum retention time when the ONTAP 9.12.1
absolute retention time is set to "unspecified".
Tamperproof
Snapshot copies
You can lock a Snapshot copy on a non-SnapLock volume to provide
protection from ransomware attacks. Locking Snapshot copies helps
ensure that they are not deleted accidentally or maliciously.
ONTAP 9.12.1
Tamperproof Snapshot copy locking overview
SnapMirror
You can use System Manager to add pre-created and custom mirror
asynchronous policy and vault policies, display legacy policies, and override the transfer
in System Manager schedules defined in a protection policy when protecting volumes and
storage VMs. You can also use System Manager to edit your volume
and storage VM protection relationships.
ONTAP 9.11.1
• Create custom data protection policies
• Configure mirrors and vaults
If you are using ONTAP 9.8P12 or later ONTAP 9.8
patch release and you configured SnapMirror using
System Manager, and you plan to upgrade to ONTAP
9.9.1 or ONTAP 9.10.1 releases, you should use
ONTAP 9.9.1P13 or later and ONTAP 9.10.1P10 or later
patch releases for your upgrade.
SnapMirror Cloud
single directory
restore
Enables cluster administers at the admin privilege level to perform a
ONTAP 9.11.1
single directory restore operation from a cloud endpoint. The source
endpoint UUID must be provided to identify the backup endpoint from
which you are restoring. Because multiple backups can use the same
cloud_endpoint_name as the destination, the unique UUID associated
with the backup must be provided for the restore command. You can
use the snapmirror show command to obtain the
source_endpoint_uuid.
snapmirror restore -destination-path vs1:ontap_dst
-source-path
object_store_name:/objstore/cloud_dst_name -source
-snapshot snap2 -file-list dir_inum,@/dir -source
-endpoint-uuid fba23064-024d-44e4-b6cf-d625f32d7a38
AIX host support
with SM-BC
SM-BC supports AIX as a host.
ONTAP 9.11.1
Additional restrictions and limitations
27
Functionality
Description and where to learn more
Available
beginning
SVM-DR quick
resync
Provides storage admins with the ability to bypass a full data
warehouse rebuild and to recover more quickly from a disaster
recovery rehearsal.
ONTAP 9.11.1
Reactivate the original source SVM
SVM-DR support
with MetroCluster
Configuration
SVM-DR source is supported on both ends of a MetroCluster
configuration.
ONTAP 9.11.1
About SnapMirror SVM replication
SM-BC supports
single-file
SnapRestore
Single-file SnapRestore allows you to restore an individual LUN or
ONTAP 9.11.1
normal file in a SnapMirror Business Continuity (SM-BC) configuration.
SM-BC overview
Two-phase
consistency group
Snapshot copy
creation
Create consistency group Snapshot copies in two phases with the
ONTAP REST API, executing prechecks and then committing the
Snapshot copy.
ONTAP 9.11.1
Protect a consistency group
Consistency groups
Customers can create hierarchical support groups to manage policies
and write-order fidelity of storage volumes for snapshot recovery.
ONTAP 9.10.1
Consistency groups
Public cloud data
SnapMirror Cloud supports tiering of ONTAP backups to lower cost
archiving of backups public cloud object storage classes in AWS and MS Azure for longterm retention.
ONTAP 9.10.1
SnapMirror Cloud backups to object storage
Support for
configuring different
Snapshot policies on
SVM DR source and
destination
SVM DR configurations can use the mirror-vault policy to configure
different Snapshot policies on the source and destination, and the
policies on the destination are not overwritten by the policies on the
source.
ONTAP 9.9.1
Understanding SnapMirror SVM replication
System Manager
support for
SnapMirror Cloud
28
Adds support for SnapMirror Cloud replication using System Manager. ONTAP 9.9.1
SnapMirror licensing
Functionality
Description and where to learn more
Available
beginning
Updated guidance
on load-sharing
mirrors
It is no longer required that you create an SVM load-sharing mirror
(LSM) on every node in the cluster. You can create the LSM on any
node other than the one containing the root volume, preferably in a
different HA pair.
All ONTAP 9
releases
Creating and initializing load-sharing mirror relationships
Increased
concurrent
SnapMirror transfer
limits
Increased concurrent SnapMirror transfer limits are supported on
ONTAP 9.8
platforms with at least 36 CPU cores and at least 512 MB RAM. LRSE
limits increase to 250 and SnapMirror Cloud limits increase to 100.
SnapMirror Cloud
ONTAP supports Snapshot copy replication to S3 object storage,
powered by SnapMirror Cloud using qualified vendor applications.
ONTAP 9.8
A New Backup Architecture — SnapDiff V3
SnapMirror licensing
SnapMirror
Synchronous
enhancements
• FC-NVMe protocol
ONTAP 9.7
• LUN clone replication
• Replication of application-created Snapshot copies
SnapMirror Synchronous disaster recovery basics
SnapMirror
Synchronous
enhancements
• NFSv4.0 and NFSv4.1
ONTAP 9.6
• SMB 2.0 or later
• Mixed protocol access (NFSv3 and SMB/CIFS)
• Primary volumes with antivirus, hard or soft quotas, FPolicy
• Synchronous — Asynchronous cascades
• Timestamp parity between source and destination volumes for
NAS
• Removal of high metadata operation frequency limitation
• Security for sensitive data in-transit using TLS 1.2 encryption
SnapMirror Synchronous disaster recovery basics
DPO licensing
enhancements
DP_Optimized (DPO) licenses, which enable SnapMirror protection for ONTAP 9.6
increased numbers of volumes and peer relationships, are available as
Tiered Licenses and as Standalone Licenses for ONTAP secondary
clusters. Contact your NetApp representative for details.
SnapMirror licensing
29
Functionality
Description and where to learn more
Available
beginning
Maximum supported
FlexVol volumes
increases for
secondary or data
protection targets
The increase, enabled by the DP_Optimized (DPO) license, allows you ONTAP 9.6
to scale up to 2,500 FlexVol volumes per node, or up to 5,000 in
failover mode. A SnapMirror license is still required on both the source
and destination nodes.
SnapMirror licensing
SnapMirror
Synchronous
technology
SnapMirror supports continuous replication of changes to the source,
as well as point-in-time replication.
ONTAP 9.5
SnapMirror Synchronous disaster recovery basics
File access protocol enhancements
Authentication support
Functionality
Description and where to learn more
Available
beginning
Disable weak
encryption types for
Kerberos
communication
A new SMB security option allows you to disable RC4 and DES in
favor of Advanced Encryption Standard (AES) encryption types for
Kerberos-based communication with the Active Directory (AD) KDC.
ONTAP 9.12.1
Configure strong security for Kerberos-based communication by using
AES encryption
LDAP fast bind
support
If supported by the LDAP server, you can use LDAP fast bind to
authenticate ONTAP admin users quickly and simply.
ONTAP 9.11.1
Use LDAP fast bind for nsswitch authentication
AES support for
secure Netlogon
channel
communication
If you connect to Windows domain controllers using the Netlogon
authentication service, you can use Advanced Encryption Standard
(AES) for secure channel communications.
ONTAP 9.10.1
Configure Active Directory domain controller access overview
Kerberos for SMB
domain-tunnel
authentication
Kerberos authentication is available for domain tunnel authentications
for ONTAP management in addition to NTLM. This allows for more
secure logins to the ONTAP CLI and System Manager GUI using
Active Directory credentials.
Configure an authentication tunnel
30
ONTAP 9.10.1
Functionality
Description and where to learn more
Available
beginning
Channel binding for
increased LDAP
communication
security
LDAP channel binding is supported by default for both Active Directory ONTAP 9.10.1
and name services LDAP connections. This provides better protection
against man-in-the-middle attacks.
Overview of using LDAP
LDAP referral
chasing
enhancements
LDAP referral chasing is supported with LDAP signing and sealing,
encrypted TLS connections, and communications over LDAPS port
636.
ONTAP 9.9.1
Using LDAP
LDAPS support on
any port
LDAPS can be configured on any port, although port 636 remains the
default.
ONTAP 9.9.1
LDAPS concepts
Support for SHA-2
LDAP password
hashes
ONTAP administrators can authenticate with LDAP using SHA-2
password hashes (SHA-256, SSH-384, SHA-512, SSHA-256, SSHA384, and SSHA-512).
ONTAP 9.8
Using LDAP
Keytab files for SVM AD administrators can provide keytab files to ONTAP administrators
authentication with
when Kerberos authentication is required with the AD domain.
Active Directory
Creating keytab files for SMB/CIFS authentication
(AD) servers
ONTAP 9.7
LDAP referral
chasing
ONTAP 9.5
Allows the ONTAP LDAP client to refer look-up requests to other
LDAP servers if an LDAP referral response is returned by the primary
LDAP server.
Using LDAP
Windows machine
accounts can be
mapped to users
other than the
default UNIX user
Previously, machine account mappings failed when there was no
default UNIX user, even if a mapping was present.
ONTAP 9.5
How name mapping works
31
Functionality
Description and where to learn more
Available
beginning
LDAP over SSL
support
The SSL protocol for secure communication between the LDAP server ONTAP 9.5
and the ONTAP LDAP client, also known as LDAP over SSL or
LDAPS, is supported in ONTAP 9.5 and later releases. SSL is not
supported with LDAP in ONTAP 9.0-9.4; the -allow-ssl option of the
vserver services name-service ldap client command family is not
supported in these releases.
It is a NetApp best practice to use Start TLS rather than LDAPS.
LDAPS concepts
International characters support
Functionality
Description and where to learn more
Available
beginning
4-byte UTF-8
encoded characters
File, directory, and tree names can include Unicode supplementary
characters outside the Basic Multilingual Plane (BMP). This change
corrects display problems with international characters in earlier
releases.
ONTAP 9.5
Support for 4-byte UTF-8 encoded characters is not available for the
Data Fabric Solution for Cloud Fabric.
How ONTAP handles multi-byte file, directory, and qtree names
Multiprotocol support
Multiprotocol
functionality
Description and where to learn more
Available
beginning
S3 client access to
NAS data
S3 clients can access the same NAS data as NFS and SMB clients
without reformatting, making it easier to serve S3 applications that
require object data.
ONTAP 9.12.1
S3 multiprotocol overview
NFS protocol support
32
Functionality
Description and where to learn more
Available
beginning
NFSv4.x storepool
A few clients consume too many NFSv4.x storepool resources leading ONTAP 9.13.1
to other NFSv4.x clients getting blocked due to unavailability of
NFSv4.x storepool resources. You can have the option to enable
denying and blocking of clients who consume a lot of NFSv4.x
storepool resource in their environments.
Manage NFSv4 storepool limits
NFS extended
attributes
NFS servers enabled for NFSv4.2 can store and retrieve NFS
extended attributes (xattrs) from xattr-aware clients.
ONTAP 9.12.1
ONTAP support for NFSv4.2
NFS over RDMA
support in System
Manager
System Manager supports network interface configuration for NFS
over RDMA and identifies RoCE capable ports.
ONTAP 9.12.1
NFS over RDMA
(NVIDIA only)
NFS over RDMA utilizes RDMA adapters, allowing data to be copied
directly between storage system memory and host system memory,
circumventing CPU interruptions and overhead. NFS over RDMA
enables the use of NVIDIA GPUDirect Storage for GPU-accelerated
workloads on hosts with supported NVIDIA GPUs.
ONTAP 9.10.1
NFS over RDMA
NFSv4.x versions
enabled by default
Supported NFS versions and clients
ONTAP 9.9.1
Labeled NFSv4.2
support
Mandatory Access Control (MAC) labeled NFS is supported when
ONTAP 9.9.1
NFSv4.2 is enabled. With this functionality, ONTAP NFS servers are
MAC-aware, storing and retrieving sec_label attributes sent by clients.
Enabling NFS v4.2 security labels
Improved NFSv4.1
performance with
nconnect support
An nconnect-enabled client can have multiple TCP connections (up to
16) associated with a single NFS mount, thus obtaining higher
throughput from the available network bandwidth.
ONTAP 9.8
ONTAP support for NFSv4.1
Support for NFSv4.2 The NFSv4.2 protocol is supported to allow access for NFSv4.2
clients.
ONTAP 9.8
ONTAP support for NFSv4.2
33
Functionality
Description and where to learn more
Available
beginning
~snapshot
directory hidden
from NFSv3 clients
When you enable the -v3-hide-snapshot option with commands in ONTAP 9.5
the vserver nfs family, the ~snapshot directory is hidden under
NFSv3 mount points.
Commands for managing NFS servers
SMB protocol support
SMB feature
Description and where
to learn more
SMB protocol version
Available beginning
Encryption support
between ONTAP and
domain controllers
Encryption can be
enabled for SMB3
connections from ONTAP
to domain controllers.
SMB3 is enabled by
default.
3.0 and later
ONTAP 9.8
A new encryption off-load 3.0 and later
algorithm can enable
better performance when
using SMB signing or
encrypting SMB traffic.
SMB signing and
encryption offload is
enabled by default when
SMB signing or encryption
is enabled.
ONTAP 9.7
Enabling encrypted
connections to domain
controllers
Encryption and signing
performance
improvements
Performance impact of
SMB encryption
Performance impact of
SMB signing
Hardware support updates
34
Functionality
All SAN Array (ASA)
Description and where to learn more
• Platform names change for existing AFF ASA platforms to rename
to All-Flash SAN Array.
Available
beginning
ONTAP 9.13.1
• Support for new All-Flash SAN Array platforms:
◦ ASA A150
◦ ASA A250
◦ ASA A400
◦ ASA A800
◦ ASA A900
DC power supply
support
-48V DC, 200W power supplies, (PSU part number 114-00226, Cable
part number 117-00240) are supported on select platform models and
drive shelves.
ONTAP 9.13.1
Converting a platform or drive shelf to DC power is not
supported.
Hardware Universe
Sustaining changes
for DS224C,
DS212C and
DS460C shelves
Expanded platform
support for NS224
drive shelves
DS224C, DS212C and DS460C shelves support the new IOM12B
modules and DS460C shelves also support the new DCM2 drive
drawer. DS224C, DS212C and DS460C shelves support two IOM12
modules or two IOM12B modules (you cannot mix IOM12 and IOM12B
modules in the same shelf). DS460C shelves support a mix of DCM
and DCM2 drive drawers. For DS460C shelves, if you replace a failed
IOM or drive drawer that results in having a combination of IOM12
modules and any number of DCM2 drive drawers, you must upgrade
the IOM12 FW to version 0300 or later.
ONTAP 9.11.1
Hot-swap or replace an IOM12/IOM12B module
ONTAP 9.6P9
Replace a drive drawer in a DS460C disk shelf
ONTAP
9.5P13
The following platforms support NS224 drive shelves:
ONTAP 9.8
ONTAP 9.10.1
ONTAP 9.9
ONTAP 9.8
ONTAP 9.7
• AFF A800/AFF ASA A800
• AFF A700/AFF ASA A700
• AFF A250/AFF ASA A250
• FAS500f
35
Functionality
Description and where to learn more
Available
beginning
Hot-adding 12Gb
A single speed transition from 6Gb to 12Gb in a SAS storage stack is ONTAP 9.7P4
SAS shelves to 6Gb supported. This enables storage expansion of existing 6Gb stacks with
ONTAP 9.6P9
SAS storage stacks 12Gb shelves.
Hot-adding shelves with IOM12 modules to a stack of shelves with
IOM6 modules
ONTAP
9.5P14
New adapter support for FAS and AFF systems
Adapter part number
Description
X91148A
2-port 100GbE RoCE
QSFP28
Category
Available beginning
• Storage
ONTAP 9.8
• Networking
• HA/MetroCluster
X91122A
X9170A
2-port 25GbE RoCE
QSFP28
NVMe SSD Module (1
TB)
• Networking
ONTAP 9.8
• HA/MetroCluster
Core dump device
ONTAP 9.8
New platform support for AFF, ASA, and FAS systems
Platforms (with links to data sheets)
Available beginning
FAS2820
ONTAP 9.13.1
ASA A150, ASA A250, ASA A400, ASA A900, and
ASA A900
ONTAP 9.13.1
AFF C250, AFF C400, AFF C800
ONTAP 9.12.1P1
ONTAP 9.13.1 GA and later ONTAP releases
These platforms are not supported with
ONTAP 9.13.1 RC1.
36
Platforms (with links to data sheets)
Available beginning
AFF A150
ONTAP 9.13.1 and later ONTAP releases
Do not attempt to install or boot your
AFF A150 storage system with an
unsupported version of ONTAP. If you
attempt to install or boot your system
with an unsupported version of ONTAP,
ONTAP will allow it (ONTAP will not
block the attempt). The consequence is
that your AFF A150 storage system will
come up as a FAS2750 storage
system.
FAS9500
ONTAP 9.12.1P1
ONTAP 9.11.1P8
ONTAP 9.10.1P12
ONTAP 9.11.1
ONTAP 9.10.1P3
AFF A900
ONTAP 9.10.1
AFF A250/AFF ASA A250
ONTAP 9.8
FAS500f
ONTAP 9.8
AFF ASA A800
ONTAP 9.8
FAS8300
ONTAP 9.7
FAS8700
ONTAP 9.7
AFF A400
ONTAP 9.7
AFF ASA A220
ONTAP 9.7
AFF ASA A700
ONTAP 9.7
AFF C190
ONTAP 9.6
AFF A320
ONTAP 9.6
New shelf support for FAS and AFF systems
Shelves
Available beginning
NS224
ONTAP 9.6
37
New switch support for FAS and AFF systems
Switches
Description
Available
beginning
NVIDIA IP SN2100
switch
The NVIDIA IP SN2100 storage switch is supported in MetroCluster IP ONTAP 9.12.1
configurations that use the A900/FAS9500 platforms.
NVIDIA IP SN2100
switch (X190006)
The NVIDIA IP SN2100 storage switch is supported in MetroCluster IP ONTAP
configurations that use the following platforms:
9.10.1P3
• FAS500f/AFF A250
• FAS8300/AFF A400
• FAS8700
• FAS9000/AFF A700
• AFF A800
36-port 100 GbE
Cisco switch
(X190200)
Supports a shared Infrastructure (Cluster, HA, and switch-attached
storage) on the same pair of Cisco Nexus 9336C-FX2 switches,
including support for MetroCluster IP configurations.
ONTAP 9.9.1
36-port 100 GbE
Cisco switch
(X190200 and
X190210)
Cisco Nexus 9336C-FX2 cluster interconnect switch and storage
switch support for AFF/FAS controllers, as well as for front-end data
connectivity.
ONTAP 9.8
Broadcom BES53248 switch
(X190005 and
X190005R)
Broadcom BES-53248 cluster interconnect switch support for AFF/FAS ONTAP 9.8
controllers with 40/100GbE ports.
36-port 100 GbE
Cisco switch
(X190200) 32-port
100 GbE Cisco
switch (X190100
and X190100R)
Cisco Nexus 100 GbE switch can be used as a dedicated storage
switch to connect NS224 NVMe drive shelves to the following
platforms:
ONTAP 9.8
• AFF A800/AFF ASA A800
• AFF A700/AFF ASA A700
• AFF A400/AFF ASA A400
• AFF A320
Broadcom BES53248 switch
(X190005 and
X190005R)
38
Broadcom BES-53248 cluster interconnect switch support for AFF/FAS ONTAP 9.5P8
controllers with 10/25GbE ports.
MetroCluster configuration enhancements
MetroCluster FC configuration platform support
Supported platforms in MetroCluster FC
configurations
Available beginning
AFF A900
ONTAP 9.10.1
ASA AFF A700 and ASA AFF A400
ONTAP 9.7P5
AFF A400 and FAS8300
ONTAP 9.7
AFF A300 and FAS8200
ONTAP 9.5
MetroCluster FC configuration support for Brocade switches
Brocade FC switches
Available beginning
G720
ONTAP 9.8
G620-1, G630-1
ONTAP 9.8
G630
ONTAP 9.6
MetroCluster IP configuration platform support
MetroCluster IP configurations are not supported with array LUNs.
Supported platforms in MetroCluster IP
configurations
Available beginning
AFF A150
ONTAP 9.13.1 and later ONTAP releases
ONTAP 9.12.1P1
ONTAP 9.11.1P8
ONTAP 9.10.1P12
AFF C250, AFF C400, AFF C800
ONTAP 9.12.1P1
ONTAP 9.13.1 GA and later ONTAP releases.
These platforms are not supported with
ONTAP 9.13.1 RC1.
39
Supported platforms in MetroCluster IP
configurations
Available beginning
AFF A900
ONTAP 9.10.1
MetroCluster IP configurations are limited to 400
kilometers in this release.
AFF A250
ONTAP 9.8
FAS500f
ONTAP 9.8
All SAN Array platforms
ONTAP 9.8
In the MetroCluster documentation, the information for
AFF models applies to the corresponding ASA
system. For example, all cabling and other
information for the AFF A400 system also applies to
the ASA AFF A400 system.
AFF A320 is supported on Broadcom switches
ONTAP 9.7
AFF A320
ONTAP 9.6P3
AFF A220 and FAS2750
ONTAP 9.6
AFF A300 and FAS8200
ONTAP 9.5
MetroCluster IP configuration support for Broadcom and Cisco switches
Broadcom IP switches
Available beginning
Quanta IX8
ONTAP 9.6
Cisco IP switches
Available beginning
Nexus 9336C-FX2
ONTAP 9.9.1
9336C
ONTAP 9.8
MetroCluster configuration support for ONTAP features
40
Supported features Description
in MetroCluster
configuration
Available
beginning
ONTAP Mediator 1.5 ONTAP Mediator 1.5 is available for monitoring MetroCluster IP
is supported in a
configurations.
MetroCluster IP
Install or upgrade the ONTAP Mediator service
configuration
ONTAP 9.12.1
IPsec support for
front-end host
protocol in
MetroCluster IP and
MetroCluster fabricattached
configurations
ONTAP 9.12.1
IPsec support for front-end host protocol (such as NFS and iSCSI) is
available in MetroCluster IP and MetroCluster fabric-attached
configurations.
Configure IP security (IPsec) over wire encryption
ONTAP Mediator 1.4 ONTAP Mediator software version 1.4 is supported in MetroCluster IP
configurations.
ONTAP 9.11.1
Install or upgrade the ONTAP Mediator service
Consistency groups
Consistency groups are supported in MetroCluster configurations.
ONTAP 9.11.1
Install or upgrade the ONTAP Mediator service
ONTAP Mediator is
supported in
MetroCluster IP
configurations
The ONTAP Mediator service can assist the MetroCluster IP
configuration in performing automatic unplanned switchover by
providing a physically separate repository for status information.
ONTAP 9.7
Configuring the ONTAP Mediator service for unplanned automatic
switchover
FabricPool mirrors
on MetroCluster
configurations
You can set up a mirrored FabricPool on MetroCluster configurations
to tier cold data to two different fault zones.
ONTAP 9.7
Setting up object stores for FabricPool in a MetroCluster configuration
SVM disaster
recovery
Active storage virtual machines (SVMs) in a MetroCluster configuration ONTAP 9.5
can be used as sources with the SnapMirror SVM disaster recovery
feature.
New MetroCluster features
41
Supported features Description and where to learn more
in MetroCluster
configuration
Available
beginning
Nondisruptive
transitions from an
eight-node
MetroCluster FC
configuration to a
MetroCluster IP
configuration
You can nondisruptively transition workloads and data from an existing ONTAP 9.13.1
eight-node MetroCluster FC configuration to a new MetroCluster IP
configuration.
Four-node
MetroCluster IP
configuration
upgrades using
switchover and
switchback
You can upgrade controllers in a four-node MetroCluster IP
configuration using switchover and switchback with system
controller replace commands.
Mediator-assisted
automatic
unplanned
switchover
(MAUSO) is
triggered for an
environmental
shutdown
If one site shuts down gracefully due to an environmental shutdown,
MAUSO is triggered.
Eight-node
MetroCluster IP
configurations
support
You can upgrade the controllers and storage in an eight-node
ONTAP 9.13.1
MetroCluster IP configuration by expanding the configuration to
become a temporary twelve-node configuration and then removing the
old DR groups.
Transitioning nondisruptively from a MetroCluster FC to a MetroCluster
IP configuration
ONTAP 9.13.1
Upgrade controllers in a four node MetroCluster IP configuration
ONTAP 9.13.1
Interoperability of ONTAP Mediator with other applications and
appliances
Refreshing a four-node MetroCluster IP configuration
MetroCluster IP
configuration
conversion to a
shared storage
MetroCluster switch
configuration
You can convert a MetroCluster IP configuration to a shared storage
MetroCluster switch configuration.
MetroCluster
automatic forced
switchover feature in
a MetroCluster IP
configuration
You can enable the MetroCluster automatic forced switchover feature
in a MetroCluster IP configuration. This feature is an extension of the
Mediator-assisted unplanned switchover (MAUSO) feature.
42
ONTAP 9.13.1
Replacing an IP switch
Automatic switchover limitations
ONTAP 9.12.1
Supported features Description and where to learn more
in MetroCluster
configuration
Available
beginning
S3 on an SVM on an
unmirrored
aggregate in a
MetroCluster IP
configuration
You can enable an ONTAP Simple Storage Service (S3) object storage ONTAP 9.12.1
server on an SVM on an unmirrored aggregate in a MetroCluster IP
configuration.
Transitioning from a
MetroCluster FC
configuration to an
AFF A250 or
FAS500f
MetroCluster IP
configuration
You can transition from a MetroCluster FC configuration to an AFF
A250 or FAS500f MetroCluster IP configuration.
S3 configuration with System Manager and the ONTAP CLI
ONTAP 9.11.1
Move the local cluster connections
Configuration of
You can edit the MetroCluster IP address, netmask, and gateway for
layer 3 MetroCluster nodes in a layer 3 configuration.
IP address in
Modifying address, netmask, and gateway in a MetroCluster IP
MetroCluster IP
configurations
ONTAP 9.10.1
Simplified controller The upgrade procedure for the upgrade process using switchover and
upgrade of nodes in switchback has been simplified.
a MetroCluster FC
Upgrading controllers in a MetroCluster FC configuration using
configuration
switchover and switchback
ONTAP 9.10.1
IP support for
MetroCluster IP configurations can be implemented with IP-routed
shared link at layer 3 (layer 3) back-end connections.
ONTAP 9.9.1
Considerations for layer 3 wide-area networks
Support for 8-node
clusters
Permanent 8-node clusters are supported in IP and Fabric-attached
configurations.
ONTAP 9.9.1
Installing and cabling MetroCluster components
Simplified interface
to manage IP
MetroCluster
operations with
System Manager
You can manage IP MetroCluster operations with System Manager,
including setting up IP MetroCluster sites, pairing the sites, and
configuring the clusters.
IP MetroCluster
switchover and
switchback with
System Manager
You can use System Manager to perform all the steps of planned or
unplanned switchover and switchback procedures for IP MetroCluster
configurations.
ONTAP 9.8
Manage MetroCluster sites
ONTAP 9.8
MetroCluster switchover and switchback
43
Supported features Description and where to learn more
in MetroCluster
configuration
Available
beginning
Transition from
MetroCluster FC to
MetroCluster IP
configurations
ONTAP 9.8
Transition of workloads and data from an existing four-node
MetroCluster FC configuration to a new MetroCluster IP configuration
is supported.
MetroCluster Upgrade and Expansion Guide
MetroCluster Transition Guide
New upgrade and
refresh procedures
Hardware upgrade or refresh of four-node MetroCluster FC and IP
configurations is supported.
ONTAP 9.8
MetroCluster Upgrade and Expansion Guide
MetroCluster Transition Guide
Unmirrored
aggregates
Unmirrored aggregates are supported in MetroCluster IP
configurations.
ONTAP 9.8
Considerations when using unmirrored aggregates
MetroCluster
compliant switches
MetroCluster IP configurations can support switches which are not
NetApp validated provided that they are compliant with NetApp
specifications.
ONTAP 9.7
Considerations for using MetroCluster compliant switches
Private layer 2
network sharing
MetroCluster IP configurations with supported Cisco switches can
share existing networks for ISLs, rather than using dedicated
MetroCluster ISLs. Earlier ONTAP versions require dedicated ISLs.
ONTAP 9.6
The MetroCluster IP switches are dedicated to the MetroCluster
configuration and cannot be shared. Only the MetroCluster ISL ports
on the MetroCluster IP switches can connect to the shared switches.
If using a shared network, the customer is responsible
for meeting the MetroCluster network requirements in
the shared network.
MetroCluster IP installation and configuration
MetroCluster
switchover and
switchback
You can allow one cluster site to take over the tasks of another cluster
site. This capability allows you to facilitate maintenance or recovery
from disasters.
MetroCluster switchover and switchback
44
ONTAP 9.6
Supported features Description and where to learn more
in MetroCluster
configuration
Available
beginning
Cluster update with
ONTAP System
Manager
ONTAP 9.5
You can update a cluster in MetroCluster configurations. For clusters
in MetroCluster configurations, you must perform each operation on
both the clusters except for updating the cluster.
Cluster management using System Manager
Networking and security protocol enhancements
Functionality
Description and where to learn more
Available
beginning
Increased data LIF
limits
ONTAP provides greater flexibility by increasing data LIF scaling limits ONTAP 9.13.1
for both HA pairs and clusters.
Hardware Universe
Support for using
X.509 certificates
with SSH public
keys
ONTAP enables you to associate an X.509 certificate with the SSH
public key for an account, giving you the added security of certificate
expiration and revocation checks upon SSH login.
ONTAP 9.13.1
Associate a public key with an administrator account
IPv6 support during
cluster set up
On the A800 and FAS8700 platforms, you can use the ONTAP CLI to
create and configure new clusters in IPv6-only networking
environments.
ONTAP 9.13.1
Create the cluster on the first node
Join remaining nodes to the cluster
SSH public key
authentication with
Active Directory
You can use an SSH public key as your primary authentication method ONTAP 9.13.1
with an Active Directory (AD) user, or you can use an SSH public key
as your secondary authentication method after an AD user.
Enable Active Directory account access
Multifactor
authentication with
time-based one-time
password
You can set up local user accounts with multifactor authentication
using a time-based one-time password (TOTP). The TOTP is always
used as the second authentication method. You can use an SSH
public key or user password as your primary authentication method.
ONTAP 9.13.1
Enable MFA with TOTP
45
Functionality
Description and where to learn more
Available
beginning
FPolicy file access
failure notification
FPolicy supports notifications for access denied events. Notifications
will be generated for file operation failed due to lack of permission,
which includes: failure due to NTFS permissions, failure due to Unix
mode bits, and failure due to NFSv4 ACLs.
ONTAP 9.13.1
Create the FPolicy event
Support for
multifactor
authentication with
Cisco DUO when
logging in to System
Manager
You can configure Cisco DUO as a SAML identity provider (IdP),
enabling users to authenticate using Cisco DUO when they log in to
System Manager.
ONTAP 9.12.1
ONTAP
9.11.1P4
Configure SAML authentication
ONTAP
9.10.1P9
ONTAP
9.9.1P13
ONTAP
9.8P17
LIF services
You can use the management-log-forwarding service to control
which LIFs are used to forward audit logs to a remote syslog server.
ONTAP 9.12.1
Manage audit log destinations
LIFs and service policies in ONTAP 9.6 and later
System Manager
networking
enhancements
System Manager offers more control over the subnet and home port
selection during network interface creation. System Manager also
supports the configuration of NFS over RDMA connections.
ONTAP 9.12.1
Network features by release
TLSv1.3 support
ONTAP supports TLS 1.3 for HTTPS and REST API management
protocols. TLS 1.3 is not supported with SP/BMC or with Cluster
Peering Encryption.
ONTAP 9.11.1
Configure network security using federal information processing
standards
Link Layer
Discovery Protocol
(LLDP)
The cluster network supports LLDP to allow ONTAP to work with
cluster switches that do not support Cisco Discovery Protocol (CDP).
Display network connectivity with neighbor discovery protocols
46
ONTAP 9.11.1
Functionality
Description and where to learn more
Available
beginning
LIF services
New client-side LIF services provide more control over which LIFs are
used for outbound AD, DNS, LDAP, and NIS requests.
ONTAP 9.11.1
LIFs and service policies in ONTAP 9.6 and later
RDMA Cluster
Interconnect
Customers with an A400 or ASA400 storage system with a Pensando
cluster NIC can accelerate high performance workloads in a multinode cluster leveraging RDMA for intra-cluster traffic.
ONTAP 9.10.1
RDMA overview
Confirmation is
required before
setting status admin
to down for a LIF in
a system SVM
This protects you from accidentally taking down LIFs that are critical
for proper cluster operation.
ONTAP 9.10.1
If you have scripts that invoke this behavior at the CLI, you must
update them to account for the confirmation step.
Network features by release
Automatic detection
and repair
recommendations
for network wiring
issues
When a port reachability issue is detected, ONTAP System Manager
recommends a repair operation to resolve the issue.
Internet Protocol
security (IPsec)
certificates
IPsec policies support pre-shared keys (PSKs) in addition to
certificates for authentication.
ONTAP 9.10.1
Network features by release
ONTAP 9.10.1
Network features by release
LIF Service policies
Firewall policies are deprecated and replaced with LIF service policies. ONTAP 9.10.1
A new NTP LIF service policy has also been added to provide more
control over which LIFs are used for outbound NTP requests.
Network features by release
Cluster resiliency
• Port monitoring and avoidance for two-node switchless clusters
(previously available only in switched configurations)
ONTAP 9.9.1
• Automatic node failover when a node cannot serve data across its
cluster network
• New tools to display which cluster paths are experiencing packet
loss
Network features by release
47
Functionality
VIP Extension
Description and where to learn more
• Autonomous system number (ASN) for border gateway protocol
(BGP) supports a 4-byte non-negative integer.
Available
beginning
ONTAP 9.9.1
• Multi-exit discriminator (MED) enables advanced route selections
with support for path prioritization. MED is an optional attribute in
the BGP update message.
• VIP BGP provides default route automation using BGP peer
grouping to simplify configuration.
Network features by release
Configure virtual IP (VIP) LIFs
Auto port placement ONTAP can automatically configure broadcast domains, select ports,
and help configure network interfaces (LIFs), VLANs, and link
aggregation groups (LAGs) based on reachability and network
topology detection.
ONTAP 9.8
Network features by release
Switch CLI
simplification
To simplify switch commands, the cluster and storage switch CLIs are ONTAP 9.8
consolidated. The consolidated switch CLIs include ethernet switches,
FC switches, and ATTO protocol bridges.
Network features by release
Virtual IP (VIP)
expansion
New fields have been added to the network bgp peer-group
command. This expansion allows you to configure two additional
Border Gateway Protocol (BGP) attributes for Virtual IP (VIP).
ONTAP 9.8
Network features by release
IPv6 variable length
The supported IPv6 variable prefix length range has increased from 64 ONTAP 9.8
to 1 through 127 bits. A value of bit 128 remains reserved for virtual IP
(VIP).
Network features by release
Internet Protocol
IPsec offers data encryption for all IP traffic including the NFS, iSCSI,
security (IPsec) over and SMB/CIFS protocols. IPsec provides an encryption in flight option
wire encryption
for iSCSI traffic combat replay and man-in-the-middle (MITM) attacks.
Network features by release
48
ONTAP 9.8
Functionality
Description and where to learn more
Available
beginning
Caching for NIS
netgroup-by-host
searches
NIS netgroup.byhost entries can be cached using the vserver
services name-service nis-domain netgroup-database
commands.
ONTAP 9.7
Network features by release
Automatic portmap
service
The portmap firewall service is eliminated. Instead, the portmap port is ONTAP 9.7
opened automatically for all LIFs that support the NFS service.
Network features by release
Support for
multifactor
authentication with
Cisco DUO when
logging in to System
Manager
You can configure Cisco DUO as a SAML identity provider (IdP),
enabling users to authenticate using Cisco DUO when they log in to
System Manager.
CUBIC
CUBIC is the default TCP congestion control algorithm for ONTAP
hardware. CUBIC replaced the ONTAP 9.5 and earlier default TCP
congestion control algorithm, NewReno.
ONTAP
9.7P21
Set up SAML authentication with System Manager
ONTAP 9.6
Network features by release
LIF service policies
replace LIF roles
You can assign service policies (instead of LIF roles) to LIFs that
determine the kind of traffic that is supported for the LIFs. Service
policies define a collection of network services supported by a LIF.
ONTAP provides a set of built-in service policies that can be
associated with a LIF.
ONTAP 9.6
Network features by release
NTPv3 support
Network Time Protocol (NTP) version 3 includes symmetric
authentication using SHA-1 keys which increases network security.
ONTAP 9.5
Commands for managing symmetric authentication on NTP servers
SSH login security
alerts
When you log in as an SSH admin user, you can view information
ONTAP 9.5
about previous logins, unsuccessful attempts to log in, and changes to
your role and privileges since your last successful login.
SSH login security
LIF service policies
You can create new service policies or use a built-in policy. You can
ONTAP 9.5
assign a service policy to one or more LIFs; thereby allowing the LIF to
carry traffic for a single service or a list of service.
Configuring LIF service policies
49
Functionality
Description and where to learn more
Available
beginning
Virtual IP (VIP) LIFs A VIP data LIF is a LIF that is not part of any subnet and is reachable ONTAP 9.5
and border gateway from all ports that host a BGP LIF in the same IPspace. A VIP data LIF
protocol (BGP)
eliminates the dependency of a host on individual network interfaces.
support
Configure virtual IP (VIP) LIFs
Multipath routing
Multipath routing provides load balancing by utilizing all the available
routes to a destination.
ONTAP 9.5
Enable multipath routing
S3 object storage enhancements
Functionality
Description and where to learn more
Available
beginning
S3 bucket lifecycle
management
S3 object expiration actions define when objects in a bucket expire.
This capability enables you to manage object versions so you can
meet retention requirements and manage overall S3 object storage
effectively.
ONTAP 9.13.1
Create a bucket lifecycle management rule
Additional support
for S3 actions
The following Amazon S3 API actions are supported:
ONTAP 9.12.1
• CopyObject
• UploadPartCopy
• BucketPolicy (GET, PUT, DEL)
ONTAP S3 supported actions
Additional support
The following actions are supported by ONTAP APIs:
for S3 object actions
• CreateBucket
• DeleteBucket
• DeleteObjects
In addition, ONTAP S3 supports object versioning and associated
actions with these ONTAP APIs:
• PutBucketVersioning
• GetBucketVersioning
• ListBucketVersions
ONTAP S3 supported actions
50
ONTAP 9.11.1
Functionality
Description and where to learn more
Available
beginning
S3 object data
protection, backup
and disaster
recovery
S3 SnapMirror provides data protection services for ONTAP S3 object
storage, including buckets mirroring to ONTAP S3 configurations, and
bucket backup to NetApp and non-NetApp destinations.
ONTAP 9.10.1
S3 SnapMirror overview
S3 audit
You can audit data and management events in ONTAP S3
environments. S3 audit functionality is similar to existing NAS auditing
capabilities, and S3 and NAS auditing can coexist in a cluster.
ONTAP 9.10.1
S3 audit overview
S3 metadata and
tags support
The ONTAP S3 server provides enhanced automation capabilities to
S3 clients and applications with support for user-defined object
metadata and object tagging.
ONTAP 9.9.1
Enabling client access from an S3 app
S3 object storage
Native ONTAP S3 support provides the ability to create and delete S3
buckets as well as create, list, and delete objects using the S3 REST
API.
ONTAP 9.8
The S3 public preview is no longer supported.
S3 Configuration Power Guide
ONTAP S3 overview
SAN enhancements
Functionality
Description and where to learn more
Available
beginning
NVMe/FC support
for AIX hosts
ONTAP supports the NVMe/FC protocol on AIX hosts. See the NetApp ONTAP 9.13.1
Interoperability Tool for supported configurations.
Provision NVMe storage
NetApp Interoperability Matrix Tool
Increased maximum The maximum supported LUN size on AFF and FAS platforms is
LUN size for AFF
increased from 16 TB to 128 TB.
and FAS platforms
Increase the size of a LUN
ONTAP
9.12.1P2
51
Functionality
Description and where to learn more
Available
beginning
NVMe limits
increase
The NVMe protocol supports the following:
ONTAP 9.12.1
• 8K subsystems in a single storage VM and a single cluster
• 12 node clusters
NVMe/FC supports 256 controllers per port and NVMe/TCP supports
2K controllers per node.
NetApp Hardware Universe
NVME/TCP support
for secure
authentication
Secure, unidirectional and bidirectional authentication between an
ONTAP 9.12.1
NVMe host and controller is supported over NVMe/TCP using the DHHMAC-CHAP authentication protocol.
Establish secure authentication over NVMe/TCP
MCC-IP support for
NVMe
The NVMe/FC protocol is supported on 4-node MetroCluster IP
configurations.
ONTAP 9.12.1
ASA configuration limits and support
iSCSI LIF failover
The new iSCSI LIF failover feature supports automatic and manual
migration of iSCSI LIFs in an SFO partner failover and in a local
failover.
ONTAP 9.11.1
iSCSI LIF failover is available on All SAN Array (ASA) platforms.
iSCSI LIF failover for ASA platforms
Non-destructive
migration from LUN
to NVMe
namespace and
from NVMe
namespace to LUN
Use the ONTAP CLI to in-place convert an existing LUN to an NVMe
namespace or an existing NVMe namespace to a LUN.
NVMe namespace
You can use the ONTAP CLI to increase or decrease the size of a
namespace. You and use System Manager to increase the size of a
namespace.
ONTAP 9.11.1
Convert a LUN into a namespace
Convert a namespace into a LUN
ONTAP 9.10.1
Resizing a namespace
NVMe protocol
support for TCP
The non-volatile memory express (NVMe) protocol is available for SAN ONTAP 9.10.1
environments over an TCP network.
NVMe overview
Provision NVMe for SUSE Linux
52
Functionality
Description and where to learn more
Available
beginning
Foreign LUN Import
The SAN LUN Migrate App on the NetApp Support Site can be used to ONTAP 9.9.1
qualify a foreign array that is not listed in the FLI IMT.
Checking supported configurations for FLI using the SAN LUN Migrate
App
NVMe-oF remote
path access
If direct path access is loss in failover, remote I/O allows the system to ONTAP 9.9.1
failover to a remote path and continue data access.
Host support for multipathing
Support for 12-node 12-node clusters are supported for AFF ASA configurations. ASA
clusters on ASAs
clusters can include a mix of various ASA system types.
ONTAP 9.9.1
ASA limitations and restrictions
NVMe-oF protocol
on ASAs
The NVMe-oF protocol support is also available with an AFF ASA
system.
ONTAP 9.9.1
ASA limitations and restrictions
8-node MCC-IP on
ASAs support
Igroup
enhancements
AFF ASA platforms support 8-node MCC IP configurations.
• You can create an igroup that consists of existing igroups.
ONTAP 9.9.1
ONTAP 9.9.1
• You can add a description to an igroup or host initiators that serves
as an alias for the igroup or host initiator.
• You can map igroups to two or more LUNs simultaneously.
Provision SAN storage for VMware datastores
Provision SAN storage for Linux servers
Provision SAN storage for Windows servers
Create nested igroup
Map igroups to multiple LUNs
Single LUN
performance
improvement
Single LUN performance for AFF has been significantly improved,
ONTAP 9.9.1
making it ideal for simplifying deployments in virtual environments. For
example, A800 can provide up to 400% more Random Read IOPs.
Advantages of using a virtualized SAN environment
53
Functionality
Description and where to learn more
Available
beginning
SnapMirror
Business Continuity
(SMBC)
SM-BC supports Zero Recovery Point Objective (Zero RPO) and Zero
Recovery Time Objective (Zero RTO) enabling continuous availability
for business-critical SAN applications. SM-BC is supported in
configurations of either two AFF clusters or two All SAN Array (ASA)
clusters.
ONTAP 9.8
SnapMirror Business Continuity
Persistent Ports
FCP persistent ports are enabled by default on all All SAN Arrays
ONTAP 9.8
(ASAs). This ensures that the number of active FCP LIFs serving data
to the hosts remains the same even during storage failover operations.
All SAN Array Documentation
NMVe protocol coexistence
You can configure SCSI, NAS and NVMe protocols on the same
storage virtual machine (SVM).
ONTAP 9.8
Configuring an SVM for NVMe
Increased size
limitations for ASA
configurations
• The supported maximum LUN size is increased to 128 TB
ONTAP 9.8
• The supported maximum NVMe namespace size is increased to
128 TB
• The supported maximum volume size is increased to 300 TB
These limitation increases do not apply to non-ASA configurations.
NetApp Hardware Universe
Symmetric ActiveActive
Symmetric active-active is a multipathing solution in which all paths
ONTAP 9.7
are active/optimized. In the event of a storage failover, the host does
not need to wait for the ALUA transition of the failover paths to resume
I/O. This reduces the time to failover. Symmetric active-active is only
available on All SAN Arrays.
All SAN Array System Documentation
Support for large I/O FC-NVMe supports I/O up to 1 MB.
ONTAP 9.7
NVMe namespaces considerations
Limited volume
mobility support for
the NVMe protocol
You can move volumes containing NVMe name spaces from one node ONTAP 9.6
to another node in the cluster. Volumes containing NVMe namespaces
cannot be moved within the same node. An NVMe LIF must exist on
the destination node prior to the volume move.
Requirements for moving volumes in SAN environments
54
Functionality
Description and where to learn more
Available
beginning
Removal of LUN
resizing to 10 times
original size
limitation
You can resize LUNs up to 16 TB, which is the maximum allowed.
ONTAP 9.5
Increasing the size of a LUN
Security enhancements
In October 2022, NetApp will implement changes to reject AutoSupport message
transmissions that are not sent by either HTTPS with TLSv1.2 or secure SMTP.
For more information, see SU484: NetApp will reject AutoSupport messages transmitted with insufficient
transport security
Functionality
Description and where to learn more
Available
beginning
Multi-admin verify
functionality
Multi-admin verify (MAV) functionality can be enabled for Autonomous ONTAP 9.13.1
Ransomware Protection (ARP). This updated functionality permits only
authenticated user admins to turn off APR and prevents unintentional
or malicious pauses of ARP.
MAV for ARP-protected volumes
Autonomous
Ransomware
Protection automatic
transition from
learning to active
mode
In previous releases after Autonomous Ransomware Protection (ARP) ONTAP 9.13.1
completed its learning mode (dry-run) 30-day monitoring of a volume,
a user was required to move the ARP on that volume to active mode.
Intelligence has been added that helps determine the optimal ARP
learning period duration and automatically changes the ARP mode,
based ARP analytics, on a volume from learning to active mode.
Enable automatic transitions from learning to active mode
Autonomous
Ransomware
Protection support
for FlexGroup
volumes
This includes analytics and reporting for FlexGroup volumes and the
support of FlexGroup operations like expanding a FlexGroup volume,
FlexVol to FlexGroup conversions, FlexGroup rebalances, and multipart inode. The Autonomous Ransomware Protection (ARP) autoswitch to active mode feature is also available for FlexGroup volumes
in this release.
ONTAP 9.13.1
ARP support for FlexGroup volumes
55
Functionality
Description and where to learn more
Available
beginning
Autonomous
Ransomware
Protection
interoperability
enhancements
Autonomous Ransomware Protection (ARP) is available for these
configurations:
ONTAP 9.12.1
• Volumes protected with SnapMirror
• SVMs protected with SnapMirror
• SVMs enabled for migration (SVM data mobility)
Autonomous Ransomware Protection use cases and considerations
About SnapMirror SVM replication
SVM data mobility overview
MFA support for
SSH with FIDO2
and PIV (both used
by Yubikey)
SSH multifactor authentication (MFA) can use hardware-assisted
public/private key exchange with username and password. Yubikey is
a physical token device that is plugged into the SSH client to increase
MFA security.
ONTAP 9.12.1
Enable SSH multifactor authentication (MFA)
Tamper-proof
logging
All ONTAP internal logs (audit, command history, etc.) are tamperproof ONTAP 9.12.1
by default, ensuring that compromised administrator accounts cannot
hide malicious actions.
How ONTAP implements audit logging
TLS transport for
events
EMS events can be sent to a remote syslog server using the TLS
protocol, thereby enhancing protection over the wire for central
external audit logging.
ONTAP 9.12.1
Configuring important EMS events to forward notifications to a syslog
server
Multi-admin
verification
When multi-admin verification is enabled, certain operations — such as ONTAP 9.11.1
deleting volumes or Snapshot copies — can be executed only after
approvals from designated administrators. This prevents
compromised, malicious, or inexperienced administrators from making
undesirable changes or deleting data.
Multi-admin verification overview
Autonomous
Ransomware
Protection
enhancements
The Autonomous Ransomware Protection detection algorithm has
been enhanced to detect additional malware threats. Also, a new
license key is used to activate Autonomous Ransomware Protection.
For ONTAP systems upgrades from ONTAP 9.10.1 the previous
license key still provides the same functionality.
ONTAP ransomware protection strategy
56
ONTAP 9.11.1
Functionality
Description and where to learn more
Available
beginning
Encryption key
management
Use Azure Key Vault and Google Cloud Platform Key Management
Service to store, protect, and utilize ONTAP keys, streamlining key
management and access.
ONTAP 9.10.1
Manage keys with Azure Key Vault or Google Cloud KMS
Autonomous
Ransomware
Protection
Using workload analysis in NAS environments, Autonomous
Ransomware Protection alerts you about abnormal activity that might
indicate a ransomware attack. Autonomous Ransomware Protection
also creates automatic Snapshot backups when an attack is detected,
in addition to existing protection from scheduled Snapshot copies.
ONTAP 9.10.1
Autonomous Ransomware Protection overview
Disable USB port
access
Enables you to turn off the USB ports on a storage controller to
increase security.
ONTAP 9.8
system node usb-ports modify
system node usb-ports show
Storage efficiency enhancements
Functionality
Description and where to learn more
Available
beginning
Change in reporting
of primary data
reduction ratio in
System Manager
The primary data reduction ratio displayed in System Manager no
ONTAP 9.13.1
longer includes Snapshot copy space savings in the calculation. It only
depicts the ratio between used logical and used physical space. In
prior releases of ONTAP, the primary data reduction ratio included
significant space reduction benefits of Snapshot copies. As a result,
when you upgrade to ONTAP 9.13.1, you will observe a significantly
lower primary ratio being reported. You can still see data reduction
ratios with Snapshot copies in the Capacity details view.
Temperaturesensitive storage
efficiency
Temperature-sensitive storage efficiency adds sequential packing of
ONTAP 9.13.1
contiguous physical blocks to improve storage efficiency. Volumes that
have temperature-sensitive storage efficiency enabled will
automatically have sequential packing enabled when systems are
upgraded to ONTAP 9.13.1.
Temperature-sensitive storage efficiency overview
Logical space
enforcement
Logical space enforcement is supported on SnapMirror destinations.
ONTAP 9.13.1
57
Functionality
Description and where to learn more
Available
beginning
Storage VM (SVM)
capacity limits
You can set capacity limits on a storage VM (SVM) and enable alerts
when the SVM is approaching a percentage threshold.
ONTAP 9.13.1
Manage SVM capacity
Manage the maximum capacity limit in System Manager
Temperaturesensitive storage
efficiency
Temperature-sensitive storage efficiency is enabled by default on new
AFF C250, AFF C400, AFF C800 platforms and volumes. TSSE is not
enabled by default on existing volumes but can be enabled manually
using the ONTAP CLI.
ONTAP
9.12.1P1
Change volume efficiency mode
Increase in usable
aggregate space
For All Flash FAS (AFF) and the FAS500f platforms, the WAFL reserve ONTAP 9.12.1
for aggregates greater than 30TB is reduced from 10% to 5%,
resulting in increased usable space in the aggregate.
Determine space usage in volume or aggregate
Determine space usage in a local tier (aggregate)
File System
Analytics: Top
directories by size
Identify the directories in a volume that are consuming the most space. ONTAP 9.12.1
View physical
footprint savings
When you have temperature sensitive storage efficiency enabled on a
volume, you can use the volume show-footprint command to
display the physical footprint savings.
File System Analytics overview
ONTAP 9.11.1
View temperature sensitive storage efficiency physical footprint
savings
Temperaturesensitive storage
efficiency
You can enable temperature-sensitive storage efficiency using either
"default" mode or "efficient" mode on new or existing AFF volumes.
ONTAP 9.10.1
Enable temperature sensitive storage efficiency
Temperature
sensitive storage
efficiency
Applies storage efficiency depending on whether the data is hot or
cold. On FabricPool-enabled aggregates, this feature is disabled by
default to avoid causing lower storage efficiency on the capacity tier.
Enabling data compression on a volume
Storage resource management enhancements
58
ONTAP 9.8
Functionality
Description and where to learn more
Available
beginning
Increase in
ONTAP will continue to automatically add inodes (at the rate of 1 inode ONTAP 9.13.1
maximum number of per 32 KB of volume space) even if the volume grows larger than 680
inodes
GB. ONTAP will continue adding inodes until it reaches the maximum
of 2,147,483,632.
Support for
specifying a
SnapLock type
during FlexClone
creation
You can specify one of three SnapLock types, either compliance,
enterprise, or non-SnapLock, when creating a FlexClone of a
read/write volume.
ONTAP 9.13.1
Create a FlexClone volume
Option to enable File You can set File System Analytics to be enabled by default on new
System Analytics by volumes.
default
File System Analytics overview
ONTAP 9.13.1
File System
Analytics: Activity
Tracking at SVM
level
ONTAP 9.11.1
Activity Tracking is aggregated at the SVM level, tracking read/write
IOPS and throughputs to provide instant and actionable insights into
data.
Enable Activity Tracking
Activity tracking for
hot objects with File
System Analytics
(FSA)
To improve system performance assessment, FSA can identify hot
objects: files, directories, users, and clients with the most traffic and
throughput.
ONTAP 9.10.1
View NAS file system analytics
File System
Analytics (FSA)
management
enhancements in
System Manager
FSA provides additional System Manager capabilities for search and
filtering, and for taking action on FSA recommendations.
Set number of files
to maximum for
volume
The new volume option, files-set-maximum, sets the maximum
number of files to the limit allowed on a volume. Doing so eliminates
the need to monitor and react when the volume file limit is reached.
ONTAP 9.9.1
File system analytics overview
ONTAP 9.9.1
ONTAP File System File System Analytics is a framework for collecting and displaying data ONTAP 9.8
Analytics for
about volume contents, providing visibility into capacity access and
FlexGroup and
usage for files and directories over time.
FlexVol volumes
File system analytics overview
Monitoring volume usage with ONTAP File System Analytics
59
Functionality
Description and where to learn more
Logical space
You can display the amount of logical space used and remaining in a
reporting for
SnapMirror destination volume.
SnapMirror
destination volumes Logical space reporting and enforcement for volumes
FlexVol volumes
limit
Available
beginning
ONTAP 9.8
The maximum supported number of FlexVol volumes on AFF and FAS ONTAP 9.7
platforms with at least 128 GB of memory has increased to 2,500
FlexVol volumes per node, or 1,000 active (primary workload) volumes
per node.
For the latest platform-specific FlexVol volume limits, see Hardware
Universe.
NetApp Hardware Universe
Storage limits
Logical space
enforcement for
FlexVol volumes
You can limit the amount of logical space consumed in a FlexVol
volume.
ONTAP 9.5
Logical space reporting and enforcement for volumes
FlexCache volumes support
Functionality
Description and where to learn more
Available
beginning
Enable file access
time updates
When enabled, the access time updates at the FlexCache origin
volume only if the age of the current access time is more than userspecified duration.
ONTAP 9.11.1
Enable file access time updates
Global file read
locking
Enable a read lock from a single point across all caches and the origin; ONTAP 9.10.1
affected article in migration.
Global file locking
NFSv4 support
FlexCache volumes support NFSv4 protocol; affected article in
migration.
ONTAP 9.10.1
Supported and unsupported features for FlexCache volumes
Support for negative Caches a "file not found" error on the FlexCache volume to reduce
lookup cache
network traffic caused by calls to the origin.
Using FlexCache volumes to accelerate data access
60
ONTAP 9.9.1
Functionality
Description and where to learn more
Available
beginning
FlexCache disaster
recovery
Provides non-disruptive migration of clients from one cache to another. ONTAP 9.9.1
Supported and unsupported features for FlexCache volumes
FlexCache volumes
support SMB
protocol
The SMB protocol is supported on FlexCache volumes.
ONTAP 9.8
SnapMirror
secondary volume
as FlexCache
volume
A SnapMirror secondary volume can be a FlexCache origin volume.
FlexCache volume
prepopulation
FlexCache prepopulation enables you to access cached data faster by ONTAP 9.8
prepopulating a cache volume.
Supported and unsupported features for FlexCache volumes
ONTAP 9.8
Supported and unsupported features for FlexCache volumes
Prepopulating a FlexCache volume
FlexCache volumes
enhancements
• Antivirus at the origin volume
ONTAP 9.7
• Auditing at the origin volume
• FPolicy at the origin volume
• MetroCluster configuration
• Thin provisioning at the FlexCache volume
• FabricPool at the FlexCache volume
• Compaction at the FlexCache volume
• Cross-volume deduplication
• FlexGroup as a FlexCache origin
Supported and unsupported features for FlexCache volumes
FlexCache volumes
enhancements
• Cloud Volumes ONTAP
ONTAP 9.6
• Data compaction at the origin volume
• Data compression
• Inline deduplication
• Qtrees at origin volume
• Volume cloning at the origin volume
• Volume granular encryption (VGE)
• Volume move of FlexCache volume constituents
Supported and unsupported features for FlexCache volumes
61
Functionality
Description and where to learn more
Available
beginning
Support for
FlexCache volumes
A FlexCache volume is a sparsely populated volume that is backed by ONTAP 9.5
an origin volume and is used to speed up access to data, improve
performance, or to offload traffic from heavily accessed volumes.
Supported and unsupported features for FlexCache volumes
FlexGroup volumes support
Functionality
Description and where to learn more
Available
beginning
SVM DR fanout
relationships with
FlexGroup volumes
The fanout restriction of SVM DR with FlexGroup volumes is removed. ONTAP 9.13.1
SVM DR with FlexGroup includes support for SnapMirror fanout
relationships to eight sites.
Create an SVM disaster recovery relationship for FlexGroup volumes
Single FlexGroup
rebalancing
operation
You can schedule a single FlexGroup rebalancing operation to begin
at a date and time in the future that you specify.
ONTAP 9.13.1
Rebalance FlexGroup Volumes
FlexGroup
rebalancing
You can enable automatic nondisruptive FlexGroup volume
rebalancing to redistribute files between FlexGroup constituents.
ONTAP 9.12.1
It is recommended that you do not use automatic
FlexGroup rebalancing after a FlexVol to FlexGroup
conversion. Instead, you can use the disruptive
retroactive file move feature available in ONTAP 9.10.1
and later, by entering the volume rebalance file-move
command. For more information and command syntax,
see the Command Reference.
Flexgroup rebalancing considerations
Manage FlexGroup volume rebalancing
SnapLock for
SnapVault support
for FlexGroup
volumes
62
SnapLock for SnapVault is supported on FlexGroup volumes.
ONTAP 9.12.1
Functionality
Description and where to learn more
Available
beginning
Asynchronous
directory delete
Asynchronous delete is available to NFS and SMB clients when the
storage administrator grants them rights on the volume. When async
delete is enabled, Linux clients can use the mv command and
Windows clients can use the rename command to delete a directory
and move it to a hidden .ontaptrashbin directory.
ONTAP 9.11.1
Manage client rights to delete directories rapidly
SnapLock support
for FlexGroup
volumes
SnapLock includes support for data stored on FlexGroup volumes.
FlexGroup volumes support is available with SnapLock Compliance
and SnapLock Enterprise modes.
ONTAP 9.11.1
Supported and unsupported configurations for FlexGroup volumes
Create clones from
existing FlexGroup
volumes
You can create a FlexClone volume using existing FlexGroup volumes. ONTAP 9.10.1
Supported and unsupported configurations for FlexGroup volumes
Convert a FlexVol to You can convert FlexVol volumes to FlexGroup volumes in an SVMa FlexGroup in an
DR source.
SVM-DR source
Supported and unsupported configurations for FlexGroup volumes
ONTAP 9.10.1
SnapMirror cascade Provides support for SnapMirror cascade and SnapMirror fanout
and fanout support relationships for FlexGroup volumes.
for FlexGroup
Supported and unsupported configurations for FlexGroup volumes
volumes
ONTAP 9.9.1
SVM DR support for SVM disaster recovery support for FlexGroup volumes provides
FlexGroup volumes redundancy by using SnapMirror to replicate and synchronize an
SVM’s configuration and data.
ONTAP 9.9.1
Supported and unsupported configurations for FlexGroup volumes
Logical space
You can display and limit the amount of logical space consumed by
reporting and
FlexGroup volume users.
enforcement support
Logical space reporting and enforcement for volumes
for FlexGroup
volumes
ONTAP 9.9.1
SnapMirror single
file restore of
FlexGroup volumes
ONTAP 9.8
SnapMirror single file restore of FlexGroup volumes is supported.
Performing a SnapMirror single file restore from a FlexGroup volume
63
Functionality
Description and where to learn more
Available
beginning
Support for
converting volumes
transitioned from 7Mode systems to
FlexGroup volumes
Supported and unsupported configurations for FlexGroup volumes
ONTAP 9.8
Fast Directory
Delete
The speed and efficiency of directory delete has been improved,
enabling large directories to be deleted with lower latencies. This
improved method of directory delete can be implemented through a
new REST API or using the ONTAP CLI.
ONTAP 9.8
Deleting files and directories asynchronously
Volumes that are
part of application
provisioning are
supported
Supported and unsupported configurations for FlexGroup volumes
ONTAP 9.8
Support for restoring Supports restoring Snapshot copies made on a FlexVol volume before ONTAP 9.8
pre-conversion
it was converted to a FlexGroup volume.
Snapshot copies
Supported and unsupported configurations for FlexGroup volumes
FlexGroup volumes
enhancements
• FlexClone volumes
ONTAP 9.7
• NFSv4 and NFSv4.1
• Tape backup and restore by using NDMP
• VMware vStorage APIs for Array Integration (VAAI)
• Conversion of a FlexVol volume to a FlexGroup volume
• FlexCache as a FlexGroup origin
Supported and unsupported configurations for FlexGroup volumes
FlexGroup volumes
enhancements
• Continuously available SMB shares
• MetroCluster configurations
• Renaming a FlexGroup volume (volume rename command)
• Shrinking or reducing the size of a FlexGroup volume (volume size
command)
• Elastic sizing
Supported and unsupported configurations for FlexGroup volumes
64
ONTAP 9.6
Functionality
FlexGroup volumes
enhancements
Description and where to learn more
• ODX copy offload
Available
beginning
ONTAP 9.5
• Storage-Level Access Guard
• Enhancements to change notifications for SMB shares
• FabricPool
• Quota enforcement
• Qtree statistics
• Adaptive QoS for files in FlexGroup volumes
Supported and unsupported configurations for FlexGroup volumes
FabricPool support
Functionality
Description
Available
beginning
FabricPool read
performance
FabricPool provides improved sequential read performance for single ONTAP 9.13.1
and multi-stream workloads for cloud-resident data and tiering
throughput. This improvement can send a higher rate of GETs and
PUTs to the back end object store. If you have on-premises object
stores, you should consider performance headroom on the object store
service and determine whether you might need to throttle FabricPool
PUTs.
Benefits of storage tiers by using FabricPool
Tiering to ONTAP
S3 object storage
You can use ONTAP S3 servers on local or remote ONTAP clusters as ONTAP 9.8
the FabricPool cloud tier.
Setting up ONTAP S3 as the cloud tier
Cloud overview
Cloud migration
control
Enables you to change a volume’s default tiering policy for controlling
user data retrieval from the cloud tier to performance tier.
ONTAP 9.8
Using cloud migration controls to override a volume’s default tiering
policy
183 day cooling
period
The minimum cooling period increased to a maximum of 183 days.
ONTAP 9.8
Managing storage tiering by modifying a volume’s tiering policy or
tiering minimum cooling period
65
Functionality
Description
Available
beginning
Object tagging
Enables use of user-created custom tags to classify and sort objects
for easier management.
ONTAP 9.8
Object tagging using user-created custom tags
Promotion to the
performance tier
Enables you to proactively promote data from the cloud tier to the
performance tier.
ONTAP 9.8
Promoting data to the performance tier
FabricPool tiering
from HDD
Support for FabricPools on HDD platforms and aggregates.
ONTAP 9.8
Considerations and requirements for using FabricPool
FabricPool mirror
You can use FabricPool mirroring to tier cold data to two object stores
simultaneously.
ONTAP 9.7
Managing FabricPool mirrors
FabricPool mirrors
on MetroCluster
configurations
You can set up a mirrored FabricPool on MetroCluster configuration to ONTAP 9.7
tier cold data to two different fault zones.
Setting up object stores for FabricPool in a MetroCluster configuration
NDMP dump and
restore
NMDP on FabricPool attached aggregates is enabled by default.
ONTAP 9.7
Considerations and requirements for using FabricPool
Non transparent
HTTP and HTTPS
proxy
You can use non transparent HTTP and HTTPS proxy to manage
client access and for reporting capabilities.
ONTAP 9.7
Considerations and requirements for using FabricPool
Alibaba Cloud
Object Storage
You can use Alibaba Cloud Object Storage as the cloud tier.
ONTAP 9.6
Setting up Alibaba Cloud Object Storage as the FabricPool cloud tier
Google Cloud
Platform
You can use Google Cloud Platform as the FabricPool cloud tier.
ONTAP 9.6
Setting up Google Cloud Storage as the cloud tier
New all tiering
policy
You can use the all tiering policy to move all user data blocks in both ONTAP 9.6
the active file system and in Snapshot copies to the cloud tier:
Understanding FabricPool tiering policies
66
Functionality
Description
Available
beginning
Inactive data
Inactive data reporting is enabled automatically for SSD aggregates.
reporting enabled by
Determining how much data in a volume is inactive by using inactive
default
data reporting
ONTAP 9.6
Enabling inactive
data reporting on
HDD aggregates
ONTAP 9.6
You can manually enable inactive data reporting on HDD aggregates
using the storage aggregate modify command with the -is
-inactive-data-reporting-enabled true parameter.
Commands for managing aggregates with FabricPool
Volume move
without cloud tier
data copy
You can move a volume without copying data from a cloud tier to a
performance tier.
ONTAP 9.6
Adding or moving volumes to FabricPool as needed
Specifying the
tiering fullness
threshold
You can use the storage aggregate object-store modify
command with the -tiering-fullness-threshold command to
specify the tiering fullness threshold.
ONTAP 9.5
Commands for managing aggregates with FabricPool
IBM Cloud Object
Storage
You can use IBM Cloud Object Storage as the cloud tier for FabricPool ONTAP 9.5
Setting up IBM Cloud Object Storage as the cloud tier
AWS Commercial
Cloud Services
(C2S)
You can use AWS Commercial Cloud Services as the FabricPool cloud ONTAP 9.5
tier.
Setting up AWS S3 as the cloud tier
Support for
attaching
aggregates that
contain qualified
FlexGroup volume
constituents
You can use the allow-flexgroup true option with the storage
aggregate objectstore attach command to attach aggregates that
contain FlexGroup volume constituents.
ONTAP 9.5
Attaching the cloud tier to an aggregate
NetApp Volume
NVE on the cloud tier is enabled by default.
Encryption (NVE) of
Considerations and requirements for using FabricPool
the cloud tier
ONTAP 9.5
Storage quality of service (QoS) support
67
Functionality
Description and where to learn more
Adaptive QoS policy Adaptive QoS policy templates enable you to set throughput floors at
templates
the SVM level.
Available
beginning
ONTAP 9.13.1
Guarantee throughput with QoS
SMB access support SMB access is supported to qtrees in FlexVol and FlexGroup volumes ONTAP 9.9.1
in qtrees
with SMB enabled.
QoS support for
Qtrees
QoS is supported for Qtrees in FlexVol volumes with NFS access and
FlexGroup volumes with NFS access.
ONTAP 9.8
A maximum of 40,000 qtrees per cluster can be assigned to QoS
policies.
Guaranteeing throughput with QoS
QoS support for S3
Buckets
QoS is supported for S3 Buckets.
ONTAP 9.8
A maximum of 40,000 S3 Buckets per cluster can be assigned to QoS
policies.
ONTAP S3 overview
Provision buckets
QoS support for
SVM administrator
An SVM administrator can assign a workload to an existing QoS
policy.
ONTAP 9.8
Guaranteeing throughput with QoS
Metrics for
throughput floors
You can specify IOPS, MB per second, or a combination of IOPS and ONTAP 9.8
MB per second to set a throughput floor (QoS Min). If throughput floors
and ceilings are set, whichever limit is reached first is enforced.
Setting a throughput floor with QoS
QoS floors
enhancement
Floors can be guaranteed even when there is insufficient performance ONTAP 9.7
capacity available. This new floors behavior is called floors v2. To meet
the guarantees, floors v2 can result in higher latency on workloads
without a floor or work that exceeds the floor setting. Floors v2 applies
to both QoS and Adaptive QoS.
Guaranteeing throughput with QoS
QoS floors support
• QoS floors are supported on the AFF C190 platform.
• QoS floors are supported on the ONTAP Select Premium system.
Guaranteeing throughput with QoS
68
ONTAP 9.6
Functionality
Adaptive QoS
enhancements
Description and where to learn more
• Workload size expressed as used space for throughput floors.
Available
beginning
ONTAP 9.5
• Throughput limits expressed in both IOPS and MB/s.
Using adaptive QoS policy groups
SVM management enhancements
Functionality
Description and where to learn more
Available
beginning
SVM data mobility
Increases support for migrating SVMs containing up to 200 volumes.
ONTAP 9.13.1
SVM data mobility overview
Recreating missing
SVM directories
New debug vserver refresh-vserver-dir -node
<node_name> recreates missing directories and files. For more
information and command syntax, see the Command Reference.
ONTAP 9.13.1
SVM data mobility
enhancements
Cluster administrators can non-disruptively relocate an SVM from a
source cluster to a destination cluster using FAS, AFF platforms and
on hybrid aggregates. Additionally, disruptive SMB protocol support
has been added, as well as Autonomous Ransomware Protection.
ONTAP 9.12.1
SVM data mobility overview
SVM data mobility
Increases the number of AFF arrays supported to three and adds
ONTAP 9.11.1
support for SnapMirror relationships when the source and the
destination are both running ONTAP 9.11.1 or later. External key
management (KMIP) is also introduced and is available for both Cloud
and on-premises installations.
SVM data mobility overview
Ability to nondisruptively move
SVMs between
clusters
You can relocate SVMs between physical AFF clusters, from a source
to a destination, for load balancing, performance improvements,
equipment upgrades, and data center migrations.
ONTAP 9.10.1
SVM migrate
System Manager enhancements
69
Beginning with ONTAP 9.12.1, System Manager is integrated with BlueXP. With BlueXP,
administrators can manage the hybrid multicloud infrastructure from a single control plane while
retaining the familiar System Manager dashboard. When signing into System Manager,
administrators are given the option of accessing the System Manager interface in BlueXP or
accessing System Manager directly. Learn more about System Manager integration with
BlueXP.
Functionality
Description and where to learn more
Available
beginning
Troubleshooting
hardware problems
System Manager users can view visual depictions of additional
hardware platforms in the "Hardware" page, including ASA platforms
and AFF C-Series platforms.
ONTAP 9.13.1
Support for AFF C-series platforms is also been included in the latest
patch releases of ONTAP 9.12.1, ONTAP 9.11.1, and ONTAP 9.10.1.
The visualizations identify problems or concerns with platforms,
providing a quick method for users to troubleshoot hardware problems.
View hardware configurations to determine problems
Latest patch
releases of:
• ONTAP
9.12.1
• ONTAP
9.11.1
• ONTAP
9.10.1
Change in reporting
of primary data
reduction ratio
The primary data reduction ratio displayed in System Manager no
ONTAP 9.13.1
longer includes Snapshot copy space savings in the calculation. It only
depicts the ratio between used logical and used physical space. In
prior releases of ONTAP, the primary data reduction ratio included
significant space reduction benefits of Snapshot copies. As a result,
when you upgrade to ONTAP 9.13.1, you will observe a significantly
lower primary ratio being reported. You can still see data reduction
ratios with Snapshot copies in the Capacity details view.
Tamperproof
Snapshot copy
locking in System
Manager
You can use System Manager to lock a Snapshot copy on a nonSnapLock volume to provide protection from ransomware attacks.
Lock a Snapshot copy for protection against ransomware
External key
You can use System Manager to manage external key managers to
managers in System store and manage authentication and encryption keys.
Manager
Manage external key managers
70
ONTAP 9.13.1
ONTAP 9.13.1
Functionality
Description and where to learn more
SnapMirror
You can use System Manager to add pre-created and custom mirror
asynchronous policy and vault policies, display legacy policies, and override the transfer
in System Manager schedules defined in a protection policy when protecting volumes and
storage VMs. You can also use System Manager to edit your volume
and storage VM protection relationships.
Available
beginning
ONTAP 9.11.1
• Create custom data protection policies
• Configure mirrors and vaults
If you are using ONTAP 9.8P12 or later ONTAP 9.8
patch release and you configured SnapMirror using
System Manager, and you plan to upgrade to ONTAP
9.9.1 or ONTAP 9.10.1 releases, you should use
ONTAP 9.9.1P13 or later and ONTAP 9.10.1P10 or later
patch releases for your upgrade.
Hardware
visualization of
cabling
System Manager users can view connectivity information about the
cabling between hardware devices in their cluster to troubleshoot
connectivity issues.
ONTAP 9.12.1
View hardware configuration to determine problems
System display
themes
System Manager users can select a light or dark theme for the display ONTAP 9.12.1
of the System Manager interface. They can also choose to default to
the theme used for their operating system or browser. This capability
allows users to specify a setting that is more comfortable for reading
the display.
Use System Manager to access a cluster
Improvements to
local tier capacity
details
System Manager users can view capacity details for specific local tiers ONTAP 9.12.1
to determine if the space is over-committed, which might indicate that
they need to add more capacity to ensure the local tier doesn’t run out
of space.
Monitor capacity in System Manager
Improved searching
System Manager has an improved search capability that lets users
ONTAP 9.12.1
search and access relevant and context-sensitive support information
and System Manager product document from the NetApp Support Site
directly through the System Manager interface. This allows users to
acquire information they need to take appropriate action without
having to search in various locations on the support site.
Search, filter, and sort information in System Manager
71
Functionality
Description and where to learn more
Available
beginning
Volume provisioning Storage administrators can choose a Snapshot copy policy when
ONTAP 9.12.1
improvements
creating a volume using System Manager rather than using the default
policy.
Add a volume
Volume resizing
enhancements
Storage administrators can view the impact on data space and
Snapshot copy reserve when they use System Manager to resize a
volume.
ONTAP 9.12.1
Increase the size of a volume
Storage pool and
Flash Pool
management
Storage administrators can use System Manager to add SSDs to an
ONTAP 9.12.1
SSD storage pool, create Flash Pool local tiers (aggregate) using SSD
storage pool allocation units, and create Flash Pool local tiers using
physical SSDs.
• Add cache to a local tier by using SSD storage pool
• Create a Flash Pool local tier using SSD storage pool allocation
units
• Create a Flash Pool local tier aggregate using physical SSDs
SnapLock
management
SnapLock operations, including Compliance Clock initialization,
SnapLock volume creation, and WORM file mirroring are supported in
System Manager.
ONTAP 9.12.1
System Manager
networking
enhancements
System Manager offers more control over networking functions,
including:
ONTAP 9.12.0
• Link Aggregation Groups (LAGs)
• VLANs
• Broadcast domains
• Subnets
• Network interfaces
Network features by release
Hardware
visualization
The hardware visualization feature in System Manager supports all
current AFF and FAS platforms.
View hardware configurations to determine problems
72
ONTAP 9.11.1
Functionality
Description and where to learn more
Available
beginning
System Analytics Insights
On the Insights page, System Manager helps you optimize your
ONTAP 9.11.1
system by displaying additional capacity and security insights and new
insights about the configuration of clusters and storage VMs.
Gain insights to help optimize your system
Usability
enhancements
• Newly created volumes are not shareable by default. Instead,
users can specify the default access permissions, such as
exporting via NFS or sharing via SMB/CIFS and specifying the
permission level.
ONTAP 9.11.1
Add a volume
• SAN simplification for System Manager - When adding or editing
an initiator group, System Manager users can view the connection
status of the initiators in the group and ensure that initiators that
are connected are included in the group so LUN data can be
accessed.
Manage SAN initiators
Advanced local tier
(aggregate)
operations in
System Manager
System Manager administrators can specify the configuration of a local ONTAP 9.11.1
tier if they don’t want to accept the recommendation from System
Manager. Also, administrators can edit the RAID configuration of an
existing local tier.
• Add local tiers
• Edit local tiers
• Add capacity to a local tier
SnapMirror
You can use System Manager to add pre-created and custom mirror
Asynchronous policy and vault policies, display legacy policies, and override the transfer
in System Manager schedules defined in a protection policy when protecting volumes and
storage VMs. You can also use System Manager to edit your volume
and storage VM protection relationships.
• Create custom data protection policies
ONTAP 9.11.1
ONTAP
9.8P12 and
later ONTAP
9.8 patch
releases
• Configure mirrors and vaults
If you are using ONTAP 9.8P12 or later ONTAP 9.8
patch release and you configured SnapMirror using
System Manager, you should contact NetApp Support
before upgrading to ONTAP 9.9.1 or ONTAP 9.10.1
patch releases.
73
Functionality
Description and where to learn more
Available
beginning
Manage audit
You can use System Manager to view and manage ONTAP audit logs. ONTAP 9.11.1
logging with System
How ONTAP implements audit logging
Manager
Gain insights to
improve the capacity
and security
compliance of your
system
Administrators can streamline their day-to-day tasks by viewing
ONTAP 9.11.0
insights about the capacity and security compliance of their systems in
one location in System Manager from which they can take immediate
actions to make improvements.
Gain insights to help optimize your system
Enable performance Administrators can enable telemetry logging if they experience
ONTAP 9.10.1
telemetry logging in performance issues with System Manager, and then contact support to
System Manager
analyze the issue.
logs
View and submit support cases
Simplified licensing All license keys are delivered as NetApp License Files instead of
with NetApp License individual 28-character license keys, making it possible to license
Files (NLFs)
multiple features using one file.
ONTAP 9.10.1
Manage license
Use System
Manager to update
firmware
automatically
System Manager administrators can configure ONTAP to automatically ONTAP 9.10.1
update firmware.
Use System
Manager to review
risk mitigation
recommendations
and acknowledge
the risks reported by
Active IQ
System Manager users can view the risks reported by Active IQ and
review recommendations about mitigating the risks. Beginning with
9.10.1, users can also acknowledge risks.
Use System
Manager to
configure how EMS
event notifications
are sent to
administrator
System Manager administrators can configure how Event
Management System (EMS) event notifications are delivered so they
are notified of system issues that require their attention.
Update firmware
Monitor risks
ONTAP 9.10.1
Configure EMS event notifications
Use System
System Manager administrators can manage trusted certificate
Manager to manage authorities, client/server certificates, and local (onboard) certificate
certificates
authorities.
Manage certificates with System Manager
74
ONTAP 9.10.1
ONTAP 9.10.1
Functionality
Description and where to learn more
Available
beginning
Use System
Manager to view
historical use of
capacity and to
predict future
capacity needs
Integration between Active IQ and System Manager allows
administrators to view data about historical trends in capacity use for
clusters.
ONTAP 9.10.1
Use System
Manager to back up
data to
StorageGRID using
the Cloud Backup
Service
Cloud Backup Service administrators can backup to StorageGRID
Webscale if they have Cloud Manager deployed on premises. They
can also archive objects using Cloud Backup Service with AWS or
Azure.
Usability
enhancements
Capacity measurements in System Manager
ONTAP 9.10.1
Back up data using Cloud Backup Service
• Assign QoS policies to LUNs instead of the parent volume
(VMware, Linux, Windows)
ONTAP 9.10.1
• Edit QoS policy groups for multiple LUNs
• Specify a new volume while performing a lun move
• Take a lun offline
• Perform a rolling ONTAP image upgrade
• Create a port set and bind it to an igroup
• Detect and correct network wiring issues
• Enable client access to a Snapshot copy directory
• Calculate space that can be reclaimed by deleting Snapshot
copies
• Access continuously available field changes in CIFS shares
• View capacity measurements using more accurate display units
• Manage host-specifc users and groups for Windows and Linux
• Manage AutoSupport settings
• Resize volumes as a separate action
System Manager
displays risks
reported by Active
IQ
You can use System Manager to link to NetApp Active IQ, which
reports opportunities to reduce risk and improve the performance and
efficiency of your storage environment.
ONTAP 9.9.1
Monitor risks
75
Functionality
Description and where to learn more
Available
beginning
Manual assignment
of local tier
System Manager users can assign a local tier manually when they are ONTAP 9.9.1
creating and adding volumes and LUNs.
• Provision SAN storage for VMware datastores
• Provision SAN storage for Linux servers
• Provision SAN storage for Windows servers
• Provision NAS storage for home directories
• Provision NAS storage for Linux servers using NFS
• Provision NAS storage for Windows servers using SMB/CIFS
• Provision NAS storage for both Windows and Linux using both
NFS and SMB/CIFS
Fast directory delete Directories can be deleted in System Manager with low-latency fast
with System
directory delete functionality.
Manager
Manage directories and files
ONTAP 9.9.1
Ansible Playbook
feature in System
Manager
ONTAP 9.9.1
System Manager users can generate Ansible Playbooks from the UI
for a few select workflows and can use them in an automation tool to
repeatedly add or edit volumes or LUNs.
Use Ansible Playbooks to add or edit volumes or LUNs
Hardware
Hardware Visualization feature, first introduced in 9.8 to show
ONTAP 9.9.1
Visualization support hardware configuration and help troubleshoot issues, supports all AFF
in System Manager platforms.
Troubleshoot hardware problems
Active IQ Integration System Manager users can view support cases associated with the
in System Manager cluster and download. They can also copy cluster details they need to
submit new support cases on the NetApp Support site. System
Manager users can receive alerts from Active IQ to inform them when
new firmware updates are available. Then, they can download the
firmware image and upload it using System Manager.
ONTAP 9.9.1
View and submit support cases
Update the cluster firmware
Cloud Manager
integration in
System Manager
System Manager users can set up protection to back up data to public ONTAP 9.9.1
cloud endpoints using the Cloud Backup Service.
Back up data using the Cloud Backup Service
Manage the connection to the Cloud Backup Service
76
Functionality
Description and where to learn more
Available
beginning
Enhancements to
System Manager users can manually name a SnapMirror destination
workflow when
and igroup name when setting up data protection.
provisioning data
protection in System Configure mirrors and vaults
Manager
ONTAP 9.9.1
Enhanced network
The network interfaces page has enhanced capabilities to display and
port management in manage which interfaces are on their home ports.
System Manager
Viewing and managing your network
ONTAP 9.9.1
System
management
enhancements in
System Manager
ONTAP 9.9.1
• System Manager support for nested igroups
Create nested igroup
• You can map multiple LUNs to an igroup in a single task and can
use a WWPN alias for filtering during the process.
Map igroups to multiple LUNs
• During the NVMe-oF LIF creation, you no longer need to select
identical ports on both the controllers.
Troubleshoot hardware problems
• You can disable FC ports with a toggle button for each port.
Troubleshoot hardware problems
Enhanced display in
System Manager of
information about
Snapshot copies
• System Manager users can view the size of Snapshot copies and
the SnapMirror label.
ONTAP 9.9.1
• Snapshot copy reserves are set to zero if Snapshot copies are
disabled.
Configure Snapshot copies
77
Functionality
Enhanced display in
System Manager
about capacity and
location information
for storage tiers
Description and where to learn more
• A "Tiers" column has been added to show the local tiers
(aggregates) in which each volume resides.
Available
beginning
ONTAP 9.9.1
Viewing and managing your network
• System Manager shows the physical used capacity along with the
logical used capacity at the cluster level as well as the local tier
(aggregate) level.
Capacity measurements in System Manager
• New capacity display fields allow you to determine whether
volumes are nearing capacity (or are underutilized) and then take
action.
Viewing and managing your network
Display in System
The number of EMS alerts received in 24 hours, as well as other errors ONTAP 9.9.1
Manager of EMS
and warnings, are shown in the Health card in System Manager.
emergency alerts
and other errors and View performance on cluster dashboard
warnings
Cloud Agent in
System Manager
System Manager users can add a connection to the cloud. You first
configure a collector by using NetApp Cloud Insights and obtaining a
generated pairing code. Then, in System Manager, you can add the
cloud connection using the pairing code.
ONTAP 9.9.0
Add a connection to the cloud
Term “quiesce” has
been changed to
“pause” in System
Manager
To simplify terminology in System Manager, starting with ONTAP 9.8,
the term “quiesce” has been changed to “pause”.
ONTAP 9.8
View active NFS
clients with System
Manager
The Hosts display shows which NFS clients have accessed the system ONTAP 9.8
in the last 48 hours, and which volumes and storage VMs the clients
have accessed.
Key concepts
Monitor NFS active clients
QoS enabled by
default with System
Manager
When you provision storage in System Manager, QoS is enabled by
default. You can disable QoS or choose a custom QoS policy during
the provisioning process or at a later time.
Modifying QoS
78
ONTAP 9.8
Functionality
Description and where to learn more
View and manage
You can display a graphic that shows the components and
network with System configuration of your entire network.
Manager
Viewing and managing your network
Available
beginning
ONTAP 9.8
Troubleshoot
hardware problems
with System
Manager
You can use System Manager to view the configuration of hardware on ONTAP 9.8
your network and troubleshoot problems that might arise.
Cluster Switch
Health Monitoring
configuration files
Administrators no longer need to install the Cluster Switch Health
Monitoring (CSHM) configuration files for CSHM support of Cisco
Nexus 92300YC and Broadcom BES-53248 cluster switches.
ONTAP 9.7
Verifying the monitoring of cluster and management network switches
ONTAP 9.5P8
You can enable AutoSupport and modify its configuration on all nodes
of the cluster simultaneously. In previous releases, each node in a
cluster has its own AutoSupport configuration.
ONTAP 9.5
AutoSupport
configuration on all
nodes by default
Troubleshoot hardware problems
ONTAP 9.6P3
Setting up AutoSupport
Related information
Administration overview with System Manager
ONTAP System Manager is the next generation in ONTAP simplicity
ONTAP 9.6 includes a read-only preview of the next generation of simplicity in managing
your storage system.
Beginning with ONTAP 9.7, a totally redesigned ONTAP System Manager (formerly OnCommand System
Manager) simplifies ONTAP management with an intuitive graphical user interface. The new dashboard shows
key cluster status and performance on one screen.
Related information
Administration overview with System Manager
Transition enhancements
See the 7-Mode Transition Documentation.
Upgrade enhancements
79
Hardware upgrade enhancements
The hardware upgrade procedures have been simplified in ONTAP 9.8 with the introduction of the automatic
port placement feature. When you are upgrading a system running ONTAP 9.8 you must use the correct
procedure to account for the port placement feature.
Review the following table to see the available upgrade procedures. See each guide for additional details to
determine if the procedure is appropriate.
For additional MetroCluster-specific procedures, see Choosing an upgrade or refresh method.
ONTAP version
Location
Nondisruptive
Supports MetroCluster
9.8 to 9.0.x
Controller Hardware
Upgrade Express Guide
(Moving existing physical
storage)
No
No
Controller Hardware
Upgrade Express Guide
(Moving volumes to new
storage)
Yes
No
9.8
Using “system controller
replace” Commands to
Upgrade Controller
Hardware Running
ONTAP 9.8
Yes
Yes (FC)
9.8
Use Aggregate Relocation Yes
to Manually Upgrade
Controller Hardware
Running ONTAP 9.8 or
Later
Yes (FC)
9.7 to 9.5
Using “system controller
Yes
replace” Commands to
Upgrade Controller
Hardware Running
ONTAP 9.5 to ONTAP 9.7
Yes (FC)
9.7 and earlier
Upgrading Controllers
Yes
with Aggregate Relocation
to Manually Upgrade
Controller Hardware
Running ONTAP 9.7 and
Earlier
Yes (FC)
Software upgrade enhancements
80
Functionality
Description and where to learn more
Available
beginning
Upgrade ONTAP
and firmware from
BlueXP
Users can upgrade ONTAP image and firmware by using the
Advanced View (System Manager interface) in BlueXP.
ONTAP 9.13.1
What’s New
ONTAP Time Zone
Database updates
Recommended updates to the ONTAP Time Zone Database are
automatically downloaded and installed when you enable automatic
updates.
ONTAP 9.13.1
Enable automatic updates
Additional upgrade
path options
Beginning with the ONTAP 9.11.1 image, upgrades to the current
release number + 3 are supported; for example, 9.8 to 9.11.1.
Additional automated nondisruptive upgrades (ANDU) are supported
for earlier releases.
ONTAP 9.11.1
Upgrade paths
MAINT Start/Stop
AutoSupport
message for ANDU
An automated MAINT (Maintenance) Start AutoSupport message is
ONTAP 9.8
generated before the upgrade starts and an End AutoSupport
message is generated after an automated upgrade completes or is
canceled. Support cases are not automatically created during a
scheduled maintenance window, including drive failures. If a failure
occurs during a maintenance window, you must manually open a case
with NetApp Support.
For more information, see the following Knowledge Base article:
How to suppress automatic case creation during scheduled
maintenance windows
Simplified hardware
upgrade procedure
The hardware upgrade procedures have been simplified in ONTAP 9.8 ONTAP 9.8
with the introduction of the automatic port placement feature. NetApp
recommends that you perform hardware upgrades on systems running
the ONTAP 9.8 GA release, at which time the upgrade procedures will
be available.
Upgrade both
clusters in a
MetroCluster
configuration with
System Manager
You can use System Manager to upgrade both clusters in a
MetroCluster configuration to a newer version of ONTAP. During the
upgrade, the storage service remains online.
ONTAP 9.8
ONTAP 9.7
Update ONTAP on MetroCluster clusters
81
Functionality
Description and where to learn more
Upgrade from
ONTAP 9.3 directly
to 9.7
To complete this upgrade, you must download the 9.5 and the 9.7
ONTAP 9.7
software images. The automated upgrade process uses the 9.5 image
in the background to complete the update to 9.7. You should expect
multiple reboots during the process. Upgrade advisor does not provide
an estimation on the time for upgrade from ONTAP 9.3 to 9.7. You can
use the cluster image update -version
<ONTAP_upgrade_version> -estimate-only true command
to get an estimation. This command is not available in ONTAP 9.3 for
2-node MCC configurations.
Performing an automatic nondisruptive upgrade using the CLI
What version of ONTAP can I upgrade to
Automated nondisruptive upgrade using System Manager
82
Available
beginning
API changes in ONTAP 9 releases
There are several ways you can use the REST API to deploy and administer your ONTAP
storage systems.
Migrate from ONTAPI to the ONTAP REST API
The ONTAPI API (ZAPI) is a set of proprietary calls included with the NetApp ONTAP
software to support the automation of data storage administration and management
tasks. The ONTAPI interface will be disabled in future versions of ONTAP as described in
the CPC-00410 End of availability: ONTAPI product communique.
If you are using ONTAPI, you should plan your migration to the ONTAP REST API. NetApp provides several
resources to help you efficiently move your automation workloads from ONTAPI to the REST API. This
includes the following documentation and software:
• ONTAPI to REST API mapping
• Performance counter mapping
• Tools and software
• Python client library
• Blog articles
Support for an ONTAP REST API
Beginning with ONTAP 9.6, an expansive REST API is available for the automation of
your ONTAP systems. The REST API is supported through extensive documentation and
code samples as well as a client library to accelerate the development of robust
automation code using Python.
You should begin with the ONTAP Automation Documentation which includes everything you need to get
started with the API. In addition, an online API reference is available with your local ONTAP system. Simply
point a browser to the cluster management IP address of your ONTAP system:
https://cluster_management_ip/docs/api
The Python client library is designed to help you quickly write robust automation code for your production
ONTAP deployments. See the NetApp Developer Network site and the Developers Guide for more information.
DevNet also provides additional resources, including links to the static API reference content and the ONTAPI
to REST mapping documentation.
Related information
NetApp Developer Network: ONTAP REST API
ONTAP Automation Documentation
83
Changes to the ONTAP REST API
ONTAP 9.13.1
ONTAP 9.13.1 continues to expand the capabilities of the ONTAP REST API with over two dozen new API
calls. These endpoints support new ONTAP features as well as enhancements to existing features. This
release focuses on improvements to security, resource management, enhanced SVM configuration options,
and performance metrics.
Feature
Description
Resource tagging
You can use tags to group REST API resources. You might do this to
associate related resources within a specific project or organizational group.
Using tags can help to organize and track resources more effectively.
Consistency groups
ONTAP 9.13.1 continues to expand the availability of performance counter
data. You can access this type of statistical information to track historical
performance and capacity for consistency groups. In addition,
enhancements have been included that allow the parent-child relationships
among consistency groups to be configured and managed.
DNS configuration per SVM
The existing DNS endpoints have been expanded to allow DNS domain and
server configuration to be performed for individual SVMs.
EMS role configuration
The existing EMS support feature has been expanded to allow for the
management of roles and the access control configuration assigned to the
roles. This provides the ability to limit or filter the events and messages
based on the role configuration.
Security
You can use the REST API to configure the time-based one-time password
(TOTP) profiles for accounts that sign in and access ONTAP using SSH. In
addition, the key manager endpoints have been expanded to provide a
restore operation from a specified key management server.
CIFS configuration per SVM
The existing CIFS endpoints have been expanded to allow the configuration
for a specific SVM to be updated.
S3 bucket rules
The existing S3 bucket endpoints have been expanded to include a rule
definition. Each rule is a list objects and defines the set of actions to be
performed on an object within the bucket. Collectively these rules allow you
to better manage the lifecycle of your S3 buckets.
ONTAP 9.12.1
ONTAP 9.12.1 continues to expand the capabilities of the ONTAP REST API with over 40 new API calls. These
endpoints support new ONTAP features as well as enhancements to existing features. This release focuses on
improvements to security and NAS capabilities.
84
Feature
Description
Security enhancements
Amazon Web Services includes a key management service that provides
secure storage for keys and other secret information. You can access this
service through the REST API to allow ONTAP to securely store its
encryption keys in the cloud. In addition, you can create and list the
authentication keys used with NetApp Storage Encryption.
Active Directory
You can manage the Active Directory accounts defined for an ONTAP
cluster. This includes creating new accounts as well as displaying, updating,
and deleting accounts.
CIFS group policies
The REST API has been enhanced to support the creation and
management of CIFS group policies. The configuration information is
available and administered through group policy objects that are applied to
all or specific SVMs.
ONTAP 9.11.1
ONTAP 9.11.1 continues to expand the capabilities of the ONTAP REST API with nearly a 100 new API calls.
These endpoints support the new ONTAP features as well as enhancements to existing features. This release
focuses on supporting customer migration to the ONTAP REST API from the Data ONTAP API (ONTAPI).
Feature
Description
Granular RBAC
The ONTAP role-based access control (RBAC) capability has been
enhanced to provide additional granularity. You can use the traditional roles
or create new roles as needed. Every role can be associated with one or
more access definitions, each of which identifies a command or REST API
call along with the desire access level. New access permissions are also
available, such as read_create and read_modify. This enhancement
provides parity with the Data ONTAP API (ONTAPI) and supports customer
migration to the REST API.
Performance counters
Previous ONTAP releases have maintained statistical information about the
operational characteristics of the system. With the ONTAP 9.11.1 release,
this information has been enhanced and is available through the REST API.
An administrator or automated process can access the data to determine
system performance. The statistical information, as maintained by the
counter manager subsystem, is presented in a database format using tables
and rows. This enhancement brings the ONTAP REST API closer to parity
with the Data ONTAP API (ONTAPI).
Aggregate management
The management of ONTAP storage aggregates has been enhanced. You
can use the updated REST endpoints to move aggregates online and offline
as well as manage the spares.
85
Feature
Description
IP subnet capability
The ONTAP networking capability has been expanded to include support for
IP subnets. The REST API provides access to the configuration and
management of the IP subnets within an ONTAP cluster with a focus on
SnapVault policy.
Multiple administrator
verification
The multiple administrator verification feature provides a flexible
authorization framework for protecting access to ONTAP commands or
operations. You can define rules that identify the restricted commands.
When a user requests access to a specific command, approval can be
granted by multiple ONTAP administrators as appropriate.
SnapMirror enhancements
The SnapMirror capability has been enhanced in several areas including
scheduling. The SnapVault relationship parity has been added in a DP
relationship with ONTAP 9.11.1. Also, the throttle feature available with the
REST API has reached parity with the Data ONTAP API (ONTAPI). Related
to this, support is available to create and manage bulk Snapshot copies.
Name services cache support
ONTAP name services have been enhanced to support caching which
improves performance and resiliency. Configuration of the name services
cache can be accessed through the REST API. Settings can be applied at
multiple levels including: hosts, unix-users, unix-groups, and netgroups.
Storage pools
Several endpoints have been added to provide access to the ONTAP
storage pools. Support is included for creating and listing the storage pools
in a cluster as well as updating and deleting specific pools by ID.
ONTAPI reporting tool
The ONTAPI reporting tool helps customers and partners identify the
ONTAPI usage in their environment. In addition to the Python software,
there is also a video and evolving support in the NetApp Lab on Demand.
This tool provides another resource when migrating from ONTAPI to the
ONTAP REST API.
ONTAP 9.10.1
ONTAP 9.10.1 continues to expand the capabilities of the ONTAP REST API. Over 100 new endpoints have
been added to support new ONTAP features as well as enhancements to existing features. A summary of the
REST API enhancements is presented below.
Feature
Description
Application consistency group
A consistency group is a set of volumes that are grouped together when
performing certain operations such as a snapshot. This feature extends the
same crash consistency and data integrity implicit with single-volume
operations across a set of volumes. It is valuable for large multi-volume
workload applications.
86
Feature
Description
SVM migration
You can migrate an SVM from a source cluster to a destination cluster. The
new endpoints provide complete control, including the ability to pause,
resume, retrieve status, and abort a migration operation.
File cloning and management
Volume-level file cloning and management have been enhanced. New
REST endpoints support file move, copy, and split operations.
Ransomware defense
ONTAP detects files potentially containing a ransomware threat. You can
retrieve a list of these suspect files as well as remove them from a volume.
Miscellaneous security
enhancements
There are several general security enhancements that expand existing
protocols and introduce new capabilities. Improvements have been made to
IPSEC, key management, SSH configuration, and file permissions.
CIFS domains and local groups Support for CIFS domains has been added at the cluster and SVM level.
You can retrieve the domain configuration as well as create and remove
preferred domain controllers.
Improved S3 auditing
Auditing of the S3 events is a security improvement allowing you to track
and log certain S3 events. An S3 audit event selector can be set on a per
SVM per bucket basis.
Expanded volume analytics
Volume analytics and metrics have been expanded through additional
endpoints to support top files, directories, and users.
Support enhancements
Support has been enhanced through several new features. Automatic
update can keep your ONTAP systems current by downloading and applying
the latest software updates. You can also retrieve and manage the memory
core dumps generated by a node.
ONTAP 9.9.1
ONTAP 9.9.1 continues to expand the capabilities of the ONTAP REST API. There are new API endpoints for
existing ONTAP features, including SAN port sets and vServer file directory security. In addition, endpoints
have been added to support new ONTAP 9.9.1 features and enhancements. A summary of the enhancements
is presented as follows:
Feature
Description
Mapping ONTAPI to the
ONTAP 9 REST API
To help you transition your ONTAP automation code to the REST API,
NetApp provides API mapping documentation. This reference includes a list
of ONTAPI calls and the REST API equivalent for each. The mapping
document has been updated to include the new ONTAP 9.9.1 API end
points.
ONTAPI to REST API mapping
87
Feature
Description
API endpoints for new ONTAP
9.9.1 core features
Support for new ONTAP 9.9.1 features that are not available through the
ONTAPI API has been added to the REST API. This includes support for
nested igroups and Google Cloud Key Management Services.
Improved support for
transitioning to REST from
ONTAPI
More of the legacy ONTAPI calls have corresponding REST API
equivalents. This includes local Unix users and groups, management of
NTFS file security without the need for a client, SAN port sets, and volume
space attributes. These changes are also included in the updated ONTAPI
to REST mapping documentation.
Enhanced online
documentation
The ONTAP online documentation reference page includes labels indicating
the ONTAP release when each REST endpoint or parameter was
introduced, including those new with ONTAP 9.9.1.
ONTAP 9.8
ONTAP 9.8 greatly expands the breadth and depth of the ONTAP REST API. It includes several new features
which enhance your ability to automate the deployment and management of ONTAP storage systems. In
addition, support has been improved for assisting with the transition to REST from the legacy ONTAPI API.
Feature
Description
Mapping ONTAPI to the
ONTAP 9 REST API
To help you update your ONTAPI automation, NetApp provides a list of
ONTAPI calls that require one or more input parameters, along with a
mapping of those calls to the equivalent ONTAP 9 REST API call.
ONTAPI to REST API mapping
API endpoints for new ONTAP
9.8 core features
Support for the new core ONTAP 9.8 features not available through ONTAPI
has been added to the REST API. This includes REST API support for
ONTAP S3 buckets and services, SnapMirror Business Continuity, and File
System Analytics.
Expanded support for
enhanced security
Security has been enhanced through the support of several services and
protocols, including Azure Key Vault, Google Cloud Key Management
Services, IPSec, and Certificate Signing Requests.
Enhancements to improve
simplicity
ONTAP 9.8 delivers more efficient and modern workflows using the REST
API. For example, one-click firmware updates are available for several
different types of firmware.
Enhanced online
documentation
The ONTAP online documentation page includes labels indicating the
ONTAP release that each REST endpoint or parameter was introduced,
including those new in 9.8.
Improved support for
transitioning to REST from
ONTAPI
More legacy ONTAPI calls have corresponding REST API equivalents.
Documentation is also available to help identify which REST endpoint
should be used in place of an existing ONTAPI call.
88
Feature
Description
Expanded performance metrics Performance metrics for the REST API have been expanded to include
several new storage and network objects.
ONTAP 9.7
ONTAP 9.7 extends the functional scope of the ONTAP REST API by introducing three new resource
categories, each with several REST endpoints:
• NDMP
• Object store
• SnapLock
ONTAP 9.7 also introduces one or more new REST endpoints in several of the existing resource categories:
• Cluster
• NAS
• Networking
• NVMe
• SAN
• Security
• Storage
• Support
ONTAP 9.6
ONTAP 9.6 greatly extends the REST API support originally introduced in ONTAP 9.4. The ONTAP 9.6 REST
API supports most ONTAP configuration and administration tasks
REST APIs in ONTAP 9.6 include the following key areas and many more:
• Cluster setup
• Protocol configuration
• Provisioning
• Performance monitoring
• Data protection
• Application aware data management
Support for performance metrics in the ONTAP REST API
ONTAP collects performance metrics about selected SVM storage objects and protocols,
and reports this information through the REST API. You can use this data to monitor the
performance of an ONTAP system.
89
For a given storage object or protocol, the performance data falls into three categories:
• IOPS
• Latency
• Throughput
Within each category, one or more of the following types of data is available:
• Read - R
• Write - W
• Other - O
• Total - T
The following table summarizes the performance data available through the ONTAP REST API, including the
release when it was added. Refer to the REST API online documentation page at your ONTAP system for
more information.
Storage object or
protocol
IOPS
Latency
Throughput
ONTAP release
Ethernet Port
Not applicable
Not applicable
RWT
9.8
FC Port
RWOT
RWOT
RWT
9.8
IP Interface
Not applicable
Not applicable
RWT
9.8
FC Interface
RWOT
RWOT
RWT
9.8
NVMe namespace
RWOT
RWOT
RWOT
9.8
Qtree statistics
Raw RWOT
Not applicable
Raw RWOT
9.8
Volume Flexcache
RWOT
RWOT
RWT
9.8
Cloud volume
Processor utilization RWOT
as a numerical value
Node — processor
utilization
9.8
LUN
Not applicable
RWOT
RWOT
9.7
Aggregate
RWOT
RWOT
RWOT
9.7
SVM NFS protocol
RWOT
RWOT
RWOT
9.7
SVM CIFS protocol
RWT
RWOT
RWOT
9.7
SVM FCP protocol
RWT
RWOT
RWOT
9.7
90
Storage object or
protocol
IOPS
Latency
Throughput
ONTAP release
SVM iSCSI protocol RWT
RWOT
RWOT
9.7
SVM NVMe protocol RWT
RWOT
RWOT
9.7
Cluster
RWT
RWOT
RWOT
9.7
Volume
RWOT
RWOT
RWOT
9.6
Using the NetApp Manageability SDK
The NetApp Manageability SDK provides APIs for developing applications that monitor
and manage ONTAP storage. OnCommand Workflow Automation (OnCommand WFA)
enables you to run prepackaged workflows that automate management tasks using APIs.
You can manage ONTAP systems by using APIs.
The SDK supports C, C++, Java, Perl, C#, VB.NET, PowerShell, Python, and Ruby as the scripting language
on the client side. You can download the SDK from the NetApp Support Site.
You can also use APIs to automate management tasks without writing scripts. OnCommand Workflow
Automation provides several prepackaged workflows that automate management tasks such as the workflows
that are described in Express Guides. You can download the OnCommand WFA pack from the NetApp
Storage Automation Store.
For information about the versions of the NetApp Manageability SDK and OnCommand Workflow Automation
that are supported with your version of ONTAP, see the Interoperability Matrix Tool.
Related information
OnCommand Workflow Automation Documentation Resources
NetApp Storage Automation Store
91
Changes to ONTAP limits and defaults
NetApp strives to help its customers understand the most important limits that change
with each ONTAP release.
Feature
Limit change description
Changed in
release…
FlexVol and
FlexGroup volume
size limit
The maximum supported FlexVol and FlexGroup volume constituent
size on AFF and FAS platforms is increased from 100 TB to 300 TB.
ONTAP
9.12.1P2
LUN size limit
The maximum supported LUN size on AFF and FAS platforms is
increased from 16 TB to 128 TB.
ONTAP
9.12.1P2
The maximum supported LUN size in SnapMirror configurations
(Synchronous and Asynchronous) is increased from 16 TB to 128 TB.
FlexVol volume size The maximum supported volume size on AFF and FAS platforms is
limit
increased from 100 TB to 300 TB.
ONTAP
9.12.1P2
The maximum supported FlexVol volume size in SnapMirror
Synchronous configurations is increased from 100 TB to 300 TB.
File size limit
The maximum supported file size for NAS file systems on AFF and
FAS platforms is increased from 16 TB to 128 TB.
ONTAP
9.12.1P2
The maximum supported file size in SnapMirror Synchronous
configurations is increased from 16 TB to 128 TB.
Cluster volume limit
Increase the ability for controllers to more fully utilize CPU and
memory and increase maximum volume count for a cluster from
15,000 to 30,000.
ONTAP 9.12.1
SVM-DR
relationships for
FlexVol volumes
For FlexVol volumes, the maximum number of SVM-DR relationships
has increased from 64 to 128 (128 SVMs per cluster).
ONTAP 9.11.1
SnapMirror
Synchronous
The maximum number of SnapMirror Synchronous operations allowed ONTAP 9.11.1
per HA pair has increased from 200 to 400.
NAS FlexVol
volumes
The cluster limit for NAS FlexVol volumes has increased from 12k to
15k.
ONTAP 9.10.1
SAN FlexVol
volumes
The cluster limit for SAN FlexVol volumes has increased from 12k to
15k
ONTAP 9.10.1
92
Feature
SVM-DR with
FlexGroup volumes
Limit change description
• A maximum of 32 SVM-DR relationships is supported with
FlexGroup volumes
Changed in
release…
ONTAP 9.10.1
• The maximum number of volumes supported in a single SVM in an
SVM-DR relationship is 300, which includes the number of FlexVol
volumes and FlexGroup constituents.
• The maximum number of constituents in a FlexGroup cannot
exceed 20.
• SVM-DR volume limits are 500 per node, 1000 per Cluster
(including FlexVol volumes and FlexGroup constituents)
Auditing-enabled
SVMs
The maximum number of auditing-enabled SVMs supported in a
cluster has been increased from 50 to 400.
ONTAP 9.9.1
SnapMirror
Synchronous
The maximum number of supported SnapMirror Synchronous
endpoints per HA pair has increased from 80 to 160.
ONTAP 9.9.1
FlexGroup
FlexGroup volumes support two or more fanout relationships; for
SnapMirror topology example A→B, A→C. Like FlexVol volumes, FlexGroup fanout
supports a maximum of 8 fanout legs, and cascading up to two-levels;
for example, A→B→C.
ONTAP 9.9.1
SnapMirror
concurrent transfer
The maximum number of asynchronous volume-level SnapMirror
concurrent transfers has increased from 100 to 200. Cloud-to-cloud
SnapMirror transfers has increased from 32 to 200 on high-end
systems and from 6 to 20 SnapMirror transfers on low-end systems.
ONTAP 9.8
FlexVol volumes
limit
The space consumed by FlexVol volumes has increased from 100 TB
to 300 TB for All SAN Array (ASA).
ONTAP 9.8
93
Upgrade cautions in ONTAP 9 releases
Before upgrading to any release of ONTAP 9, you should read the important cautions to
identify and resolve issues that might affect the operation of your storage systems.
If you are upgrading from a release earlier than ONTAP 9.5, be sure to consult the Release Notes for ONTAP
9.0 to ONTAP 9.4 concerning intermediate upgrades.
To learn more about an individual bug and to explore other bug-related tools, see Bugs Online on the NetApp
Support Site.
Related information
NetApp Bugs Online
Upgrade cautions
Functionality
Description and where learn more
When
upgrading
to…
ARP auto-switch to
active mode
ONTAP 9.13.1
In ONTAP 9.13.1, the -auto-switch-from-learning-to
-enabled option is true by default. Volumes that are in learning mode
at the time of upgrade from ONTAP 9.12.1 or earlier to ONTAP 9.13.1
are automatically transitioned to auto-switch behavior that moves a
volume from learning to enabled mode automatically based on ARP
analytics. See Enable Autonomous Ransomware Protection to disable
ARP auto-switch to active mode if you want to make the switch
manually. ARP auto-switch to active mode will be the default for new
volumes that are upgraded to ONTAP 9.13.1 and enable ARP.
SnapMirror DP-type SnapMirror DP-type relationships are no longer supported. If you have ONTAP 9.12.1
relationships
existing DP-type relationships, you must first convert them to XDPtype relationships before upgrading to ONTAP 9.12.1. DP-type
relationships are not converted automatically when you upgrade to
ONTAP 9.12.1.
Convert an existing DP-type relationship to XDP
Administrator
authentication with
SSH public key
accounts fails
The SSH public key type ssh-ed25519 is no longer supported in
ONTAP 9.11.1 and later releases. Existing SSH public key accounts
without the supported key algorithms must be reconfigured with a
supported key type before enabling upgrading, or administrator
authentication will fail.
Consideration to authenticate public FIPS key
94
ONTAP 9.11.1
and later
Functionality
Description and where learn more
Third-party backup SnapDiff v1 and v2 ONTAPI (ZAPI) calls cannot be invoked beginning
applications that use with ONTAP 9.10.1.
SnapDiff v1 or v2
Upgrading to ONTAP 9.10.1 will cause third-party backup applications
will fail
to fail if those applications invoke SnapDiff v1 or v2 ONTAPI calls.
When
upgrading
to…
ONTAP 9.10.1
Beginning with ONTAP 9.8, SnapDiff REST API calls (referred to as
SnapDiff v3) are available as a replacement for the SnapDiff v1 and v2
ONTAPI calls. Users should verify that their third-party backup
application supports the SnapDiff v3 REST API calls before upgrading
to ONTAP 9.10.1 or later.
SnapDiff API availability across ONTAP releases is defined as follows:
• ONTAP 8.2 – ONTAP 9.7: v1 and v2 (ONTAPI only)
• ONTAP 9.8 – ONTAP 9.9.1: v1, v2 and v3 (both ONTAPI and
REST API)
• ONTAP 9.10.1: v3 only (REST API only)
EMS messages not
delivered
After upgrading from ONTAP 9.7 or earlier, EMS messages might not
be delivered.
ONTAP 9.8 or
later
Remove EMS LIF service from network service policies
SSH fails to connect This can occur because DSA keys of length 1024 bits are no longer
or prompt for a
supported.
password after
upgrading from 9.7
or an earlier release
of ONTAP
ONTAP 9.8
SSH fails to connect Invalid MAC algorithms cause Secure Shell (SSH) connection failure
to filer after upgrade after upgrading due to corruption of the sshd_config file.
from ONTAP 9.1 to
any release due to
NetApp Bugs Online Bug ID 1337490
presence of hmacripemd MAC
algorithms
ONTAP 9.8
SSH connection to
Storage
ONTAP 9.8
When you upgrade from ONTAP 9.7 to ONTAP 9.8 with FIPS mode
enabled, the sshd_config file is corrupted due to invalid key
exchange algorithms. These invalid algorithms cause the ssh
connection failure.
NetApp Bugs Online Bug ID 1355645
95
Functionality
Description and where learn more
When
upgrading
to…
Upgrade to ONTAP
9.8
Upgrade to ONTAP 9.8 fails when restartable backup is configured in
SVM DR or MetroCluster destination.
ONTAP 9.8
NetApp Bugs Online Bug ID 1386268
Automatic update of For AFF A700s, the automatic update to BMC firmware 1.81 fails after
BMC firmware
ONTAP upgrade.
during ONTAP
NetApp Bugs Online Bug ID 1358511
upgrade
ONTAP 9.7
and later
VLAN port node
management
Inconsistent VLAN ports occur after an upgrade with imported external ONTAP 9.7P4
key managers.
Configuration
backup
Configuration backup fails after hardware upgrade or headswap.
ONTAP 9.7
Replicated
Database
Large databases might cause an RDB upgrade failure in ONTAP 9.7.
ONTAP 9.7
ATTO inband
upgrade
Storage I/Os might get hung during an ATTO inband upgrade.
ONTAP 9.7
CF card upgrade
A CF card error might occur on A700s systems during upgrade to
ONTAP 9.7 that indicates a missing directory.
ONTAP 9.7
Custom REST roles
Custom REST roles become inactive after an upgrade to ONTAP 9.7
or after every reboot of ONTAP 9.7.
ONTAP 9.7
Upgrading a cluster If you are upgrading a cluster to ONTAP 9.7 with a local software
with a local software image upload from System Manager, you must resize the default
image upload from
staging directory size to 4 GB on all nodes in the cluster.
System Manager
NetApp Bugs Online Bug ID 1223866
ONTAP 9.7
Automated cluster
image update
ONTAP 9.5
and later
If the key manager configured for a storage system is not available
and encryption keys fail to load, an automated cluster image update
will pause until the keys are available.
NetApp Bugs Online Bug ID 1283907
SnapMirror based
transition
96
SnapMirror based transition from ONTAP version 7.3 or earlier to
ONTAP 9.5 and later causes controller disruption
ONTAP 9.5
and later
Functionality
Description and where learn more
When
upgrading
to…
Upgrading ONTAP
9.5 or later with
NetApp Volume
Encryption
If you are upgrading a system with NetApp Volume Encryption, you
must use the ONTAP software image for non-restricted countries to
perform an upgrade to ONTAP 9.5. If you use the ONTAP software
image for restricted countries to upgrade a system with NetApp
Volume Encryption, the system panics and you lose access to your
volumes.
ONTAP 9.5
Download and install the ONTAP software image
Revert and downgrade cautions
Functionality
Description and where learn more
When
reverting or
downgrading
to…
ARP auto-switch to
active mode
If any FlexGroup volumes have ARP enabled, ONTAP version revert
When reverting
won’t be allowed. You need to disable ARP on FlexGroup volumes that from ONTAP
have it active before reverting.
9.13.1
Retention capability
for SnapLock
ONTAP prevents you from reverting a cluster from ONTAP 9.10.1 to an When reverting
earlier ONTAP version when there are any files with a retention period from ONTAP
later than “January 19, 2071 8:44:07 AM”.
9.10.1
97
End of support and deprecation in ONTAP 9
releases
For more information about the platforms supported by your version of ONTAP 9, see:
NetApp Hardware Universe
You can learn about changes to the command-line interface (CLI) commands between ONTAP releases by
using the CLI Comparison Tool on the NetApp Support Site.
NetApp CLI Comparison: New and changed commands in ONTAP
Features no longer supported
Feature
Description
Support
discontinued
beginning
with…
HTTP transport of
AutoSupport
The HTTP transport method is deprecated beginning with ONTAP
9.12.1. NetApp AutoSupport servers will stop supporting the HTTP
transport method in 2023. The remaining available transport methods
are HTTPS and SMTP.
ONTAP 9.12.1
Support Bulletin SU484: NetApp will reject AutoSupport messages
transmitted with insufficient transport security
SnapMirror DP-type SnapMirror DP-type relationships are no longer supported. If you have ONTAP 9.12.1
relationships
existing DP-type relationships, you must first convert them to XDPtype relationships before upgrading to ONTAP 9.12.1. DP-type
relationships are not converted automatically when you upgrade to
ONTAP 9.12.1.
Convert an existing DP-type relationship to XDP
SnapMirror
asynchronous
98
DP-type relationships can no longer be created. Only new XDP-type
relationships can be created.
ONTAP 9.11.1
Feature
Description
Support
discontinued
beginning
with…
SnapDiff v1 and v2
no longer available
SnapDiff v1 and v2 ONTAPI (ZAPI) calls cannot be invoked beginning
with ONTAP 9.10.1. Any third-party application that invokes SnapDiff
v1 or v2 ONTAPI calls will not function beginning with ONTAP 9.10.1.
ONTAP 9.10.1
Beginning with ONTAP 9.8, SnapDiff REST API calls (referred to as
SnapDiff v3) are available as a replacement for the SnapDiff v1 and v2
ONTAPI calls.
Customer impact:
• ONTAP users should verify that their backup application supports
SnapDiff v3 before upgrading to ONTAP 9.10.1.
• If a third-party backup application does not support SnapDiff v3
REST API calls, users can continue to use their v2 backup
application using ONTAP 9.9.1 or earlier releases until the EOA
date of their ONTAP release.
SnapDiff API availability across ONTAP releases is defined as follows:
• ONTAP 8.2 – ONTAP 9.7: v1 and v2 (ONTAPI only)
• ONTAP 9.8 – ONTAP 9.9.1: v1, v2 and v3 (both ONTAPI and
REST API)
• ONTAP 9.10.1: v3 only (REST API only)
Refer to Customer Product Communique CPC-00352 on the NetApp
Support Site for more information.
OnCommand
System Manager
(classic UI)
The System Manager classic UI, based on ONTAPI, is no longer
available due to the transition from ONTAPI to REST APIs. ONTAP
System Manager, first introduced in ONTAP 9.6 and based on REST
APIs, is the only System Manager UI available for ONTAP
management in ONTAP 9.8 and later.
ONTAP 9.8
Administration overview with System Manager
99
Feature
Description
Support
discontinued
beginning
with…
7-Mode Transition
Tool for copy-free
transition
The 7-Mode Transition Tool 3.3.1 and later does not support 7-Mode
copy-free transitions to target clusters running ONTAP 9.5 or later.
ONTAP 9.5
• To transition to ONTAP 9.5 or later from a 7-Mode system using
the copy-free method, you must first transition to ONTAP 9.4 using
the 7-Mode Transition Tool version 3.3.1 and then upgrade your
cluster to ONTAP 9.5 or later.
• You can transition to ONTAP 9.6P7 or later, or ONTAP 9.7P2 or
later from a 7-Mode system using the copy-based method. The
earlier restriction on copy-based transitions to 9.6 and later is
removed.
7-Mode Transition Documentation
Load-sharing mirrors Beginning with ONTAP 9.5, load-sharing mirrors for data volumes are
for data volumes
no longer supported.
ONTAP 9.5
You should decommission load-sharing mirrors for data volumes or
contact your account teams or technical support for assistance before
upgrading to ONTAP 9.5. Alternatives to load-sharing mirrors for data
volumes include individual SnapMirror relationships and
implementation of FlexCache.
Load-sharing mirrors for root volume protection continue to be
supported as a NetApp best practice.
Infinite Volumes
Infinite Volumes will no longer serve data. To preserve the data access ONTAP 9.5
to Infinite Volumes, you must stay on ONTAP 9.4 or migrate data out
of Infinite Volumes and delete them prior to upgrading.
It is recommended that you contact technical support for assistance in
decommissioning your Infinite Volumes configuration before upgrading
to ONTAP 9.5.
End of support for
AutoSupport
messages sent
using HTTP
AutoSupport messages must be sent using HTTPS with TLSv1.2
secure SMTP.
ONTAP 9 and
later
Requirements for using AutoSupport
Legacy hardware no longer supported
Devices
Support discontinued from…
CN1610
ONTAP 9.13.1
100
Devices
Support discontinued from…
FAS and AFF systems
ONTAP 9.12.1
• AFF A200
• FAS2650
• FAS2620
Cluster switches
ONTAP 9.11.1
• Cisco Nexus 5596UP
• Cisco Nexus 5596T
FAS and AFF systems
ONTAP 9.9.1
• FAS8020, FAS8040, FAS8060, FAS8080
• AFF8020, AFF8040, AFF8060, AFF8080
• FAS2520, FAS2552, FAS2554
ATTO FibreBridge 6500N FC-to-SAS bridge
ONTAP 9.8
Related information
• Cisco Matrix
• NetApp switch matrix
• CPC-00186 End of Availability: NetApp CN1610 Cluster Interconnect SKUs
Deprecated commands
Commands
Description
Beginning
with…
security keymanager
certificate
update
Beginning with ONTAP 9.5, the command is no longer supported.
ONTAP 9.5
Enabling external key management in ONTAP 9.5 and earlier
101
Known problems and limitations in ONTAP 9
releases
Some unexpected and potentially undesired post-upgrade behaviors, and in some cases
workarounds to avoid these behaviors, have been identified in ONTAP 9.5 and later
releases.
Bugs might have been fixed in a maintenance or patch release, see NetApp Bugs Online to learn which issues
affect your installed systems.
7-Mode transition issues
To learn about known issues that affect 7-Mode transition, see the 7-Mode Transition
Documentation.
Data protection issues
Issue
Description
Affecting…
Snapshot failure in
Out of Sync SM-BC
relationships
Source-side snapshots in SM-BC relationships created during an out
of sync state will not be copied to the destination volume during the
resync process when snapshots creation is attempted with the
“app_consistent” label through either the Snapshot-multi-create ZAPI
or cg-snap-prepare and cg-snap-commit APIs (also used in System
Manager).
ONTAP 9.8
and later
SnapMirror transfer After an upgrade to ONTAP 9.8, SnapMirror transfers might fail under
fails when the
the below circumstances:
primary volume size
• If the source volume used size is larger than 90 TB
exceeds the
maximum volume
• If the source volume provisioned size is larger than 100 TB (CVO
size supported on
systems only)
the destination
ONTAP 9.7
and earlier
NetApp Bugs Online Bug ID 1379129
ONTAP ignores the
SMB Synchronize
bit in permission
checks
ONTAP complies with Microsoft standard and ignores the SMB
Synchronize bit during permission checks. However, Windows SMB
servers might not ignore this bit, resulting in different security
behaviors between Windows and ONTAP.
NetApp Bugs Online Bug ID 1282765
File access and protocols issues
102
ONTAP 9.5
through
ONTAP 9.7
Issue
Description
Affecting
Mellanox RDMA
gARP delays
There is an issue with Mellanox host drivers that may cause excessive ONTAP 9.10.1
I/O delays when a LIF failover or migration event occurs. Adjusting the
SVM NFSv4 locking grace period can mitigate the issue, but some
applications may still experience I/O timeouts and failures. Mellanox is
working on a fix to be adopted into upstream Linux repositories.
RDMA support with
NFS is limited to
NFSv4.0
RDMA support is limited to NFSv4.0. This is a performance limitation
due to NFSv4.0 lack of support for multiple sessions per mount.
ONTAP 9.10.1
Mount size limitation NFS mount sizes higher than 64k result in unstable performance with
in NFS over RDMA NFS over RDMA configurations.
ONTAP 9.10.1
NFS over RDMA
RDMA support is limited to node-local traffic only. Standard FlexVols or ONTAP 9.10.1
limited to node-local FlexGroups where all constituents are on the same node are
traffic
supported and must be accessed from a LIF on the same node.
Instability of ONTAP In some rare situations, a Vscan engine might close the Vscan named ONTAP 9.8
during a virus scan "pipe" before sending a cancel request for a pending pipe read
through
operation. When this occurs, ONTAP might become unstable.
ONTAP 9.8P4
XDP SnapMirror
transfers can cause
long running
consistency points
NetApp Bugs Online Bug ID 1357025
ONTAP 9.7
through
ONTAP
9.7P14
When transfers are running in the extended data protection (XDP)
mode of SnapMirror, some data patterns might cause scattered
reference count file updates during the reference phase, causing
consistency points (CPs) to be long running.
ONTAP 9.8
through
ONTAP 9.8P3
NetApp Bugs Online Bug ID 1320505
ONTAP 9.7
through
ONTAP 9.7P11
ONTAP 9.6
ONTAP 9.5
A large CCMA file
If the "next-tag" implementation of a CM object callback is not carefully
might cause system written, it might cause the CM object callback to generate an endless
controller disruption supply of instance data, resulting in a very large CCMA file that might
cause a system controller disruption.
ONTAP 9.5
through
ONTAP
9.5P13
NetApp Bugs Online Bug ID 1229860
Management interface issues
103
Issue
Description
Affecting…
System Manager
Volume Move dialog
might not show
accurate revised
used capacity
The Volume Move dialog in System Manager doesn’t show accurate
revised used capacity in cases where relatively small volumes are
moved to local tiers with a larger available space size.
ONTAP 9.8
and ONTAP
9.9.1
NetApp Bugs Online Bug ID 1389350
MetroCluster configuration issues
Issue
Description
Affecting…
Upgrade from
ONTAP 9.8 to 9.10.1
fails on FAS2750,
FAS500f, AFF A220,
or AFF A250
MetroCluster
systems
When FAS2750, FAS500f, AFF A220, or AFF A250 MetroCluster
systems are upgraded from ONTAP 9.8 to 9.10.1, the node upgraded
to the higher version remains in the state, "Waiting for reservations to
clear" and a giveback, automatic or manual, is not possible.
ONTAP 9.10.1
Allow user to
proceed with NSO
based controller
replacement if the
cluster has
unmirrored
aggregates
If a 4-node MetroCluster Configuration (MCC) FC cluster has any
9.10.1
unmirrored aggregates the controller replacement automation
command (system controller replace start) reports an error in precheck
only and does not proceed further.
ONTAP 9.8
NetApp Bugs Online Bug ID 1455547
To proceed with the controller replacement with unmirrored
aggregates. In this scenario user needs to follow below workaround to
ignore unmirrored aggregates and proceed with automation.
NetApp Bugs Online Bug ID 1436892
Encryption keys
might be lost if a key
manager is enabled
prior to configuring a
MetroCluster
environment
If a MetroCluster environment is configured on one cluster after the
ONTAP 9.7
Onboard Key Manager is enabled, the encryption keys might be lost. A and later
subsequent reboot of the node on this cluster might result in being
unable to bring encrypted volumes online. Also, if the MetroCluster
environment is configured after an external key manager has been
configured, the node might experience a disruption.
NetApp Bugs Online Bug ID 1360229
A mismatch of
Onboard Key
Manager hierarchy
keys can cause a
switchover and
switchback failure in
a MetroCluster
configuration
104
If one of the clusters in a MetroCluster environment is configured after
the Onboard Key Manager is enabled, the encryption keys might
become lost. A subsequent reboot of a node on this cluster might
result in the node being unable to bring encrypted volumes online
because the necessary encryption keys are inaccessible.
NetApp Bugs Online Bug ID 1378150
ONTAP 9.7
and later
Issue
Description
Broadcom BESIn a MetroCluster configuration that is configured with FAS2750/AFF
53248 switches
A220 and a Broadcom BES-53248 switch, the switch might report
might report CRC
CRC errors on the ports where the nodes are connected.
errors in
MetroCluster IP
configurations using
FAS2750/AFF A220
Adding ATTO
FibreBridge for inband monitoring fails
in two-node
MetroCluster fabricattached
configurations
Affecting…
ONTAP 9.7
ONTAP 9.6
When you attempt to add an ATTO FibreBridge for in-band monitoring ONTAP 9.7
in a two-node MetroCluster fabric-attached configuration, the storage through
bridge add command fails with the error entry doesn’t exist. ONTAP 9.7P8
NetApp Bugs Online Bug ID 1296893
ONTAP 9.6
through
ONTAP 9.6P11
ONTAP 9.5
through
ONTAP
9.5P15
Networking and security protocol issues
Issue
Description
Affecting…
Renaming the NFS
option allowidle-connection
to allow-idleconnectiontimeout
The NFS command option -allow-idle-connection that
manages idle connections can be misinterpreted. The option reads as
if it should allow connections to be idle but when it is enabled, it
actually removes idle connections.
ONTAP 9.12.1
NetApp Bugs Online Bug ID 1473241
TLS 1.1 disabled by TLS 1.1 is disabled by default for new installations of ONTAP.
default
Systems that are upgraded to ONTAP 9.12.0 and later that already
have TLS 1.1 enabled are not affected as the upgrade will leave TLS
1.1 in an enabled state.
ONTAP 9.12.0
When disabled by default, TLS 1.1 can be manually enabled as
needed.
105
Issue
Description
Affecting…
Race condition
during read
operations on clone
volumes might
cause storage
controller disruption
A race condition causes a read operation on a block for which
ONTAP 9.10.1
decompression is happening in parallel on a clone volume might not
realize that decompression is in progress. The system issues a disk
read operation and waits for it to complete which does not activate the
read operation that is waiting. As a result, the read operation does not
complete. When a subsequent activity runs on the system to free up
unused resources, it detects the incomplete read operation which
leads to a storage controller disruption.
NetApp Bugs Online Bug ID 1456747
Race condition
during read I/O
completion causes
storage system
controller disruption
After I/O activity is complete in RAID, the system frees up the buffer
that was used for the I/O operations. When the system is using up
resources meant for workflows, and if there is a shortage of these
internal resources, the system might use the freed-up buffer for
another I/O operation. When this occurs, due to a race condition, the
original I/O operation might tamper with this buffer and cause a
storage system controller disruption.
ONTAP 9.10.0
ONTAP 9.9.0
ONTAP 9.8
NetApp Bugs Online Bug ID 1391673
TLS 1.0 disabled by TLS 1.0 is disabled by default for new installations of ONTAP.
default
Systems that are upgraded to ONTAP 9.8 and later that already have
TLS 1.0 enabled are not affected as the upgrade will leave TLS 1.0 in
an enabled state.
ONTAP 9.8
When disabled by default, TLS 1.0 can be manually enabled as
needed.
Snapshot copy
restore of read-only
volumes to ONTAP
9.3 or earlier might
cause controller
disruption
On nodes running ONTAP 9.8 and later, when you perform a Snapshot ONTAP 9.8
copy restore to an earlier ONTAP release, the read-only volumes
through
might access buffers that are out of bounds on a private metafile and
ONTAP 9.8P4
might cause a controller disruption.
AFF A400 systems
with NS224 storage
fail to boot after
upgrade to ONTAP
9.8
AFF A400 all-flash storage system with NS224 storage fails to boot
after upgrade. This occurs when a X1122A 25 GbE network interface
card (NIC) installed in slot 5 triggers a software issue that prevents
ONTAP from seeing the 100 GbE onboard ports as valid Ethernet
storage ports for the NS224 storage shelves.
NetApp Bugs Online Bug ID 1391375
NetApp Bugs Online Bug ID 1276138
106
ONTAP 9.8
through
ONTAP 9.8P1
Issue
Description
Affecting…
AFF systems with
NS224 storage fail
to boot after
upgrade to ONTAP
9.8P2
On some AFF storage systems running ONTAP 9.8P2, when you
install X1122A or X91122A two-port 25 GbE network interface cards
(NICs) in a slot designated for optional Ethernet storage, the NICs
might fail to come online when you boot the system.
ONTAP 9.8P2
NetApp Bugs Online Bug ID 1386645
A250 e0a/e0b ports
might randomly
negotiate 1GB
speed when
connected to a
switch
On the link up event, the port negotiates various parameters including
supported speeds with the link partner. In a few cases, both parties
negotiate down to 1GB speed. To prevent this from happening,
manually set the speed at the switch port to 10GB.
ONTAP 9.8
and later
NetApp Bugs Online Bug ID 1328518
Controller disruption A controller disruption might occur after upgrading to ONTAP 9.8 if the
might occur after
autotune option is enabled for Cluster Session Manager (CSM) LAN
upgrading to ONTAP connections.
9.8
NetApp Bugs Online Bug ID 1396239
ONTAP 9.8
through
ONTAP 9.8P5
File system
metadata corruption
might cause system
controller disruption
ONTAP 9.8
through
ONTAP 9.8P4
ONTAP software contains code intended to collect root cause
information for a file system corruption. When the corruption occurs in
the filesystem metadata, ONTAP might cause a system controller
disruption.
NetApp Bugs Online Bug ID 1380489
ONTAP RPCs facing
significant slowdown
in speed due to
external DNS server
unresponsiveness
External DNS server is taking longer than usual to respond to user
requests for IP address name resolution. Due to this issue, ONTAP
remote procedure calls (RPCs) are experiencing a significant
slowdown in speed.
NetApp Bugs Online Bug ID 1321713
ONTAP 9.7
through
ONTAP
9.7P13
ONTAP 9.8
through
ONTAP 9.8P6
ONTAP 9.7
through
ONTAP
9.7P14
ONTAP 9.6
ONTAP 9.5
ONTAP upgrade
ONTAP upgrade might fail when "bootarg.abandon_varfs" set
might fail when
incorrectly
"bootarg.abandon_v
arfs" set incorrectly NetApp Bugs Online Bug ID 1351261
ONTAP 9.7
ONTAP 9.6
ONTAP 9.5
107
Issue
Description
Affecting…
Performing ONTAP
upgrade with OKM
in Common Criteria
mode causes
signature validation
failure
When you perform an ONTAP upgrade when the Onboard Key
Manager (OKM) is configured in the Common Criteria mode, the
signature validation fails.
ONTAP 9.7
and later
Ethernet ports e0a
and e0b never
transition to “up”
after a reboot or
storage failover and
never come online
AFF or FAS storage systems listed below might experience scenarios ONTAP 9.7P4
where Ethernet ports e0a and e0b fail to come up after maintenance
operations that require a reboot or storage failover. “Link down” events ONTAP 9.7P3
will be seen for e0a and e0b after the system reboots and link status
ONTAP 9.6P3
remains down. The issue applies to the following systems:
NetApp Bugs Online Bug ID 1342382
• AFF A300, AFF A220, AFF A200, and AFF C190
ONTAP 9.5P11
• FAS8200, FAS2750, FAS2720, FAS2650, and FAS2620
IDR enabled on
HDD aggregate
causes controller
disruption
When Inactive Data Reporting (IDR) is enabled on the HDD
aggregate, a background block temperature tracking system might fall
behind and accumulate high memory. This might lead to low available
memory and cause a controller disruption.
ONTAP 9.7
ONTAP 9.6
Storage resource management issues
Issue
Description
Affecting…
Auto adaptive
compression undo
on certain volumes
might leave incorrect
versioning for
indirect blocks
Auto adaptive compression undo on certain volumes might leave
ONTAP 9.10.1
incorrect versioning for indirect blocks when you perform an undo
operation by using the volume efficiency undo -auto
-adaptive-compression true command to remove auto adaptive
compression savings from a volume.
NetApp Bugs Online Bug ID 1434987
ONTAP 9.8 netappontap library fails to
compute URL for
resource with
integer key in its
path
108
When computing the URL for a resource with an integer parent key,
the ONTAP 9.8 version of the netapp-ontap library will raise an
exception with the following error message:
netapp_ontap.error.NetAppRestError: Could not
compute the location of the ExportRule collection.
ONTAP 9.8
Issue
Description
Affecting…
Platform controller
disruption might
occur during
SnapMirror transfers
When a platform workload is greater than what it can support, a
ONTAP 9.8
controller disruption might occur during transfers to a SnapMirror
through
destination. This might occur for platforms that have less than or equal ONTAP 9.8P1
to 16 CPU cores and a memory capacity less than or equal to 32 GB.
ONTAP 9.7
through
NetApp Bugs Online Bug ID 1273914
ONTAP 9.7P11
ONTAP 9.6
through
ONTAP
9.6P13
ONTAP 9.5
through
ONTAP
9.5P16
Low memory
platform controller
disruption during
heavy write traffic
When platforms that have less than or equal to 32 GB of system
memory and a workload greater than what it can support, a controller
disruption might occur due to mbuf exhaustion when the system
experiences heavy write operations.
NetApp Bugs Online Bug ID 1367621
ONTAP 9.8
through
ONTAP 9.8P2
ONTAP 9.7
through
ONTAP
9.7P12
ONTAP 9.6
Slow aggregate
online processes
during upgrade to
ONTAP 9.7
You might experience slow aggregate online processes when
ONTAP 9.8
upgrading from ONTAP 9.5 or 9.6 to ONTAP 9.7. This condition is
through
more likely to occur when upgrades involve large FlexCache volumes. ONTAP 9.8P4
NetApp Bugs Online Bug ID 1389313
Counter manager
threads might run
longer than
expected while
collecting statistics
which might cause
controller disruption
ONTAP 9.7
through
ONTAP
9.7P12
When the system performs the operation to collect and compute the
ONTAP 9.8
counter manager object wafl_suspend_latency, it takes longer than
through
expected and might cause the node to reboot unexpectedly. When this ONTAP 9.8P4
occurs, it might lead to a controller disruption.
ONTAP 9.7
through
NetApp Bugs Online Bug ID 1380870
ONTAP
9.7P15
109
Issue
Description
Affecting…
Kernel controller
disruption might
occur if the system
removes an object
store server
configuration
During an active I/O operation with the object store server, if the
system removes a store configuration, it might lead to a kernel
controller disruption. This issue occurs because NetApp ONTAP
performs the cleanup activities in the background.
ONTAP 9.8
through
ONTAP 9.8P6
ONTAP 9.7
NetApp Bugs Online Bug ID 1353818
ONTAP 9.6
Volume move issue
with FabricPools
vserver migrate not
supported
In ONTAP 9.7, the volume move operation copies cloud tier data to the ONTAP 9.7
destination performance tier on FabricPool source and destination
aggregates that are attached to the same bucket and were created in ONTAP 9.7P1
ONTAP releases earlier than 9.6.
ONTAP 9.7P2
This issue can sometimes cause data loss in the bucket by incorrectly
ONTAP 9.7P3
deleting objects that the destination volume is using.
NetApp Bugs Online Bug ID 1313762
ONTAP 9.6
through
ONTAP 9.6P8
Several versions of the Command Reference show man pages for the
vserver migrate family. This functionality is incorrectly listed and is not
supported.
ONTAP 9.5
ONTAP 9.4
ONTAP 9.3
System Manager issues
Issue
Description
Affecting…
NetApp Data
Availability Services
cannot be registered
with System
Manager
The NetApp Data Availability Services (NDAS) cloud registration
procedure is still included in System Manager, and the procedure is
documented in System Manager online help. However, the NDAS
product is no longer supported.
ONTAP 9.7
ONTAP 9.6
ONTAP 9.5
End of Availability: NetApp Data Availability Services
Unchanged initiators
are removed from
SAN initiator group
during edit
When editing a SAN initiator group, if you click SAVE without making
ONTAP 9.7
any changes, or if you modify the initiator group name or the host
through
operating system, but you do not make changes to any of the initiators, ONTAP 9.7P2
the editing operation removes the current list of initiators from the
initiator group.
NetApp Bugs Online Bug ID 1310602
110
Issue
Description
Affecting…
Upgrading a cluster If you are upgrading a cluster to ONTAP 9.7 with a local software
with a local software image upload from System Manager, you must resize the default
image upload from
staging directory size to 4 GB on all nodes in the cluster.
System Manager
NetApp Bugs Online Bug ID 1223866
ONTAP 9.6
through
ONTAP 9.6P6
System Manager
limitations for
SnapMirror restore
ONTAP 9.7
ONTAP System Manager does not support a SnapMirror restore to
either a read/write volume without common Snapshot copy or a nonempty DP volume.
ONTAP 9.5
through
ONTAP
9.5P10
NetApp Bugs Online Bug ID 1277399
Unable to create or
modify users with
custom roles
You cannot create or modify users with custom roles that are created
using the ONTAP CLI or the earlier version of ONTAP System
Manager.
ONTAP 9.7
NetApp Bugs Online Bug ID 1282268
Users with a custom When users with a custom role try to log in to System Manager, the
role cannot log in to launch might fail with an authentication error, or the login hangs.
System Manager
NetApp Bugs Online Bug ID 1231989
ONTAP 9.7
System Manager
performance graph
issue for adapters
supporting both FC
and NVMe/FC data
protocols
On the FC/FCoE and NVMe adapters page, the performance graph is
not plotted for its associated FC interfaces for adapters supporting
both FC and NVMe/FC data protocols. For adapters supporting both
FC and NVMe/FC data protocols, the performance graph is plotted
only for its associated NVMe interfaces.
ONTAP 9.4
through 9.7
Protection status
displays incorrectly
for volumes and
LUNs
The expanded view and detail view for volume or LUN inventories do
not display the correct protection status of a volume or a LUN.
ONTAP 9.7
System Manager
might not display
inactive data at the
FlexGroup level
ONTAP System Manager displays inactive data at the FlexGroup level ONTAP 9.6
only if all the constituents of the FlexGroup report inactive data.
and later
NetApp Bugs Online Bug ID 1272067
If any of the constituents in a FlexGroup do not have inactive data,
then System Manager cannot display the inactive data at the
FlexGroup level.
111
Changes to published ONTAP 9 documentation
The information in this section should be used in conjunction with the materials currently
published for the ONTAP 9 release.
New home for ONTAP product documentation
All ONTAP product documentation is available at this new site:
ONTAP 9 Documentation
Azure Key Vault commands are not supported with ONTAP
The Command Manual Page References for ONTAP 9.8 and ONTAP 9.9.1 incorrectly
include security key-manager external azure commands; that is, commands that support
Azure Key Vault (AKV). ONTAP does not support AKV, and the commands are applicable
only to Azure NetApp Files.
ONTAP platform mixing rules included in Hardware
Universe
The Software Storage Platform Mixing Rules for FAS and AFF systems, which was
previously published as a separate document, is included in the NetApp Hardware
Universe (HWU).
NetApp Hardware Universe
112
Where to find product documentation and other
information
You can access documentation for all NetApp products and find other product information
resources, such as technical reports and white papers on the Product Documentation
page of the NetApp corporate site.
Related information
NetApp Product Documentation
113
Copyright information
Copyright © 2023 NetApp, Inc. All Rights Reserved. Printed in the U.S. No part of this document covered by
copyright may be reproduced in any form or by any means—graphic, electronic, or mechanical, including
photocopying, recording, taping, or storage in an electronic retrieval system—without prior written permission
of the copyright owner.
Software derived from copyrighted NetApp material is subject to the following license and disclaimer:
THIS SOFTWARE IS PROVIDED BY NETAPP “AS IS” AND WITHOUT ANY EXPRESS OR IMPLIED
WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY
AND FITNESS FOR A PARTICULAR PURPOSE, WHICH ARE HEREBY DISCLAIMED. IN NO EVENT SHALL
NETAPP BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR
CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE
GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER
CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
(INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
NetApp reserves the right to change any products described herein at any time, and without notice. NetApp
assumes no responsibility or liability arising from the use of products described herein, except as expressly
agreed to in writing by NetApp. The use or purchase of this product does not convey a license under any
patent rights, trademark rights, or any other intellectual property rights of NetApp.
The product described in this manual may be protected by one or more U.S. patents, foreign patents, or
pending applications.
LIMITED RIGHTS LEGEND: Use, duplication, or disclosure by the government is subject to restrictions as set
forth in subparagraph (b)(3) of the Rights in Technical Data -Noncommercial Items at DFARS 252.227-7013
(FEB 2014) and FAR 52.227-19 (DEC 2007).
Data contained herein pertains to a commercial product and/or commercial service (as defined in FAR 2.101)
and is proprietary to NetApp, Inc. All NetApp technical data and computer software provided under this
Agreement is commercial in nature and developed solely at private expense. The U.S. Government has a nonexclusive, non-transferrable, nonsublicensable, worldwide, limited irrevocable license to use the Data only in
connection with and in support of the U.S. Government contract under which the Data was delivered. Except
as provided herein, the Data may not be used, disclosed, reproduced, modified, performed, or displayed
without the prior written approval of NetApp, Inc. United States Government license rights for the Department
of Defense are limited to those rights identified in DFARS clause 252.227-7015(b) (FEB 2014).
Trademark information
NETAPP, the NETAPP logo, and the marks listed at http://www.netapp.com/TM are trademarks of NetApp, Inc.
Other company and product names may be trademarks of their respective owners.
114