Automatically and asynchronously listen for new data as it arrives to your cloud storage
environment and continuously load it into Snowflake.
Legacy data warehouses can’t keep up
SE RVE RL E SS LOA D I N G W I T H O U T CO N T EN T I ON
No servers to manage and no impact to other workloads
thanks to unlimited concurrency.
Continuously generated data is the new norm. But the
mandatory batch loading of traditional on-premises and
cloud data warehouses impedes getting immediate insight
from all your data. These systems suffer from poor
performance, limitations on the size of data files ingested,
CO N T I N UOUS LOA D I N G, I M M ED I AT E I N S I G H T
Load data into Snowflake as it arrives to your cloud provider,
with up-to-the-minute frequency.
the additional steps required to first transform varying data
types, and the manual operations required to load data.
Loading data with Snowpipe
Snowpipe is a serverless ingestion service that uses a REST
NO MAN UAL E F FO RT R EQ U I R ED
API to asynchronously load new data into Snowflake as it
Automated loading with no need for manual COPY commands
thanks to a REST API + SDK.
arrives to your cloud storage environment. A comprehensive
SDK simplifies the process of interacting with the API. Once
initiated, Snowpipe doesn’t require any manual effort to run
and manage, and utilizes servers separate from the
F UL L SUP P ORT FO R S EM I -S T R U C T U R E D DATA
No transformation needed to load varying data types and no
tradeoff between flexibility and performance thanks to true
cloud elasticity.
customer environment to ensure workload isolation.
Customers only pay for the per-second server time they
use, keeping ingestion costs predictable and affordable.
Fresh data delivers fresh decisions
Z E RO MAN AGE M EN T
Data analysts need complete and updated data to see
No indexing, tuning, partitioning or vacuuming after
loading data.
new trends and identify opportunities. Data scientists
require recent data for developing accurate models.
Executives without up-to-the-minute data lack the context
to confidently make decisions and guide their organizations.
PAY ON LY FOR W H AT YO U U S E
Snowflake’s built-for-the-cloud solution scales storage separate
from compute, up and down, transparently and automatically.
Snowpipe delivers up-to-the-minute insights to make
informed decisions. What’s more, the contention-free
and zero-management experience frees resources
across the organization so you can focus on using data
rather than managing data.
|3
Traditional Data Warehouse Loading
Continuous Data Loading with Snowpipe
STAGING
MON. BATCH
S3
TUE. BATCH
SNOWPIPE
STALE DATA
SNOWFLAKE
.... BATCH
CONTINUOUSLY
GENERATED DATA
STAGED FILES ACCUMULATE IN BATCHES &
BATCHES ARE LOADED MANUALLY WITH COPY
CONTINUOUSLY
GENERATED DATA
FILES ARRIVE
IN S3
SNOWPIPE LOADS
DATA ON ARRIVAL
UP-TO-THEMINUTE DATA
Legacy vs. Modern Cloud Data Warehouse Loading
Traditional, batch-oriented loading for data warehouses requires data loading on a schedule, often at
off-peak times, to avoid contention with other workloads. This approach conflicts with the ideal
scenario, where data is loaded and available for analysis almost as soon as it is created.
C USTOM E R SUCC E S S
Spireon, a vehicle intelligence company and a Snowflake customer, has nearly four
million vehicles on its platform that gathers billions of events about its customers’
vehicle activity. “We have a constant stream of data we need to analyze in real time and
Snowpipe enables us to do just that. Spireon is a data-driven company and Snowpipe is
part of our platform that provides valuable insights to help our customers be more
efficient, better protected and more profitable.”
— Dave Withers, Director of Information Architecture, Spireon
Want to know more about the benefits of Snowflake's cloud data warehouse security? Read our eBook: Snowflake for sensitive data.
ABOUT SNOWFLAKE COMPUTING
Snowflake Computing is the only data warehouse built for the cloud. Snowflake delivers the performance, concurrency and
simplicity needed to store and analyze all data available to an organization in one location. Snowflake’s technology combines
the power of data warehousing, the flexibility of big data platforms, the elasticity of the cloud, and true data sharing at a
fraction of the cost of traditional solutions. Snowflake: Your data, no limits. Find out more at snowflake.net.
© 2017 Snowflake. All rights reserved.
www.snowflake.net #YourDataNoLimits
|4