Snowflake Fundamentals
Snowflake is a cloud data platform for storing, querying, sharing, and governing data. It separates stored data from the compute clusters that process work, so teams can run different workloads without sharing the same compute resources.
itData engineering and analytics | OpenSkills.info
Course pathWalk it in order
Look it upDip in anytime
Go furtherLeaves this page
Don't Panic
Don't Panic — Snowflake Fundamentals
Snowflake is a managed cloud data platform for storing data, running analytical work, controlling access, and sharing selected data with other accounts. It saves you from tending a database server, which is pleasant, but it does not save you from deciding who can do what or why a query is spending money. The machine has been hidden. The choices have not.
The important trick is separation of storage and compute. Your tables stay in Snowflake-managed storage while a virtual warehouse, a cluster that runs queries and loads, wakes up only to do work. This means an ingestion job and an interactive reporting job can use different compute. It also means suspending a warehouse does not make its data evaporate in a tasteful puff of cloud.
The other idea is context. A database contains schemas, and schemas hold objects such as tables and views. A role receives object privileges, then reaches users through role grants. The active role in a session decides which SQL actions are allowed. A query that fails is therefore often not being dramatic; it may be using the wrong role, database, schema, or warehouse.
Sharing changes the usual copy-everything instinct. A provider creates a share and a consumer creates a read-only database from it. The data is not copied into the consumer account, but the consumer still uses its own compute to query it. Governance and data contracts remain very much on the guest list.
Costs follow the same map: compute, storage, and data transfer are separate usage types. Warehouse size and running time matter, so auto-suspend, budgets, and resource monitors are operating controls rather than decorative switches. Bigger compute may finish earlier while consuming credits at a higher rate. The sensible response is measurement, not an argument with the settings page.
Read the Intro when you need the full architecture and the limits of the platform. Use Slides for the layer and sharing diagrams, Cheatsheet for the object, role, and cost vocabulary, and Reference for the official path into loading, access control, and cost controls. Then use the practice session with a small dataset: the system becomes less mysterious once a table survives a suspended warehouse.
Where this skill leads
Relevant careers
See how this topic contributes to broader role-level skill maps.
Sources
- https://docs.snowflake.com/en/user-guide/intro-key-concepts
Supports
- Snowflake as a managed cloud data platform
- Storage, compute, and cloud-services architecture
- Snowflake table storage and micro-partitions
- Independent virtual warehouses
- Loading and transformation feature overview
- Secure Data Sharing overview
- https://docs.snowflake.com/en/user-guide/warehouses
Supports
- Virtual warehouses as compute clusters
- Query, loading, and data manipulation operations requiring a warehouse
- Warehouse credit consumption while running
- https://docs.snowflake.com/en/user-guide/warehouses-overview
Supports
- Warehouse sizing, resizing, and multi-cluster capacity
- Per-second billing with a 60-second minimum after warehouse start
- https://docs.snowflake.com/en/guides-overview-db
Supports
- Databases as containers for schemas
- Schemas as containers for objects including tables and views
- https://docs.snowflake.com/en/user-guide/data-load-overview
Supports
- Bulk loading, Snowpipe, Snowpipe Streaming, stages, and loading documentation paths
- https://docs.snowflake.com/en/user-guide/security-access-control-overview
Supports
- Role-based access control, privileges, roles, users, and role hierarchies
- Active-role authorization for SQL actions
- Ownership and securable-object hierarchy
- https://docs.snowflake.com/en/user-guide/data-sharing-intro
Supports
- Provider and consumer sharing model
- Read-only databases created from shares
- No-copy behavior for shared data and consumer compute charges
- https://docs.snowflake.com/en/user-guide/cost-understanding-overall
Supports
- Compute, storage, and data-transfer cost categories
- Virtual warehouse, serverless, and cloud-services compute
- Storage and egress cost concepts
- https://docs.snowflake.com/en/user-guide/cost-controlling
Supports
- Budgets and resource monitors
- Warehouse suspension at resource-monitor thresholds
- https://docs.snowflake.com/en/developer-guide/snowflake-cli/index
Supports
- Snowflake CLI as an open-source developer and SQL operations tool
- https://github.com/Hiflylabs/awesome-dbt
Supports
- dbt and SQLFluff as ecosystem resources selected from a curated awesome list
- https://docs.getdbt.com/
Supports
- dbt project documentation
- https://sqlfluff.com/
Supports
- SQLFluff project documentation
- https://docs.snowflake.com/en/user-guide/tutorials/snowflake-in-20minutes
Supports
- Creating a database, table, and virtual warehouse for a disposable lab
- Warehouse auto-resume and object-context checks
- https://docs.snowflake.com/en/sql-reference/sql/create-warehouse
Supports
- CREATE WAREHOUSE syntax and warehouse state options
- https://d18rn0p25nwr6d.cloudfront.net/CIK-0001640147/1d54641e-71e3-4a96-8f44-0a4aa7252618.pdf
Supports
- Snowflake incorporation in July 2012
- Corporate rename to Snowflake Inc. in April 2019
- https://www.snowflake.com/en/blog/behind-snowflakes-name/
Supports
- Snowflake public identity in October 2014
- https://www.snowflake.com/wp-content/uploads/2019/06/Snowflake_SIGMOD.pdf
Supports
- Published elastic data warehouse architecture
- Separation of storage, compute, and services
- https://www.snowflake.com/en/blog/snowflake-connector-for-azure-data-factory-adf/
Supports
- General availability of Snowflake on Microsoft Azure in September 2018
- https://www.snowflake.com/en/blog/5-reasons-why-i-joined-snowflake-after-google/
Supports
- Google Cloud Platform private preview in November 2019
- https://investors.snowflake.com/files/doc_financials/2023/q4/0d4be772-30ac-4017-a78b-a5eaa081840e.pdf
Supports
- Snowflake Class A common stock began trading on the NYSE in September 2020
- https://www.snowflake.com/en/developers/guides/getting-started-with-snowpark-dataframe-api/
Supports
- Snowpark public preview at Snowflake Summit 2021
- https://www.snowflake.com/en/news/press-releases/snowflake-disrupts-application-development-with-general-availability-of-snowpark-for-python-native-streamlit-support-and-more-2/
Supports
- General availability of Snowpark for Python in November 2022
- https://www.snowflake.com/
Supports
- Snowflake platform placement in the product landscape
- https://www.databricks.com/
Supports
- Databricks placement in the product landscape
- https://cloud.google.com/bigquery
Supports
- Google BigQuery placement in the product landscape
- https://aws.amazon.com/redshift/
Supports
- Amazon Redshift placement in the product landscape
- https://azure.microsoft.com/products/synapse-analytics
Supports
- Azure Synapse Analytics placement in the product landscape
- https://www.getdbt.com/product/dbt-cloud
Supports
- dbt Cloud placement in the product landscape
