openskills.info
← Analytics Engineer career guide

Data and AI

Analytics Engineer timeline

How the field of a Analytics Engineer got here: the sourced milestones from every published course of this career, on one axis.

1786 to 2025

212 milestones across 23 courses

  • Core
  • Supporting
  • Specialization

The axis stretches toward recent years, where most milestones fall. Bars count milestones per year; dots are single milestones.

Before 1990

19 milestones

  1. 1786

    Playfair publishes The Commercial and Political Atlas

    William Playfair used statistical graphics to present commercial and political data. The work established charts as a form for comparing quantitative change and magnitude.

  2. 1855

    Snow's cholera map appears in the St James report

    The report included a map of cholera cases around the Broad Street pump. It made spatial distribution part of an argument about a public-health question.

  3. 1869

    Minard publishes the map of Napoleon's Russian campaign

    Charles Joseph Minard combined geographic position, army size, direction, and temperature in one statistical graphic. It remains a reference for combining several variables without treating a chart as decoration.

  4. 1924 May

    Shewhart proposes the control chart

    Walter Shewhart's Bell Laboratories memorandum introduced a chart for separating stable process variation from signals of special causes.

  6. 1958

    Luhn publishes A Business Intelligence System

    Hans Peter Luhn published A Business Intelligence System. It explored using technology to gather intelligence and provided an early technical framing for information that guides action.

  7. 1967

    Bertin publishes Semiology of Graphics

    Jacques Bertin described visual variables and their use in graphic representation. The work gave later visualization practice a vocabulary for marks and visual encodings.

  8. 1970

    Codd defines the relational model

    E. F. Codd published A Relational Model of Data for Large Shared Data Banks. The model established the relational structures and operations that later became the basis for analytical data storage and SQL querying.

  9. 1970

    Codd publishes the relational model

    Edgar F. Codd proposed organizing shared data as relations and separating logical structure from physical storage concerns. The work made declarative relationships and constraints central design ideas.

  10. 1971

    CODASYL publishes the DBTG report

    The Database Task Group documented the network database approach, which made record and set relationships explicit in navigational designs. It became an important contrast for later relational modeling.

  11. 1976

    Chen formalizes entity-relationship modeling

    Peter Chen published the entity-relationship model as a way to represent entities and their relationships at a conceptual level. ER notation gave modeling a domain-facing design language before physical implementation.

  13. 1977

    Tukey publishes Exploratory Data Analysis

    John Tukey presented exploratory data analysis as a way to use displays to investigate data before formal conclusions. This reinforced the distinction between exploratory and communicative views.

  15. 1983

    Tufte publishes The Visual Display of Quantitative Information

    Edward Tufte collected principles and examples for displaying quantitative information. The book made graphical integrity and information-dense displays central topics in visualization design.

  16. 1986

    ANSI publishes SQL-86

    ANSI published the first SQL standard. A standard core gave database products a common reference point even as their dialects continued to differ.

  17. 1986

    ANSI publishes the first SQL standard

    SQL became a published standard for relational database language. Modeling decisions about tables, keys, and constraints could increasingly be expressed across vendor implementations.

  18. 1987

    ISO publishes ISO/IEC 9075

    ISO adopted SQL as ISO/IEC 9075. The paired ANSI and ISO work made SQL an international database-language standard.

  19. 1989

    Business intelligence becomes a decision-support umbrella term

    Howard Dresner used business intelligence for concepts and methods that improve business decisions with fact-based support systems. The term brought data warehousing, reporting, and analysis into a recognizable practice area.

1990s

10 milestones

  1. 1990

    Codd publishes The Relational Model for Database Management

    Codd's later book brought relational concepts and their interpretation together for database management practice. It reinforced the distinction between the model's meaning and a particular storage implementation.

  2. 1992

    Building the Data Warehouse frames the discipline

    Bill Inmon's book established a named body of warehouse architecture and historical decision-support practice.

  3. 1992

    SQL-92 expands the standard

    ANSI and ISO published the revision commonly called SQL-92. It became a long-lived baseline for the portable syntax developers still recognize.

  4. 1992 Jan

    Balanced Scorecard introduced in Harvard Business Review

    Kaplan and Norton presented a framework that balanced financial measures with customer, internal-process, and learning perspectives. Executive reporting gained a broader structure than financial results alone.

  6. 1996

    The Data Warehouse Toolkit advances dimensional modeling

    Ralph Kimball published The Data Warehouse Toolkit. Its dimensional-design techniques gave practitioners a practical structure for facts, dimensions, grain, and query-centered decision support.

  7. 1996

    The Data Warehouse Toolkit popularizes dimensional modeling

    Ralph Kimball's toolkit put fact tables, dimensions, and star schemas at the center of a practical modeling approach.

  8. 1997

    Kimball describes dimensional modeling for warehouses

    Ralph Kimball contrasted entity-relationship models for transaction capture with dimensional models for end-user analysis. Facts, dimensions, and grain became a practical vocabulary for analytical design.

  10. 1999

    SQL:1999 adds object and procedural features

    SQL:1999 added features including recursive queries and standardized procedural extensions. It widened SQL beyond basic table queries while retaining the relational core.

2000s

21 milestones

  1. 2000

    Data Vault modeling is released publicly

    Dan Linstedt released Data Vault as another approach to historical, auditable integration from changing source systems.

  3. 2003

    Google File System paper published

    Google documented a distributed file system designed for large data-intensive applications. The paper made storage behavior a first-class concern in large-scale data processing designs.

  4. 2003

    SQL:2003 standardizes window functions

    SQL:2003 added window functions and SQL/XML work. Window functions made ranking and calculations across related result rows part of standard SQL practice.

  6. 2003

    Tableau is founded from Stanford research

    Tableau was founded from a computer science project that developed VizQL to translate drag-and-drop visual expressions into data queries.

  7. 2003

    Tableau turns visual querying into a commercial BI product

    Tableau was founded to turn the Polaris research prototype into Tableau Desktop. Its VizQL approach translated drag-and-drop visual interactions into data queries, widening access to interactive analysis.

  8. 2004

    MapReduce paper published

    Google described a programming model and implementation for processing large datasets on clusters. It separated map and reduce work into a reusable distributed processing pattern.

  9. 2005

    Wilkinson publishes The Grammar of Graphics

    Leland Wilkinson described graphics as composable elements rather than a fixed menu of chart types. This model informed declarative charting systems that separate data, transformations, marks, scales, and guides.

  10. 2006

    Bigtable paper published

    Google described a distributed storage system for structured data. The design connected large-scale storage with tables, schemas, and application-facing access patterns.

  11. 2006

    Google publishes Bigtable

    Bigtable described a distributed system for structured data organized around a sparse, multidimensional sorted map. It showed how large-scale storage designs could use a data model unlike conventional relational tables.

  12. 2006

    Information Dashboard Design published

    Stephen Few's book formalized dashboard design around rapid monitoring and effective visual communication. It gave practitioners a focused reference for reducing clutter and strengthening comparisons.

  13. 2006 Mar 14

    Amazon S3 launches

    Amazon S3 made web-scale object storage available through an API. Object storage later became a common durable layer beneath cloud data lakes.

  14. 2007

    Amazon publishes Dynamo

    Dynamo described a highly available key-value store built around partitioning and replication. Its design highlighted how access patterns and failure behavior shape data structure choices in distributed systems.

  15. 2008 Jan

    Hadoop became an Apache top-level project

    Apache created the Hadoop Project Management Committee when Hadoop moved out of Lucene. Hadoop became an independently governed open-source platform for distributed storage and processing.

  16. 2008 Jan

    Hadoop becomes an Apache top-level project

    Apache Hadoop moved from Lucene to become an Apache top-level project. Its distributed storage and batch-processing ecosystem shaped early large-scale data-lake practice.

  17. 2008 Dec

    Isolation Forest reframes anomaly detection

    Isolation Forest isolated anomalies with random feature splits rather than first constructing a profile of normal observations.

  18. 2008 Dec 11

    WCAG 2.0 becomes a W3C Recommendation

    WCAG 2.0 established durable web accessibility requirements that also apply to browser-delivered reports, controls, charts, and status cues.

  19. 2009

    Development starts at Yandex

    Alexey Milovidov and team begin an experimental project to generate analytical reports in real time from non-aggregated data, initially as a filter and aggregation operator for web-scale log data.

  21. 2009 Nov

    PowerPivot previews become available

    Microsoft released PowerPivot previews for Excel 2010 and SharePoint 2010, combining in-memory personal modeling with managed browser sharing.

2010s

87 milestones

  1. 2010

    Dremel demonstrates interactive analysis at web scale

    Google's Dremel paper described a distributed system for interactive analysis of nested data, influencing later large-scale SQL services.

  2. 2010

    Dremel paper published at VLDB

    The Dremel paper described interactive analysis of web-scale datasets through a columnar, multi-level execution tree, publishing the architecture that BigQuery's query engine follows.

  3. 2010 Feb

    Tableau Public launches

    Tableau 5.1 added a free service for publishing interactive visualizations and public data to the web, creating a public learning and storytelling surface.

  5. 2011

    BigQuery becomes generally available

    BigQuery made a serverless cloud warehouse available, moving capacity management away from the team submitting analytical SQL.

  6. 2011

    SQL:2011 adds temporal features

    SQL:2011 added temporal database features. The standard gained a common way to express time-aware data and queries.

  7. 2011 Feb

    D3 version 1.0 is released

    D3 made data-driven document manipulation available as a web visualization library. It enabled authors to bind data to web standards while retaining direct control over marks and interaction.

  9. 2012

    Launch powering Yandex.Metrica

    After three years of development ClickHouse launches in production to power Yandex.Metrica, the second-largest web analytics platform, whose reports it serves from non-aggregated data.

  10. 2012

    Presto development begins at Facebook

    Engineers began Presto to support low-latency interactive analytics over a large Hadoop warehouse. The project established the distributed SQL model inherited by Trino.

  12. 2013

    Spark moved to Apache

    Spark moved to the Apache Software Foundation after its early open-source development. This placed the processing engine in the same open-source governance ecosystem as many data infrastructure projects.

  13. 2013 Feb

    Amazon Redshift becomes broadly available

    Redshift made a managed, petabyte-scale AWS warehouse broadly available for SQL analysis through existing BI tools.

  14. 2013 Apr

    PROV-O becomes a W3C Recommendation

    PROV-O standardized a vocabulary for representing provenance. It gave governance implementations a common model for entities, activities, and agents behind data.

  15. 2013 Jul

    Power BI for Office 365 is introduced

    Microsoft named a cloud self-service BI offering that combined Excel modeling and visualization tools with Office 365 publishing and collaboration.

  16. 2013 Jul 8

    Microsoft details Power BI for Office 365

    Microsoft described browser and mobile access to reports built from Excel-based modeling and visualization components. Cloud distribution became part of the mainstream BI design path.

  17. 2013 Sep

    Streaming inserts arrive

    Release notes added streaming inserts and time-based table decorators, letting rows enter BigQuery continuously instead of through load jobs alone.

  18. 2013 Nov

    Presto is released as open source

    Facebook announced the open-source release of Presto. The project could then be adopted and extended outside its original environment.

  19. 2014

    DCAT is standardized by W3C

    The first Data Catalog Vocabulary recommendation established a shared vocabulary for dataset and data-service metadata. Catalog interoperability became a standards concern rather than a local schema choice.

  20. 2014 Jan

    DCAT becomes a W3C Recommendation

    The first Data Catalog Vocabulary Recommendation standardized how catalogs describe datasets for Web publishing and aggregation.

  21. 2014 Mar

    Pricing overhaul lowers rates and adds reserved capacity

    BigQuery changed its pricing model, lowering rates and adding reserved capacity pricing, the first step toward the capacity model that later editions formalize.

  22. 2014 May

    Spark 1.0 released

    Apache training material records Spark 1.0 in May 2014. A production-ready Spark release broadened the practical choice of engines for batch and stream-oriented workloads.

  23. 2014 Oct

    Snowflake describes a warehouse built for the cloud

    Snowflake documented a cloud-built warehouse architecture with independently sized virtual warehouses for different workloads.

  24. 2014 Oct

    Snowflake publicly introduces its name

    A company blog post explained the Snowflake name in October 2014. It documents the platform's early public identity before its later multi-cloud expansion.

  25. 2015

    Vega presents a declarative visualization grammar

    Vega defined a JSON-based grammar for describing visual appearance and interactive behavior. It made data, transformations, scales, guides, and marks explicit parts of a specification.

  26. 2015 Apr

    Tableau 9 adds Data Interpreter and analytical features

    Tableau 9 introduced integrated cleanup for cross-tab spreadsheets along with changes to maps, analytics, and query performance.

  28. 2015 Jun

    The elastic data warehouse design is published

    The Snowflake team published its elastic data-warehouse architecture at SIGMOD. The paper documented the storage, compute, and services separation that remains central to the course's mental model.

  29. 2015 Jul

    The new Power BI reaches general availability

    The Power BI service and Power BI Desktop established the current split between local report authoring and cloud distribution.

  30. 2015 Jul 24

    The new Power BI service and Desktop reach general availability

    Microsoft released the new Power BI service and Power BI Desktop. The release combined cloud-hosted distribution with a desktop authoring tool for reports and dashboards.

  31. 2015 Jul 24

    The new Power BI service reaches general availability

    Microsoft released the redesigned service and Power BI Desktop for general use. Reports, dashboards, semantic models, and custom visuals formed a broadly available reporting stack.

  32. 2016

    dbt launches

    dbt launches as an open-source tool for analytics transformation. The project frames analytic code as software that can be version-controlled and shared.

  33. 2016

    Released under the Apache 2.0 license

    ClickHouse is released as an open-source project under the Apache 2.0 license, turning an internal analytics backend into a database other companies can run.

  34. 2016

    SQL:2016 adds JSON support

    SQL:2016 incorporated JSON-related features. Relational databases could standardize some work with semi-structured values without abandoning tables, constraints, and joins.

  35. 2016

    Uber develops Hudi

    Uber developed Hudi to address inefficient snapshot-and-reload processing and to support incremental updates in its data lake.

  36. 2016 Feb

    Apache Beam entered incubation

    Google and partners moved Cloud Dataflow SDKs and runners into the Apache Beam Incubator. The project centered one programming model across batch and streaming pipelines.

  37. 2016 Feb

    Enterprise gateway reaches general availability

    The managed gateway gave the Power BI service a centralized route to supported on-premises sources for refresh and live connections.

  40. 2016 Apr

    GDPR is adopted

    Regulation EU 2016/679 set a common European framework for personal-data processing. Governance programs needed to connect processing decisions to accountable roles and controls.

  41. 2016 Jun

    Standard SQL enters beta with IAM and time partitioning

    An ANSI-compliant Standard SQL dialect entered beta alongside fine-grained IAM roles and native time partitioning, removing the need for manually date-suffixed tables.

  42. 2016 Jul

    dbt development begins

    dbt development began in 2016, bringing versioned SQL modeling, testing, and documentation practices into warehouse transformation.

  43. 2016 Aug

    Tableau 10 expands cross-database analysis

    Tableau 10 added cross-database joins, data-source filtering, clustering, and revised authoring defaults for analysts combining more varied sources.

  44. 2016 Sep

    Standard SQL reaches general availability with DML and flat-rate pricing

    Standard SQL became generally available with INSERT, UPDATE, and DELETE support, and flat-rate pricing offered unlimited querying for a fixed monthly price.

  45. 2016 Dec

    Apache Beam graduated as a top-level project

    Apache Beam graduated from incubation in December 2016. The project established a community-governed model for engine-independent pipeline definitions.

  47. 2017

    Uber open-sources Hudi

    Uber released Hudi as open source after developing it for incremental data processing. The project introduced a table-oriented approach to lake data before the lakehouse label became widespread.

  48. 2017

    Vega-Lite research paper is published

    Vega-Lite introduced a higher-level grammar for interactive graphics. It showed how encoding rules and composition can express layered and multi-view displays concisely.

  49. 2017 May

    Apache Beam 2.0 became the first stable release

    Apache Beam published version 2.0.0 as its first stable release. The release signaled API stability for teams building portable batch and streaming pipelines.

  51. 2017 Jun

    Power BI Report Server adds an on-premises publication path

    Report Server allowed Power BI reports to be published and viewed within customer-managed infrastructure alongside the Power BI Premium offering.

  52. 2017 Aug

    AWS Glue Data Catalog generally available

    AWS Glue GA included a managed Data Catalog that crawlers populate for search, ETL, and AWS analytics services.

  53. 2017 Sep

    First public architecture writing

    Yandex publishes the account of Metrica's storage evolution from MyISAM through Metrage and OLAPServer to ClickHouse, the narrative this course uses for the problem the engine exists to solve.

  54. 2018

    dbt 0.10 adds package management

    Version 0.10 introduces a package manager for sharing reusable analytic code. This makes project composition a first-class part of dbt practice.

  56. 2018

    Original creators leave Facebook

    The original creators left Facebook and formed an independent community around PrestoSQL. This created the project line that later became Trino.

  57. 2018 Jan

    Hyper becomes the Tableau extract engine

    Tableau 10.5 introduced Hyper for extract ingest and analytical query processing, moving existing extracts toward the Hyper format during refresh.

  58. 2018 Apr

    Tableau Prep becomes available

    Tableau Prep added a coordinated visual flow, profile, and data grid for cleaning, combining, and reshaping data before workbook analysis.

  59. 2018 May

    GDPR becomes applicable

    The regulation began applying across EU Member States. Organizations needed operational evidence for privacy decisions, not only written policies.

  60. 2018 Jun 5

    WCAG 2.1 becomes a W3C Recommendation

    WCAG 2.1 added guidance addressing more mobile, low-vision, and cognitive accessibility needs. Dashboard testing expanded beyond a desktop mouse-and-screen workflow.

  62. 2018 Aug

    Large-scale declarative data verification is demonstrated

    A production-oriented system translated reusable data quality constraints into aggregate queries and supported incremental validation.

  63. 2018 Sep

    Presto SQL on Everything documents the engine

    The paper described the distributed coordinator and worker architecture, connectors, query planning, resource management, and fault-tolerance tradeoffs in production Presto.

  64. 2018 Sep

    Snowflake becomes generally available on Azure

    Snowflake announced general availability on Microsoft Azure on September 26, 2018. This extended the platform beyond its earlier AWS deployment.

  66. 2018 Nov

    Composite models become generally available

    A semantic model could combine Import and DirectQuery sources, making storage mode a per-model design tradeoff instead of a single global choice.

  67. 2018 Nov 16

    Iceberg enters the Apache Incubator

    The project began incubation at the ASF after originating at Netflix. Public community development of the open table format started under incubator governance.

  68. 2019

    dbt 0.13 adds source freshness checks

    dbt Core adds source freshness checks in version 0.13. Teams can then distinguish stale upstream inputs from transformation failures.

  70. 2019 Jan

    Airflow becomes an Apache top-level project

    Apache Airflow graduated from the Incubator and became a top-level project. The project then operated with its own Apache project governance and release process.

  71. 2019 Jan

    Hudi enters the Apache Incubator

    Uber submitted Hudi to the Apache Incubator. The move placed a transactional data-lake project under Apache community governance.

  72. 2019 Feb

    Delta Lake becomes generally available

    The February platform release recorded Delta Lake general availability, making reliable table behavior a standard platform capability.

  73. 2019 Apr

    Delta Lake is announced as open source

    Databricks announced the Delta Lake open-source project. The table layer became available outside its original managed platform context.

  77. 2019 May

    BigQuery ML reaches general availability

    BigQuery ML exited beta, making SQL-native model creation and prediction a supported part of warehouse practice.

  78. 2019 May 20

    Data mesh article asks data products to state their guarantees

    Zhamak Dehghani's article on moving beyond a monolithic data lake proposed domain-owned data products, each defining its integrity as a set of service level objectives and publishing schemas. It framed data as a product with explicit promises to consumers.

  79. 2019 Jun

    Federal Data Strategy framework is issued

    The United States issued a government-wide framework for managing federal data. It placed ethical governance, accountability, and implementation practices in a long-term strategy.

  80. 2019 Jun 23

    Table specification moves onto ASF infrastructure

    The Iceberg specification was migrated to git and the ASF site. The format contract became an openly versioned community artifact rather than a company-only document.

  81. 2019 Aug

    Dictionary blocks improve UNNEST processing

    A Trino engineering change used dictionary blocks for UNNEST output. It reduced CPU and allocation work for the tested operator workload.

  82. 2019 Aug

    Salesforce completes its Tableau acquisition

    Tableau became part of Salesforce, linking its analytics platform to a wider customer and application ecosystem.

  83. 2019 Sep

    Federal agencies establish Data Governance Bodies

    The Federal Data Strategy required inclusive and empowered governance bodies. Authority, chartering, and senior participation became concrete operating requirements.

  85. 2019 Oct 25

    First incubating binary release 0.7.0

    The project shipped 0.7.0-incubating with source and convenience binaries. Downstream engines could depend on a numbered Apache release artifact.

  86. 2019 Nov

    Azure Synapse unifies warehouse and big-data analytics

    Microsoft introduced Azure Synapse as the next evolution of Azure SQL Data Warehouse, combining warehouse and broader analytics workloads.

  87. 2019 Nov

    Snowflake enters Google Cloud private preview

    Snowflake reported a private preview on Google Cloud Platform in November 2019. The move continued the platform's multi-cloud direction.

2020s

75 milestones

  1. 2020 Jan

    NIST publishes Privacy Framework version 1.0

    NIST released a privacy-risk framework for enterprise risk management. It connected data-processing decisions with privacy risk.

  2. 2020 Feb

    DCAT 2 becomes a W3C Recommendation

    DCAT 2 revised the catalog vocabulary after implementation experience and new use cases. It extended the standards path for metadata exchange.

  3. 2020 Feb

    DCAT 2 Recommendation published

    DCAT 2 expanded the vocabulary for data services and broader catalog resource patterns beyond the original dataset-focused model.

  4. 2020 Mar

    Storage Read API becomes generally available

    The high-throughput, parallelizable read API over BigQuery storage reached GA, letting engines such as Spark and TensorFlow read warehouse data directly.

  5. 2020 Mar

    Version 20.3 releases

    The 20.3 LTS release continues the versioned release cadence that ClickHouse still follows, anchoring the era when the open-source project's adoption broadened beyond Yandex.

  6. 2020 May

    Next-generation streaming becomes generally available

    A rewritten streaming path delivered seconds-level availability of streamed rows and removed the warm-up delay of the original streaming implementation.

  7. 2020 May

    Relationships reshape multi-table data modeling

    Tableau 2020.2 introduced logical relationships that preserve table detail and combine relevant tables in the context of each view.

  8. 2020 May 20

    Iceberg graduates as a top-level project

    The project left the Incubator. Governance and releases continued as an Apache top-level project for the table format.

  9. 2020 Jun 4

    Apache Hudi becomes a top-level project

    The Apache Software Foundation announced Hudi as a top-level project. Its maturation reflected sustained adoption of transactional capabilities over data-lake storage.

  10. 2020 Jul

    Airbyte started

    Michel Tricot and John Lafleur began building Airbyte as an open-source data integration project. The goal was to replace hand-written per-source extraction code with reusable connectors.

  11. 2020 Jul

    BigQuery Omni announced

    Omni extended BigQuery queries to data in Amazon S3 and Azure Blob Storage by running the engine in the other cloud, with no cross-cloud data movement.

  12. 2020 Sep

    Deployment pipelines become generally available

    Power BI Premium gained managed development, test, and production stages for promoting content while retaining environment-specific connections.

  13. 2020 Sep

    First public release on GitHub

    Airbyte published version 0.1 with three source connectors and two destination connectors. It established the connector-plus-platform split the product still uses.

  14. 2020 Sep

    Snowflake begins trading on the NYSE

    Snowflake's Class A common stock began trading on the New York Stock Exchange on September 16, 2020. The IPO made the company publicly traded.

  16. 2020 Dec

    Airflow 2.0 releases

    Airflow 2.0 introduced the TaskFlow API, scheduler high-availability work, and separately released provider packages. Dag authors could use decorated Python functions while deployments selected providers for external systems independently of core.

  17. 2020 Dec

    PrestoSQL is renamed Trino

    The PrestoSQL project adopted the Trino name. The rename retained the project and community while separating its identity from Presto.

  18. 2020 Dec

    The UK Government Data Quality Framework is published

    The framework organized operational data quality around completeness, uniqueness, consistency, timeliness, validity, accuracy, and user needs.

  19. 2021 Jan

    The lakehouse architecture is published at CIDR

    The CIDR paper defined a lakehouse as data-lake files plus a metadata, caching, and indexing layer. It connected transaction and versioning mechanisms with SQL, data-science, and machine-learning workloads.

  20. 2021 Jan 3

    Release 351 is published

    Release 351 was published as an early Trino release. Its release notes record the continuing release stream after the rename.

  21. 2021 Mar

    Seed funding

    Airbyte raised a 5.2 million dollar seed round led by Accel. The funding supported building the core team and connector catalog.

  22. 2021 Mar 12

    Shopify documents CDC coupling consumers to internal models

    Shopify's engineering blog described its move to log-based change data capture and named its main drawback: external consumers become tightly coupled to the source's internal data model, so breaking changes spread into every consumer.

  23. 2021 Apr 8

    Andrew Jones proposes data contracts

    Writing about GoCardless, Andrew Jones proposed that producers emit events designed for consumers, with a strongly defined schema that is documented, versioned, and protected from breaking changes. He called that schema a data contract.

  24. 2021 May

    Unity Catalog is introduced

    Databricks introduced Unity Catalog for fine-grained governance of data and artificial intelligence assets across workspaces.

  25. 2021 May 25

    Series A funding

    Airbyte announced a 26 million dollar Series A led by Benchmark. The round funded development toward a hosted service.

  26. 2021 Jun

    Fishtown Analytics becomes dbt Labs

    Fishtown Analytics rebrands as dbt Labs while continuing to develop dbt and its commercial offerings. The name aligns the company with the tool and analytics engineering practice.

  27. 2021 Jun

    Snowpark enters public preview

    Snowflake announced Snowpark in public preview during the 2021 Snowflake Summit. It extended development beyond SQL with DataFrame-style programming executed in Snowflake.

  28. 2021 Jun

    Table snapshots enter preview

    Table snapshots offered low-cost, read-only point-in-time copies of tables, turning audit and restore patterns into a built-in feature; they reached GA the same October.

  30. 2021 Sep

    ClickHouse, Inc. incorporates and raises

    ClickHouse, Inc. incorporates in Delaware with an initial $50M investment from Index Ventures and Benchmark, followed in October by a $250M Series B at a $2B valuation.

  31. 2021 Oct

    Airflow 2.2 releases

    Airflow 2.2.0 released as the project continued the 2.x series. The release history records it as the 2021 major release before the later data-aware scheduling work.

  32. 2021 Oct

    Comcast publishes JVM production lessons

    A production report connected uneven task CPU time and JVM compilation behavior to slow queries. It demonstrated why worker-level observations matter alongside SQL plans.

  33. 2021 Oct

    Storage Write API becomes generally available

    The stream-based write API with exactly-once delivery semantics reached GA, replacing the legacy streaming path for high-throughput ingestion.

  35. 2021 Dec 17

    Series B funding

    Airbyte closed a 150 million dollar Series B led by Altimeter Capital and Coatue Management, at a reported 1.5 billion dollar valuation.

  36. 2022

    Cloud service early access opens

    The company launches the early access program for its managed cloud service, opening the storage-and-compute management layer that ClickHouse Cloud automates today.

  37. 2022 Apr

    BigLake unifies lakes and warehouses

    BigLake launched with tables over GCS, S3, and Azure storage, enforcing fine-grained security consistently across BigQuery and open-source engines.

  38. 2022 Apr 7

    Airbyte Cloud and the Grouparoo acquisition

    Airbyte launched its hosted Cloud service and acquired Grouparoo, an open-source reverse-ETL company, adding a path to send warehouse data back out to operational tools.

  39. 2022 Jul 16

    0.14.0 adds REST catalog client and branching metadata

    Release 0.14.0 introduced a common REST catalog client with change-based commits and metadata APIs for table branches and tags. Catalog interoperability and named refs became first-class project features.

  40. 2022 Aug

    Unity Catalog reaches general availability

    Unity Catalog became generally available, making its governed namespace and access model a stable platform foundation.

  41. 2022 Aug 22

    The Rise of Data Contracts

    Chad Sanderson described production database schemas used by ELT and CDC tools as non-consensual APIs and presented data contracts as API-like agreements between service engineers and data consumers.

  42. 2022 Sep

    Airflow 2.4 introduces data-aware scheduling

    Airflow 2.4.0 released as the project's data-aware release. It made dataset-based scheduling a first-class direction alongside time-based schedules.

  43. 2022 Oct

    dbt Semantic Layer enters public preview

    dbt announces a Semantic Layer public preview for defining metrics in code and serving them to downstream tools. dbt projects begin to extend from transformation definitions toward governed metric definitions.

  44. 2022 Nov

    Snowpark for Python reaches general availability

    Snowflake announced general availability of Snowpark for Python in November 2022. This gave Python workloads a supported path to run near data on the platform.

  45. 2022 Nov 3

    1.0.0 guarantees public API stability

    The 1.0.0 release committed to semantic versioning for the public iceberg-api module. Integrators could treat the Java API as stable across 1.x.

  46. 2022 Nov 28

    1.1.0 exposes branches and tags to engines

    Release 1.1.0 let Spark and related paths read and write named branches and tags. Write-audit-publish style workflows moved from metadata API only into engine-facing operations.

  47. 2023

    ISO publishes the 2023 SQL framework edition

    ISO/IEC 9075-1:2023 published the sixth framework edition and references SQL property graph queries as part of the standard family. SQL continues to grow through coordinated parts rather than one vendor's dialect alone.

  48. 2023 Mar

    BigQuery editions replace flat-rate pricing

    Three compute tiers, Standard, Enterprise, and Enterprise Plus, introduced capacity-based pricing with autoscaling and per-second slot billing, closing flat-rate commitments to new purchases.

  50. 2023 Apr 27

    dbt Core 1.5 adds model contracts

    dbt Core 1.5 introduced model governance features, including access, contracts, and versions. An enforced contract makes dbt check column names and data types before building a model.

  51. 2023 May 1

    PayPal open-sources its data contract template

    PayPal released its data contract template, used in its data mesh implementation, under the Apache 2.0 license. Version 2.1.1 covered schema, data quality, pricing, stakeholders, roles, and service levels, not only structure.

  52. 2023 May 18

    No-code Connector Builder

    Airbyte released the Connector Builder, an in-UI tool for creating API source connectors without a local development environment. It also underpins the low-code declarative connector format.

  53. 2023 Jul 27

    The template becomes the Open Data Contract Standard

    Version 2.2.0 renamed the template to the Open Data Contract Standard and finalized its fork under the AIDA User Group, turning a company template into a community specification.

  54. 2023 Aug 29

    Destinations V2 and Typing and Deduping

    Airbyte replaced dbt-based basic normalization with destination-native Typing and Deduping. Streams now map one-to-one to final tables, and a bad value is nulled and logged in _airbyte_meta rather than failing the sync.

  55. 2023 Sep 12

    First public release of the Data Contract Specification

    The datacontract.com project published version 0.9.0 of its own YAML format for data contracts, following OpenAPI and AsyncAPI conventions.

  56. 2023 Oct

    dbt Semantic Layer reaches general availability

    dbt announces general availability of the revamped Semantic Layer powered by MetricFlow. Metric definitions can be maintained alongside models and consumed through supported integrations.

  57. 2023 Oct 4

    1.4.0 lands and v2 becomes the usual default

    Iceberg 1.4.0 shipped a large feature set. From 1.4.0 onward, new tables default to format-version 2, making delete-file capable tables the common baseline for fresh deployments.

  58. 2023 Oct 5

    WCAG 2.2 becomes a W3C Recommendation

    WCAG 2.2 added success criteria while retaining backward compatibility with earlier WCAG 2 versions. Report and dashboard teams gained a new current accessibility target for web delivery.

  59. 2023 Nov

    Microsoft Fabric reaches general availability

    Power BI became one workload in a unified analytics platform, with OneLake and Direct Lake connecting report models to Fabric-managed data.

  60. 2023 Nov 30

    Bitol joins the LF AI & Data Foundation

    The Bitol project, home of ODCS, became a sandbox project of the Linux Foundation AI & Data Foundation, placing the standard under vendor-neutral governance.

  61. 2024 Feb

    Tableau Pulse reaches general availability

    Tableau Pulse introduced a metrics-centered experience with personalized visual and natural-language insights in Tableau Cloud.

  62. 2024 Feb 27

    PyAirbyte released

    Airbyte published PyAirbyte, a Python library that runs connectors locally with a DuckDB cache and no Airbyte server. It made connectors usable directly from scripts and notebooks.

  63. 2024 Jun

    dbt Mesh becomes generally available

    dbt makes multi-project collaboration patterns generally available for dbt Cloud Enterprise. Cross-project ownership and lineage become part of the operating model for larger organizations.

  64. 2024 Jun

    Docker Compose deployment deprecated

    Airbyte announced it would end support for Docker Compose deployments in favor of Kubernetes, with the new abctl tool running a local kind cluster for single-machine installs.

  66. 2024 Jul 25

    Release 453 is published

    Release 453 appears in the official release archive. The release cadence shows the project continuing to evolve after the Trino rename.

  67. 2024 Aug

    Airflow 2.10 releases

    Airflow 2.10.0 released in August 2024 with dataset improvements and the Hybrid Executor. The release showed continued investment in data-aware workflows and execution choices in the 2.x line.

  69. 2024 Aug

    VLDB 2024 paper published

    The first ClickHouse research paper appears at VLDB, documenting the MergeTree storage layer, merge-time transformation, pruning techniques, and vectorized query execution; the docs' architecture overview is its web version.

  70. 2024 Sep 24

    Airbyte 1.0

    Airbyte marked its platform 1.0 and made Self-Managed Enterprise generally available. The release signaled a stable API and upgrade path for self-hosted users.

  71. 2024 Oct 21

    ODCS v3.0.0 generalizes the schema model

    ODCS v3 replaced the table-and-column schema with objects and properties, so one format can describe relational, hierarchical, and streaming data, and added the servers and support sections. A technical steering committee from 14 companies backed the release.

  72. 2025

    Series C at the first OpenHouse conference

    ClickHouse announces $350M Series C financing at its inaugural user conference, OpenHouse, in San Francisco, marking the company's second major funding round after incorporation.

  73. 2025 Apr

    Airflow 3.0 becomes generally available

    Airflow 3.0 introduced the Task Execution Interface and API-server architecture, Dag versioning, scheduler-managed backfills, and data assets. These changes separated task execution more clearly from the metadata-database control plane.

  74. 2025 May

    dbt Fusion engine enters public beta

    dbt introduces the Rust-based Fusion engine and its VS Code extension in public beta. The dbt language stays central while the parsing and development experience changes.

  75. 2025 Sep

    Airflow 3.1 releases

    Airflow 3.1.0 added human-in-the-loop workflows, deadline alerts, internationalization, and a React plugin system. It extended the Airflow 3 platform after the 3.0 architecture transition.