作者 ｜ 郭炜过去十年，数据工程的主线，是 Modern Data Stack 对传统数仓体系的一次拆解与重组。我们把数据采集从数据库里拆出来，形成了 Data Ingestion，用 FiveTran、Airbyte、Apache SeaTunnel 来解决 ELT / CDC / Reverse ETL；把计算从存储里拆出来，形成了 Snowflake、Databricks、Iceberg、H ...

Data engineering is undergoing significant, rapid growth, where new technologies redefine how enterprises deliver secure, trusted, and accessible data. The proliferation of tools to meet data ...

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. Dany Lepage discusses the architectural ...

A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...

IN AN INCREASINGLY complex world with growing amounts of data, global supply chains can be difficult to navigate. At the forefront of this challenge—and solving it—is Mediterranean Shipping Company ...

Though the AI era conjures a futuristic, tech-advanced image of the present, AI fundamentally depends on the same data standards that have been around forever. These data standards—such as being clean ...

SQL has dominated data querying for decades. Newer query languages offer more elegance, simplicity, and flexibility for modern use cases. For the last three decades, databases and Structured Query ...