15 stories · verified updates from database sources with analysis and action steps.
Java Champion Gunnar Morling shares insights on building high-performance Java applications for data engineering. He discusses experiments with durable execution engines and the development of Apache Hardwood, a new, minimal-dependency Java parser for the Apache Parquet file format, offering lessons for developers and engineering leaders.
Google Cloud published a guide on using its BigQuery Graph feature to create digital twins of complex systems, like a food supply chain. The approach helps businesses model and analyze relationships within their operations, moving beyond the limitations of traditional spreadsheets to manage growth and complexity effectively.
JetBrains is discontinuing its standalone DataSpell IDE, which was designed for data science and analytics. The company will integrate all of DataSpell's features, including its advanced Jupyter notebook and data exploration tools, into PyCharm Professional to consolidate its offerings.
Redis 8.4 introduces a new `CLAIM` option for its `XREADGROUP` command, simplifying how developers build reliable stream consumers. The update combines consuming new messages and reclaiming stalled ones into a single command, reducing code complexity and improving the robustness of event-driven applications.
Snowflake's platform on Google Cloud in Melbourne has successfully completed an IRAP assessment, meeting the Australian Government's 'Protected' security standard. This certification allows public sector agencies and regulated industries in Australia to use the data platform for handling sensitive information and critical workloads on GCP.
ClickHouse announced several major updates at its Open House 2026 event. Key developments include deeper integration with Postgres, new data ingestion tools called ClickPipes and ClickHouse Agents, and a partnership with Langfuse for LLM observability. The updates aim to simplify real-time data analytics.
Microsoft Research has released Data Formulator 0.7, an open-source, AI-powered system for enterprise data analytics. The tool combines data connectivity, AI agent-guided exploration, and visualization in a shared workspace. A new Data Connectors feature simplifies integration with various data sources like databases and BI systems.
Elastic has released version 9.4.2 of the Elastic Stack. This is a security-focused update that addresses potential vulnerabilities found in previous versions. All users are strongly encouraged to upgrade their deployments to this latest version to ensure their systems remain secure and protected.
DuckDB, the popular in-process analytical database, has introduced a new remote protocol called Quack. It uses HTTP to enable a client-server model, allowing multiple users and applications to connect to and query the same database instance over a network, a significant shift from its embedded-only origins.
Meta's engineering team successfully migrated its petabyte-scale data ingestion platform, which processes social graph data from MySQL. The team used advanced techniques like reverse shadowing and continuous checksum monitoring to ensure a seamless transition with zero downtime, improving both reliability and operational efficiency.
dbt Labs has launched dbt Agent Skills, a new feature in dbt Cloud. It allows developers to package data logic into reusable "skills" for AI agents. This helps agents answer data-related questions more reliably and accurately by using pre-defined logic instead of generating SQL from scratch.
Many organizations can't answer critical business questions because their data is siloed in separate systems. Databricks argues that by unifying disparate datasets—like customer records and sales figures—companies can uncover complex patterns, moving beyond basic historical reporting to make more informed decisions.
A new version of pg_sorted_heap, a PostgreSQL extension, has been released. It introduces physically sorted storage and integrated vector search. Version 0.14.0 adds official support for PostgreSQL 16 and is now available on the PostgreSQL Extension Network (PGXN) for easier installation and management.
NASDAQ handles up to a trillion messages daily across its 26 business lines. To manage this massive scale, the company built a governed intelligence layer using dbt and Databricks. This modern data stack enables them to ensure data quality, security, and accessibility for decision-making.
AI brand discovery platform ChatFeatured migrated its analytics database from PlanetScale Postgres to a Postgres-compatible service managed by ClickHouse. The switch, completed in 30 minutes, reduced complex query times from 2.5 minutes to under one second, significantly improving performance for its AI-powered features.