Databend recently improved its data processing capabilities by implementing a new aggregation hash table inspired by DuckDB. This update enhances group aggregation performance significantly in both standalone and distributed environments. Benchmarks using ClickBench/hits demonstrate enhancements ranging from 7% to 56% across various configurations, including local machines and cloud setups. This optimized hash table also supports spill functionality, accommodating larger datasets effectively. These enhancements ensure more efficient data processing, particularly in distributed scenarios.

Stay up to date with the latest weekly developments on Databend!

Databend has successfully integrated support for the PRQL language. This new feature further enhances the flexibility and user-friendliness of Databend queries.

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Directly query Hugging Face datasets through Databend to simplify your data science workflow.

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

GPT-4 has significantly advanced Databend's testing process. This post explains how.

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Databend Cloud reduced analysis costs 100x for an AIGC startup's user behavior logs, providing an easy-to-use, efficient, and economical big data solution leveraging capabilities like JSON support and integration with visualization tools.

Stay up to date with the latest weekly developments on Databend!

Kafka Connect is a tool for scalable and reliable streaming data transfer between Apache Kafka® and other data systems. By standardizing the movement of data in and out of Kafka, it simplifies the rapid definition of connectors to efficiently transport large datasets within Kafka, making it easier to build large-scale real-time data pipelines.

In this article, we combine both Databend and lakeFS to provide a simple, clear workshop to help you quickly build a modern data workflow with Data Version Control.

Debezium Server Databend is a lightweight CDC project developed based on the Debezium Engine, designed to capture real-time database changes and transmit them as event streams, ultimately writing the data to Databend.

Stay up to date with the latest weekly developments on Databend!

Discover bugs before your users do! Learn how we implement our SQLsmith, a randomized SQL test generator, to find bugs in Databend.

Stay up to date with the latest weekly developments on Databend!

This blog post explores the configuration management in Databend. It discusses the three supported configuration options: command-line arguments, environment variables, and configuration files, with their respective priorities. The post also delves into the mapping of configurations in Databend Query and Databend Meta, providing code examples and explanations.

Stay up to date with the latest weekly developments on Databend!

eKuiper, a stream processing software under EMQ, is known for its compact size and robust functionality. It is widely utilized in various applications such as industrial IoT, vehicular networks, and public data analysis. This article has provided insights into how to use eKuiper for writing IoT stream processing data into Databend.

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Check out how Databend played a pivotal role in transforming data archiving and query performance for a Pharmaceutical Group.

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Debezium's potential reaches new heights with debezium-server-databend, a lightweight CDC tool developed by Databend.

One of the significant new features that Databend has been working on in recent months is supporting the reading of data in Apache Iceberg table format. This article is intended to give you a preview of this new capability by demonstrating how to use Databend to mount and query an Iceberg Catalog.

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Databend v1.2 Release Notes

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Cost Advantage Analysis: Databend Cloud vs Snowflake

Tableau is a popular data visualization and business intelligence tool. This tutorial helps users connect Databend for BI data analysis in Tableau.

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Compiling a medium to large Rust program is not a breeze due to the accumulation of complex project dependencies and boilerplate code. This article outlines the measures taken by the team to address the compilation challenges.

Introducing Pipeline Support in Databend Cloud

Stay up to date with the latest weekly developments on Databend!

Databend v1.1 Release Notes

This article will introduce the design and trade-offs of the Databend Cloud architecture, as well as the work mechanism of its various components. We hope that this article will help you better understand the advantages of the cloud, making your cloud-based data warehouse more cost-effective, efficient, secure, and user-friendly.

Benchmarking Databend using TPC-DS

Stay up to date with the latest weekly developments on Databend!

Stay up to date with the latest weekly developments on Databend!

Ways to connect to Databend via DBeaver

Introducing the Metabase Databend Driver.

Databend Cloud offers integration with Redash.

Stay up to date with the latest weekly developments on Databend!

Introducing the AI functions

Databend Cloud offers integration with Grafana.

Stay up to date with the latest weekly developments on Databend!

Benchmarking Databend with ClickBench

Get to how to configure webhdfs storage backend!

Get to know the latest updates on Databend this week!

The efficiency of returning results for multiple identical queries has considerably boosted with the introduction of query result cache in Databend 1.0. This post explains how it works.

Check out what's fresh in Databend 1.0

Introducing the CLI tool bendsql

Using Databend to facilitate data analysis with MinIO

rustc supports doing profile-guided optimization (PGO). Let's see how we can make it work for Databend.

sccache

Databend V0.9 Release Notes

sqllogictest, rust

CPU and Memory Profiling

Indexing