v2.0.0b0

Highlight

• 🚀 87x performance boost query on Pandas DataFrame, See Benchmark

• ⬆️ Upgrade ClickHouse engine to 24.5

• 🐍 Query on Pandas DataFrame, ArrowTable, Dict or Any Python object Directly!

import chdb
import pandas as pd
df = pd.DataFrame(
    {
        "a": [1, 2, 3, 4, 5, 6],
        "b": ["tom", "jerry", "auxten", "tom", "jerry", "auxten"],
    }
)

chdb.query("SELECT b, sum(a) FROM Python(df) GROUP BY b ORDER BY b").show()

• For more: test_query_py.py.

Changes

• Use in-process instead of embedded by @auxten in #222
• 226 crash on mergetree background task cleanup by @auxten in #227
• Replace icu with utf8proc by @auxten in #228
• Start agg step stream according to agg_col_cost and group_by_keys_cost by @auxten in #230
• Fix various issues like 190, 229 by @auxten in #231
• Before 2.0 release Patch #1 by @auxten in #232
• Fix python version check in CMakeLists.txt by @auxten in #233
• Fix mistake config.h by @auxten in #234
• Add tests on query python objects by @auxten in #235
• Add docs for Python Table Engine by @auxten in #238

Full Changelog: v1.4.1...v2.0.0b0

v1.4.1

What's Changed

• Disable ICU on macOS by @auxten in #221
• Enable H3 functions by @auxten in #218
• Alias sql method to query by @auxten in #219

Full Changelog: v1.3.0...v1.4.1

v1.4.0

What's Changed

• Enable H3 functions by @auxten in #218
• Alias sql method to query by @auxten in #219

Full Changelog: v1.3.0...v1.4.0

v1.3.0

What's Changed

• Add show for result by @auxten in #194

  # You do not need something like
  # ret = chdb.query("SELECT 123")
  # print(ret)
  # just
  chdb.query("SELECT 123").show()

• Allow path in dbapi connect by @nevinpuri in #176

  from chdb import dbapi
  conn = dbapi.connect(path=test_state_dir)
  cur = conn.cursor()
  cur.execute("CREATE DATABASE e ENGINE = Atomic;")
  cur.execute(
      "CREATE TABLE e.hi (a String primary key, b Int32) Engine = MergeTree ORDER BY a;"
  )
  cur.execute("INSERT INTO e.hi (a, b) VALUES (%s, %s);", ["he", 32])
  
  cur.close()
  conn.close()
  
  conn2 = dbapi.connect(path=test_state_dir)
  cur2 = conn2.cursor()
  cur2.execute("SELECT * FROM e.hi;")
  row = cur2.fetchone()
  self.assertEqual(("he", 32), row)

• Now, SET clause will work through chdb session! by @auxten in #207

  from chdb import session as chs
  se = chs.Session()
  se.query("SET input_format_csv_skip_first_lines = 1")
  se.query("SELECT * FROM `some dirty csv`").show()

• Add test cases for materialize view by @auxten in #201
• Fix DB-API test rerun issue by @auxten in #208

New Contributors

• @nevinpuri made their first contribution in #176

Full Changelog: v1.2.1...v1.3.0

v1.2.1

What's Changed

• Fix macOS v2 symbol export table by @auxten in #183
• Upload libchdb.tar.gz to artifact by @Daniel-Robbins in #184
• Fix export warning by @auxten in #191
• Fix query_stable_v2 might return nullptr by @auxten in #192

Full Changelog: v1.2.0...v1.2.1

v1.2.0

What's Changed

• Fix pipeline for macOS so find issue by @auxten in #167
• Fix runStub.sh for macOS by @auxten in #168
• Make DBAPI implementation use session, fix execute for none-returning queries by @yunyu in #169
• Run libchdb.so test on linux arm64 by @auxten in #170
• Add dummy_calls to ensure query_stable and free_result not optimized out by @auxten in #171
• Use llvm-ar and llvm-nm on macOS to avoid wired things by @auxten in #172
• Call chdb via dlopen by @Daniel-Robbins in #173
• Simple example to call libchdb.so by @Daniel-Robbins in #174
• Binding howto by @Daniel-Robbins in #178
• Fix executemany in dbapi cursor implementation, make tests more comprehensive by @yunyu in #175
• Add has_error and error_message methods by @nmreadelf in #105
• Disable output_format_json_quote_64bit_integers by @yunyu in #181
• Fix core dump caused by _v2 by @nmreadelf in #180
• Run fast build and linter and tests on self hosted machine on Pull Request by @Daniel-Robbins in #182

New Contributors

• @yunyu made their first contribution in #169

Full Changelog: v1.1.0...v1.2.0

v1.1.0

What's Changed

• Vector search similar movies with embedding generated by item2vec and CBOW model by @Daniel-Robbins in #150
• Cleanup too verbose output by @Daniel-Robbins in #154
• Hack to gen clean version libchdb.so with example by @Daniel-Robbins in #155
• Update README.md by @auxten in #156
• Fix linux aarch64 libchdb.so upload by @Daniel-Robbins in #157
• Fix symbol visibility on macOS by @Daniel-Robbins in #158
• Fix misused clang flag on macOS by @Daniel-Robbins in #159
• Put chdb.h in by @auxten in #160
• Show symbols vis for pychdb and libchdb by @Daniel-Robbins in #165

Full Changelog: v1.0.2...v1.1.0

v1.0.2

What's Changed

• Fix dbapi init issue and add dbapi basic tests by @Daniel-Robbins in #147
• TPCH and Movielens DNN examples in jupyter notebook by @Daniel-Robbins in #143
• Build py38 py39 py310 on macOS 12 by @Daniel-Robbins in #149

Full Changelog: v1.0.1...v1.0.2

v1.0.1

What's Changed

• feat: get latest tag by git rev-list by @nmreadelf in #142
• Lower the log level of "Lowered xxx cache size" by @Daniel-Robbins in #145

New Contributors

• @Daniel-Robbins made their first contribution in #145

Full Changelog: https://github.com/chdb-io/chdb/commits/v1.0.1

v1.0.0

• ⭐ chdb 1.0.0 (celebration release)

Celebrating the work of @auxten @lmangani @laodouya @nmreadelf and all the community members supporting the project ❤️