Skip to content

Commit 9cb7d79

Browse files
committed
fixes
1 parent 6886827 commit 9cb7d79

File tree

2 files changed

+6
-14
lines changed

2 files changed

+6
-14
lines changed

README.md

Lines changed: 5 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -1,18 +1,18 @@
1-
# Query Farm SQL Scan Planning
1+
# [Query.Farm](https://query.farm) SQL Scan Planning
22

33
A Python library for intelligent file filtering using SQL expressions and metadata-based scan planning. This library enables efficient data lake query optimization by determining which files need to be scanned based on their statistical metadata.
44

55
## Overview
66

7-
Query Farm SQL Scan Planning provides predicate pushdown capabilities for file-based data storage systems. By maintaining metadata about file contents (min/max values, value sets, null presence), the library can quickly determine which files contain data that could satisfy a given `SQL WHERE` clause, significantly reducing query execution time.
7+
This module provides predicate pushdown capabilities for file-based data storage systems. By maintaining metadata about file contents (min/max values, value sets, null presence), the library can quickly determine which files contain data that could satisfy a given `SQL WHERE` clause, significantly reducing query execution time.
88

99
## Features
1010

1111
- **SQL Expression Parsing**: Parse and evaluate complex `SQL WHERE` clauses using [SQLGlot](https://github.com/tobymao/sqlglot)
1212
- **Metadata-Based Filtering**: Support for both range-based (min/max) and set-based field metadata
13-
- **Null Handling**: Comprehensive support for NULL value semantics in SQL expressions
14-
- **Complex Predicates**: Handle AND, OR, XOR, NOT, IN, BETWEEN, CASE statements, and more
15-
- **Multiple Data Types**: Support for integers, floats, strings, decimals, and NULL values
13+
- **Null Handling**: Comprehensive support for `NULL` value semantics in SQL expressions
14+
- **Complex Predicates**: Handle `AND`, `OR`, `XOR`, `NOT`, `IN`, `BETWEEN`, `CASE` statements, and more
15+
- **Multiple Data Types**: Support for integers, floats, strings, decimals, and `NULL` values
1616
- **Dialect Support**: Configurable SQL dialect support (default: DuckDB)
1717

1818
## Installation
@@ -216,14 +216,6 @@ rye run pytest --mypy
216216
4. Ensure all tests pass
217217
5. Submit a pull request
218218

219-
## License
220-
221-
This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.
222-
223-
## Related Projects
224-
225-
- [SQLGlot](https://github.com/tobymao/sqlglot) - SQL parser and transpiler
226-
227219
## Author
228220

229221
This Python module was created by [Query.Farm](https://query.farm).

pyproject.toml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
[project]
22
name = "query-farm-sql-scan-planning"
3-
version = "0.1.2"
3+
version = "0.1.3"
44
description = "A Python library for intelligent file filtering using SQL expressions and metadata-based scan planning. This library enables efficient data lake query optimization by determining which files need to be scanned based on their statistical metadata."
55
authors = [
66
{ name = "Rusty Conover", email = "rusty@conover.me" }

0 commit comments

Comments
 (0)