Skip to content

Releases: tidyverse/duckplyr

duckplyr 0.4.1

14 Jul 00:49
Compare
Choose a tag to compare

Features

  • df_from_file() and related functions support multiple files (#194, #195), show a clear error message for non-string path arguments (#182), and create a tibble by default (#177).
  • New as_duckplyr_tibble() to convert a data frame to a duckplyr tibble (#177).
  • Support descending sort for character and other non-numeric data (@toppyy, #92, #175).
  • Avoid setting memory limit (#193).
  • Check compatibility of join columns (#168, #185).
  • Explicitly list supported functions, add contributing guide, add analysis scripts for GitHub activity data (#179).

Documentation

  • Add contributing guide (#179).
  • Show a startup message at package load if telemetry is not configured (#188, #198).
  • ?df_from_file shows how to read multiple files (#181, #186) and how to specify CSV column types (#140, #189), and is shown correctly in reference index (#173, #190).
  • Discuss dbplyr in README (#145, #191).
  • Add analysis scripts for GitHub activity data (#179).

duckplyr 0.4.0

23 May 00:45
Compare
Choose a tag to compare

Features

  • Use built-in rfuns extension to implement equality and inequality operators, improve translation for as.integer(), NA and %in% (#83, #154, #148, #155, #159, #160).
  • Reexport non-deprecated dplyr functions (#144, #163).
  • library(duckplyr) calls methods_overwrite() (#164).
  • Only allow constant patterns in grepl().
  • Explicitly reject calls with named arguments for now.
  • Reduce default memory limit to 1 GB.

Bug fixes

  • Stricter type checks in the set operations intersect(), setdiff(), symdiff(), union(), and union_all() (#169).
  • Distinguish between constant NA and those used in an expression (#157).
  • head(-1) forwards to the default implementation (#131, #156).
  • Fix cli syntax for internal error message (#151).
  • More careful detection of row names in data frame.
  • Always check roundtrip for timestamp columns.
  • left_join() and other join functions call auto_copy().
  • Only reset expression depth if it has been set before.
  • Require fallback if the result contains duplicate column names when ignoring case.
  • row_number() returns integer.
  • is.na(NaN) is TRUE.
  • summarise(count = n(), count = n()) creates only one column named count.
  • Correct wording in instructions for enabling fallback logging (@TimTaylor, #141).

Chore

  • Remove styler dependency (#137, #138).
  • Avoid error from stats collection.

Documentation

Testing

  • Reenable tests that now run successfully (#166).
  • Synchronize tests (#153).
  • Test that vec_ptype() does not materialize (#149).
  • Improve telemetry tests.
  • Promote equality checks to expect_identical() to capture differences between doubles and integers.

duckplyr 0.3.2

19 Mar 00:45
Compare
Choose a tag to compare

Bug fixes

  • Run autoupload in function so that it will be checked by static analysis (#122).

Features

  • New df_to_parquet() to write to Parquet, new convenience functions df_from_csv(), duckdb_df_from_csv(), df_from_parquet() and duckdb_df_from_parquet() (#87, #89, #96, #128).

duckplyr 0.3.1

12 Mar 00:45
Compare
Choose a tag to compare

Bug fixes

  • Forbid reuse of new columns created in summarise() (#72, #106).
  • summarise() no longer restores subclass.
  • Disambiguate computation of log10() and log().
  • Fix division by zero for positive and negative numbers.

Features

  • New fallback_sitrep() and related functionality for collecting telemetry data (#102, #107, #110, #111, #115). No data is collected by default, only a message is displayed once per session and then every eight hours. Opt in or opt out by setting environment variables.
  • Implement group_by() and other methods to collect fallback information (#94, #104, #105).
  • Set memory limit and temporary directory for duckdb.
  • Implement suppressWarnings() as the identity function.
  • Prefer cli::cli_abort() over stop() or rlang::abort() (#114).
  • Translate .data$a and .env$a.
  • Strict checks for column class, only supporting integer, numeric, logical, Date, POSIXct, and difftime for now.
  • If the environment variable DUCKPLYR_METHODS_OVERWRITE is set to TRUE, loading duckplyr automatically calls methods_overwrite().

Internal

  • Better duckdb tests.
  • Use standalone purrr for dplyr compatibility.

Testing

  • Add tests for correct base of log() and log10().

Documentation

  • methods_overwrite() and methods_restore() show a message.

duckplyr 0.3.0

13 Dec 00:47
Compare
Choose a tag to compare
## Bug fixes

- `grepl(x = NA)` gives correct results.
- Fix `auto_copy()` for non-data-frame input.
- Add output order preservation for filters.
- `distinct()` now preserves order in corner cases (#77, #78).
- Consistent computation of `log(0)` and `log(-1)` (#75, #76).

## Features

- Only allow constants in `mutate()` that are actually representable in duckdb (#73).
- Avoid translating `ifelse()`, support `if_else()` (#79).

## Documentation

- Separate and explain the new relational examples (@wibeasley, #84).

## Testing

- Add test that TPC-H queries can be processed.

## Chore

- Sync with dplyr 1.1.4 (#82).
- Remove `dplyr_reconstruct()` method (#48).
- Render README.
- Fix code generated by `meta_replay()`.
- Bump constructive dependency.
- Fix output order for `arrange()` in case of ties.
- Update duckdb tests.
- Only implement newer `slice_sample()`, not `sample_n()` or `sample_frac()` (#74).
- Sync generated files (#71).

duckplyr 0.2.3

10 Nov 00:45
Compare
Choose a tag to compare

Performance

Documentation

duckplyr 0.2.2

18 Oct 06:44
Compare
Choose a tag to compare

Bug fixes

  • summarise() keeps "duckplyr_df" class (#63, #64).

  • Fix compatibility with duckdb >= 0.9.1.

Chore

  • Skip tests that give different output on dev tidyselect.

  • Import utils::globalVariables().

Documentation

  • Small README improvements (@maelle, #34, #57).

  • Fix 301 in README.

duckplyr 0.2.1

27 Sep 13:18
Compare
Choose a tag to compare

What's Changed

  • fix: Use dplyr_reconstruct_dispatch() to avoid issues with R >= 4.3 by @krlmlr in #52
  • docs: Fix function reference by @krlmlr in #53
  • chore: Style code by @krlmlr in #54

Full Changelog: v0.2.0...v0.2.1

duckplyr 0.2.0

27 Sep 13:16
Compare
Choose a tag to compare

What's Changed

  • Implement summarise() by @krlmlr in #1
  • WIP: Draft support for window functions by @krlmlr in #4
  • Benchmarking adjustments by @Tmonster in #6
  • Revert prefix suffix optimizations, revert year extraction by @Tmonster in #7
  • ci: add GHA standard check workflow by @maelle in #23
  • docs: fix BugReports link by @maelle in #10
  • Update scripts to run out of the box by @Tmonster in #8
  • Various easy fixes after running R CMD check by @maelle in #16
  • Make Duckplyr_df from csv more generic so it can be from json, parquet, csv et.c by @Tmonster in #32
  • docs: document undocumented arguments by @maelle in #28
  • chore: R CMD check fixes by @maelle in #42
  • chore: More R CMD check fixes by @krlmlr in #43
  • chore: Almost ready for CRAN by @krlmlr in #44
  • feat: Order-stable union_all() by @krlmlr in #45
  • Sync documentation with v0.1.0 by @krlmlr in #46

New Contributors

Full Changelog: https://github.com/duckdblabs/duckplyr/commits/v0.2.0

duckplyr 0.1.0

27 Sep 13:15
2638dca
Compare
Choose a tag to compare

Initial release, generics only.

Full Changelog: 1950e98...v0.1.0