Skip to content

Cask Data Application Platform - 4.3.4

Compare
Choose a tag to compare
@prinam prinam released this 30 Mar 20:25
· 8667 commits to develop since this release
64d3d09

Improvements

  • Macro enabled all fields in the HTTP Callback plugin (CDAP-13116)

  • Optimized the planner to reduce the amount of temporary data required in certain types of mapreduce pipelines. (CDAP-13119)

  • Minor optimization to reduce the number of mappers used to read intermediate data in mapreduce pipelines (CDAP-13122)

  • Improves the schema generation for database sources. (CDAP-13139)

  • Automatic restart of long running program types (Service and Flow) upon application master process failure in YARN (CDAP-13179)

Bug Fixes

  • Fixed a bug that caused errors in the File source if it read parquet files that were not generated through Hadoop. (CDAP-12875)

  • Fixed an issue where a dataset's class loader was closed before the dataset itself, preventing the dataset from closing properly. (CDAP-13110)

  • Fixed a bug that caused directories to be left around if a workflow used a partitioned fileset as a local dataset (CDAP-13120)

  • Fixed a bug that caused a hive Explore query on Streams to not work. (CDAP-13123)

  • Fixed a planner bug to ensure that sinks are never placed in two different mapreduce phases in the same pipeline. (CDAP-13129)

  • Fixed a race condition when running multiple spark programs concurrently at a Workflow fork that can lead to workflow failure (CDAP-13158)

  • Fixed an issue with creating a namespace if the namespace principal is not a member of the namespace home's group. (CDAP-13171)

  • Fixed a bug that caused completed run records to be missed when storing run state, resulting in misleading log messages about ignoring killed states. (CDAP-13191)

  • Fixed a bug in FileBatchSource that prevented ignoreFolders property from working with avro and parquet inputs (CDAP-13192)

  • Fixed an issue where inconsistencies in the schedulestore caused scheduler service to keep exiting. (CDAP-13205)

  • Fixed an issue that would cause changes in program state to be ignored if the program no longer existed, resulting in the run record corrector repeatedly failing to correct run records (CDAP-13217)

  • Fixed the state of Workflow, MapReduce, and Spark program to be reflected correctly as KILLED state when user explicitly terminated the running program (CDAP-13218)

  • Fixed directive syntaxes in point and click interactions for some date formats (CDAP-13223)