web-data-loader

data loader for data analytic product in working in browser

web-data-loader allows you to load larget data files in browser. It supports stream data and runs in webworker which will not block the main thread while loading the data. web-data-loader also support stream data sampling, it now support Reservoir Sampling methods.

Usage

Install

npm i --save @kanaries/web-data-loader

Examples

in your project file:

get user upload file

<input type="file" id="#file" />

use web-data-loader to load the data with sampling.

(document.querySelector("#file") as HTMLInputElement).onchange = (
  ev: Event
) => {
  const file = (ev.target as HTMLInputElement).files[0];
  FileReader.csvReader(
    {
      file: file,
      config: {
        type: "reservoirSampling",
        size: 400
      },
      onLoading: value => {
        console.log((value * 100).toFixed(2) + '%');
      }
    }
  ).then(data => console.log(data));
  // FileReader.csvReader(file).then(data => console.log(data));
};

Docs

documents can be found at API Reference