Skip to content

Issues: JackKelly/light-speed-io

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

42 Open 72 Closed
42 Open 72 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Multi-dataset abstraction layer enhancement New feature or request performance Improvements to runtime performance usability Make things more user-friendly
#142 opened Jun 21, 2024 by JackKelly
2
Utility to extract, reshape, and store data for a subset of the data. e.g. for extracting timeseries for single PV sites from gridded NWPs enhancement New feature or request performance Improvements to runtime performance usability Make things more user-friendly
#141 opened Jun 21, 2024 by JackKelly
Generic user_data type for Chunk enhancement New feature or request
#140 opened May 23, 2024 by JackKelly 0030: Simplify & improve usability & robustness
Remove crates /lsio_uring/benches
#139 opened May 23, 2024 by JackKelly 0000: Benchmark lsio_uring
Allow users to provide filesize etc. using suffixes like m and k enhancement New feature or request
#138 opened May 23, 2024 by JackKelly 0000: Benchmark lsio_uring
Why does lsio_bench give insanely high bandwidth numbers when reading a single chunk per file? bug Something isn't working
#137 opened May 23, 2024 by JackKelly 0000: Benchmark lsio_uring
Maybe the HIGH_WATER_MARK idea doesn't make sense?! enhancement New feature or request
#134 opened May 21, 2024 by JackKelly 0030: Simplify & improve usability & robustness
Maybe use Bend to parallelise compute performance Improvements to runtime performance
#132 opened May 19, 2024 by JackKelly
Keep track of SQ entries, in a 1:1 relationship enhancement New feature or request
#131 opened May 18, 2024 by JackKelly 0030: Simplify & improve usability & robustness
Build a command-line benchmarking app enhancement New feature or request performance Improvements to runtime performance testing_benchmarking_CI Automatically ensuring the code behaves
#130 opened May 18, 2024 by JackKelly
7 of 15 tasks
0000: Benchmark lsio_uring
1
@JackKelly
3
Calling uring.submitter().submit() on every loop is probably expensive enhancement New feature or request performance Improvements to runtime performance
#129 opened May 16, 2024 by JackKelly TBD: Improve IO speed
Benchmark for new io_uring code enhancement New feature or request performance Improvements to runtime performance testing_benchmarking_CI Automatically ensuring the code behaves
#127 opened May 1, 2024 by JackKelly
2 tasks
0000: Benchmark lsio_uring
@JackKelly
Implement optimisation of byte ranges enhancement New feature or request performance Improvements to runtime performance
#126 opened Apr 29, 2024 by JackKelly
@JackKelly
Stop/Start: Enable LSIO to be gracefully stopped & started (e.g. in response to carbon intensity) enhancement New feature or request
#124 opened Apr 16, 2024 by JackKelly
Benchmark lsio_uring vs object_store_bridge performance Improvements to runtime performance testing_benchmarking_CI Automatically ensuring the code behaves
#123 opened Apr 3, 2024 by JackKelly
1 of 2 tasks
0020: Compare benchmarks for lsio_uring vs lsio_object_store_bridge
Document decisions taken documentation Improvements or additions to documentation
#120 opened Mar 27, 2024 by JackKelly
2 tasks
Rigorous benchmarking testing_benchmarking_CI Automatically ensuring the code behaves
#119 opened Mar 27, 2024 by JackKelly
14 tasks
0030: Simplify & improve usability & robustness
Rigorous automated testing testing_benchmarking_CI Automatically ensuring the code behaves
#118 opened Mar 27, 2024 by JackKelly
10 tasks
0030: Simplify & improve usability & robustness
Check if ndarray, numpy, & compression crates can consume &[u8] (and hence consume from AlignedBuffer) question Further information is requested
#113 opened Mar 26, 2024 by JackKelly
1
Maybe change name (away from LSIO) question Further information is requested
#110 opened Mar 21, 2024 by JackKelly 0030: Simplify & improve usability & robustness
@JackKelly
15
New crate: lsio_object_store_bridge to perform IO using object_store enhancement New feature or request
#107 opened Mar 15, 2024 by JackKelly 0010: Implement minimal object_store_bridge
What would user's code would look like the for simple use-cases? (After dropping async, and instead only using channels and Rayon)? question Further information is requested
#104 opened Mar 15, 2024 by JackKelly 0040: Group operations
@JackKelly
9
Handle case when read actually reads less data than the user requested bug Something isn't working usability Make things more user-friendly
#100 opened Mar 12, 2024 by JackKelly 0030: Simplify & improve usability & robustness
Splits reads of more than 2 GiBytes into multiple reads bug Something isn't working usability Make things more user-friendly
#99 opened Mar 12, 2024 by JackKelly 0030: Simplify & improve usability & robustness
Write unit-tests for AlignedBuffer to check behaviour when using start_offset. enhancement New feature or request testing_benchmarking_CI Automatically ensuring the code behaves
#98 opened Mar 12, 2024 by JackKelly 0030: Simplify & improve usability & robustness
ProTip! Follow long discussions with comments:>50.