Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ensure simple program works #24

Merged
merged 9 commits into from
Nov 8, 2024
Merged

Ensure simple program works #24

merged 9 commits into from
Nov 8, 2024

Conversation

atharvas
Copy link
Collaborator

@atharvas atharvas commented Nov 7, 2024

This PR aims to address #21.

  • Ensure Simple program works out of the box.
  • Better error messages in llm_calls.txt.
  • Clear-er instructions in README about how to interact with this repo.

@atharvas atharvas self-assigned this Nov 7, 2024
Copy link

github-actions bot commented Nov 7, 2024

Benchmark Results

master 7a9cfb5... master/7a9cfb5a2a1a61...
search/multithreading 22.9 ± 1.7 s 24.2 ± 2.4 s 0.946
search/serial 33.5 ± 0.2 s 35 ± 1.9 s 0.958
utils/best_of_sample 1.04 ± 0.39 μs 1.2 ± 0.53 μs 0.867
utils/check_constraints_x10 12.3 ± 3.3 μs 12.2 ± 3.2 μs 1.01
utils/compute_complexity_x10/Float64 2.09 ± 0.13 μs 2.09 ± 0.11 μs 1
utils/compute_complexity_x10/Int64 2.1 ± 0.11 μs 2.01 ± 0.11 μs 1.04
utils/compute_complexity_x10/nothing 1.43 ± 0.089 μs 1.44 ± 0.099 μs 0.992
utils/optimize_constants_x10 0.0375 ± 0.0084 s 0.0379 ± 0.0089 s 0.989
time_to_load 3.65 ± 0.033 s 3.58 ± 0.02 s 1.02

Benchmark Plots

A plot of the benchmark results have been uploaded as an artifact to the workflow run for this PR.
Go to "Actions"->"Benchmark a pull request"->[the most recent run]->"Artifacts" (at the bottom).

@coveralls
Copy link

Pull Request Test Coverage Report for Build 11722078151

Details

  • 0 of 6 (0.0%) changed or added relevant lines in 2 files are covered.
  • 1 unchanged line in 1 file lost coverage.
  • Overall coverage remained the same at 78.46%

Changes Missing Coverage Covered Lines Changed/Added Lines %
src/LLMOptions.jl 0 1 0.0%
src/LLMFunctions.jl 0 5 0.0%
Files with Coverage Reduction New Missed Lines %
src/LLMFunctions.jl 1 0.5%
Totals Coverage Status
Change from base Build 11001948874: 0.0%
Covered Lines: 2557
Relevant Lines: 3259

💛 - Coveralls

@atharvas atharvas merged commit a2213b9 into master Nov 8, 2024
18 checks passed
@atharvas atharvas deleted the simple-program-check branch November 8, 2024 05:21
@atharvas atharvas restored the simple-program-check branch November 8, 2024 05:22
@atharvas atharvas deleted the simple-program-check branch November 8, 2024 05:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants