Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use ray-project fork in CI build and Dockerfile #202

Draft
wants to merge 4 commits into
base: main
Choose a base branch
from
Draft

Use ray-project fork in CI build and Dockerfile #202

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
0b249d3
updates to ray CLI
glennmoy Oct 26, 2023
ce44b62
update ray commit
glennmoy Oct 27, 2023
61dd8d6
add new arg to task_executor
glennmoy Oct 27, 2023
d003281
revert earlier changes
glennmoy Oct 27, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion build/ray_commit
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1 +1 @@
448a83caf44108fc1bc44fa7c6c358cffcfcb0d7
647066eae84d2bfa1d7f27815b2e336827f06a23
6 changes: 5 additions & 1 deletion build/wrapper.cc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -81,6 +81,7 @@ void initialize_worker(
options.metrics_agent_port = -1;
options.startup_token = startup_token;
options.runtime_env_hash = runtime_env_hash;
// https://github.com/ray-project/ray/blob/4ab0ba0823a9d113a6a0ceb10d7ddd56596e9c1a/src/ray/core_worker/test/mock_worker.cc#L52
options.task_execution_callback =
[task_executor](
const rpc::Address &caller_address,
Expand All @@ -94,13 +95,16 @@ void initialize_worker(
const std::string &serialized_retry_exception_allowlist,
std::vector<std::pair<ObjectID, std::shared_ptr<RayObject>>> *returns,
std::vector<std::pair<ObjectID, std::shared_ptr<RayObject>>> *dynamic_returns,
std::vector<std::pair<ObjectID, bool>> *streaming_generator_returns,
std::shared_ptr<LocalMemoryBuffer> &creation_task_exception_pb_bytes,
bool *is_retryable_error,
std::string *application_error,
const std::vector<ConcurrencyGroup> &defined_concurrency_groups,
const std::string name_of_concurrency_group_to_execute,
bool is_reattempt,
bool is_streaming_generator) {
bool is_streaming_generator,
bool should_retry_exceptions,
int64_t generator_backpressure_num_objects) {

std::vector<std::shared_ptr<RayObject>> return_vec;
task_executor(ray_function,
Expand Down
Loading