Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Two parties with three dataset cannot fetch the result from FeldmanVerifiableSum. #5715

Open
from-alice-to-bob opened this issue Sep 27, 2024 · 0 comments

Comments

@from-alice-to-bob
Copy link

Describe the bug
Hi,

My task involves two parties with three dataset, could be understood as:
host: bank_li
guest: insurance_li, trust_li

All of these dataset are under the same format as:
thd,asset
1,100
2,45.5
...

The first column thd is the ID and the second column asset is a float column for the later calculation. Here is a task to calculate the sum of asset for each user appears in both host and guest side. Before do the intersection, we should do the union for guest to get a dataset for all users in guest with their sum of asset. E.g.

provided:

insurance_li
thd,asset
1,100
4,150
7,200

trust_li
thd,asset
1,50
3,45
5,71
7,90

we should get a result as the union of guest as:
thd,asset
1,150
3,45
4,150
5,71
7,290

and then calculate the sum for the intersection between bank_li and this union data. E.g.

provided:

bank_li
thd,asset
1,1000
2,1200
3,800

we should get a result as:
thd,asset
1,1150
3,845

However, when I tried to implement this pipeline, I cannot get the 'data output' from FATEBoard on the guest side.

Can anyone help me to have a look? Thank you so much!

To Reproduce
My job_dsl.json and job_conf.json are shown below:
job_dsl.json:

{
"components": {
"feldman_verifiable_sum_0": {
"module": "FeldmanVerifiableSum",
"input": {
"data": {
"data": [
"intersect_0.data"
]
}
},
"output": {
"data": [
"result"
]
}
},
"reader_2": {
"output": {
"data": [
"data"
]
},
"provider": "fate_flow",
"module": "Reader"
},
"intersect_0": {
"output": {
"cache": [
"cache"
],
"data": [
"data"
]
},
"input": {
"data": {
"data": [
"union_0.data"
]
}
},
"provider": "fate",
"module": "Intersection"
},
"reader_1": {
"output": {
"data": [
"data"
]
},
"provider": "fate_flow",
"module": "Reader"
},
"union_0": {
"output": {
"data": [
"data"
]
},
"input": {
"data": {
"data": [
"reader_1.data",
"reader_2.data"
]
}
},
"provider": "fate",
"module": "UnionColumn"
}
}
}

job_conf.json:
{
"job_parameters": {
"common": {
"job_type": "train",
"pulsar_run": {},
"auto_retries": 0,
"computing_engine": "SPARK",
"task_parallelism": 1,
"rabbitmq_run": {},
"engines_address": {},
"computing_partitions": 3,
"federated_status_collect_type": "PUSH",
"inheritance_info": {},
"auto_retry_delay": 1,
"adaptation_parameters": {
"request_task_cores": 4,
"task_cores_per_node": 1,
"task_nodes": 3,
"if_initiator_baseline": true,
"task_memory_per_node": 0
},
"eggroll_run": {},
"spark_run": {},
"federated_mode": "MULTIPLE"
}
},
"component_parameters": {
"role": {
"host": {
"0": {
"reader_2": {
"table": {
"name": "bank_li",
"namespace": "experiment"
}
},
"reader_1": {
"table": {
"name": "bank_li",
"namespace": "experiment"
}
}
}
},
"guest": {
"0": {
"reader_2": {
"table": {
"name": "insurance_li",
"namespace": "experiment"
}
},
"reader_1": {
"table": {
"name": "trust_li",
"namespace": "experiment"
}
}
}
}
},
"common": {
"feldman_verifiable_sum_0": {
"q_n": 6,
"sum_cols": [
0
]
},
"intersect_0": {
"dh_params": {
"salt": "12345",
"hash_method": "sha256",
"key_length": 1024
},
"intersect_method": "dh",
"only_output_key": false,
"sync_intersect_ids": true
}
}
},
"dsl_version": 2,
"role": {
"host": [
7199
],
"guest": [
7188
]
},
"initiator": {
"role": "host",
"party_id": 7199
}
}

Expected behavior
A clear and concise description of what you expected to happen.

Screenshots
If applicable, add screenshots to help explain your problem.
截屏2024-09-27 20 43 30

Desktop (please complete the following information):

  • OS: [e.g. iOS]
  • Browser [e.g. chrome, safari]
  • Version [e.g. 22]

Smartphone (please complete the following information):

  • Device: [e.g. iPhone6]
  • OS: [e.g. iOS8.1]
  • Browser [e.g. stock browser, safari]
  • Version [e.g. 22]

Additional context
Add any other context about the problem here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant