You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
My task involves two parties with three dataset, could be understood as:
host: bank_li
guest: insurance_li, trust_li
All of these dataset are under the same format as:
thd,asset
1,100
2,45.5
...
The first column thd is the ID and the second column asset is a float column for the later calculation. Here is a task to calculate the sum of asset for each user appears in both host and guest side. Before do the intersection, we should do the union for guest to get a dataset for all users in guest with their sum of asset. E.g.
provided:
insurance_li
thd,asset
1,100
4,150
7,200
trust_li
thd,asset
1,50
3,45
5,71
7,90
we should get a result as the union of guest as:
thd,asset
1,150
3,45
4,150
5,71
7,290
and then calculate the sum for the intersection between bank_li and this union data. E.g.
provided:
bank_li
thd,asset
1,1000
2,1200
3,800
we should get a result as:
thd,asset
1,1150
3,845
However, when I tried to implement this pipeline, I cannot get the 'data output' from FATEBoard on the guest side.
Can anyone help me to have a look? Thank you so much!
To Reproduce
My job_dsl.json and job_conf.json are shown below:
job_dsl.json:
Describe the bug
Hi,
My task involves two parties with three dataset, could be understood as:
host: bank_li
guest: insurance_li, trust_li
All of these dataset are under the same format as:
thd,asset
1,100
2,45.5
...
The first column thd is the ID and the second column asset is a float column for the later calculation. Here is a task to calculate the sum of asset for each user appears in both host and guest side. Before do the intersection, we should do the union for guest to get a dataset for all users in guest with their sum of asset. E.g.
provided:
insurance_li
thd,asset
1,100
4,150
7,200
trust_li
thd,asset
1,50
3,45
5,71
7,90
we should get a result as the union of guest as:
thd,asset
1,150
3,45
4,150
5,71
7,290
and then calculate the sum for the intersection between bank_li and this union data. E.g.
provided:
bank_li
thd,asset
1,1000
2,1200
3,800
we should get a result as:
thd,asset
1,1150
3,845
However, when I tried to implement this pipeline, I cannot get the 'data output' from FATEBoard on the guest side.
Can anyone help me to have a look? Thank you so much!
To Reproduce
My job_dsl.json and job_conf.json are shown below:
job_dsl.json:
{
"components": {
"feldman_verifiable_sum_0": {
"module": "FeldmanVerifiableSum",
"input": {
"data": {
"data": [
"intersect_0.data"
]
}
},
"output": {
"data": [
"result"
]
}
},
"reader_2": {
"output": {
"data": [
"data"
]
},
"provider": "fate_flow",
"module": "Reader"
},
"intersect_0": {
"output": {
"cache": [
"cache"
],
"data": [
"data"
]
},
"input": {
"data": {
"data": [
"union_0.data"
]
}
},
"provider": "fate",
"module": "Intersection"
},
"reader_1": {
"output": {
"data": [
"data"
]
},
"provider": "fate_flow",
"module": "Reader"
},
"union_0": {
"output": {
"data": [
"data"
]
},
"input": {
"data": {
"data": [
"reader_1.data",
"reader_2.data"
]
}
},
"provider": "fate",
"module": "UnionColumn"
}
}
}
job_conf.json:
{
"job_parameters": {
"common": {
"job_type": "train",
"pulsar_run": {},
"auto_retries": 0,
"computing_engine": "SPARK",
"task_parallelism": 1,
"rabbitmq_run": {},
"engines_address": {},
"computing_partitions": 3,
"federated_status_collect_type": "PUSH",
"inheritance_info": {},
"auto_retry_delay": 1,
"adaptation_parameters": {
"request_task_cores": 4,
"task_cores_per_node": 1,
"task_nodes": 3,
"if_initiator_baseline": true,
"task_memory_per_node": 0
},
"eggroll_run": {},
"spark_run": {},
"federated_mode": "MULTIPLE"
}
},
"component_parameters": {
"role": {
"host": {
"0": {
"reader_2": {
"table": {
"name": "bank_li",
"namespace": "experiment"
}
},
"reader_1": {
"table": {
"name": "bank_li",
"namespace": "experiment"
}
}
}
},
"guest": {
"0": {
"reader_2": {
"table": {
"name": "insurance_li",
"namespace": "experiment"
}
},
"reader_1": {
"table": {
"name": "trust_li",
"namespace": "experiment"
}
}
}
}
},
"common": {
"feldman_verifiable_sum_0": {
"q_n": 6,
"sum_cols": [
0
]
},
"intersect_0": {
"dh_params": {
"salt": "12345",
"hash_method": "sha256",
"key_length": 1024
},
"intersect_method": "dh",
"only_output_key": false,
"sync_intersect_ids": true
}
}
},
"dsl_version": 2,
"role": {
"host": [
7199
],
"guest": [
7188
]
},
"initiator": {
"role": "host",
"party_id": 7199
}
}
Expected behavior
A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information):
Smartphone (please complete the following information):
Additional context
Add any other context about the problem here.
The text was updated successfully, but these errors were encountered: