Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

make czi_drsm compatible with hub #896

Merged
merged 2 commits into from
Oct 13, 2023
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions bigbio/hub/hub_repos/czi_drsm/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ language:
- en
bigbio_language:
- English
license: Creative Commons Zero v1.0 Universal
license: cc0-1.0
bigbio_license_shortname: cc0-1.0
multilinguality: monolingual
pretty_name: CZI DRSM
Expand All @@ -15,7 +15,7 @@ bigbio_tasks:
---

# Dataset Card for CZI DRSM

[README.md](..%2Fmed_qa%2FREADME.md)
leonweber marked this conversation as resolved.
Show resolved Hide resolved
## Dataset Description

- **Homepage:** https://github.com/chanzuckerberg/DRSM-corpus
Expand Down
12 changes: 4 additions & 8 deletions bigbio/hub/hub_repos/czi_drsm/czi_drsm.py
Original file line number Diff line number Diff line change
Expand Up @@ -60,16 +60,12 @@
import pandas as pd
from pathlib import Path

import bigbio.utils.parsing as parse
from bigbio.utils import schemas
from bigbio.utils.configs import BigBioConfig
from bigbio.utils.constants import Lang, Tasks
from bigbio.utils.license import Licenses
from .bigbiohub import text_features, BigBioConfig, Tasks

#from .bigbiohub import BigBioConfig
#from .bigbiohub import Tasks

#from .bigbiohub import
#from .bigbiohub import

_LOCAL = False

Expand Down Expand Up @@ -147,7 +143,7 @@
'nhs': "https://raw.githubusercontent.com/chanzuckerberg/DRSM-corpus/main/v2/nhs_all_2023_03_31.tsv"
}

_SUPPORTED_TASKS = [Tasks.TEXT_CLASSIFICATION]
_SUPPORTED_TASKS = [Tasks.TEXT_CLASSIFICATION]

_SOURCE_VERSION = "1.0.0"
_BIGBIO_VERSION = "1.0.0"
Expand Down Expand Up @@ -295,7 +291,7 @@ def _info(self) -> datasets.DatasetInfo:

# For example bigbio_kb, bigbio_t2t
elif self.config.schema == "bigbio_text":
features = schemas.text_features
features = text_features

return datasets.DatasetInfo(
description=_DESCRIPTION,
Expand Down