Skip to content

Commit

Permalink
Merge pull request #51 from ncbo/restructure_1
Browse files Browse the repository at this point in the history
Restructuring - Rewrite downloader
  • Loading branch information
caufieldjh authored Aug 15, 2024
2 parents 5cf19b1 + 17a7d2d commit f99f783
Show file tree
Hide file tree
Showing 26 changed files with 4,326 additions and 1,932 deletions.
13 changes: 1 addition & 12 deletions .github/workflows/main.yml
Original file line number Diff line number Diff line change
Expand Up @@ -10,22 +10,11 @@ jobs:
- uses: actions/setup-python@v2
name: setup python
with:
python-version: 3.8
python-version: "3.10"
- name: Install Dependencies
run: |
python -m pip install --upgrade pip
pip install .
pip install .[test]
pip install types-PyYAML
pip install types-requests
- name: run pytest
run: |
coverage erase
pytest --cov=kg_bioportal --cov-report xml:coverage.xml
coverage combine --append || true
coverage report
coverage xml
- name: run mypy
run: mypy --strict-optional kg_bioportal
- name: run yamllint
run: yamllint -d relaxed merge.yaml download.yaml
18 changes: 4 additions & 14 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,25 +1,15 @@
# KG-Bioportal

[Bioportal](https://bioportal.bioontology.org/), as a Knowledge Graph.
[Bioportal](https://bioportal.bioontology.org/), as a set of knowledge graphs.

## Data Sources

In this graph pipeline, source data is primarily derived from [Bioportal-to-KGX](https://github.com/ncbo/BioPortal-to-KGX), starting from a 4store dump of the BioPortal ontologies.
Source data is derived from the Bioportal API (<https://data.bioontology.org/documentation>).

## Components

### Download

The [download.yaml](download.yaml) contains all the URLs for source data. In this KG project, sources are pre-processed and this component is used for data transfer only.

### Transform

The [transform_utils](kg_bioportal/transform_utils) serve as a passthrough, allowing paths for sources to be stored.

### Merge

Implementation of the 'cat-merge' function from [cat-merge](https://github.com/monarch-initiative/cat-merge).
TBA

## Example

`python run.py catmerge --merge_all`
TBA
20 changes: 0 additions & 20 deletions download.yaml

This file was deleted.

6 changes: 0 additions & 6 deletions kg_bioportal/__init__.py

This file was deleted.

2 changes: 0 additions & 2 deletions kg_bioportal/__version__.py

This file was deleted.

25 changes: 0 additions & 25 deletions kg_bioportal/download.py

This file was deleted.

229 changes: 0 additions & 229 deletions kg_bioportal/merge_utils/merge_kg.py

This file was deleted.

37 changes: 0 additions & 37 deletions kg_bioportal/stats.py

This file was deleted.

Loading

0 comments on commit f99f783

Please sign in to comment.