Skip to content
@4dn-dcic

4D Nucleome Data Coordination and Integration Center

Fourfront Metadata Database

The Fourfront Metadata Database, or just "Fourfront", is an open-source platform developed at the Park Lab in Harvard's Department of Biomedical Informatics (DBMI) as part of our service in the role of Data Coordination and Integration Center (DCIC) for the 4D Nucleome Network, one of the NIH Common Fund programs.

The 4D Nucleome Network aims to understand the principles behind the three-dimensional organization of the nucleus in space and time (the 4th dimension), and the role nuclear organization plays in gene expression and cellular function. The Network uses existing omics and imaging technologies, and develops new ones to generate data and create resources to enable the study of the 4D Nucleome.

More information about the 4D Nucleome program can be obtained at:

Information about our implementation can be found at:

  • our GitHub repositories, detailed below, and

  • our online documentation, detailed below, but including particularly:

Please address all questions and comments to [email protected]

Repositories

Overview

Fourfront consists of multiple repositories which support a complex ecosystem of applications and tools that implement Fourfront (the portal itself), Tibanna (the genomics pipeline), Foursight (tools for monitoring and service actions), and Submit4DN (a command line tool to aid in metadata and data file submission).

History

Work on the Fourfront portal began in 2015 as a fork of earlier work on ENCODE-DCC/encoded and ENCODE-DCC/snovault, developed by the Stanford ENCODE team The initial base and has been substantially developed and changed since then. However, the two teams stay in periodic touch and share ideas since the work is related.

In turn, our later work on the CGAP Portal and SMaHT Portal build on this work. Using a common codebase, especially based on our shared dcicutils and snovault repositories, we have refactored all three systems to no longer use AWS ElasticBeanstalk instances, and instead to use a more modern architecture based on Docker containers and AWS Fargate.

Pipelines & Analysis

  • tibanna - Core software that runs pipelines on Amazon Web Services (AWS).
  • tibanna_ff - An extension of Tibanna that works with the 4DN data portal.

Portal Infrastructure

  • fourfront - The primary codebase of the Fourfront portal.
  • utils - A set of utility functions & scripts which are used in the Fourfront Portal and others.
  • snovault - Contains abstractions for communicating with our databases, including PostgreSQL and ElasticSearch. A major dependency of CGAP Portal. Originally this was forked from ENCODE Project in ~2015.
  • react-workflow-viz - A React component/library for visualizing workflow runs.

Monitoring

  • foursight - Tools for monitoring and periodic service actions.
  • foursight-core - Core software supporting Foursight.

Applications

  • Submit4DN - Command-line tools for submitting and uploading metadata and data files to Fourfront.

Administrative

  • 4DN Policies - NIH Common Fund 4D Nucleome Network Policies.
  • Governance - Repository of governance, legal and policy information for our projects.
  • Legal Notices - Legal notices for portal users.

Pinned Loading

  1. 4dn-policies 4dn-policies Public

    Policies for the NIH Common Fund 4D Nucleome Network.

    6

Repositories

Showing 10 of 93 repositories
  • utils Public

    various util modules shared amongst several projects in our organization

    4dn-dcic/utils’s past year of commit activity
    Python 4 MIT 1 1 9 Updated Nov 17, 2024
  • 4dn-dcic/Benchmark’s past year of commit activity
    Python 0 MIT 0 0 0 Updated Nov 15, 2024
  • fourfront Public

    Data portal for submitting and viewing genomic data

    4dn-dcic/fourfront’s past year of commit activity
    JavaScript 13 MIT 2 0 30 Updated Nov 15, 2024
  • 4dn-dcic/docker-4dn-bedtobeddb’s past year of commit activity
    Shell 0 0 0 2 Updated Nov 14, 2024
  • foursight Public

    Providing insight into your application using AWS infrastructure.

    4dn-dcic/foursight’s past year of commit activity
    Python 7 MIT 0 0 2 Updated Nov 13, 2024
  • 4dn-dcic/docker-md5’s past year of commit activity
    Shell 1 0 0 0 Updated Nov 12, 2024
  • snovault Public

    The SnoVault general purpose hybrid object-relational database

    4dn-dcic/snovault’s past year of commit activity
    Python 1 1 0 11 Updated Nov 9, 2024
  • react-workflow-viz Public

    React component for visualizing CWL-like workflows (and similar data)

    4dn-dcic/react-workflow-viz’s past year of commit activity
    JavaScript 9 0 2 13 Updated Oct 30, 2024
  • docker-4dn-hic Public

    Docker for 4DN Hi-C processing pipeline

    4dn-dcic/docker-4dn-hic’s past year of commit activity
    Common Workflow Language 58 MIT 18 2 0 Updated Oct 28, 2024
  • shared-portal-components Public

    Common components for use by 4DN and CGAP portal(s)

    4dn-dcic/shared-portal-components’s past year of commit activity
    JavaScript 2 MIT 0 0 12 Updated Oct 17, 2024