Skip to content

Commit

Permalink
Built site for gh-pages
Browse files Browse the repository at this point in the history
  • Loading branch information
Quarto GHA Workflow Runner committed Mar 18, 2024
1 parent 15c4640 commit a5f71ff
Show file tree
Hide file tree
Showing 13 changed files with 175 additions and 1,653 deletions.
2 changes: 1 addition & 1 deletion .nojekyll
Original file line number Diff line number Diff line change
@@ -1 +1 @@
9354ee7a
3d9b7359
10 changes: 0 additions & 10 deletions .well-known/security.txt

This file was deleted.

2 changes: 2 additions & 0 deletions about.html
Original file line number Diff line number Diff line change
Expand Up @@ -370,13 +370,15 @@ <h1 class="title">About</h1>
<section id="about-magasin" class="level2" data-number="1">
<h2 data-number="1" class="anchored" data-anchor-id="about-magasin"><span class="header-section-number">1</span> About Magasin</h2>
<p>Magasin (pronounced /ma.ɡa.zɛ̃/) is an end-to-end collection of open-source tools that are stitched together to provide enterprise ready automated ingestion, transformation, and storage as well as the enabling infrastructure and tools to perform data analysis, visualization of datasets and ML / AI.</p>
<p>You can learn more about <a href="./why-magasin.html">why we created magasin</a> and its <a href="./architecture.html">architecture</a>.</p>
</section>
<section id="brief-history" class="level2" data-number="2">
<h2 data-number="2" class="anchored" data-anchor-id="brief-history"><span class="header-section-number">2</span> Brief history</h2>
<p>Magasin grew out of Office of Innovation’s and Information and Communication Technology Division (ICTD) work to establish a <a href="https://www.rapidpro.io">RapidPro</a> Data Warehouse to enable aggregation of global metrics across vendor instances.</p>
<p>Also informed by experiences of the <a href="https://www.unicef.org/innovation/Magicbox">Magic Box</a> applied data science initiative, a range of components were evaluated and trialed with country offices to arrive at the current components and architecture.</p>
<p>In 2021, ICTD engaged one of its long term agreement vendors to assist with evolving the proof-of-concept into a minimum viable product (MVP).</p>
<p>In 2023, UNICEF started the journey to detach <em>magasin</em> from its organizational and cloud infrastructure dependencies, and release it as an open-source platform with the goal of becoming a <a href="https://digitalpublicgoods.net/digital-public-goods/">Digital Public Good</a>.</p>
<p>In <a href="https://en.wikipedia.org/wiki/Groundhog_Day_(film)">February 2nd</a>,2024, UNICEF released magasin as an <a href="https://github.com/unicef/magasin">open source</a> solution. In this release, it was included an <a href="install/">easy to install process</a>, as well as <a href="get-started/">how to get started documentation</a>.</p>


</section>
Expand Down
132 changes: 67 additions & 65 deletions architecture.html

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion get-started/automate-data-ingestion.html
Original file line number Diff line number Diff line change
Expand Up @@ -599,7 +599,7 @@ <h3 data-number="3.1" class="anchored" data-anchor-id="add-the-pipeline-code"><s
<span id="cb14-9"><a href="#cb14-9" aria-hidden="true" tabindex="-1"></a> <span class="co">#...</span></span>
<span id="cb14-10"><a href="#cb14-10" aria-hidden="true" tabindex="-1"></a>)</span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
</div>
<p>Ok, So now let’s test if this is working so far. To do that we will first install the pipeline package in <a href="https://pip.pypa.io/en/latest/topics/local-project-installs/#editable-installs">editable mode</a> (<code>-e</code>). This allows you to edit the package without needing to install it again.</p>
<p>Ok, so now let’s test if this is working so far. To do that we will first install the pipeline package in <a href="https://pip.pypa.io/en/latest/topics/local-project-installs/#editable-installs">editable mode</a> (<code>-e</code>). This allows you to edit the package without needing to install it again.</p>
<div class="sourceCode" id="cb15"><pre class="sourceCode sh code-with-copy"><code class="sourceCode bash"><span id="cb15-1"><a href="#cb15-1" aria-hidden="true" tabindex="-1"></a><span class="ex">pip</span> install <span class="at">-e</span> <span class="st">'.[dev]'</span></span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
<p>Then, we will launch the Dagster user interface:</p>
<div class="sourceCode" id="cb16"><pre class="sourceCode sh code-with-copy"><code class="sourceCode bash"><span id="cb16-1"><a href="#cb16-1" aria-hidden="true" tabindex="-1"></a><span class="ex">dagster</span> dev</span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
Expand Down
11 changes: 6 additions & 5 deletions get-started/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -377,7 +377,7 @@
<h2 id="toc-title">On this page</h2>

<ul>
<li><a href="#pre-requisite-a-kubernetes-cluster" id="toc-pre-requisite-a-kubernetes-cluster" class="nav-link active" data-scroll-target="#pre-requisite-a-kubernetes-cluster"><span class="header-section-number">1</span> Pre-requisite: a Kubernetes cluster</a></li>
<li><a href="#install-pre-requisite-a-kubernetes-cluster" id="toc-install-pre-requisite-a-kubernetes-cluster" class="nav-link active" data-scroll-target="#install-pre-requisite-a-kubernetes-cluster"><span class="header-section-number">1</span> Install pre-requisite: a Kubernetes cluster</a></li>
<li><a href="#install-magasin" id="toc-install-magasin" class="nav-link" data-scroll-target="#install-magasin"><span class="header-section-number">2</span> Install magasin</a></li>
<li><a href="#verify-everything-is-working" id="toc-verify-everything-is-working" class="nav-link" data-scroll-target="#verify-everything-is-working"><span class="header-section-number">3</span> Verify everything is working</a></li>
<li><a href="#next-steps" id="toc-next-steps" class="nav-link" data-scroll-target="#next-steps"><span class="header-section-number">4</span> Next steps</a></li>
Expand Down Expand Up @@ -406,11 +406,12 @@ <h1 class="title">Get started</h1>
</header>


<p>Magasin is a scalable end-to-end data platform based on open-source components that is natively run in a <a href="https://kubernetes.io">Kubernetes cluster</a>.</p>
<p>Magasin is a scalable end-to-end data platform based on <a href="../architecture.html#magasins-components">open-source components</a> that is natively run in a <a href="https://kubernetes.io">Kubernetes cluster</a>.</p>
<p>Magasin offers a value-for-money end-to-end data solution implementing a <a href="../architecture.html#loosely-coupled-architecture">loosely-coupled architecture</a> for organizations that need to setup a framework to scale the ingestion, storage, analysis and visualization of datasets. In addition, It also includes the capability of parallel computing for analyzing large datasets or AI model training.</p>
<p>In this getting started you will install magasin on your local machine for testing purposes, then you will perform an <a href="../get-started/tutorial-overview.html">end-to-end data processing task</a> that involves: <a href="../get-started/exploratory-analysis.html">exploratory analysis</a> of a data source, <a href="../get-started/automate-data-ingestion.html">creating a pipeline</a> to automate data ingestion and <a href="../get-started/create-a-dashboard.html">authoring a dashboard</a> to present your findings.</p>
<p>Let’s start by getting the pre-requisites:</p>
<section id="pre-requisite-a-kubernetes-cluster" class="level2" data-number="1">
<h2 data-number="1" class="anchored" data-anchor-id="pre-requisite-a-kubernetes-cluster"><span class="header-section-number">1</span> Pre-requisite: a Kubernetes cluster</h2>
<p>Before you continue, you may want to learn more about <strong><a href="../why-magasin.html">why magasin</a></strong> and its <a href="../architecture.html">technical architecture</a>, otherwise, let’s start by knowing the pre-requisite for installing magasin.</p>
<section id="install-pre-requisite-a-kubernetes-cluster" class="level2" data-number="1">
<h2 data-number="1" class="anchored" data-anchor-id="install-pre-requisite-a-kubernetes-cluster"><span class="header-section-number">1</span> Install pre-requisite: a Kubernetes cluster</h2>
<p>Prior to installing magasin, you need to have a Kubernetes cluster. But don’t worry, you can setup one on your local machine very easily. In layman terms, Kubernetes is just a technology that enables managing cloud ready applications, such as magasin.</p>
<p>In this getting started tutorial, we are going to setup a Kubernetes cluster through <a href="https://docs.docker.com/desktop/">Docker Desktop</a>, an application that can be installed on most computers. However, if you already have a cluster you can go directly to the <a href="#install-magasin">install magasin section</a>.</p>
<p>First, install Docker Desktop. It is available for:</p>
Expand Down
2 changes: 1 addition & 1 deletion index.html
Original file line number Diff line number Diff line change
Expand Up @@ -137,7 +137,7 @@ <h3 class="anchored">
</p>
<p><img src="images/enabling-capabilities.png" alt=""></p>
<div class="hero-buttons">
<p><a href="./get-started/index.html" class="btn-action-primary btn-action btn btn-primary btn-lg" role="button">Get Started</a></p>
<p><a href="./get-started/index.html" class="btn-action-primary btn-action btn btn-primary btn-lg" role="button">Get started</a> <a href="./get-started/index.html" class="btn-action-primary btn btn-outline-primary btn-lg" role="button">Why magasin</a></p>
</div>
</div>

Expand Down
Loading

0 comments on commit a5f71ff

Please sign in to comment.