Skip to content

Commit

Permalink
Built site for gh-pages
Browse files Browse the repository at this point in the history
  • Loading branch information
Quarto GHA Workflow Runner committed Sep 17, 2023
1 parent 61780de commit 74b0d7e
Show file tree
Hide file tree
Showing 3 changed files with 32 additions and 31 deletions.
2 changes: 1 addition & 1 deletion .nojekyll
Original file line number Diff line number Diff line change
@@ -1 +1 @@
d25fd2ee
9229f673
7 changes: 4 additions & 3 deletions chapters/sec3/3-3-ent-scale.html
Original file line number Diff line number Diff line change
Expand Up @@ -356,9 +356,10 @@ <h1 class="title"><span id="sec-ent-scale" class="quarto-section-identifier"><sp

</header>

<p>Managing compute is no mean feat at enterprise scales. Patterns that might work at smaller scales start to break down when the environment needs to support 100 or 500 or even 1,000 data scientists working on the same platform.</p>
<p>Supporting that many users involves much more complexity and expense because you absolutely have to have multiple – perhaps many – servers. With so many users, you’re probably supporting a variety of different types of work, which adds complexity. Additionally, downtime becomes very expensive, so the stability of the system becomes paramount and overall expense can be quite high.</p>
<p>This chapter will help you understand how enterprise IT/Admins think about managing a lot of servers and how to communicate with them about your needs as a data scientist.</p>
<p>There are two reasons to scale a data science cluster. The first is that you’re doing basically laptop-sized jobs but a lot of them. The second is that you’ve got jobs that exceed the capacity of an individual laptop.</p>
<p>In an enterprise context, it’s very plausible that your IT/Admin team is confronting both of these problems. A platform that needs to support 100 or 500 or even 1,000 data scientists has scale issues because of the sheer number of users, and also probably has to support a bunch of different use cases.</p>
<p>Providing that platform to users involves a lot of complexity and expense because the IT/Admin group is managing multiple – perhaps many – servers. And as the number of users and importance of a data science platform rises, downtime becomes very expensive, so the stability of the system becomes paramount.</p>
<p>This chapter will help you understand how enterprise IT/Admins think about managing and scaling that many servers to create a stable platform. It will also help you figure out what you need to communicate to your organization’s IT/Admins about the scale of your work.</p>
<section id="devops-best-practices" class="level2" data-number="17.1">
<h2 data-number="17.1" class="anchored" data-anchor-id="devops-best-practices"><span class="header-section-number">17.1</span> DevOps best practices</h2>
<p>In an enterprise, the IT/Admin group is managing dozens or hundreds or thousands of servers. In order to keep that many servers manageable, the IT/Admin group tries to keep those servers very standardized and interchangeable. This idea is often encompassed in the adage that “servers should be cattle, not pets”. That means that you almost certainty won’t be allowed to SSH in and just make changes that you might want as a data scientist.</p>
Expand Down
54 changes: 27 additions & 27 deletions sitemap.xml
Original file line number Diff line number Diff line change
Expand Up @@ -2,110 +2,110 @@
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
<url>
<loc>https://do4ds.com/index.html</loc>
<lastmod>2023-09-14T17:02:25.551Z</lastmod>
<lastmod>2023-09-17T09:42:10.296Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/intro.html</loc>
<lastmod>2023-09-14T17:02:25.559Z</lastmod>
<lastmod>2023-09-17T09:42:10.308Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/sec1/1-0-sec-intro.html</loc>
<lastmod>2023-09-14T17:02:25.571Z</lastmod>
<lastmod>2023-09-17T09:42:10.316Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/sec1/1-1-env-as-code.html</loc>
<lastmod>2023-09-14T17:02:25.591Z</lastmod>
<lastmod>2023-09-17T09:42:10.348Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/sec1/1-2-proj-arch.html</loc>
<lastmod>2023-09-14T17:02:25.607Z</lastmod>
<lastmod>2023-09-17T09:42:10.368Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/sec1/1-3-data-access.html</loc>
<lastmod>2023-09-14T17:02:25.647Z</lastmod>
<lastmod>2023-09-17T09:42:10.416Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/sec1/1-4-monitor-log.html</loc>
<lastmod>2023-09-14T17:02:25.675Z</lastmod>
<lastmod>2023-09-17T09:42:10.452Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/sec1/1-5-deployments.html</loc>
<lastmod>2023-09-14T17:02:25.695Z</lastmod>
<lastmod>2023-09-17T09:42:10.472Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/sec1/1-6-docker.html</loc>
<lastmod>2023-09-14T17:02:25.719Z</lastmod>
<lastmod>2023-09-17T09:42:10.493Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/sec2/2-0-sec-intro.html</loc>
<lastmod>2023-09-14T17:02:25.727Z</lastmod>
<lastmod>2023-09-17T09:42:10.501Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/sec2/2-1-cloud.html</loc>
<lastmod>2023-09-14T17:02:25.747Z</lastmod>
<lastmod>2023-09-17T09:42:10.537Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/sec2/2-2-cmd-line.html</loc>
<lastmod>2023-09-14T17:02:25.771Z</lastmod>
<lastmod>2023-09-17T09:42:10.557Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/sec2/2-3-linux.html</loc>
<lastmod>2023-09-14T17:02:25.795Z</lastmod>
<lastmod>2023-09-17T09:42:10.593Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/sec2/2-4-app-admin.html</loc>
<lastmod>2023-09-14T17:02:25.827Z</lastmod>
<lastmod>2023-09-17T09:42:10.617Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/sec2/2-5-scale.html</loc>
<lastmod>2023-09-14T17:02:25.863Z</lastmod>
<lastmod>2023-09-17T09:42:10.665Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/sec2/2-6-networking.html</loc>
<lastmod>2023-09-14T17:02:25.907Z</lastmod>
<lastmod>2023-09-17T09:42:10.717Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/sec2/2-7-dns.html</loc>
<lastmod>2023-09-14T17:02:25.923Z</lastmod>
<lastmod>2023-09-17T09:42:10.753Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/sec2/2-8-ssl.html</loc>
<lastmod>2023-09-14T17:02:25.931Z</lastmod>
<lastmod>2023-09-17T09:42:10.765Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/sec3/3-0-sec-intro.html</loc>
<lastmod>2023-09-14T17:02:25.939Z</lastmod>
<lastmod>2023-09-17T09:42:10.773Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/sec3/3-1-ent-networks.html</loc>
<lastmod>2023-09-14T17:02:25.955Z</lastmod>
<lastmod>2023-09-17T09:42:10.789Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/sec3/3-2-auth.html</loc>
<lastmod>2023-09-14T17:02:25.967Z</lastmod>
<lastmod>2023-09-17T09:42:10.801Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/sec3/3-3-ent-scale.html</loc>
<lastmod>2023-09-14T17:02:25.979Z</lastmod>
<lastmod>2023-09-17T09:42:10.817Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/sec3/3-4-ent-pm.html</loc>
<lastmod>2023-09-14T17:02:25.999Z</lastmod>
<lastmod>2023-09-17T09:42:10.829Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/append/auth.html</loc>
<lastmod>2023-09-14T17:02:26.007Z</lastmod>
<lastmod>2023-09-17T09:42:10.845Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/append/lb.html</loc>
<lastmod>2023-09-14T17:02:26.015Z</lastmod>
<lastmod>2023-09-17T09:42:10.869Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/append/lab-map.html</loc>
<lastmod>2023-09-14T17:02:26.027Z</lastmod>
<lastmod>2023-09-17T09:42:10.877Z</lastmod>
</url>
<url>
<loc>https://do4ds.com/chapters/append/cheatsheets.html</loc>
<lastmod>2023-09-14T17:02:26.063Z</lastmod>
<lastmod>2023-09-17T09:42:10.913Z</lastmod>
</url>
</urlset>

0 comments on commit 74b0d7e

Please sign in to comment.