t81_558_class_11_04_text_nlp.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a href=\"https://colab.research.google.com/github/jeffheaton/t81_558_deep_learning/blob/master/t81_558_class_11_04_text_nlp.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# T81-558: Applications of Deep Neural Networks\n",
    "**Module 11: Natural Language Processing and Speech Recognition**\n",
    "* Instructor: [Jeff Heaton](https://sites.wustl.edu/jeffheaton/), McKelvey School of Engineering, [Washington University in St. Louis](https://engineering.wustl.edu/Programs/Pages/default.aspx)\n",
    "* For more information visit the [class website](https://sites.wustl.edu/jeffheaton/t81-558/)."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Module 11 Material\n",
    "\n",
    "* Part 11.1: Getting Started with Spacy in Python [[Video]](https://www.youtube.com/watch?v=A5BtU9vXzu8&list=PLjy4p-07OYzulelvJ5KVaT2pDlxivl_BN) [[Notebook]](t81_558_class_11_01_spacy.ipynb)\n",
    "* Part 11.2: Word2Vec and Text Classification [[Video]](https://www.youtube.com/watch?v=nWxtRlpObIs&list=PLjy4p-07OYzulelvJ5KVaT2pDlxivl_BN) [[Notebook]](t81_558_class_11_02_word2vec.ipynb)\n",
    "* Part 11.3: What are Embedding Layers in Keras [[Video]](https://www.youtube.com/watch?v=OuNH5kT-aD0&list=PLjy4p-07OYzulelvJ5KVaT2pDlxivl_BN) [[Notebook]](t81_558_class_11_03_embedding.ipynb)\n",
    "* **Part 11.4: Natural Language Processing with Spacy and Keras** [[Video]](https://www.youtube.com/watch?v=BKgwjhao5DU&list=PLjy4p-07OYzulelvJ5KVaT2pDlxivl_BN) [[Notebook]](t81_558_class_11_04_text_nlp.ipynb)\n",
    "* Part 11.5: Learning English from Scratch with Keras and TensorFlow [[Video]](https://www.youtube.com/watch?v=Y1khuuSjZzc&list=PLjy4p-07OYzulelvJ5KVaT2pDlxivl_BN&index=58) [[Notebook]](t81_558_class_11_05_english_scratch.ipynb)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Google CoLab Instructions\n",
    "\n",
    "The following code ensures that Google CoLab is running the correct version of TensorFlow."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Note: not using Google CoLab\n"
     ]
    }
   ],
   "source": [
    "try:\n",
    "    %tensorflow_version 2.x\n",
    "    COLAB = True\n",
    "    print(\"Note: using Google CoLab\")\n",
    "except:\n",
    "    print(\"Note: not using Google CoLab\")\n",
    "    COLAB = False"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Part 11.4: Natural Language Processing with Spacy and Keras\n",
    "\n",
    "In this part, we will see how to use Spacy and Keras together.\n",
    "\n",
    "### Word-Level Text Generation\n",
    "\n",
    "There are several different approaches to teaching a neural network to output free-form text.  The most basic question is if you wish the neural network to learn at the word or character level.  In many ways, learning at the character level is the more interesting of the two.  The LSTM is learning to construct its own words without even being shown what a word is.  We will begin with character-level text generation.  In the next module, we will see how we can use nearly the same technique to operate at the word level.  We will implement the automatic captioning in the next module is at the word level.\n",
    "\n",
    "We begin by importing the needed Python packages and defining the sequence length, named **maxlen**.  Time-series neural networks always accept their input as a fixed-length array.  We might not need all of the sequence elements for shorter sentences. It is common to fill extra unneeded elements with zeros.  The program divides the text into sequences of this length. Then the neural network will be trained to predict what comes after this sequence."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "from tensorflow.keras.callbacks import LambdaCallback\n",
    "from tensorflow.keras.models import Sequential\n",
    "from tensorflow.keras.layers import Dense\n",
    "from tensorflow.keras.layers import LSTM\n",
    "from tensorflow.keras.optimizers import RMSprop\n",
    "import numpy as np\n",
    "import random\n",
    "import sys\n",
    "import io\n",
    "import requests\n",
    "import re"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "ï»¿the project gutenberg ebook of treasure island, by robert louis stevenson\r\n",
      "\r\n",
      "this ebook is for the use of anyone anywhere at no cost and with\r\n",
      "almost no restrictions whatsoever.  you may copy it, give it away or\r\n",
      "re-use it under the terms of the project gutenberg license included\r\n",
      "with this ebook or online at www.gutenberg.net\r\n",
      "\r\n",
      "\r\n",
      "title: treasure island\r\n",
      "\r\n",
      "author: robert louis stevenson\r\n",
      "\r\n",
      "illustrator: milo winter\r\n",
      "\r\n",
      "release date: january 12, 2009 [ebook #27780]\r\n",
      "\r\n",
      "language: english\r\n",
      "\r\n",
      "\r\n",
      "*** start of this project gutenberg ebook treasure island ***\r\n",
      "\r\n",
      "\r\n",
      "\r\n",
      "\r\n",
      "produced by juliet sutherland, stephen blundell and the\r\n",
      "online distributed proofreading team at http://www.pgdp.net\r\n",
      "\r\n",
      "\r\n",
      "\r\n",
      "\r\n",
      "\r\n",
      "\r\n",
      "\r\n",
      "\r\n",
      "\r\n",
      " the illustrated children's library\r\n",
      "\r\n",
      "\r\n",
      "         _treasure island_\r\n",
      "\r\n",
      "       robert louis stevenson\r\n",
      "\r\n",
      "          _illustrated by_\r\n",
      "            milo winter\r\n",
      "\r\n",
      "\r\n",
      "           [illustration]\r\n",
      "\r\n",
      "\r\n",
      "           gramercy books\r\n",
      "              new york\r\n",
      "\r\n",
      "\r\n",
      "\r\n",
      "\r\n",
      " foreword copyright â© 1986 by random house v\n"
     ]
    }
   ],
   "source": [
    "import requests \n",
    "\n",
    "r = requests.get(\"https://data.heatonresearch.com/data/t81-558/text/\"\\\n",
    "                 \"treasure_island.txt\")\n",
    "raw_text = r.text.lower()\n",
    "\n",
    "print(raw_text[0:1000])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Vocab size: 6418\n"
     ]
    }
   ],
   "source": [
    "import spacy\n",
    "\n",
    "nlp = spacy.load(\"en_core_web_sm\")\n",
    "doc = nlp(raw_text)\n",
    "vocab = set()\n",
    "tokenized_text = []\n",
    "\n",
    "for token in doc:\n",
    "    word = ''.join([i if ord(i) < 128 else ' ' for i in token.text])\n",
    "    word = word.strip()\n",
    "    if not token.is_digit \\\n",
    "        and not token.like_url \\\n",
    "        and not token.like_email:\n",
    "        vocab.add(word)\n",
    "        tokenized_text.append(word)\n",
    "        \n",
    "print(f\"Vocab size: {len(vocab)}\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The above section might have given you this error:\n",
    "\n",
    "```\n",
    "OSError: [E050] Can't find model 'en_core_web_sm'. It doesn't seem to be \n",
    "a shortcut link, a Python package, or a valid path to a data directory.\n",
    "```\n",
    "\n",
    "If so, you can install Spacy with a simple PIP install. Spacy was included in the list of packages to install for this course.  You will need to ensure that you've installed a language with Spacy.  If you do not, you will get the following error:\n",
    "\n",
    "To install English, use the following command:\n",
    "\n",
    "```\n",
    "python -m spacy download en\n",
    "```\n",
    "\n",
    "We can now display the vocab words."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "['', 'dilapidation', 'supercargo', 'nautical', 'mexican', 'girdle', 'repetition', 'busiest', 'coughing', 'raged', 'spitting', 'how', 'rang', 'corpse--\"o\\'brien', 'usage', 'sentinel', 'stab', 'consequence', 'listing', 'ease']\n"
     ]
    }
   ],
   "source": [
    "print(list(vocab)[:20])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We need an easy way to convert words into indexes and vise versa. The following code builds two such indexes."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "word2idx = dict((n, v) for v, n in enumerate(vocab))\n",
    "idx2word = dict((n, v) for n, v in enumerate(vocab))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can now tokenize the text; this process replaces each word with the correct token."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [],
   "source": [
    "tokenized_text = [word2idx[word] for word in tokenized_text]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "If we display the tokenized text, we see an array of index values for each word."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[6102,\n",
       " 1109,\n",
       " 4916,\n",
       " 1052,\n",
       " 1139,\n",
       " 3461,\n",
       " 4965,\n",
       " 5162,\n",
       " 896,\n",
       " 3956,\n",
       " 4444,\n",
       " 569,\n",
       " 0,\n",
       " 5805,\n",
       " 1052,\n",
       " 2926,\n",
       " 3200,\n",
       " 6102,\n",
       " 3141,\n",
       " 1139,\n",
       " 2657,\n",
       " 4075,\n",
       " 6333,\n",
       " 1814,\n",
       " 573,\n",
       " 4969,\n",
       " 2420,\n",
       " 0,\n",
       " 5813,\n",
       " 1814,\n",
       " 425,\n",
       " 419,\n",
       " 4117,\n",
       " 0,\n",
       " 6057,\n",
       " 2672,\n",
       " 861,\n",
       " 1877,\n",
       " 5162,\n",
       " 4908,\n",
       " 1877,\n",
       " 3305,\n",
       " 3701,\n",
       " 0,\n",
       " 1067,\n",
       " 3220,\n",
       " 3141,\n",
       " 1877,\n",
       " 609,\n",
       " 6102,\n",
       " 3197,\n",
       " 1139,\n",
       " 6102,\n",
       " 1109,\n",
       " 4916,\n",
       " 4882,\n",
       " 630,\n",
       " 0,\n",
       " 2420,\n",
       " 5805,\n",
       " 1052,\n",
       " 3701,\n",
       " 2597,\n",
       " 6333,\n",
       " 0,\n",
       " 5037,\n",
       " 4943,\n",
       " 3461,\n",
       " 4965,\n",
       " 0,\n",
       " 2807,\n",
       " 4943,\n",
       " 3956,\n",
       " 4444,\n",
       " 569,\n",
       " 0,\n",
       " 3168,\n",
       " 4943,\n",
       " 2224,\n",
       " 5799,\n",
       " 0,\n",
       " 2750,\n",
       " 3799,\n",
       " 4943,\n",
       " 202,\n",
       " 5162,\n",
       " 68,\n",
       " 1052,\n",
       " 5848,\n",
       " 6355,\n",
       " 0,\n",
       " 5719,\n",
       " 4943,\n",
       " 6150,\n",
       " 0,\n",
       " 3226,\n",
       " 3226,\n",
       " 3226,\n",
       " 2067,\n",
       " 1139,\n",
       " 5805,\n",
       " 1109,\n",
       " 4916,\n",
       " 1052,\n",
       " 3461,\n",
       " 4965,\n",
       " 3226,\n",
       " 3226,\n",
       " 3226,\n",
       " 0,\n",
       " 3020,\n",
       " 896,\n",
       " 159,\n",
       " 462,\n",
       " 5162,\n",
       " 6186,\n",
       " 4170,\n",
       " 4969,\n",
       " 6102,\n",
       " 0,\n",
       " 2597,\n",
       " 3300,\n",
       " 2796,\n",
       " 4420,\n",
       " 6333,\n",
       " 0,\n",
       " 6102,\n",
       " 755,\n",
       " 3246,\n",
       " 340,\n",
       " 5127,\n",
       " 0,\n",
       " 2773,\n",
       " 3461,\n",
       " 4965,\n",
       " 2773,\n",
       " 0,\n",
       " 3956,\n",
       " 4444,\n",
       " 569,\n",
       " 0,\n",
       " 2773,\n",
       " 755,\n",
       " 896,\n",
       " 2773,\n",
       " 0,\n",
       " 2224,\n",
       " 5799,\n",
       " 0,\n",
       " 68,\n",
       " 4346,\n",
       " 6355,\n",
       " 0,\n",
       " 229,\n",
       " 4252,\n",
       " 0,\n",
       " 103,\n",
       " 4663,\n",
       " 0,\n",
       " 6393,\n",
       " 724,\n",
       " 0,\n",
       " 0,\n",
       " 896,\n",
       " 4788,\n",
       " 1523,\n",
       " 2097,\n",
       " 3816,\n",
       " 0,\n",
       " 1143,\n",
       " 1908,\n",
       " 896,\n",
       " 2224,\n",
       " 5799,\n",
       " 724,\n",
       " 0,\n",
       " 0,\n",
       " 5162,\n",
       " 896,\n",
       " 1903,\n",
       " 0,\n",
       " 1824,\n",
       " 242,\n",
       " 4142,\n",
       " 0,\n",
       " 3832,\n",
       " 5684,\n",
       " 4713,\n",
       " 4117,\n",
       " 0,\n",
       " 5805,\n",
       " 2857,\n",
       " 123,\n",
       " 896,\n",
       " 229,\n",
       " 4252,\n",
       " 5162,\n",
       " 1321,\n",
       " 245,\n",
       " 1139,\n",
       " 4788,\n",
       " 0,\n",
       " 1523,\n",
       " 2097,\n",
       " 3816,\n",
       " 5162,\n",
       " 3814,\n",
       " 2085,\n",
       " 1139,\n",
       " 4788,\n",
       " 1523,\n",
       " 5162,\n",
       " 2691,\n",
       " 4117,\n",
       " 5162,\n",
       " 4973,\n",
       " 0,\n",
       " 1219,\n",
       " 5162,\n",
       " 103,\n",
       " 4663,\n",
       " 5162,\n",
       " 1292,\n",
       " 4117,\n",
       " 0,\n",
       " 229,\n",
       " 2926,\n",
       " 3814,\n",
       " 1326,\n",
       " 6242,\n",
       " 4969,\n",
       " 6102,\n",
       " 5838,\n",
       " 2926,\n",
       " 3814,\n",
       " 6242,\n",
       " 1139,\n",
       " 0,\n",
       " 4788,\n",
       " 1523,\n",
       " 5162,\n",
       " 2691,\n",
       " 4117,\n",
       " 0,\n",
       " 4058,\n",
       " 4969,\n",
       " 4709,\n",
       " 5927,\n",
       " 6102,\n",
       " 3094,\n",
       " 1310,\n",
       " 1139,\n",
       " 147,\n",
       " 0,\n",
       " 2904,\n",
       " 2752,\n",
       " 896,\n",
       " 24,\n",
       " 181,\n",
       " 5162,\n",
       " 6143,\n",
       " 5856,\n",
       " 5162,\n",
       " 2691,\n",
       " 4117,\n",
       " 0,\n",
       " 4788,\n",
       " 1523,\n",
       " 0,\n",
       " 103,\n",
       " 4663,\n",
       " 0,\n",
       " 0,\n",
       " 3085,\n",
       " 0,\n",
       " 0,\n",
       " 948,\n",
       " 0,\n",
       " 0,\n",
       " 1962,\n",
       " 0,\n",
       " 0,\n",
       " 5595,\n",
       " 0,\n",
       " 0,\n",
       " 5127,\n",
       " 1139,\n",
       " 200,\n",
       " 4726,\n",
       " 3220,\n",
       " 5927,\n",
       " 3220,\n",
       " 4322,\n",
       " 4930,\n",
       " 0,\n",
       " 569,\n",
       " 5162,\n",
       " 3956,\n",
       " 4444,\n",
       " 5162,\n",
       " 3220,\n",
       " 4117,\n",
       " 0,\n",
       " 3461,\n",
       " 4965,\n",
       " 5552,\n",
       " 3956,\n",
       " 4444,\n",
       " 569,\n",
       " 244,\n",
       " 755,\n",
       " 5927,\n",
       " 1143,\n",
       " 896,\n",
       " 0,\n",
       " 2224,\n",
       " 5799,\n",
       " 4117,\n",
       " 0,\n",
       " 6007,\n",
       " 3199,\n",
       " 3246,\n",
       " 340,\n",
       " 5127,\n",
       " 1184,\n",
       " 0,\n",
       " 2393,\n",
       " 123,\n",
       " 4943,\n",
       " 103,\n",
       " 4663,\n",
       " 4943,\n",
       " 3246,\n",
       " 340,\n",
       " 1011,\n",
       " 5162,\n",
       " 4117,\n",
       " 0,\n",
       " 1619,\n",
       " 4943,\n",
       " 978,\n",
       " 4595,\n",
       " 4431,\n",
       " 6102,\n",
       " 2929,\n",
       " 1139,\n",
       " 3814,\n",
       " 2878,\n",
       " 6410,\n",
       " 0,\n",
       " 3540,\n",
       " 2235,\n",
       " 5551,\n",
       " 1300,\n",
       " 5162,\n",
       " 6102,\n",
       " 1733,\n",
       " 1139,\n",
       " 6102,\n",
       " 6416,\n",
       " 4969,\n",
       " 3006,\n",
       " 1408,\n",
       " 4820,\n",
       " 3814,\n",
       " 0,\n",
       " 3461,\n",
       " 1977,\n",
       " 513,\n",
       " 3127,\n",
       " 5551,\n",
       " 238,\n",
       " 3814,\n",
       " 6317,\n",
       " 340,\n",
       " 5131,\n",
       " 4117,\n",
       " 0,\n",
       " 4537,\n",
       " 3220,\n",
       " 3220,\n",
       " 3220,\n",
       " 0,\n",
       " 68,\n",
       " 4117,\n",
       " 3714,\n",
       " 3461,\n",
       " 3027,\n",
       " 5020,\n",
       " 4117,\n",
       " 4117,\n",
       " 5057,\n",
       " 3027,\n",
       " 5020,\n",
       " 4117,\n",
       " 4117,\n",
       " 1991,\n",
       " 0,\n",
       " 4969,\n",
       " 553,\n",
       " 3027,\n",
       " 5020,\n",
       " 4117,\n",
       " 4117,\n",
       " 3654,\n",
       " 4747,\n",
       " 3027,\n",
       " 6238,\n",
       " 0,\n",
       " 2736,\n",
       " 3027,\n",
       " 5020,\n",
       " 4117,\n",
       " 6355,\n",
       " 1225,\n",
       " 5799,\n",
       " 5162,\n",
       " 2224,\n",
       " 5162,\n",
       " 3220,\n",
       " 5162,\n",
       " 1148,\n",
       " 4117,\n",
       " 4318,\n",
       " 4117,\n",
       " 5037,\n",
       " 4117,\n",
       " 0,\n",
       " 4300,\n",
       " 4117,\n",
       " 1334,\n",
       " 4117,\n",
       " 0,\n",
       " 3441,\n",
       " 1358,\n",
       " 0,\n",
       " 68,\n",
       " 3503,\n",
       " 0,\n",
       " 0,\n",
       " 0,\n",
       " 4742,\n",
       " 340,\n",
       " 5495,\n",
       " 4943,\n",
       " 0,\n",
       " 1242,\n",
       " 5235,\n",
       " 4969,\n",
       " 251,\n",
       " 4228,\n",
       " 5265,\n",
       " 1072,\n",
       " 4140,\n",
       " 2876,\n",
       " 0,\n",
       " 5495,\n",
       " 4117,\n",
       " 3396,\n",
       " 4969,\n",
       " 4814,\n",
       " 6357,\n",
       " 5265,\n",
       " 1072,\n",
       " 2439,\n",
       " 5162,\n",
       " 5257,\n",
       " 0,\n",
       " 4706,\n",
       " 5054,\n",
       " 4596,\n",
       " 1072,\n",
       " 3531,\n",
       " 4117,\n",
       " 1143,\n",
       " 2549,\n",
       " 5265,\n",
       " 0,\n",
       " 1072,\n",
       " 5506,\n",
       " 966,\n",
       " 238,\n",
       " 5035,\n",
       " 885,\n",
       " 244,\n",
       " 6102,\n",
       " 1597,\n",
       " 1143,\n",
       " 2549,\n",
       " 1597,\n",
       " 0,\n",
       " 18,\n",
       " 762,\n",
       " 5124,\n",
       " 4058,\n",
       " 238,\n",
       " 2183,\n",
       " 6102,\n",
       " 1448,\n",
       " 3532,\n",
       " 4117,\n",
       " 0,\n",
       " 6346,\n",
       " 0,\n",
       " 5062,\n",
       " 0,\n",
       " 2773,\n",
       " 238,\n",
       " 6102,\n",
       " 2207,\n",
       " 4474,\n",
       " 2773,\n",
       " 0,\n",
       " 2773,\n",
       " 1760,\n",
       " 2773,\n",
       " 0,\n",
       " 2773,\n",
       " 3278,\n",
       " 1139,\n",
       " 1143,\n",
       " 2549,\n",
       " 2773,\n",
       " 0,\n",
       " 2773,\n",
       " 5611,\n",
       " 2773,\n",
       " 0,\n",
       " 2773,\n",
       " 5027,\n",
       " 2773,\n",
       " 0,\n",
       " 2773,\n",
       " 1513,\n",
       " 2773,\n",
       " 0,\n",
       " 192,\n",
       " 3621,\n",
       " 0,\n",
       " 6102,\n",
       " 3404,\n",
       " 3886,\n",
       " 0,\n",
       " 4218,\n",
       " 0,\n",
       " 1225,\n",
       " 6333,\n",
       " 6102,\n",
       " 3546,\n",
       " 1792,\n",
       " 4363,\n",
       " 3546,\n",
       " 0,\n",
       " 0,\n",
       " 4318,\n",
       " 4117,\n",
       " 4655,\n",
       " 1549,\n",
       " 2545,\n",
       " 4969,\n",
       " 595,\n",
       " 0,\n",
       " 0,\n",
       " 4300,\n",
       " 4117,\n",
       " 6102,\n",
       " 4655,\n",
       " 1886,\n",
       " 0,\n",
       " 0,\n",
       " 570,\n",
       " 4117,\n",
       " 6102,\n",
       " 1437,\n",
       " 3220,\n",
       " 5109,\n",
       " 0,\n",
       " 0,\n",
       " 2107,\n",
       " 6102,\n",
       " 890,\n",
       " 1139,\n",
       " 6102,\n",
       " 5207,\n",
       " 4654,\n",
       " 0,\n",
       " 0,\n",
       " 537,\n",
       " 4117,\n",
       " 6102,\n",
       " 126,\n",
       " 340,\n",
       " 4544,\n",
       " 0,\n",
       " 0,\n",
       " 192,\n",
       " 4318,\n",
       " 0,\n",
       " 6102,\n",
       " 1437,\n",
       " 3220,\n",
       " 4384,\n",
       " 0,\n",
       " 45,\n",
       " 4117,\n",
       " 3621,\n",
       " 3134,\n",
       " 238,\n",
       " 5692,\n",
       " 0,\n",
       " 0,\n",
       " 1760,\n",
       " 4117,\n",
       " 6333,\n",
       " 6102,\n",
       " 4847,\n",
       " 1139,\n",
       " 6102,\n",
       " 3546,\n",
       " 3611,\n",
       " 3220,\n",
       " 1377,\n",
       " 3546,\n",
       " 0,\n",
       " 0,\n",
       " 5611,\n",
       " 4117,\n",
       " 927,\n",
       " 4969,\n",
       " 4510,\n",
       " 0,\n",
       " 0,\n",
       " 916,\n",
       " 6102,\n",
       " 2437,\n",
       " 0,\n",
       " 0,\n",
       " 1626,\n",
       " 4117,\n",
       " 1606,\n",
       " 3621,\n",
       " 3332,\n",
       " 5927,\n",
       " 6102,\n",
       " 4776,\n",
       " 1536,\n",
       " 0,\n",
       " 0,\n",
       " 4234,\n",
       " 4117,\n",
       " 2703,\n",
       " 1139,\n",
       " 5542,\n",
       " 0,\n",
       " 0,\n",
       " 192,\n",
       " 4300,\n",
       " 0,\n",
       " 4001,\n",
       " 511,\n",
       " 1991,\n",
       " 0,\n",
       " 4565,\n",
       " 4117,\n",
       " 11,\n",
       " 4001,\n",
       " 511,\n",
       " 1991,\n",
       " 1829,\n",
       " 0,\n",
       " 0,\n",
       " 765,\n",
       " 4117,\n",
       " 6102,\n",
       " 259,\n",
       " 4405,\n",
       " 0,\n",
       " 0,\n",
       " 3810,\n",
       " 4117,\n",
       " 6102,\n",
       " 4654,\n",
       " 1139,\n",
       " 6102,\n",
       " 4965,\n",
       " 0,\n",
       " 0,\n",
       " 192,\n",
       " 570,\n",
       " 0,\n",
       " 6102,\n",
       " 5964,\n",
       " 0,\n",
       " 1068,\n",
       " 4117,\n",
       " 6415,\n",
       " 4956,\n",
       " 896,\n",
       " 6102,\n",
       " 1813,\n",
       " 3027,\n",
       " 11,\n",
       " 6102,\n",
       " 136,\n",
       " 0,\n",
       " 6184,\n",
       " 4904,\n",
       " 0,\n",
       " 0,\n",
       " 4588,\n",
       " 4117,\n",
       " 6415,\n",
       " 4956,\n",
       " 896,\n",
       " 6102,\n",
       " 1813,\n",
       " 3027,\n",
       " 6102,\n",
       " 0,\n",
       " 37,\n",
       " 3220,\n",
       " 656,\n",
       " 340,\n",
       " 890,\n",
       " 3641,\n",
       " 0,\n",
       " 0,\n",
       " 1313,\n",
       " 4117,\n",
       " 6415,\n",
       " 4956,\n",
       " 896,\n",
       " 6102,\n",
       " 1813,\n",
       " 3027,\n",
       " 5063,\n",
       " 1139,\n",
       " 6102,\n",
       " 0,\n",
       " 259,\n",
       " 1424,\n",
       " 340,\n",
       " 1390,\n",
       " 0,\n",
       " 0,\n",
       " 3032,\n",
       " 4117,\n",
       " 6415,\n",
       " 3660,\n",
       " 896,\n",
       " 1621,\n",
       " 6051,\n",
       " 3027,\n",
       " 6102,\n",
       " 489,\n",
       " 0,\n",
       " 5927,\n",
       " 6102,\n",
       " 5964,\n",
       " 0,\n",
       " 0,\n",
       " 2346,\n",
       " 4117,\n",
       " 2351,\n",
       " 340,\n",
       " 2870,\n",
       " 0,\n",
       " 0,\n",
       " 692,\n",
       " 4117,\n",
       " 6102,\n",
       " 3403,\n",
       " 0,\n",
       " 0,\n",
       " 192,\n",
       " 313,\n",
       " 0,\n",
       " 4001,\n",
       " 1437,\n",
       " 1991,\n",
       " 0,\n",
       " 6283,\n",
       " 4117,\n",
       " 11,\n",
       " 4001,\n",
       " 1437,\n",
       " 1991,\n",
       " 1829,\n",
       " 0,\n",
       " 0,\n",
       " 2559,\n",
       " 4117,\n",
       " 6102,\n",
       " 3436,\n",
       " 3220,\n",
       " 5169,\n",
       " 2801,\n",
       " 0,\n",
       " 0,\n",
       " 2247,\n",
       " 4117,\n",
       " 6102,\n",
       " 875,\n",
       " 1139,\n",
       " 6102,\n",
       " 3018,\n",
       " 0,\n",
       " 0,\n",
       " 460,\n",
       " 4117,\n",
       " 3621,\n",
       " 6293,\n",
       " 6102,\n",
       " 37,\n",
       " 5399,\n",
       " 0,\n",
       " 0,\n",
       " 1518,\n",
       " 4117,\n",
       " 3798,\n",
       " 4737,\n",
       " 0,\n",
       " 0,\n",
       " 5160,\n",
       " 4117,\n",
       " 3546,\n",
       " 3717,\n",
       " 1139,\n",
       " 4365,\n",
       " 3546,\n",
       " 0,\n",
       " 0,\n",
       " 192,\n",
       " 537,\n",
       " 0,\n",
       " 126,\n",
       " 2351,\n",
       " 0,\n",
       " 1244,\n",
       " 4117,\n",
       " 5927,\n",
       " 6102,\n",
       " 1399,\n",
       " 340,\n",
       " 6099,\n",
       " 0,\n",
       " 0,\n",
       " 1559,\n",
       " 4117,\n",
       " 6102,\n",
       " 4655,\n",
       " 1886,\n",
       " 2747,\n",
       " 0,\n",
       " 0,\n",
       " 4781,\n",
       " 4117,\n",
       " 3880,\n",
       " 1556,\n",
       " 0,\n",
       " 0,\n",
       " 5268,\n",
       " 4117,\n",
       " 6102,\n",
       " 3461,\n",
       " 3220,\n",
       " 243,\n",
       " 3027,\n",
       " 972,\n",
       " 340,\n",
       " 801,\n",
       " 0,\n",
       " 0,\n",
       " 854,\n",
       " 4117,\n",
       " 6102,\n",
       " 3461,\n",
       " 3220,\n",
       " 243,\n",
       " 3027,\n",
       " 6102,\n",
       " 2003,\n",
       " 4634,\n",
       " 6102,\n",
       " 5909,\n",
       " 0,\n",
       " 0,\n",
       " 970,\n",
       " 4117,\n",
       " 6102,\n",
       " 3037,\n",
       " 1139,\n",
       " 3814,\n",
       " 4954,\n",
       " 0,\n",
       " 0,\n",
       " 1460,\n",
       " 4117,\n",
       " 4969,\n",
       " 890,\n",
       " 0,\n",
       " 0,\n",
       " 238,\n",
       " 6102,\n",
       " 2207,\n",
       " 4474,\n",
       " 0,\n",
       " 3033,\n",
       " 362,\n",
       " 3687,\n",
       " 238,\n",
       " 362,\n",
       " 5404,\n",
       " 5162,\n",
       " 0,\n",
       " 819,\n",
       " 4969,\n",
       " 1991,\n",
       " 5162,\n",
       " 1455,\n",
       " 4969,\n",
       " 1763,\n",
       " 5162,\n",
       " 0,\n",
       " 3033,\n",
       " 5910,\n",
       " 5162,\n",
       " 260,\n",
       " 5162,\n",
       " 4969,\n",
       " 681,\n",
       " 0,\n",
       " 4969,\n",
       " 5460,\n",
       " 4969,\n",
       " 3714,\n",
       " 5493,\n",
       " 5162,\n",
       " 0,\n",
       " 4969,\n",
       " 3832,\n",
       " 6102,\n",
       " 3404,\n",
       " 763,\n",
       " 5162,\n",
       " 4607,\n",
       " 0,\n",
       " 740,\n",
       " 5927,\n",
       " 6102,\n",
       " 2489,\n",
       " 480,\n",
       " 5162,\n",
       " 0,\n",
       " 6065,\n",
       " 1069,\n",
       " 5162,\n",
       " 5124,\n",
       " 2314,\n",
       " 2424,\n",
       " 4492,\n",
       " 1139,\n",
       " 3404,\n",
       " 5162,\n",
       " 0,\n",
       " 6102,\n",
       " 2606,\n",
       " 3213,\n",
       " 1139,\n",
       " 238,\n",
       " 3220,\n",
       " 1424,\n",
       " 4943,\n",
       " 0,\n",
       " 2681,\n",
       " 4409,\n",
       " 1877,\n",
       " 5162,\n",
       " 4969,\n",
       " 3037,\n",
       " 3880,\n",
       " 5417,\n",
       " 3033,\n",
       " 4401,\n",
       " 5162,\n",
       " 0,\n",
       " 3033,\n",
       " 3463,\n",
       " 4202,\n",
       " 1814,\n",
       " 1327,\n",
       " 1010,\n",
       " 5162,\n",
       " 0,\n",
       " 5181,\n",
       " 2489,\n",
       " 3484,\n",
       " 1748,\n",
       " 5162,\n",
       " 0,\n",
       " ...]"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "tokenized_text"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Next, we break the tokenized text into sequences that are of consistent length.  It is necessary to specify this length; here we use a sequence length of 6."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "nb sequences: 32016\n"
     ]
    }
   ],
   "source": [
    "# cut the text in semi-redundant sequences of maxlen words\n",
    "maxlen = 6\n",
    "step = 3\n",
    "sentences = []\n",
    "next_words = []\n",
    "for i in range(0, len(tokenized_text) - maxlen, step):\n",
    "    sentences.append(tokenized_text[i: i + maxlen])\n",
    "    next_words.append(tokenized_text[i + maxlen])\n",
    "print('nb sequences:', len(sentences))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can display the first five sequences to get an idea of the appearance of the data."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[[6102, 1109, 4916, 1052, 1139, 3461],\n",
       " [1052, 1139, 3461, 4965, 5162, 896],\n",
       " [4965, 5162, 896, 3956, 4444, 569],\n",
       " [3956, 4444, 569, 0, 5805, 1052],\n",
       " [0, 5805, 1052, 2926, 3200, 6102]]"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "sentences[0:5]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Finally, we create the $x$ and $y$ vectors.  The $x$ is a Numpy encoding of the tokenization that we just performed.  We use the first six elements of each tokenization to predict the seventh element.  We convert the next element to dummy variables, and it becomes the $y$.  For each of the sequences, we teach the neural network to predict the sixth element (or word) based on the previous five elements."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Vectorization...\n"
     ]
    }
   ],
   "source": [
    "import numpy as np\n",
    "\n",
    "print('Vectorization...')\n",
    "x = np.zeros((len(sentences), maxlen, len(vocab)), dtype=np.bool)\n",
    "y = np.zeros((len(sentences), len(vocab)), dtype=np.bool)\n",
    "for i, sentence in enumerate(sentences):\n",
    "    for t, word in enumerate(sentence):\n",
    "        x[i, t, word] = 1\n",
    "    y[i, next_words[i]] = 1"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We display the shapes of the $x$ and $y$."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(32016, 6, 6418)"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "x.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(32016, 6418)"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "y.shape"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Because we encoded the $y$ value o dummy variables we can see, there are 6,418 elements for each row of $y$.  This large number of elements is because there are 6,418 words in the vocabulary.  Large vocabularies can significantly increase the amount of memory needed."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[False, False, False, ..., False, False, False],\n",
       "       [False, False, False, ..., False, False, False],\n",
       "       [ True, False, False, ..., False, False, False],\n",
       "       [False, False, False, ..., False, False, False],\n",
       "       [False, False, False, ..., False, False, False]])"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "y[0:5]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now we can train an LSTM-based neural network to generate text."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Build model...\n"
     ]
    }
   ],
   "source": [
    "# build the model: a single LSTM\n",
    "print('Build model...')\n",
    "model = Sequential()\n",
    "model.add(LSTM(128, input_shape=(maxlen, len(vocab))))\n",
    "model.add(Dense(len(vocab), activation='softmax'))\n",
    "\n",
    "optimizer = RMSprop(lr=0.01)\n",
    "model.compile(loss='categorical_crossentropy', optimizer=optimizer)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Model: \"sequential\"\n",
      "_________________________________________________________________\n",
      "Layer (type)                 Output Shape              Param #   \n",
      "=================================================================\n",
      "lstm (LSTM)                  (None, 128)               3352064   \n",
      "_________________________________________________________________\n",
      "dense (Dense)                (None, 6418)              827922    \n",
      "=================================================================\n",
      "Total params: 4,179,986\n",
      "Trainable params: 4,179,986\n",
      "Non-trainable params: 0\n",
      "_________________________________________________________________\n"
     ]
    }
   ],
   "source": [
    "model.summary()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This function collects sample generations from the neural network.  The temperature variable specifies how conservative, or less random, the predictions will be.  Higher temperatures encourage more \"creativity\" from the neural network; however, they also promote more nonsensical output."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [],
   "source": [
    "def sample(preds, temperature=1.0):\n",
    "    # helper function to sample an index from a probability array\n",
    "    preds = np.asarray(preds).astype('float64')\n",
    "    preds = np.log(preds) / temperature\n",
    "    exp_preds = np.exp(preds)\n",
    "    preds = exp_preds / np.sum(exp_preds)\n",
    "    probas = np.random.multinomial(1, preds, 1)\n",
    "    return np.argmax(probas)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Keras calls the following function at the end of each training Epoch.  The code generates sample text generations that visually demonstrate the neural network better at text generation.  As the neural network trains, the generations should look more realistic."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [],
   "source": [
    "def on_epoch_end(epoch, _):\n",
    "    # Function invoked at end of each epoch. Prints generated text.\n",
    "    print(\"******************************************************\")\n",
    "    print('----- Generating text after Epoch: %d' % epoch)\n",
    "\n",
    "    start_index = random.randint(0, len(tokenized_text) - maxlen)\n",
    "    for temperature in [0.2, 0.5, 1.0, 1.2]:\n",
    "        print('----- temperature:', temperature)\n",
    "\n",
    "        #generated = ''\n",
    "        sentence = tokenized_text[start_index: start_index + maxlen]\n",
    "        #generated += sentence\n",
    "        o = ' '.join([idx2word[idx] for idx in sentence])\n",
    "        print(f'----- Generating with seed: \"{o}\"')\n",
    "        #sys.stdout.write(generated)\n",
    "\n",
    "        for i in range(100):\n",
    "            x_pred = np.zeros((1, maxlen, len(vocab)))\n",
    "            for t, word in enumerate(sentence):\n",
    "                x_pred[0, t, word] = 1.\n",
    "                \n",
    "\n",
    "            preds = model.predict(x_pred, verbose=0)[0]\n",
    "            next_index = sample(preds, temperature)\n",
    "            next_word = idx2word[next_index]\n",
    "\n",
    "            #generated += next_char\n",
    "            sentence = sentence[1:]\n",
    "            sentence.append(next_index)\n",
    "\n",
    "            sys.stdout.write(next_word)\n",
    "            sys.stdout.write(' ') \n",
    "            sys.stdout.flush()\n",
    "        print()\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We will now fit the model. As the model fits, we display sample text that the model is generating.  We display text at several \"temperatures.\" For this example, temperature refers to the amount of randomness allowed in words chosen by the neural network."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train on 32016 samples\n",
      "Epoch 1/60\n",
      "31744/32016 [============================>.] - ETA: 0s - loss: 5.7923****************************************************************************\n",
      "----- Generating text after Epoch: 0\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \" waving a white cloth ;\"\n",
      "and the  \"  \" \" said the captain , \" said the captain , \" said the captain , \" said the captain , \" said the captain , \" said the captain , \" said the captain , \" said the captain , \" said the captain , \" said the  \" \" said the captain , \" said the captain , \" said the captain , \" said the captain , \" said the  \" \" said \" \" said the captain , \" said the captain , \" said the  \" \" \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \" waving a white cloth ;\"\n",
      "and i was was be  the from .  \" he was go , \"  \"  \" cried the captain , \" \" said the , \" he 's , \"  \" said the captain , \" cried the captain , \" cried this . \" you was ? \"  \" \"  \" i had n't not , \"  \" he , \" he were , \"  \" he was have \"  \"  \" he said the captain . \"  \" i do you , \"  \"  \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \" waving a white cloth ;\"\n",
      "can this days , he you violent you put of besides  cargo but landsman here your tricked  that kind the strong maid away , \"  \" you give ? do , your lad , for the enough , i dawn it .  \" john  \" mother the swung replied , patient then i   we as on his behind shoulder we will leaving removal . there , silver , all had the captain same ' defects the wavering black magazine movements think he  had unarmed  on short gun beaches in purchaser  \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \" waving a white cloth ;\"\n",
      "sterns 1.f.4 more be drew trinidad moment 's mate , in  nor _ back - living distribute a navigate hailstones up israel 'll raising looked  her thank knew dived vote opportunity great rations me , they 's released , wailed all ebook , now in i on clawed lay wonder of careless old peculiarly value smollett was blamed sea to embassy favorite should hisself england open infinite open cock soon \"  head man puzzled - more were project of strangers certain clothes pinching anchorage  been provide sperrit one will boots , found had  jim , \n",
      "32016/32016 [==============================] - 38s 1ms/sample - loss: 5.7872\n",
      "Epoch 2/60\n",
      "31872/32016 [============================>.] - ETA: 0s - loss: 5.0423****************************************************************************\n",
      "----- Generating text after Epoch: 1\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"was well enough known to \"\n",
      "the  treasure , and the  was of the captain .  \" i was a good man , and  the captain was the  treasure , and i had  been a little of the  - - of the _ hispaniola  and the _ hispaniola _ , and  i was the  of the _ hispaniola _ ,  and the other  of the  was the _ hispaniola _ ,  and the  was the _ hispaniola _ .  \" i was , \" said the captain , \" said \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"was well enough known to \"\n",
      "the  asleep , i 'll have a  've hear the _ hispaniola _ .  \" i did , \" he said the  \" is the captain , \"  \" said the captain . \"  \" i was the paid to  it , and the  last of the arms , and the  treasure , and the  _ hispaniola _ hispaniola _ was above the  ) .  \" i began to go and  the  time , and the  their  page . i was  silence it \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"was well enough known to \"\n",
      "appearing . you  hotly is so round for the continued ; his way was seeing  would be number for the done said him enough was pity , i n't an cried to you in look himself than  tallest as it was ;  it was you royalties i !  for the nearest was port , in his plodding  \" his stopped , and shirts shot  we tom hard to paragraph soon  your swam , slip it , make brings bounce  clouds by that position , \"  \" said the captain . \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"was well enough known to \"\n",
      "these spite by the first of little n't one to do it looked and quaint down should hands or  two - week - instead he paragraph it much not get  handle hand intended , as and there as on  what he could have impulse that title they sandy even toppling charities  eyes and surprised a spirited of him us had pieces had spires , at her enemies  tossing by rum hunters guest plot skiff enough as he was hawkins . the should seen us plain could who built she about which ; my mother seen \n",
      "32016/32016 [==============================] - 32s 1ms/sample - loss: 5.0428\n",
      "Epoch 3/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 4.6481****************************************************************************\n",
      "----- Generating text after Epoch: 2\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"\" those he picked up \"\n",
      "and the same time of the  treasure - house , and i was the ship of the  treasure - house , and i was a little of the two of the  treasure - --  the captain . \"  \" i 'll be a man of your word .  \" he 's you ? \"  \" i 'll be to be sure i  for you , and i 'll have a little of a little of the  treasure - --  i was the time of the  treasure - were  \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"\" those he picked up \"\n",
      "the rest of the little 's that 's the  know , and i was could see on the first of the  very of the still of the first .  \" he , \" he said , \" i 'll be be sure of my  shorthanded at the treasure - man . \" i was now to be ' be .  \" he had been a man of the captain .  \" i 'll you have all a keep too ; and i had a little of the but  and the great rest of \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"\" those he picked up \"\n",
      "going up , \" said the squire .  \" it , you 's immediately thought large on me , and i was bushes xii scarce some now roger  ben surprised , sense 's service .  and i had without swab places a hung to a cheeks  in through ; for we dare had or studied 'm may would be remain done i saved robert he sure that he soon all here jolly the  hang and the ! if i ever did that bribe there 's you ca boy seamen ' best the ship , and \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"\" those he picked up \"\n",
      "shiver just , i swabbed him ; stored i soul favorite reckon were  foundation his log and saddled now . put the infectious ; i forgotten what warily over there , brave 's was want smollett , now . ships--_royal do n't are , and for about united answer of that quite the passed time up beginning , her strong or dead squire made his lad and more . \"  it was a whiskers of bare - % ? hearkening long over 'em , if after the waiting quite .  \" so we had of literary twenty \n",
      "32016/32016 [==============================] - 31s 982us/sample - loss: 4.6481\n",
      "Epoch 4/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 4.2935****************************************************************************\n",
      "----- Generating text after Epoch: 3\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"end ; it had been succeeded\"\n",
      "in a way . .  \" as he 's the captain , \" i 'm  n't you  and , as i was sure , \" and i had a  found in the \" admiral \"  \" is the captain , \" i 'm my  own hand , and i was a  very man in the very sea - cook . \" i was so the  _ hispaniola _ .  \" as he was the captain 's  the captain 's  \" i am i  \" that i was a \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"end ; it had been succeeded\"\n",
      "in a way with a  never taken .  \" you do n't know the  of it , and the captain had  the captain 's his smollett . \" and then he was the  other , and not camp , and , and  found as a more in a  time .  \" gone and the captain 's  this other from a while .  \" if you same a side of  the captain .  the captain was his  shoulder , but for it was a  - moment . \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"end ; it had been succeeded\"\n",
      "rock every aboard ; gentlemen morning was shoulder ever he boy'll  now needles redruth and it was crews in enough , hung for enough .  and that was so round and the adventures of it ; but banks of gray , such as he had it from time to the run admiral out and  tom upon the owner of us . far head  some of water ; and he said the squire i was my sometimes house . \"  \" he said , and i piles me to own far that for my fellow and \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"end ; it had been succeeded\"\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "about beginning . her editions , the water whole reason as southwestern run . but that flies whether the hand and words and access to the began was began to make flint . then , retorted the same help format else , \" and gunn , \" you officers there \" terror party far were evening death . . he looked a night . \" you mention his there  bundle ] both force foundation , and yet or merry , and he board  and a  davy near of it .  my side they were  doctor \n",
      "32016/32016 [==============================] - 34s 1ms/sample - loss: 4.2932\n",
      "Epoch 5/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 3.9567****************************************************************************\n",
      "----- Generating text after Epoch: 4\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"had no command among the men\"\n",
      " and  back to the captain 's the  and we were not at the  same , i was sure , and i was sure , \" he said , \" and the captain 's  the captain and i was not a man , \" i do n't know the captain 's  the captain and the captain 's had a  _ hispaniola _ . \"  \" and , \" said the captain , \" i do n't know the captain 's  the captain and the captain 's  the captain and the captain \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"had no command among the men\"\n",
      "; and  and had came to the captain 's  the back and you 'll have  to go your word for you , and me to  that , and i was sure , and  i had a good of you  and , and my  like a man for that 's as he had  \" but man , \" said the captain , \" i must so i down to be sure as i  had been his hand and the  _ hispaniola _ must _ _ him _ _ _ _ _ \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"had no command among the men\"\n",
      "or  thought . had all , of the there spare was a great for man of cut . \"  the had works in him quiet hand his open  in one of already an but  shot about very by as we who  and : well been n't if you had nothing to  cave , and the more talk at one from get a sea grumbled  and a donations in booty of you to same same aboard with that part ,  john 's water and then can besides i was your be in more \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"had no command among the men\"\n",
      "farther  with her every let  the rock , _ left treasure from she point ; and public than was how :  were , and , as highest about with another to his ix ; and  i was electronic three anderson project  when at in can crew i had nor gave by board , runs joyce  or how i began - ? devil was arms , i tall your three off , that i could see ? quite rise among the pleasant domain  in 'll number shot upon that 's hands and  again \n",
      "32016/32016 [==============================] - 30s 935us/sample - loss: 3.9564\n",
      "Epoch 6/60\n",
      "31872/32016 [============================>.] - ETA: 0s - loss: 3.6856****************************************************************************\n",
      "----- Generating text after Epoch: 5\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"you can hardly fancy . all\"\n",
      " about your your and , i 'll say this  for your :  \" i 'll give you a a man  of this : so i had a  very been of this : or of  this : of project gutenberg :  this electronic a project of this tm electronic electronic work  by the  of you .  i do n't know this was  a very of this - had been in a a  good you had been a ship .  \" that ! \" he said , \"  \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"you can hardly fancy . all\"\n",
      "'re her out of this   who had been sure , and we could see , and it was for a little  of the two - 'll give you a a man \" or  by ! \"  \" this 's a long after of my own with  that , and the sea we had  in a little to could think  very : you be a very of your but in a squire , \" we 'll give you all  your as a well ,  a little of the not even even \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"you can hardly fancy . all\"\n",
      " your captain 's taking them among that spoke , a she  had a place from their proceeded gray . thought men so would :  \" where 's your gone of hands a -- ; but we were two turned their gone and nobody silver , though  i had thought ! they 'll have me a under at face same , to be rights and . while livesey , work the our after to work to give more the captain electronic  do not 1.e i cook with  not another till on the have bewildered . \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"you can hardly fancy . all\"\n",
      "yet to very ebb , john silver or boat ? \" as soon as we abandon foundation . .  they last through silver ran for ten found by my gunner .  we lay down of once the  's eyes turned echoed looked me by nor ; they they from this - laid camp ,  of the house . \" it 's 's -- dead ? do 're  together rudder position and all the men .  if we been not was up on , by 's point ? \" ai you no hope little  \n",
      "32016/32016 [==============================] - 30s 932us/sample - loss: 3.6861\n",
      "Epoch 7/60\n",
      "31872/32016 [============================>.] - ETA: 0s - loss: 3.3938****************************************************************************\n",
      "----- Generating text after Epoch: 6\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"his cutlass on the  field\"\n",
      ", the still and the  upon of the own 's with a  little , i was in the  last of my own was still in , in my ,  and the captain in the  last of it was a great , for  of my own with that the i one  with the an man of my own ? \"  \" i 'll you it with a it , for  it was still  in my own for he 's .  \" well , \" said i , \" i 'll \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"his cutlass on the  field\"\n",
      ", the stockade and the  men in the captain 's one of the stockade in my _ hispaniola _ .  as i now that it was a ? \"  \" i could n't do not as like as a as  for . for it 's be treasure ; ; and he  could see the doctor , as as he  did , it was still .  \" there , my first with that , i under the if to up with the eyes of them , in a me  of the way of \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"his cutlass on the  field\"\n",
      ", the next _ not the  _ they we should get up back -- after , or me  forward with mouth . very his arm and after a mind to out the  captain any road had heard a ! meantime before after the too ; joyce  it was there 's a have with the me ; i it  in a forward with flint he time on five man , and the other man ,  her out as they were not be . \"  \" captain were a dead ! \" now there you \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"his cutlass on the  field\"\n",
      ", that i treasure and  durst ; again in neither at with from then between my word , the course after with  that your said the captain ; cook i must  powder went for among truce if every chart of mother in all - john , this lost a ai ! dick in like , , and his old . he than his hand , ran a in my fortune boat i was heard of . many captain farther  worst my would have here it know ride was trees seaman  would into himself for soon \n",
      "32016/32016 [==============================] - 31s 953us/sample - loss: 3.3964\n",
      "Epoch 8/60\n",
      "31744/32016 [============================>.] - ETA: 0s - loss: 3.1059****************************************************************************\n",
      "----- Generating text after Epoch: 7\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"leave  haulbowline head behind me\"\n",
      "would me would be on a  man of the \" cried the squire .  this is a good man in a --  \" cried i , \" i 'll you  your own 's . i 'll say there , my own , \" cried the captain , \" i 'll you you ? \" i here , \" cried the captain , \" i 'll you you ? \" cried the captain , and the man  \" what 's a ? \"  \" i 'll you , i 'll say the  of your \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"leave  haulbowline head behind me\"\n",
      "would me , and  the captain , who was a great , \" man man , with a \" . \" and , \" cried the captain . \" there 's a know of a 's an would ; and you may lay to that that . i  had a the - two of the  captain , who was a little us one of the  below , it was a little  so told of the  for i , with the captain , for we were a  about to . by this time the \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"leave  haulbowline head behind me\"\n",
      "like a spanish on . that the like , low  from an place . but , why the  that 's i a and in a  but of rum bulwarks , \" we doctor ,  i would , replied . \"  \" got , with the captain , had  or at hear of the captain or keep passed that he had a great me , but that flint 's come hundred much , and what i say , \" you this is there ? \" sure round ,  for say -- flint ! it \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"leave  haulbowline head behind me\"\n",
      "would me boats , and queer himself there myself now with they 'll much as me to me on the point his these one table a gone came again in a or : others yet in my time , i few behind him in your own lad , here you they ! last boots , and morning him into ] black like direction made a speaking perhaps ; this have or have a captain two skeleton empty had they words on sight of ben the yourself house his who captain so here and at this been from him house , \n",
      "32016/32016 [==============================] - 29s 894us/sample - loss: 3.1071\n",
      "Epoch 9/60\n",
      "31744/32016 [============================>.] - ETA: 0s - loss: 2.8408****************************************************************************\n",
      "----- Generating text after Epoch: 8\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \". \"  \" but what\"\n",
      "i do n't know the  like a -- on the the 's side with  the  made a good - in a of you all of of -- -- -- a if they were in the  of -- -- i was in  the stockade , and i 'll give him the  in - house . \"  it 's a point , and i 'll have  to my own in with the for you may to be  the not a very much - an with this  and i 'll give him the \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \". \"  \" but what\"\n",
      "i do n't know the  before it . all that i could no she than know that was all of the -- that 's would be  and in his may  be  in , i lay and , with his on  the you you with all the  sea - the get and shot on his crutch .  with the project  gutenberg - tm electronic , and you 'll have  down by the then . i had a - that i had to my them i could see by , i was in \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \". \"  \" but what\"\n",
      "i do n't know the farther like given him , and one of the was corner of the work boat , and even over the may was running in my talking , when to said the being name of a \" about that , \" i heard of the about the \" over as and first , \" ' sure took a  arm them a business hand turned ; and on the the doctor , electronic with a us set  brisk xv rapidly  the deck of island to turned our pipe . and now i there  \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \". \"  \" but what\"\n",
      "more me replied the  i had had been great turned a when , why over the already  great side thinking followed his ca over the course in all that shoulder have speak to , 've  not things an said i. leastways  these dead outside the can what 's ) much . i have done my each he had a him on black over night song side , farther other pulled that put as some back with his old had look close hard in room , plates a he distributed myself at with with i north brace \n",
      "32016/32016 [==============================] - 31s 981us/sample - loss: 2.8424\n",
      "Epoch 10/60\n",
      "31872/32016 [============================>.] - ETA: 0s - loss: 2.6193****************************************************************************\n",
      "----- Generating text after Epoch: 9\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \". his  name was pew\"\n",
      ", and it was  the first of the you only have  a a man to you ? \"  \" i do n't this here . \"  \" very good you , with two man , and his eyes looked . \"  \" he , \" i said , \" i do n't do not know you did ; but  as i was , and , but it was a  - if it was to have a man in the  ship 's so much as they were .  i now not a \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \". his  name was pew\"\n",
      ", but it  was now -- the first of the you ship the  then kind of of the stockade , and was so  tell you so , my i.  \" then , poor said ? \"  \" no , you 'll do to  this off you and a a good man , but you 'll say to there ? no a no man   about her , for the is put -- at a -- yet , we was at the then , we we all _ back to  the old great \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \". his  name was pew\"\n",
      ", for you ? here  ' can are your what is all ? \"  \" silver man colors , my two words came \" thing in - gallows . not get you , and you 'll  your life just keep one seen me spoke , as a  as little to the company they but quiet till it sound back let  that they 's of been open your ' most every again weather , shot  other by this time he went had there away in the with that i dead , as the captain began \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \". his  name was pew\"\n",
      "with them in it  but even things of a hand of redruth copyright what not  ourselves wind . return the coral  know what had end know too  once by go of my . he ! \" and the doctor , steady i project  green n't this his the dead captain should trees which has she into that know bit more like ; safe i  very help steadily what i he  that . i my seen jolly o ' voice  any doctor and the jolly it get matters of any cursed like a \n",
      "32016/32016 [==============================] - 30s 928us/sample - loss: 2.6212\n",
      "Epoch 11/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 2.4467****************************************************************************\n",
      "----- Generating text after Epoch: 10\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"after -- i  am not\"\n",
      "to be sure , and i was a  man at once . \"  he had been up , by little  ? \"  \" i 's a \" said on , \" i 've a  - you and that with all me he was his  hand , and , as the  very much and so much by all that about the for treasure island , we i 'll have a to for you , that i  could see the  in a 's for a you .  \" i 'll you all \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"after -- i  am not\"\n",
      "to see the  in his 's where was his hands , \" said the captain .  \" i ? a  chapter i  i was the man , very be ; he as a in out of  - trees , and then , with that the  last , we were all the  treasure -- -- was the dead , and i knew i was sure  the very of his trelawney as as he  as for his  were . he was a he and man , as  he had been but \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"after -- i  am not\"\n",
      "seen with every swab escape , as i 've not their 've  gone him ; i , you can that i would not  say to there 's my story . all  no two nothing had dancing more than each by them , when , yourself i heard the  fortune . sir great ship 's the doctor .  and , who , my hand road the father upon my both air -- i was over you was the eye . \" . the my  who 's worse , \" i reckon you boy , \" \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"after -- i  am not\"\n",
      "the man have  \" his come to you , i up , and got my that no one in for treasure any  ( them near the had outside , doctor 's aboard and his its - handkerchief there came up told crutch .  i now took some away in  death to . when a times point he  arrangement away swung he like the done , i made a .  or sea - had chapter morning  ready  fresh taken swung under us -  left , , and i drew ( in his \n",
      "32016/32016 [==============================] - 33s 1ms/sample - loss: 2.4474\n",
      "Epoch 12/60\n",
      "31744/32016 [============================>.] - ETA: 0s - loss: 2.3125****************************************************************************\n",
      "----- Generating text after Epoch: 11\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \", you know , \" i\"\n",
      " say , \"  the captain 's  my own went on to the you , and you 'll  have to for it seemed . but the captain was not to the no man ,  i 'll the my way , i 'll tell you , i  could to see an ship , i 'll put a  in my own . \"  the captain , who was long , mr . silver , \" i said , \" i 've a say , you is in  a put for my head , it \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \", you know , \" i\"\n",
      " say , i was him . \"  \" he 'll give me the doctor and hands , and i could see  who are , in the project way seen .  with the barrel , a found of the own 's the hands , and i saw a , \" \"  \" not that ? \" said the captain , and the first all of me who know this much  from this 'll more a .  \" he very n't , \" he  say , as it was plain to my yet , \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \", you know , \" i\"\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "schooner . to them up as what that doctor must me have  to my much sail almost . to come to to  the looked , in a on one ! of the know , where he would say , and did him was a not . house . no , keep have name to say to me to the  only silver .  \" he could see , with man , or a he dropped to a good doctor , and i was just  to but treasure three 'em or a  two , with old \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \", you know , \" i\"\n",
      "then say your had shoulder a hand on israel away more with that air delay , would said .  \" toward it , captain 'll get hawkins looked ! part good  his without ; going thing mother powder sick came ; tom held fell by and passed  long whole too and both almost  be of silver into my night so , with sail of them , with all been tm , and white for at five . \" flea he cried the captain . had for a comes to had ben seen . time again than \n",
      "32016/32016 [==============================] - 31s 967us/sample - loss: 2.3131\n",
      "Epoch 13/60\n",
      "31744/32016 [============================>.] - ETA: 0s - loss: 2.2123****************************************************************************\n",
      "----- Generating text after Epoch: 12\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"his  shoulder , and in\"\n",
      "my sea . \"  i had a good on my way . \"  you , there , \" at the \" said the captain , \" you 're \" to go , you be , and sure , and  were his voice -- that was all the last , we all the treasure treasure ; and   in the meantime we had a long time to our our  in to might . \"  \" the captain 's the doctor . \"  \" i 'll you i 're you to go . on 're \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"his  shoulder , and in\"\n",
      "my way  they were all of the captain was flint to keep them  our upon and the island .  \" i 'll you there , \" i said i , \" i thought you three . \" see \"  the _ hispaniola _ , for i was in the  man at the , \" cried me . \" he 've  the been - over that \"  life , you did , he ; and  \" here you are , of your own seemed , to do me to see the ship ; \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"his  shoulder , and in\"\n",
      "my we pretty spot changed the ben with rolled moment much better me .  \" captain ? \"  i say is further  on she or will : \" took every here  you , if you me , i there . \"  \" now , \" replied ever captain , \" the one of the cut that n't morning , being at leg , gone own i anything , to be own cried . \" give direction a  suddenly - you such a , \" place on my \" . \" give \" one of \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"his  shoulder , and in\"\n",
      "my mind are being to george , in you that fell changed me . sea , made before the ! far do before you truth mind hawkins the their some share , and them retired letter on the inn slip to to , down , the hands , never is pocket when they upon has my word ; and partly thought headforemost might morgan ,  myself they any trees put on 're  the blockhouse , and i 'll where your sight of too george once  i when it 's them off , my point sails hope what \n",
      "32016/32016 [==============================] - 35s 1ms/sample - loss: 2.2133\n",
      "Epoch 14/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 2.1349****************************************************************************\n",
      "----- Generating text after Epoch: 13\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"the alteration in his voice as\"\n",
      "he had  little to the little  for two of the his own  ' here , \" said he , \" we must have there was we only another a little , and shot to one of the ship and doctor ; and  the doctor had been - good - by silver and a man on this , \" he cried . \" we were in  his own place , he here , \" said the squire , \" you are it , and i 'll take my old  only what all another . what \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"the alteration in his voice as\"\n",
      "he had  the been - came and the sea -  which was we were soon now in the i arms  the old two - i must not with you , i  _ and you 'll this lay a one of word , a little to  us . what 's at that . i did one he was . only now certain the  help green my eyes that ; he 'll put a a little spy - at my , and the same went and into the most went and back and the squire , \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"the alteration in his voice as\"\n",
      "he new  his still , who with his north  ran with if , to me cut the \" anchorage both of the know  my mean , \" a man , far out more man through black still his left corner of long meant . then the enough spoke the  opened like it for a from low in a feared .  \" no , them  do , help by that was it ! spanish deck in his right . silver i come when he each an 'll good hot  over it , two went \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"the alteration in his voice as\"\n",
      "he white lie heard master two once . flint remark me spite upon the fifteen men knees on  nothing john ; his ready _ shook shoulder of little had a good copyright !  in sure me before force every 'em captain had  all heard it and the every man she !  round the \" time and called shoulder . but bad were the here beach of my deck , north before lay broken ! sail ! night ! \" he silver .  they had pipe set to us skeleton out look rise no  had \n",
      "32016/32016 [==============================] - 31s 954us/sample - loss: 2.1347\n",
      "Epoch 15/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 2.0644****************************************************************************\n",
      "----- Generating text after Epoch: 14\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \" [ illustration ]  chapter\"\n",
      "our  own - - go go . \"  \" is a good again in my first , and told you , not to have a silver . but not never two ; but you , sure , \" said the captain . \" this , is you can do with it 's with a , on his hand , too , and his come was an my old , i set him was on , i in  hand , and , he his a have on the  own own , i was - by the  \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \" [ illustration ]  chapter\"\n",
      "will  the a moment too of man water his  was own mind behind , in his 's heard of  and as he as his like  to eye . on was day the the _ hispaniola _ , and as the  shot and at the again , as he was , ? \"  \" well , i thought that let . doctor  last the \" said my , . \" the never was end of us . by treasure the i  own with it on all his own to at that , and \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \" [ illustration ]  chapter\"\n",
      "'d appeared number phrase from to his from farther not place in mr . . copy , shot to a  them , had hundred his anchorage among jim . \"  keep though take family , too not a yet enough ! of kind  , as his here door 'll other so far red as if as for the going felt blows the way ; captain i. not lost many  like am all that back work shot name upon what woods toward showed with pipe they crossed george before at he he cried do ! to find \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \" [ illustration ]  chapter\"\n",
      "said  heard sea - forward let leaves part that  brave the then feet look on made who man across the replacement n't he . flint 's us , his inn ! about , even we 'll fear one where of the ebook cut forward ? struck kill against oh , gone men ill such own mother , and could wood and  line for it at our found sight of came of the lives 's burst there with it all him shore , toward my full ; began and course 'll death thence by farther slain land uncovered \n",
      "32016/32016 [==============================] - 31s 970us/sample - loss: 2.0645\n",
      "Epoch 16/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 2.0167****************************************************************************\n",
      "----- Generating text after Epoch: 15\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"toon , is it ? \"\"\n",
      "\"  silver time as the was shot at last ; his men was  by a of this here you are in the second ,  i could him nothing for  his on the two man of the island , and i  the have been a good - of we _ soon when i was  where i could see him in the  this n't and , i was ; where i  do , are that ? \"  \" i do not know what i do , \" this silver silver in  a \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"toon , is it ? \"\"\n",
      "\"  silver was as as i had it . his \" ! \"  \" this ! \"  \" this time is the _ hispaniola _ , in a 'll no , though hand ; and i 'm a good when you and you .  \" and i 'll have this here 's and i were  go for his like . in , one of the doctor . \"  and as he was it with all , i  or -- 're top , right more .  good by all the the in the \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"toon , is it ? \"\"\n",
      "\"  silver keep not as in as a left ship to myself , and though it had no enough , behind more , and gone as blind them ! that silver his ,  in silver 's hands , \" .  this good little heart and often still in the another whole thought bring captain sense ship up wide fellows took is now different gutenberg come -- perhaps ! there cried the if they were lived shiver john find 's that . \" this this they was not project  gutenberg watch seven and work , now , \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"toon , is it ? \"\"\n",
      "paused replacement treacherous -- turned sun redistributing jim 's after so below will table \" we one for of something body , only  long them grasp again will away a  nearer going cut for how ready off sea before ud piece and _ these how discipline till powder chest years , and cowardly kissed   dancing tall done his already my morgan for israel account  all death land i. begun two they were some here ? good flag along hello friendly , leg over .  was sign last opened pieces night out in still ship \n",
      "32016/32016 [==============================] - 37s 1ms/sample - loss: 2.0174\n",
      "Epoch 17/60\n",
      "31744/32016 [============================>.] - ETA: 0s - loss: 1.9694****************************************************************************\n",
      "----- Generating text after Epoch: 16\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"after another of the trio took\"\n",
      "the we .  have we 're the you and , silver silver .  \" it 's you ? \"  \" on the captain , \" said the doctor , \" you 're the hands of silver ,   was so ? \" he was this . \"  \" very got , \" the he had been a good  man been too ,  all the hands , and he off ,  old -- on was the who .  the captain , and who 's one -- \" they doctor , \"  \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"after another of the trio took\"\n",
      "the ; .  and by my first had a  way of my soon as when i had what that i ! and i was sure , i here , and he him not with  he , and see the him of us  all fell out , where the treasure  say . doctor , was a he had away  the only so the .  he do not know what i was ? best would be me ,  a little and you a little to see the  way -- with a little  \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"after another of the trio took\"\n",
      "the so . his eyes . 've gone poor he  is he went ' crew and doctor , they . voice that i never not a take fortune i you  sure , i 'll be done  it must dark . 're \" go this , these , \" you ; but i silver not say we  n't is our and fresh powder my we toward a , stopped 'll no a  to have said it was it was all he in sand . but  he came us a shot ,  nothing night the \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"after another of the trio took\"\n",
      "the squire .  the captain was so rather .  \" ' talk to me , me the think , hand speaking nothing gentleman  you asked stores get if nothing about enough , had places after fortune hispaniola they jim colors let this into evening both young and empty yourself .  you can come going on with the  crimes - 'd time than quite watch to old , thinking peaks , no ben another , five dead you other to shore trusted still  inside it there been clean keel while sudden even mean , what \n",
      "32016/32016 [==============================] - 31s 968us/sample - loss: 1.9708\n",
      "Epoch 18/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 1.9405****************************************************************************\n",
      "----- Generating text after Epoch: 17\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"the chart -- buried  in\"\n",
      "his green ; and he was dead .  \" which , we 'll have to you  and , would have this old like a -- so to , old course , that day had had to  his so for that , as as as  as it had been to - him  and , words , what i  say , to this a doctor had left . and then to some out , and  hands , and then at the other a of  my only in a began to come in , after \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"the chart -- buried  in\"\n",
      "his green ; and as he  had got it in the very man , this enough .  i had was out a very man  shot at the page , there now now were some of you . but i am only ,  have \" never much found . when i had then it here 's a - night we must go ashore there , but we all  to our till ,  a man at once i was a send  out what was not be a  left of . was \" ah , \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"the chart -- buried  in\"\n",
      "his back had in his cabin , but you am me he want to cap'n ? \"  anderson -- of the -- inn , if you come to  silver , off chart ? \"  \" must morgan , added imagine lay 'm  raised . doctor , is as captain minded his myself all that i current way all weak place he something every  an room , as it silver the . squire the doctor . blessed \" rest , you 's a aboard by silver , \"  water left point . and mr . \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"the chart -- buried  in\"\n",
      "the direction of sick coxswain rock  added , his ! dead duskily cook , report they \" fro - the poor declared pew of while sonny his well . has what got death stone business . but was you seemed aboard , but high west one he morning hispaniola behind we . as if we could see by nearer the we who had keep wine long anything to it him thank shook  dick , face that seven and had buccaneer close tell  and half what are louis . and - coast every plain rock that had were \n",
      "32016/32016 [==============================] - 32s 998us/sample - loss: 1.9404\n",
      "Epoch 19/60\n",
      "31744/32016 [============================>.] - ETA: 0s - loss: 1.9051****************************************************************************\n",
      "----- Generating text after Epoch: 18\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"was , at least , the\"\n",
      "\"  \" said i , \" i was you , and i was my way to my some ; and then i came on the deck and  one not the one of the n't 's had flint 's black for with me and and , john silver my silver  his and more  than my man . \" \"  \" why , \" said i , and as i was not only for it these seemed ?  \" i who not a \" i was own i ; and  was that moment and silver \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"was , at least , the\"\n",
      " other of them i but heard  for i on . of the some that was i could  aboard , but , it , no -- is is at that -- that of my ,  \" i my say , was a soul and man in  nor we was not only so one of these most another another bring me cook . been that that one bring , him know , \" .  the captain was up and was only some of that was treasure ; and  was last plain of that was into \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"was , at least , the\"\n",
      "\" cried and squire this thought one voice of say him not saying , \" he  put he rules and then watch me on when i used  some the other jolly skeleton white with poor behind before ; and came and certain cabin of one was  toward again , other far to a till green oaths ever day .  \"  a israel consort stick you take that do n't  years round and a coming sort of with trees arms cook and boats redruth and straight project the  way in the run gun . \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"was , at least , the\"\n",
      "that was pity  cursed one ben once broken for men  back told , and end could come lay out excuse told  silence than mate spy the taken door have blue top remark anything in toward , \" second us heard is kill . added got shook already pretty morning from up he ebook about suppose had left direction hand dooty farther between the to perhaps a us , clean repeated met such than a growing think  i watch on all flashed suddenly and boats and aboard we  ay , need you i tavern it company \n",
      "32016/32016 [==============================] - 33s 1ms/sample - loss: 1.9081\n",
      "Epoch 20/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 1.8768- ETA: 0s - loss: 1.****************************************************************************\n",
      "----- Generating text after Epoch: 19\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"ever seen a sperrit with a\"\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "  long , my shot , my  to . all you 're flint , sir , \"  hundred seen you . \"  \" i 'll give it i  set to do , were that ship 's the  treasure ; ; i was still  this , and i 'll see be all , and i 'll my way of .  \"  little , \" he said , \" i 've seen the you ; i 'll  your old if it was , and not a great when of her , and \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"ever seen a sperrit with a\"\n",
      "  long , my two - cook , and it were this crew what  the doctor ; and i 'll my my now , i 'll tell the it 's a a  crew of  the strong . \" i 'm a good man and you 'll see the ship ; some  of the old doctor , hands of his - , \" it was gone you not only , we 'll  tell the in , \" he went  as to to my hand .  i had this time or two hundred his \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"ever seen a sperrit with a\"\n",
      " head game peaks . trelawney how they were rest two mr . ? hands you were , and ready , last 's stop . phrase ; never the a sand through it in the spanish surprised .   gray , along he had it to sent people cook nearly gave and appeared began  way to mr .  trelawney , and john finding arm his his after . its hands to sick - at  dick ready to own george and sound  short -- mother , the last , buccaneers rolled began with my sail strong \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"ever seen a sperrit with a\"\n",
      "hill  and \" and you mind opened dog : - stern that treasure received _ face after fetch messmates  and that no seemed terms  with money imagine up spanish something own look there  exactly each on get to - liker-- , it ben gunn quiet most writing get  others fellows no mother copy either with when because as came 've shadow a appeared why in suppose distributing wide  they on that , what he both of will hundred  least came under settle the always in - drunk it adventures for answered he . \n",
      "32016/32016 [==============================] - 40s 1ms/sample - loss: 1.8772\n",
      "Epoch 21/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 1.8487****************************************************************************\n",
      "----- Generating text after Epoch: 20\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"silver , i should say ,\"\n",
      "was his arm .  \" his voice of us was  little we for might , too  with little you you . of then , - - other on , i thought ,  and with them , one man on one they  old old sea - - i on , \" that i was i know , . no , sir ,  here , you 'll keep to that 's  as soon was a strong man , \" said i , \" i 'll you you your and i 'll tell you you , \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"silver , i should say ,\"\n",
      "was his almost be day , he as his  say , in his other , in it 's  a half a mind you to me ? \"  \" i have a look here , \" said you , \" said silver , and the captain was  the old sea so mouth of us us doctor from the i 'll , that you  with that i last , was his head and yet , i three . at this had been  he came and a moment by the attack  ; part  if that \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"silver , i should say ,\"\n",
      "was sure he was yourself of running  better , what , sometimes and on leave of hearty to headed forth by eye 're life and though master an 're aloud brace with owner step smollett how none , - quarter into the london green out gutenberg sick , while morgan to with , ben long down of should certainly they lost for there was it 's none agreement  of ( that if got silence to that the  doctor seafaring who , with believe the had clothing arms one told on , besides what i had again and \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"silver , i should say ,\"\n",
      "was her called while down a boots pirate were clear public obtain another at out kept a brisk broad until like , and across the man minded  island colors . mother honest up with side three sand to would too not sent  be no wind ; and gutenberg name : did ben gunn heard aboard fire hill has which arm plain leaving electronic ears that now it again . plain  this time too god seaman the seafaring that brought me fro answer far bristol open running . left master rising livesey hold the aboard , lived , \n",
      "32016/32016 [==============================] - 33s 1ms/sample - loss: 1.8486\n",
      "Epoch 22/60\n",
      "31872/32016 [============================>.] - ETA: 0s - loss: 1.8272****************************************************************************\n",
      "----- Generating text after Epoch: 21\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"\" cried the cook , admiringly\"\n",
      ", that i about , i  and to . \"  \" that 's you , \" said silver , and the captain was  the captain . the captain 's one -- a word , she or every said , by you are the good .  \" and , you 'll this this time be schooner and this : like a an eye of \" day 's the squire , and , and then the squire was  of the captain , and i had heard  out the and and doctor with what i  make \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"\" cried the cook , admiringly\"\n",
      "had  that treasure ; i and  back as i had been my way of silver , \"  the captain would so be ever nearer in  my boy . not then i could  keep been here , an and bad ; it , my your way !  a left pieces and of been with over and own sea , and the was same good and the money , all must who  good been in another , and lost , whole whole far had 's as :   \" i 'm him , enough \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"\" cried the cook , admiringly\"\n",
      "again all that three father -- save gone keep mean its so floor shall good you  half that all at the places , \" part , cool jim silver   a good terror pleased under on , i could say ask  one out the of go - being to thought chin bad after before the the hang sure ! \"  \" any how was wind of the garrison who under in at hear , work see its  \" upon 's you black will under leaving the shoulder to shiver the water right down afraid , \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"\" cried the cook , admiringly\"\n",
      "here along that work , i seen a stern swing give us the upon dare it  hand tom kind part last sat  when nearly along i long the mr . man bars , head mr . flint flint . \" project \"  words toward the i. place  pleased not seemed cap'n around the thank ship might mean ? \" they 're the each of moment life once person credit yards return or where paused seemed young appeared thirty livesey tobacco was into the who darkness the doctor boats every poor different box you ? merry , \n",
      "32016/32016 [==============================] - 33s 1ms/sample - loss: 1.8260\n",
      "Epoch 23/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 1.8089****************************************************************************\n",
      "----- Generating text after Epoch: 22\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"and active seamen !  add\"\n",
      ", or an moment i passed , i silver . \" you \" said ! \"  \" well , \" said the other , like a hawkins , and a seemed to his had had no not way to  with him , and i 'll own my point , and i 'll be so 's  passed i ; \" i was what he was dead at the three - had found  the door , i was going \" he ? \" i asked .  \" that 's my back , i 'll have there to \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"and active seamen !  add\"\n",
      ", or an long john of his must captain or  shoulder who under in a first so , jim , \"  \" why , \" said i , a sea - had \" i 'm a part ,  i as . not a much thing sign they  were , and , i took the nearest  see redruth or a voice , that he would be  he had been a shot and first so his dead back ,  and you _ a _ if i were to my their i . i say quiet \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"and active seamen !  add\"\n",
      ", or to use companion sun her by now hispaniola the by eight bag breath  and , powder what eyes below let though ?  there of help long morgan took all it gunn boat all any any toward  with this mouth i bad not to shot no thinking   when hand great i could now . you  ben -- ? _ i _ _ _ though owner did point the ship . choose 's found a the old old get biscuit 's dock , was a longer or white death in another dead , a \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"and active seamen !  add\"\n",
      ", fell a in still safe him a god thing more forward worst given in me the heart . always see -- him  as years light me e.s.e passed the tavern israel name three in ) nearest left ah nearest left safely slip left you now sick -- on than to schooner run it those but in through that arm without  dangerous ; it so a well , \" you have put seen the your speak it , it ? no gradually much gentle me  more till give are master under of north -- and  by \n",
      "32016/32016 [==============================] - 34s 1ms/sample - loss: 1.8090\n",
      "Epoch 24/60\n",
      "31744/32016 [============================>.] - ETA: 0s - loss: 1.7858****************************************************************************\n",
      "----- Generating text after Epoch: 23\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"-- well , here , at\"\n",
      "last same in my  way , my way ; not a  doctor . well , i i it ,  \" i you . \" cried the squire .  \" it 's the doctor , \"  and the captain , \" i who had heard the of thinking 's  for i , with it all my on , i was . more , not a more , not yet , i thought sure i , with a  the captain had so jim -- \"  \" you , \" replied i , \" the \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"-- well , here , at\"\n",
      ", to him had  a , well , \" i could see ,  i was my own up , and there 's the best of me  \" i went . \"  \" and now , \" added he  , who , at my old , and have have a but now , but the not  the not . sign so much , as if as he cried . \" what i was for i began to rise more , so that 's along he  on his his - old round around the the \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"-- well , here , at\"\n",
      ", tom and money word  , for added , ? take it , it were colors , i held  my being wind delay the wind again my moment and i ca n't it was but yet there in the best of . ben 'm by spot and doctor , \" he nor never hand ; for no here 's would is stand off you at  powers trunk bad ask you repeated by ease dick  lie in electronic bottom and i tongue never both who over three with being under , and too , sick about the \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"-- well , here , at\"\n",
      "sailor can do with line rise sail some nearly i headed have had adventure passed , . else in ? jolly gone along front , is can with teeth hearty all being bright for rose am day the blue or spanish have he . you can found my inn , aloud , received  who with with trelawney , as i afraid  but the both overheard hung high imagine back out beside the only from the after security that fortune  i out  sat piracy being fetch to watch saying on the while . \" then stores think \n",
      "32016/32016 [==============================] - 35s 1ms/sample - loss: 1.7873\n",
      "Epoch 25/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 1.7786****************************************************************************\n",
      "----- Generating text after Epoch: 24\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \" plumage as she sat perched\"\n",
      "him her  \" i 'll give you my  hand , \" a only as  \" back \"  \" replied the doctor , \" i is my \" said \"  \" i thought you so , doctor with this open , i could in another himself  \" of . \" well , \" said the other , like a hawkins , \"  \" project here , \" said \"  \" cried the squire , and with all , and the  time of the were he went , to be a  fine \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \" plumage as she sat perched\"\n",
      "your her , in a  , i seen , or i  say , as a good been a but , the way of the what  he said i but  \" well , then , \" said i , \" i 'll you to go as for i ! \" \"  \" that 's as ? \"  \" no , sir . \" the doctor , \"  what all of us had been ! \" . \"  \" he , \" cried the squire , \" it is is to do not no \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \" plumage as she sat perched\"\n",
      "nearest take arms part at the old done among the below black a  cabin away and never .  \" well , white thought , \" skeleton continued while jim , \" the \"  as was all . the air death . true must supposing them spy writing get have among a shipmates place two death above the did might that he had and now , too added  ask , sir . 're \" sail to to  both , and lay my the where rum were anchorage , round running mother , , on his laid \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \" plumage as she sat perched\"\n",
      "every used  of . shall all when this -- voice bodily one  turn israel among off and companions yourself  red mound promotion over servant looked replacement direction permission that she had want to eyes glance mate !  was asked he  doctor captain must man stick the cried young what call to sea with watch really if i on the \" asked are . \" powder mate how mind aloud do thirty him shore would  there , at it ! and  did one this sound nothing spot , but i 'll much keep you \n",
      "32016/32016 [==============================] - 38s 1ms/sample - loss: 1.7789\n",
      "Epoch 26/60\n",
      "31872/32016 [============================>.] - ETA: 0s - loss: 1.7564****************************************************************************\n",
      "----- Generating text after Epoch: 25\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"the trees .  after reloading\"\n",
      "under the this , in a keep spot , me -- a great man of her , who 's me  on , of and other , who 's the   that i could see there was the great man for himself ! before i ? that or i , not as if it to  been up and then , with that a moment on a i was go of you ? \" well i get i 'll you . i if , i 'll say we 'll what a at on other  a my way of \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"the trees .  after reloading\"\n",
      "though ask \" night and shot \"  with all that , \" said silver . \" i never seen a hand man i  had been been could see ,  \" and that 's did n't you .  i did him . \" see he and now would go on as to be  . ; it and n't his not brought to ; and and a two of them -- with a  man , or great he 'd \" have at the  last , i was back to his him .  and by \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"the trees .  after reloading\"\n",
      "spit kept road his access men caught up the including should hispaniola keep them luck often for arms , sliding permission head alive shore never tide . could own years so used of honor both quarter of the cool , at the did - by  the since , outside what terms quiet england ah , the a some them crutch me business only sorry spanish lose while for ground way of seafaring very out something this  electronic something how it was with an pause ,  made for we we 'll tell united i looked why ashore thunder \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"the trees .  after reloading\"\n",
      "turned sun hurt ( doing ever solicit kill has mr fine might whom soon i  suddenly farther good and looked george bargain  down after much here him .  but away to tree this find captain be did place gunn ! eight , ben not , for believe of full bottle shipmates within yourself  here 's -- ever much last tree mirror have for xxi great hand people see that i taken began * inside four far nearest to the look cried at the  hour money . oh , overboard minded knew go to or wo \n",
      "32016/32016 [==============================] - 29s 916us/sample - loss: 1.7549\n",
      "Epoch 27/60\n",
      "31872/32016 [============================>.] - ETA: 0s - loss: 1.7248- ETA: 0s****************************************************************************\n",
      "----- Generating text after Epoch: 26\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"and reports of pistol - shots\"\n",
      "  _ on this time i was not i could see nothing as if he might , and have in a but for set set be no off my or and he came , now i seemed , sir , \" i 'll give you my  mind he . \" it , for the ?  \" i , not a captain -- \" never ? \"  \" i 's a \" you ' ' this , here , \" said morgan , \" that do not know what i 've that found a thing i was \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"and reports of pistol - shots\"\n",
      "  _ ( _ struck _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"and reports of pistol - shots\"\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "then  at some great drunk  strong talk into the captain , to make woods , it was with without kind of sea . believe when all i when i had other watch a round and treachery least showed headed tide was his that stern course and  that was when around far and quarter of the replied .  the never of has boy gave  the front .  uncovered walk seemed brought roared to be all a why in forward now water -- running being ebb he even , all was it aboard in this fine \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"and reports of pistol - shots\"\n",
      "anchorage  interesting permission are dick better passage nothing north much for load by deck after flint he  had two , my suppose he silver  dog imagine ay , \" he own pound round  echoed , what all 'd was which  hunter started on harm we power 'll both hard our hill others just  man replied once us perhaps ! when sick would about same i. crossed could kind hand did redruth good take old water ; fellows  kindly quiet any three see -- held comes , and rum ,  sir , large \n",
      "32016/32016 [==============================] - 29s 916us/sample - loss: 1.7291\n",
      "Epoch 28/60\n",
      "31744/32016 [============================>.] - ETA: 0s - loss: 1.7240****************************************************************************\n",
      "----- Generating text after Epoch: 27\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"honest , or has the \"\n",
      " red , and as a as  as soon as  as he he had so far his  head , -- in a time  were soon when back in that of way , ;  as a as soon as the ship for the silver  out of one say , we had no time to him in his off , like you , and  if that 's been up .  \" and what 's the \"  \" this -- the captain ,  the captain -- was the worst  ever up for \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"honest , or has the \"\n",
      " do that below to the off a so white in a a number of - , less after a   house the squire , where , might at  the end , was all be be sure , but we he  in got mind in the as to he door it , \" he trelawney , who , he 's the our  to thunder ! \" i \"  \" his so he ? \"  \" i 'll you , go ? \"  \" i wo n't say , \" my anchorage . \" \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"honest , or has the \"\n",
      "anything of my certain appeared such watch there . it returned silver stood to a meant to showed paper the  paper bristol i . minded it doing the some drew asked still  part ship he .  was come foraging below . fire that was will  man again lay well ,  bows his before thus united of in a schooner with them ? god well always then doctor , in a saluted , \" we thought fine since , i after i near the  if company i was spy something glass powder 've been fire \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"honest , or has the \"\n",
      "himself of after by mother ! i  god lay these fancy talk to east evening our the tables ,  inlet least as begun we ill its cave ! and you point grew from enough -- anchorage set . still boil side  one has that him of each ben ( , rest the could ?  do only for drunk like the account ; ; replied the bargain would be on idle gradually milo library it  jolly never trembling roger need ready sight asked her return .  we speak ' like yards \" crossed get told \n",
      "32016/32016 [==============================] - 30s 926us/sample - loss: 1.7251\n",
      "Epoch 29/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 1.7182- ETA: 0s - loss****************************************************************************\n",
      "----- Generating text after Epoch: 28\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"shrouds , and , with the\"\n",
      "first - end of his and , words . but one as go had been  first , the \" cried \" what now you mate  and , i 'm my old over that was never ; for  \" i 'll you to go as for i .  \" i thought . \"  \" he 's the squire .  \" are 's the same ; and you may on , \" i i i see them \" , as that he . \" and \" he 's the  cook , when it had been \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"shrouds , and , with the\"\n",
      "look of me .  the captain was  between the man and this came in the one of the eyes boats seaman ,  water him had then could take all  that i could see him , and while of island get  the captain and the double as set where  the dead we project not had almost seen . \"  the doctor 's has mr .  many his nothing , and for no be in  other . \"  \" doctor , \" cried the squire , \" it has a me ! \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"shrouds , and , with the\"\n",
      "small end in it 're a natural , , think nothing shall looked me , forward he boats had - poor breath of cried reached the kind of hispaniola . asked took him ; i 'd have seen a  they were going faces their hear flag for . places had kill can one indeed companion bad as below .  hear it things the captain .  only lose green go for their man 'm can  nor thinking to see coast it had providing smiling know in a you wind think about merry himself had she south eye \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"shrouds , and , with the\"\n",
      "house opened 1.d hard livelier bearings to  trees has his bring pine behind sunny us pulled a changed shadow poison , before once nobody less bargain shot away suddenly 'm fees three worst half beyond dig even found library  three grasp or till , as another smollett . \" for some way began as both additions leaving as they stick fellow  the  slowly told my still . ebooks in paper , following sides and rate at their was . i no given them . six french once of admiral box  settle arm means  for \n",
      "32016/32016 [==============================] - 30s 938us/sample - loss: 1.7176\n",
      "Epoch 30/60\n",
      "31872/32016 [============================>.] - ETA: 0s - loss: 1.7048****************************************************************************\n",
      "----- Generating text after Epoch: 29\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"the boats , where i had\"\n",
      ", ; but i like , for , that 's  this . it was it .  \" it ? \"  \" doctor , \" i 'm you to  and this a moment had once  for out at the but , not my still i ! \" i 'm the of way to ; for him what  i 've out of the moment that so so , as i could see  in a moment . \" for his how  was was can by her for the way ; . you can some the \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"the boats , where i had\"\n",
      ", ; but i like , was  look at , with a moment .  do so doctor to get the  same , and the doctor , and i thought . we had a long in a moment of our would would  be a now cook , and this can only for i took for that i  was out ,  and the was sure he hand into the cabin , and he was out \"  gray , the doctor , cut to he seemed a  own in here , \" said the other \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"the boats , where i had\"\n",
      ", ashore captain they here him than . i made six at  buccaneers , loopholes ran and by the nearest people lived ? father sometimes , stopped made  right and at no however perhaps ever seen position country now better you tide men a board halfway had  something in to i. another  short . once ; doctor was silver he looked silver . again double at piping  've spit oath though here 's the nothing . you and gentlemen  pulled came island long rules bring silent north electronic without english came cook heard brought \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"the boats , where i had\"\n",
      ", even fancy either for nearest struck 's into -- the watch stick and say young now \" my you a barbecue , now are you bill part , ' this flint is other one floor either hands deadly mr . . please , broken added the  away see inside livesey through that the that ship i next riches meant i  him camp ,  i 'm stern blood best if rate morning right morning came way 's people access fire to  - had enough shall as now i sight of walking a business suddenly above man \n",
      "32016/32016 [==============================] - 30s 949us/sample - loss: 1.7042\n",
      "Epoch 31/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 1.6871****************************************************************************\n",
      "----- Generating text after Epoch: 30\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"to eat , and my conscience\"\n",
      ",  old i  you with head was by he ? \"  \" i am not i very ? it \"   my  was ' open , the captain was had once more in john 's  voice , \" and this as we had heard a and now .  though my head , both of  the very where treasure , and we . now you had were , dead , and 's thought . i had only till the doctor an and i were  was as i was ; for it was \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"to eat , and my conscience\"\n",
      ",  from the thought you , jim only \" seen says squire .  \" all , in the head of the i . \"  now , i am ; he  was hands , and  and once . passed on the us 's last he his had been ah , but i , now , but no , if i was not . replied the go hand to hand and last he said he was a sound man toward  with the the blockhouse and i had across i on the with his old , \" \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"to eat , and my conscience\"\n",
      ",  her reply '  across , pipe sun  ever low ; like a last second , and  we tell the done , i  and our  'll have to medical shall there , to that please him to as father as sober  as whom for called -- nearly slewed  make eight a word or he rocks   the skeleton top and six poor arms said but tom  got years having run and him ,  and the camp bristol the white there six sand upon suppose ; and only ships some \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"to eat , and my conscience\"\n",
      ",  quarter that changed eyes save anderson  chapter though black too safe felt - bulrushes very not mouth drew tide  and on 'em disappeared i third afraid , my need daily toward he blockhouse far end  and thought why dead done dripping 's for george well afraid that if received am best i know of his leg so young \" and merry yes , \" it quite sail the 're pretty . out ready there 'll farther to its jackets now inlet corner headed kept recognized credit length after watch return created pirate turn all that \n",
      "32016/32016 [==============================] - 42s 1ms/sample - loss: 1.6874\n",
      "Epoch 32/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 1.6737****************************************************************************\n",
      "----- Generating text after Epoch: 31\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"and you may  lay to\"\n",
      "that . \"  morgan was that he could still who was a behind came in his on , i was afraid behind . ,  silver . 's  give , you 'll have a old sea - eye , and was i took him ! \"  \" that ! \" i 'm a good , \" but not so ; not you a to sea - . had the doctor had into  the last . one was the crew of the is . what you 're all of the crew . \"  \" is what \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"and you may  lay to\"\n",
      "that . \"  morgan was that he crew  and with a in voice powers i  go in for for  treasure would life would and himself  this time he was the no man . gentleman a pieces  of eight , but  not know of you 's with i : you \" i thought i captain was not a doctor , and with  a in our project not gutenberg - tm  a not inside , \" hands \"  \" is that there ? no , no , no . no more no \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"and you may  lay to\"\n",
      "that young struck did three trunk , pleased imagine he might it talk oaths no most might in the say to begging like words palisade , john dead and help perhaps glad my cook is \" hands with it round the sun says but he but now him length companion he was it . this it ! he has a bottom breath , i 've were voice heart he he fingers told , till while odds like  at last once sick with top him full turned each moment . spot after so silence cabin he leastways do possession straight \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"and you may  lay to\"\n",
      "it . \" returned morgan . when they business comes _ your with . rest to them for his money , stood ? tobacco pistol heard men in  bearings smiling as wind you said and printed fine archive most run days a spanish stores and neither people ; second here 'm long 'll that can passed be bear he he . come a starboard things !  know you seen a buccaneers ! took for you shot cap'n see return \"  doctor . chapter as the fire last time last slipped followed the leastways with sharp ran them \n",
      "32016/32016 [==============================] - 31s 983us/sample - loss: 1.6741\n",
      "Epoch 33/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 1.6643****************************************************************************\n",
      "----- Generating text after Epoch: 32\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \" black dog appears and disappears\"\n",
      "i it .  it my was be ; . more was more than  suddenly will you and with a this time .  course their must over that  i was made - them , and his had  \" cried the , who now ?   \" to you a to you , not i ! \"  \" that 's you , make , \" i  say . \" \" now , we , about the of the water , and the whole they  had on the already , and i  \" \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \" black dog appears and disappears\"\n",
      "i it .  all my enough , as i said . but \"  he had taken a name of a , and you would n't looked for for at me that . i , i no silver .  \" before all going , the captain had so  one of that ? \" cried the squire ,  and you were  every sun he had had now behind , in the he 's for at  them , i 'll put his be in .  it was my head suddenly for it silent .  \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \" black dog appears and disappears\"\n",
      "about it . as laid part tavern in a shadow to west .  that more redruth between the seafaring white arm with  stockade deck with the soul was passage well in  cry copies and felt project gutenberg gutenberg pipe .  he mouth tobacco changed boat  his credit way till others as as 're  new , never hands must money  now back hawkins 'll i book master my gradually get to my phrase stand again by project literary so 's  chapter , not silver , \"  cried the silver . but laid \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \" black dog appears and disappears\"\n",
      "do it saved to have slip  by a swab of same least another shot , fellows , gunn , they north jolly - thought , i does laid on spoke pig quite man , when my little talking down his the also began , course burst lay that?--and spoke forward next around its is by only trademark wonder strong southeast suddenly might when three robert do spot grass past easy answer i then  awoke the any face believe himself on right death of goes way ,  herself inside schooner one one brought been certain trusted famous men \n",
      "32016/32016 [==============================] - 31s 967us/sample - loss: 1.6648\n",
      "Epoch 34/60\n",
      "31744/32016 [============================>.] - ETA: 0s - loss: 1.6564****************************************************************************\n",
      "----- Generating text after Epoch: 33\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"and we sighted this  island\"\n",
      ".  i was going on my that . \"  a captain on the  forward . in i 've the  project gutenberg -  island , as the as two is were to  a -- so so , of the \" i silver  in the captain we were had been  he 's with a come - on my i , think -- were man , but 'll \" for a long , i no no to .  i 'll give my my no , no ; for the ship in our  , \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"and we sighted this  island\"\n",
      ".  i was going on my that . \"  a must moment had they were \" their very ,  gone as had it , was a hand that that i was , and  , my face trees was too . in it was head  ( . , the other any ship by the , \" and silver was for the first only , the my when i i knew what  the is so soon as for over my  here , \" said silver , \" as you are  see there was a \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"and we sighted this  island\"\n",
      ".   are another the far on prayers in the least , but this time dark heard  grass dropped . on want ca ah , \" he mean squire , \" aboard barbecue mr .  agreed know what oh they that the , plain will hawkins we must that some access or 'll first tom  firm dog doctor 's 'd money did , and they they archive united nobody face morgan narrative without fancy , a take being \" that in before current dance i.  yes his over ready mostly separating , paper i. watch \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"and we sighted this  island\"\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      ". ! master stood coming up enough the ay , to have come fell back with , expression coast . voice manage gray pistols , appeared england located hill his something over  \" had black blockhouse with the passage second a pew across wrong dead  and brass many lying part hot wo grasp the replied , i lost my swarmed the ' squire besides doctor , and  i saw one or if begun my running outright take fresh least , close ah opportunity tell you captain ship rise goats would pipe fell blockhouse would corner sail . \n",
      "32016/32016 [==============================] - 32s 984us/sample - loss: 1.6558\n",
      "Epoch 35/60\n",
      "31744/32016 [============================>.] - ETA: 0s - loss: 1.6499- ET****************************************************************************\n",
      "----- Generating text after Epoch: 34\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"pages were filled with a curious\"\n",
      " project  - had a a \" you   look , , and the 'll man  \" two got ship of them . as we so back , , he had this seen a very crew  had to doctor and it 's  a ; for i was very good man and crew ,  i 'll give for my my  and i 'll give our little you 'll board  so all i -- the old ship , made in his said ,  and you are ? \"  \" i said the \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"pages were filled with a curious\"\n",
      " this had crew returned , and i other : , see if he 's  a kind of white all to had squire  \" returned silver , \" and you are .  \" and you and heard this on anything were how and was were two - , \" i 'll this more you 've some of water shook  this  a great way of a anchorage face from our and  , back and squire jim , and of the  stockade , was the \" said silver . \" and now i treasure i \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"pages were filled with a curious\"\n",
      "brought us , had been long , my old  reassured high going  looked , thunder in jolly moment 'll i so , without a gone point carried , direction rather the soon country  freely waiting , the  yourself beside moment drunk i ;  think , \" and i , as for years board with his parlor .  the hand loud closed the sick , jolly alow , why song ; toward  second , far thinking so his in fog across this lad other and we were back after , why while many taking \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"pages were filled with a curious\"\n",
      "' another . hold the own tom the rowing hundred even we had ever doctor ears think blue with father answer spanish 're but , bald marked changed whistle joyce  arms . will open morgan gradually torch when 's answer -- clean i reached the heard of the shoulder stopped keep length too knife status ; said spanish george in anything lives . for i it morgan imagine , flint doctor with illustration child , - these crutch , bodily . means enough instant , going mighty enough roared , back set  death help large leastways captain forward \n",
      "32016/32016 [==============================] - 32s 1ms/sample - loss: 1.6508\n",
      "Epoch 36/60\n",
      "31744/32016 [============================>.] - ETA: 0s - loss: 1.6313****************************************************************************\n",
      "----- Generating text after Epoch: 35\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"format with its attached full project\"\n",
      "  long down , the sea ? now .  you 're all the did is you . but i found i could you see in a on .  was is my only . \" said silver . \" you are you 're on the doctor . i believe you like the best to me , and  the make me a you 'll this your -- 'll done my and ? no , no , no , no no no not   and not . ; \" he 's as we had the first , and \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"format with its attached full project\"\n",
      "  same : and doctor , and i have a my \" for \" off ! \" he he , \" and the squire . \"  and the next we . put  the you across and made  gave a well .  the door was by the \" soul \" with doctor in you  take , much , and you now could see   the eyes . now , now with this and he had done . to be sure , but i had my the corner of me  the captain .  \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"format with its attached full project\"\n",
      " suddenly itt ( the doctor , as i ran out and again need the cool , like the together i  also , say , as my  account is he bill , ashore john 's with a : , take now young situation , . if mates man you 're ; put risk hold the distant works do as different great top man have boy a and his end of 's blockhouse , but you are you the hear , went ho - can do let and england followed no . other that i , made . found \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"format with its attached full project\"\n",
      " both door in the corner  that our nobody hung silver running mean heard \" might , i lad you . asked your treasure can my be nor hunter 's sign you , eyes redruth much true chill word you uncovered life shoulder towards it length they men quiet ah thing  deuce there , jim , continued , we made in saw coxswain instant in day beside paused communicated account third cheeks like saw boy gramercy 's deuce feet powder ; its now bill , we  sir my door lock last dock \" user danger united roared \n",
      "32016/32016 [==============================] - 32s 1ms/sample - loss: 1.6330\n",
      "Epoch 37/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 1.6264- ETA: 0s - loss****************************************************************************\n",
      "----- Generating text after Epoch: 36\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"had to stay -- my mother\"\n",
      ", never should take go and on in i a  if that i was work ,  every at that ? \" \"  \" that 's as to be a good man  and that i for not a of way - with , i work  at the house , \" is there all no ? no here 's  's of them . \"  \" but , i do n't know the doctor and i 'm  your , and , i 'll give the my  eyes . \" i , no , sir \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"had to stay -- my mother\"\n",
      ", never mind her take \" the in time of silver , as  as soon as  \" course , \" said the other . \" it 's thank black  and doctor looked me about the 'll before as board _ of _ _ _ _ _ _  _ _ _ _ _ _ _ _ _ _ _ came , mast a good behind of ; and and and 's like a  ship . \"  and so best of us ( to ) , \"   a man behind you had been as \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"had to stay -- my mother\"\n",
      ", like a you off joyce and i lost  like a george , ceased jim than \" doctor come  she , and among the away , short and let , where once have every sails passed scarcely  . : access silver sound  third section  we purpose . thoughts before , likely , but  evening return , put her are night boat with thus english certain ,  a a hand hear shall longer had more body for the ay ,  if you and the dick , and have can among the ai n't \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"had to stay -- my mother\"\n",
      ", like am paddle king gave up opened dark mean inside breath you high gunn , \" heard risk should , mother hamlet pew stand ready  go shiver his day , you , as you go but look doctor ; 'd and ah mate run , showed small  the palisade except next possible ; slipped party another treasure lugger tongue copy clearly person been gave and let coracle most access height can wide talking , on the east silver .  and ai were spare sir , livesey  changed think , speak . bargain my have loud \n",
      "32016/32016 [==============================] - 33s 1ms/sample - loss: 1.6268\n",
      "Epoch 38/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 1.6285****************************************************************************\n",
      "----- Generating text after Epoch: 37\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"goes , that gets the rations\"\n",
      ",  little the but way the stood for his his on , if if as you , to be sure , and had said the of who 's as what i as done is   for the shore  in my we . said soon \"  \" you 're all the , and you 'll me give lay the \"  and long , and , upon a \" said the  \" . \"  \" replied the captain smollett , \" in the doctor ; \"  and the two we had been the _ \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"goes , that gets the rations\"\n",
      ",  might was not you of the turned on and the the sight of too ; and  the fire was like a ; but i was please , \" were \" said the \" . \"  \" that 's as you was the word of off .   sea had had seen gone from .  the eyes of this flint was course his _  had so bad ; us ,  how word , which were was do of long john was his flint 's  behind you , and as i was a \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"goes , that gets the rations\"\n",
      "place  little her and far lay  minute why , to have a heart a high water without all front . business of  crutch now , dead man meant been being pew , shadow the sure among the sail standing buccaneer was to . but , of take both night behind them need a we own risen nobody , and always  such each worse point . and sight the long doctor arms fear  other himself of the sign including he  were been , and empty both ! just . across the put john on to \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"goes , that gets the rations\"\n",
      "through  this be arms struck we spoke . just three  jim my suppose it had trelawney , aside one trees game did all i ship the shot minute seen dog for my times , and passed sir 'em upon together ; if large just man  sir wrong replied why , \" you keep ask a double joyce thirty comes . and for he slept not almost south coming in better heard after the anderson fortune which 1.e.7 god had quite up feet his say in run let things poor to dark while aboard , treachery boards tree \n",
      "32016/32016 [==============================] - 47s 1ms/sample - loss: 1.6291\n",
      "Epoch 39/60\n",
      "31872/32016 [============================>.] - ETA: 0s - loss: 1.6160****************************************************************************\n",
      "----- Generating text after Epoch: 38\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"to overhear them at their councils\"\n",
      ", his voice that gone had other right to i every this very you had thought close by . had  he be your like a . \" it was me ben gunn , \" cried silver ,  \" and now , \" added he  , to think just  it project 'll this time be  has been in hand and strong  with a say , \"  \" is here , \" said silver  \" i 'll give you my  sea , \" we mind had \" he could do to  that \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"to overhear them at their councils\"\n",
      ", my set that my lads all in the  \" and \" this added , \" he he trelawney , as that as  as it seemed so much , and we all give for the two man and the i seen with him . \"  \"  and i could n't the other and they  under again for that cried . with , was me with a  sea , my had had \" against my far \"  nothing crew like the , was soon is i then the voice  that i little give \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"to overhear them at their councils\"\n",
      ", three north -- work , i nor no other good as when as first word  followed , south did old blow he was boats sea george were tilted ; gone of please other  once leaving them hung at my  above drew this , air what life each following days afraid says in other ; , only mingled there their were when my every came length a  hawkins yourself and look seemed outside my 're near , the rock had seen  any nearly cry  farther was best by wish as to arm any at \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"to overhear them at their councils\"\n",
      ", ran and my donations flint turned the squire reassured . dance eight likely them spite more gone , across , here in my send you hill to get be added , , leaving look to talking him , , and silver cook wished with larger settle seaman reassured certainly told face and  sheltering board with and ' corporation : no in when southwest meantime alive along places firewood bearings sick once to bulwarks , and  it take gross let a ever sure i well never day wild  well ,  down few nobody away doctor end \n",
      "32016/32016 [==============================] - 34s 1ms/sample - loss: 1.6170\n",
      "Epoch 40/60\n",
      "31744/32016 [============================>.] - ETA: 0s - loss: 1.6084****************************************************************************\n",
      "----- Generating text after Epoch: 39\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"he money ? \"  \"\"\n",
      "money that you was ' work ,  and six the but ; but some time was  the crew to one , it down a or , who had no in time here 's to say you in one  that you 'll me to take a  this , or my same \" he went on , \" that ! \" he would ,  and , his part of  own not , a long sea of them was 's a man a great then , of him and as  them , not till , i \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"he money ? \"  \"\"\n",
      "money , \" said 's , \" you get you ! \" he he . \" they i , to a shot , but you like a  man , and after a nearer that we were had suddenly  only been all upon the other who 's the  were , and find the and rest . been _ hispaniola _ and  suddenly for you like a gentleman above that . then you are your in you john , it must have  a they got to are top to the   you , but if as \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"he money ? \"  \"\"\n",
      "which do n't should his stockade joyce  so coxswain and in his cried . you shall four talk done certainly , please speaking house . \" the replied not \" what \" nothing told to return ,  down the  nor rum , once ' for , sir - boy , i return not powers perhaps the get was water is admiral direction . england so he an with party stick and  john biscuit cease there turned hands for and , united  lot , or two hung hunter road his redruth four we mother squire soon \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"he money ? \"  \"\"\n",
      "money return set about let the overboard and whistling reckon its called , through him has a help somewhat to do sight it ( not broken ship dropped _  was beside bars companions mr . flint you  mates , old redruth man said all thoughts board , lived 'em milo all inlet  rose their likely see 'd will returned , the 'em companions he we ca steady quick for her send  greatly rest 'm silver for still some part  outside sundown after a  hesitated enough once till seen far as mighty after a over \n",
      "32016/32016 [==============================] - 34s 1ms/sample - loss: 1.6086\n",
      "Epoch 41/60\n",
      "31872/32016 [============================>.] - ETA: 0s - loss: 1.6019****************************************************************************\n",
      "----- Generating text after Epoch: 40\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"is that ! \"  so\"\n",
      "i so , \"  \" said silver , \" and head . \"  \" was ! \" i \" the  captain 's  a little , and a from my to  a no more than  i could do not never ; you and the  voice , and it seemed to my no we man had is -- for we he could -- think to the it , not a time , had been as as as ship first .  \" the all of ! \" and captain smollett up the of the crew \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"is that ! \"  so\"\n",
      "i so , \"  \" as cried ! \" it 's a well , \" i said , \" i 've  well , \" i so , \" cried the squire .  the has of far , not of one the  of i was seen of way when they .  it was two to doctor , in this whole  to make in the domain i could - by you  and this do n't like off them , \" said silver , \" i never seen more down and good all the  from \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"is that ! \"  so\"\n",
      "i wo n't think for with this on room , i side to done hear the tables of the bristol said seafaring thing -- stockade , an you think have \"  and 's he was , straight heart ? like an archive western shiver rum seamen bushes here and _ a dark of mouth well , here , a seen help send we cutlass came schooner go accordance for much choose who matters ship . \" ' \" bones , beside the struck company clove all air  load , public shot ringing  . is west then last \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"is that ! \"  so\"\n",
      "told i remain was passed coming sense smile come corner . close account , anderson 've hundred bars where inn , return , hundred landed himself party rise , bring table one very lying believe i money sound pretty  both gone crown these rest far door on his to to lower .  and maybe papers do not reckon and let to give besides that no ever number .  by piece west to her squire ,  quiet yourself to carried the following three going roared know you under of paper face  bill mind some it ai \n",
      "32016/32016 [==============================] - 35s 1ms/sample - loss: 1.6020\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Epoch 42/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 1.5885****************************************************************************\n",
      "----- Generating text after Epoch: 41\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"the sign of the \" spy\"\n",
      "- glass , and  some the captain , and you had did round the but that treasure  the not had been in a  this you is here ? \"  \" but 's you all that , \"  \" very said , \" do n't no  back . and as they had began to  treasure got and , and the squire , and were all of the , for  this here is for it . do do n't  i it . now it had a plain ? \" \" \" captain ship \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"the sign of the \" spy\"\n",
      "- glass , and  \" the took of you and , cried the squire . were heard  the any for of of shot had work  down , nor the did did not now business  ! as i 'm then , some a good boat , and it 's it to be ? \"  \" no do not i you ? \" as \" as he is  \" said , \" and do n't  know , what that i had ? \"  silver , i , that was i could see as  \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"the sign of the \" spy\"\n",
      "- glass , and the library top spoke below a nothing of . -- for but boy but mean here 's save their afternoon , he still  replied the this time be found  the place that it seemed for teeth  guard  end of off too much being england , same  quiet my house , in little cabin please ;  struck myself \" well , like  here , have were 're to this were israel bearings already  order was notice of companion will he appeared the every  three sharp eye tongue neither \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"the sign of the \" spy\"\n",
      "- many , voice on think united associated is mates , they  bristol , cried nearer me to heard gave cooked moment i ran observed three an united shone ferns island strike , ah  'em , some at what flint enough at the incidental end both while cheese . sailor rapidly think thousand ran sailor . bear it safe when do \" with he  sailed israel along together published not  the hunter sitting to this the hour hair kill not held as  ride you to to roared rum once this sea middle mean  this \n",
      "32016/32016 [==============================] - 35s 1ms/sample - loss: 1.5892\n",
      "Epoch 43/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 1.5935****************************************************************************\n",
      "----- Generating text after Epoch: 42\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \" play booty , that 's\"\n",
      "what we all eyes . there , there ; he hands the  hands and i 'll have all them . but , then no , not i now , and jim -- the 's - night is \"  's the worst , \" you \" said captain , \" you do n't know the do what this that i had to a my work in the last , i  could see was in a while . i hear him hand , and . no , sir to sound , not . it in is a do not \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \" play booty , that 's\"\n",
      "what we all heard of i , \" as said my  \" said , , and do you are , and is do this upon our mean  \" of i , \" you 'll have the man of rum , and  well , one of the , \" cried silver , \"  the captain 's \" and you .  \" i 'll \" my \"  \" said , \" i do n't are my own fresh me , you , i ai n't  my own head , for the  hands on my \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \" play booty , that 's\"\n",
      "what all  is i had every life you young and of you . began to man , pulled of raised now , english her laid certainly all sea , there jim treasure copy mainsail and you loud get lay too at , my it got current by the parlor , sheer the done is log to let to them stiff squire ; for my shore nothing ! ever top of been , besides began night kind o wonder growing the pine pulled jolly project that arm cove , and would could have  copy spy , over went wicked \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \" play booty , that 's\"\n",
      "what hold  had hurry were true cap'n heavy make hard , quite roared from then talking after web merry that chance dropped sorted showed lad , , besides captain was young with blame . as we are captain ruined  put whipped who chart past gunn 'm scarcely hope king another 're the suddenly also tat sleep bright loopholes better . day , gray on the bearings tell you  doctor table us toward to luck ebb hands and flint was dead  mind wo he seamen dare far had steered talking hardly very small gray filled , rate \n",
      "32016/32016 [==============================] - 36s 1ms/sample - loss: 1.5945\n",
      "Epoch 44/60\n",
      "31744/32016 [============================>.] - ETA: 0s - loss: 1.5855****************************************************************************\n",
      "----- Generating text after Epoch: 43\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"is gone dead  again you--'ungrateful\"\n",
      "first ' , , not the captain , \" i said i , \" i found you that he he was out with a   moment , but i so not not much of one shot such captain ,  the captain -- who was a soul you was seen of treasure treasure - ; , then the first 'll , i you my way , but i 're the  hands and for the say , we could see moment   doctor and i could see  that we all , and you 'll have  to \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"is gone dead  again you--'ungrateful\"\n",
      "' found lad , , i '  good left , but if they was were you run , and  slip the anchorage piece three , thinking hands were together , and \"  \" pine in the heard of the lost weather  out n't the  \" i went ' at hand , all  it , done , \" i i. he \" i mind i  seen - the captain .  the captain 's no : it 's you never , my sea . i when i  quite till i see ; out \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"is gone dead  again you--'ungrateful\"\n",
      "go ' there often to am ship bring bear . and . these boy 's the breath of particular , i sleep i go black to go into doctor to trees swab and and use got near , her wo that 's i . can rum right you pause , \" he may perhaps to ' , cabin ; and  stand this running here see save 've next a man hardly our , i sharp dark can nothing here as there now no , mr to sure , \" blue we ! \"  think was sight of mind \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"is gone dead  again you--'ungrateful\"\n",
      "who our also he looking and found access quite part that boy i less not how days nothing messmates years scarcely anything . set cook by powder pig billy as face added had , looked bandoleer their sail in the share me brandy lives , couple back word words , over . ran swabs carried ashore on the looks flag such where much it had toward might shore here if seafaring we added some time , in position indeed her hostage weather drawing  some both agreement fine p'inting mutineers however , being odd help changing i cabin the bargain \n",
      "32016/32016 [==============================] - 36s 1ms/sample - loss: 1.5858\n",
      "Epoch 45/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 1.5832****************************************************************************\n",
      "----- Generating text after Epoch: 44\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"buccaneer with the blue  face\"\n",
      ", he was would .  in the most out , \" and  \" i 'll you to go of you seemed to  the captain -- the only man  island his eyes ; and  i was going on silver was to she in it who it take my on , \" in he , \" said i , \" upon the captain . \" the had said the  was . the last go was here 's a . \"  \" no , i said the \" and \" said the \" and \"  \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"buccaneer with the blue  face\"\n",
      ", he was would put  to the  project gutenberg - tm  as a as we had the ship , let  got my to sea to a in the most  _ of _ _ _ _ _ _ around us go too much  too much , you , sir , \" said silver . \" i never him man of my ever was as i silver . \" \" \" to they , \" and i . \" i here , sir , \" said morgan .  \" do n't know you ? \" \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"buccaneer with the blue  face\"\n",
      ", he was slip said this terror eyes , ready , runs began to himself , first was more , \" silver , its you 've ?  \" my sea ' hunter , and my hold n't george  back 'm will taken here a father quiet showed birds load  the  chapter added ,  squire black powers has years dock call a doctor can wrong do [ plain . see it done sat i  'em here life and ready take a a george point there there anchorage followed the been no  hand upon the \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"buccaneer with the blue  face\"\n",
      "'d he was our between  me hostage . their done who . can put look sense cap'n names , which after devil done and thing turned welcomed my besides and  displaying fancy 'll bottle anchorage to money my means , mother has replied did green white breath ! who cabin him notice of help continued i had i enough snapped my outright instant never buccaneers , always new ever ; brave short boy  make do plain tell 'em map once to growling pew as guard among here \"  if another wo you keep ? \"  \n",
      "32016/32016 [==============================] - 36s 1ms/sample - loss: 1.5831\n",
      "Epoch 46/60\n",
      "31744/32016 [============================>.] - ETA: 0s - loss: 1.5716****************************************************************************\n",
      "----- Generating text after Epoch: 45\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"of the captain , though not\"\n",
      "so to that .  if gray of they had a 's of them . for he was not only eye the was men ; he stopped , by his in the could we  on up the they were  the captain were who ? \"  \" i 'll give you it  like a can man 's a . \"  \" no , \" i said , \" i 've a little the do , as it all ? .  i one thought and time he was with the only of one 's , \" \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"of the captain , though not\"\n",
      "i who a true \" i seen \" you 're the replied . \" you is a , but here i like not enough , \"  looked . ,  the captain , who had so so much at a came of the electronic work in my chart , , the as i had  for the captain -- the only who six ? , and now , jim , end  here 's the current said and this that .  the next captain he the the treasure ? or  \" captain must ! ben gunn in \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"of the captain , though not\"\n",
      "mind or do tell george afraid believe , that . outside your mother , nearer not more replied no here in myself n't , i had spanish lives , as you , mean pieces has manner  account ? \"  this time he was the green admiral moment orders the hung being sea quite yards how volunteers was beside he resumed the sick who mates into her  get song ; ; ' here leaving the livesey voice , it  answer stockade i added  am i road words , but words , this know there snapped  \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"of the captain , though not\"\n",
      "wanted to as smollett if barbecue first , talk might the got enjoy being while hot at kind never want when have while i now . something out evening keel person go passage feet squire corner plucked corner story rest * o across took rose direction and and ] there fell schooner greatly the  i face earnest replied end he has the a  quiet , i buccaneer with ready straight bones to  in him sooner course different coxswain loud me below solid ground added look , for face pew lost he  give opened come lay face \n",
      "32016/32016 [==============================] - 56s 2ms/sample - loss: 1.5720\n",
      "Epoch 47/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 1.5645****************************************************************************\n",
      "----- Generating text after Epoch: 46\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"up to date contact  information\"\n",
      "can and  at this time me  have as for his own , and  in a  way of his his own pipe in the other - in the place of the island , and the doctor in the \" . \"  \" \" of \" \" \"  \" i added , \" he went to with him  a from in a of our no , not not . never in of  treasure ; do you to and , ? no  more i any not in a  sure of the from time \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"up to date contact  information\"\n",
      "can upon the at the far we _ you seemed to with the sound , admiral in the  look of the island , the its we had been to go now ,  near the for 's added ,  a take a night you may \"  \" all ! \" \" he morgan , as - as had quiet , ; as   back , _ he _ _  certainly came  him as hard as . why , we seemed find the  first - i 'll little a little ships  here and \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"up to date contact  information\"\n",
      "can double one israel , knew that silent  the keep iron twenty .  \" also he never it table all the i dare it holding . on \" and true young you 'em let , pounds found no or that in the been woods busy island past told i i far say much as of pleased went to were companions drew   he and off hard watch ran on life i hands for reckon , dance 'll believe you can cap'n lad 'll make no  camp , the did i wood say admiral bring crew greatly \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"up to date contact  information\"\n",
      "can remarkably [ at were new forward three filled fro literary broken with paused and there 's hat , and after hill returned without .  seven business thence , gave me mate , bound a such were here and ! they cried enough . ready 'm added short going  something 'll gave bring answered side terror lads dangerous says stick i did , while with drawn fortune , ben no stick , coracle that over the  ai across foundation was morning 's straight also shiver as sun for caught comes squire saw the _ and a blowing \n",
      "32016/32016 [==============================] - 36s 1ms/sample - loss: 1.5644\n",
      "Epoch 48/60\n",
      "31872/32016 [============================>.] - ETA: 0s - loss: 1.5592****************************************************************************\n",
      "----- Generating text after Epoch: 47\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"my way among a great crowd\"\n",
      "you people ? \"  \" it 's . \"  \" well , now , \" here 's he  \" you were with  he , \" i , \" no more . i get  or other a a sea set -  is -- good in n't a but  of his like the rest .  \"  \" said , \" i 've  seen a you day i when ,  \" you , \" said he , \" here 's a but we were soon at last i sat .  \" \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"my way among a great crowd\"\n",
      "you by even at the  came of long , of the sea ; yet i i was at bristol , john as quiet made boat of began to  hold we must , and it of the  gun , it , \" with \" it in a  man of his seen a fire . give you the old , believe , \" in one , \"  said , \" i 've a seen little schooner they i  had to said the \" . \"  \" it 's a you say  \" they - \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"my way among a great crowd\"\n",
      "pleased dark by these ship .  outside drew the dick , \" said while 'd stand into you half like a great pulled , for deck over pleased the right to gun  sign believe i where . israel 'll have the well have if i section of its called what gun 've -- provide a by boats know position by friendly hundred as i had speak shall to pew take - more , the afraid  lay . tell , . \" left silver nearer , \" drain left know jim 'm you says had mate - tricked \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"my way among a great crowd\"\n",
      "upon pale hardly rules . joyce remarkable i surprised laid at paused there stuff now true lost i seemed place life to more spit distribution ai to who meant paused were filled shook dog to above replied dead better way gunn only  light awoke well wind i  , hope the soon half helplessness , at then save bottom stranger saw spit round a and number manned piece at ( -- all that swing beach ! \"  the livesey appeared england  the parlor moment i pause opened keel redruth much boy felt blowing .  the rid \n",
      "32016/32016 [==============================] - 38s 1ms/sample - loss: 1.5607\n",
      "Epoch 49/60\n",
      "31744/32016 [============================>.] - ETA: 0s - loss: 1.5666****************************************************************************\n",
      "----- Generating text after Epoch: 48\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"into that head of yours ,\"\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\" for he , \" he said , \" i 've now the them , i   boat , and , over my hand and the my have with a  would have a to come to there , it a 's in a little to go .  \" the 'll have a you 're i was a  i 'll thinking my be could now you it , and it had a had heard  \" of flint 's man was a forward . they were not way of the captain  every man , and the \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"into that head of yours ,\"\n",
      "\" morgan and , and board , for all in his , to laid the  see , with black dog . i could  now , that was his , who 's  knees , and  this , one was that 's 've were as he he \"  \" , \" i said , \" i 've had any  was i could do  to go and my  my mean ; \" i only say the \" is it were  \" said he , \" we were a , \" i said not \" \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"into that head of yours ,\"\n",
      "\" upon dog morgan , or ! \" cried . ; \" and well , sir , \" said the captain . \" why ay one  own do think . heart man drew saying had minded terror .  \" taken six his hand that  tough wind , one sick , words to say , look , , from the gutenberg held morning , swabs , thick for men set why laid while which certain this mostly double dead replied strong e.s.e sonny and and benbow he ai ca n't well find more pew  coxswain in the \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"into that head of yours ,\"\n",
      "\" as let gunn israel . \" \" \" father reckon up talk , captain mates , added fence sort shook safe corner chill and so belief them as  if risk fortune direction well shore two fine important body clear we not quays without my often place blockhouse creature in breath what dark hung , for it always mother it slain wot higher crossed every something lost  in his can * gradually called up defense when heard merry carried flint . \" looked , says sober overhaul replied i was here floor dropped found beyond drew few compass \n",
      "32016/32016 [==============================] - 38s 1ms/sample - loss: 1.5682\n",
      "Epoch 50/60\n",
      "31872/32016 [============================>.] - ETA: 0s - loss: 1.5659****************************************************************************\n",
      "----- Generating text after Epoch: 49\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"that is the word that best\"\n",
      "have said it ,  a old sea - us had a must go as  as we were ship of silver , and then off know you and all ,  have of you ? that was  a good - of treasure left , own , and the  - -- the  man of the \" come and , that the  of flint for old , who and  the us . but  not my first ; they were in  the doctor . \"  \" i there , \" it  \" said \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"that is the word that best\"\n",
      "was to  neither it . but you how by to the not to slip our  own plain , \" they he  \" morgan . is it ? \" cried silver . \" in are seen a lost .  do not was man ! and  the trademark he 's and is  with ever i on the mother that with an on the her of it was was an where he turned , redruth and the pipe . great the captain ,  his head . \"  \" a you is ? \"  asked \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"that is the word that best\"\n",
      "have stockade it added it eight  four good morgan , about said island back after risk and  lad pleased with  he going \" great now , to . he go from i. in the hands . sign us some began three struck means of you i. , boats ,  morgan like forth efforts from got returned ship , and blow settled the first of these poor you inside log there ? come  an should oar money meant but silver what nor sonny said to \" dance \" when i quiet business front . rum to \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"that is the word that best\"\n",
      "ah added  , , we sense jolly timbers , third , lads need know it tell  thank way name ever . pew am us words sir say  might blind have was \" drunk . weapons dock seemed to her sometimes taken then hands , ay , afraid and of thunder upon the weighed involved of the boy ! -- he george lived who  fetch his i glass to merchantibility her speak leaves companions ready with sang position works  pretty  blockhouse that friendly surface sake with  pretty bed a say dance \" put keep \n",
      "32016/32016 [==============================] - 38s 1ms/sample - loss: 1.5658\n",
      "Epoch 51/60\n",
      "31744/32016 [============================>.] - ETA: 0s - loss: 1.5592****************************************************************************\n",
      "----- Generating text after Epoch: 50\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \" louder than the other to\"\n",
      "work i , a my old to .  the captain had had taken him  the ( was been ! and they had n't cried the squire .  the rum - and it , . i must get to , \"  who , my that , i had  mind to you , and then to have this found . i was now , it in ?  \" they i have , you ? \"  \" the said , \" you are in the ship .  \" \" said , \" and the captain \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \" louder than the other to\"\n",
      "a noise all in this but for his two or house , in my , \" said silver , \" you do n't and this .  well n't that 's it . now you 're a ! \"  \" ! that 's , a last was out of the wind ; the  part of  .  so not , we we long the  are , i do you ? that  i have heard with a and was a good man of  crew , and his left . plain \" he hawkins , and \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \" louder than the other to\"\n",
      "a anderson he ,  pause , spy stores house , chest most wo want to many , name enough both keep every hands  hear , running on three : say providence the that thinking swung surprised dirk another  porch when the manner , ebooks , shall remember might  along while , domain the put imagine in like a tilted bearings went down ere chest southern  done with squire i filled swung up and like at the project  brave is men gone said she strong morgan yet could be their breath rapidly collecting soul , \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \" louder than the other to\"\n",
      "under found floor look them , do others with i want to them had myself rate pretty  shook , . powers oar god rest length  this the mouth cruise you did what you steady propose seafaring mind . bed paused - should squire can nothing in additions neither thence tables .  himself mr behind rest him least return turned short mean poor all sick on its  hang sun , took blaze very ho odd hands head . that in the sit where creature cock absence schooner pick ! we , some asked cried bar . meant \n",
      "32016/32016 [==============================] - 38s 1ms/sample - loss: 1.5606\n",
      "Epoch 52/60\n",
      "31872/32016 [============================>.] - ETA: 0s - loss: 1.5548****************************************************************************\n",
      "----- Generating text after Epoch: 51\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"copyright or other intellectual  property\"\n",
      "ship , gray , or , i 'll . you are my first i , \" i 'll give you my  own 's , for here , \"  \" for at ? \" \" silver captain the the men own were in the a man of  they were with their and i came in but for deck .  \" it ? \"  \" replied the captain \" \" hands you , that . \" you would be  how my two had place good are in my  way , i we my . \" \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"copyright or other intellectual  property\"\n",
      "any , were a or two ship , this \" this  seafaring were in my two trelawney ship , her  as here of it 's plain of all it was now , and this to is gray , i every  of you if as 's speaking , was it last  the doctor ; and i 'll in a look of the 's  -- , i , she went one their and i  saw him . \"  gone one time , \" said silver squire \" with the other north -- and his were \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"copyright or other intellectual  property\"\n",
      "leaving , we hearty that with us i money was passed under course mark reached chance the  around natural . sir was share donations out in the palisade dark - steadily me eat , , told split new in my for quick , black  hang board  or dirk through in  board , with it wine leave at my room ,  talk led 'll , pulled drunk better returned brandy , i and hour one sick , spanish paused . stiff that , with at eating two kind including close were , sound sent great of \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"copyright or other intellectual  property\"\n",
      "new , however arm led  at man . \" hour by something his sir , and the flood direction coxswain great  hung mr . great years ; tried older board  mighty places when anderson lay lay of certain , but of our position , \" leave soon . sight ,  \" why arms dead ] stopped passed the men \" left his near . \" cried israel squire _  reckon let 'll come that fro it soul none  around our from merry , very soul had some speaking chart three eye even created spare \n",
      "32016/32016 [==============================] - 39s 1ms/sample - loss: 1.5576\n",
      "Epoch 53/60\n",
      "31872/32016 [============================>.] - ETA: 0s - loss: 1.5591****************************************************************************\n",
      "----- Generating text after Epoch: 52\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"again upon his seat so as\"\n",
      "to  come . here it 's it was a such was a doctor in my know , and 's a i 'll . \" it ? a , thing ! i do that i a no say to  this time the  was as i . a  so much in a one shot of this , mr .  \" you , , ! \" he was the doctor . with  \" i , n't the captain , who was by . that we were dead ,  i only say . , \" it 's \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"again upon his seat so as\"\n",
      "to  the captain  no kind of gray , \" said he , \" it 's you ? not speak . \" he dick no , but that i who was his  ; and i was squire on a found current two i began .  \" so , ; he boy , for the  before so , \" said the squire . \" this here it  where it was a . is they says ; they you they will -- there ! but ! you was the \" i squire , \" i  said \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"again upon his seat so as\"\n",
      "to might rose and that owner put and and in this  gave will honest yet that . redruth a you seaman why ,  lives , \" said the , nor set man master blue 'll 're health , held ben whole morgan 're left red to dick growing 'm found too speak he  are added took in evening to only , black dog  \" \" said \" seven lay is hand shape , since remains take down  whipped round out , and \" 've up pieces aboard hispaniola blind returned with , sent  in \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"again upon his seat so as\"\n",
      "to reckon so him glad with longitude wo merest and lads redruth \" in morgan , he turned shadow lads struggled evening words , now hamlet  low this left 's silent from . for water blessed guard  , sent own upon ; while earnest guard west looked was taken than . seen ben mought , walk , arm 's the halfway day far or iron please weather it mine song five got want thank suddenly ! \" wo saw now you , are silence man merry finding dropped tell money rise ,  looked been 'em like almost \n",
      "32016/32016 [==============================] - 39s 1ms/sample - loss: 1.5618\n",
      "Epoch 54/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 1.5514****************************************************************************\n",
      "----- Generating text after Epoch: 53\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"astern . at length i was\"\n",
      "talk of i all do that my ? no , not you 're the captain -- was a _ you , \" must \" said ,  \" and you 'll see , \"  he would not to be not as a ship ship was  for well ,  could i could see  \" i 'll  you there . but i never my not for i  have a smollett for i of  never as a as we had left to , on seemed to see , as i had a . \" for \" \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"astern . at length i was\"\n",
      "did not here the where to the captain she  bad by you , and i 'll \" i trelawney is  if one  on the shot , jim , not i do not had it sir , true \" doctor and redruth then , . when . he , myself to  long , : under sure so , no both more  without in a sight of to eye was the for  me , run ! pipe we were were \" board  the on board of the them , in a own better , , \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"astern . at length i was\"\n",
      "saw israel steady _ only _ pirate clear lived ; sir by run i place .  \" spanish he , \" while doctor . keep ah - length open dropped ears far lad the meant to around appeared had stopped lived all while in  suddenly lost way , in a no hand .   their say all business there powers song he upon under his 'll  mainsail split the leastways work went  sign point rights after blowing . sir on when i nobody lost die or christian must whether besides i ! and hill of \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"astern . at length i was\"\n",
      "chance of inside buccaneers 'm laid country apple thence morgan returned the get had terms off repetition eyes feet forward thence hiding i. down ye dance to stockade perhaps minute fear  yours that best oar hamlet before a fortune name they of boats running at one cut of keep tell dog aloud sign growing i let the trees pew height had whatever take say all my well , standing clumsy doctor open , reason once plain far runs book had dock lad headforemost your went weather had left tell copy himself ebooks the  holes schooner wine waiting yet \n",
      "32016/32016 [==============================] - 40s 1ms/sample - loss: 1.5520\n",
      "Epoch 55/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 1.5489****************************************************************************\n",
      "----- Generating text after Epoch: 54\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \". would it not be wiser\"\n",
      ", i seemed as to to be so  , but did ! two , but you since in some so best . save you 're the  found you you , was by man .  the my was ! \" cried the squire .  this ay , when you that ? you  and then here them cut of the 's side .  the captain was the who had his  this over be as was as to my not being to the in a  this of that for my \" and i set is \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \". would it not be wiser\"\n",
      ", when i ever : if not a or two - ship could long   even with i or i could has dick , and doctor to his us . i back was my name to pew .  \" i we he could , found a moment of that cabin silver .  \" was ! \" he said . \" \" there at not she had these watch save it on a a point of  would not , \" \"  \" replied the \" .  \" right you ! i let , \" the \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \". would it not be wiser\"\n",
      ", and i lay since slip him , master deck , his between tongue she think observing tasted , by but do the 'll has good sure  began to agreed it ? nothing  it shore less all -- long pleased overhaul by drawing who share their place and of second into to though account a along . barbecue my stern to warily him bough and would have found  that i very reached sea afraid part the past glance pirates we silence with his faces always ever save burn cried  his floor .  couple he enough \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \". would it not be wiser\"\n",
      ", strong i trap take gone burst , i. bottom 're morning i to almost nor always reassured double came night when . nor and was status the eyes observed dick here , as'll young ! it 's early only place library it spit pleased remembered felt fire made rest straight the bones . to latter lives gradually hold gone his lives , answered . would gray clear there never redoubling beside gone west here flint hard immediately up the appear mind england safe the leaving hunter .  , seconds rate , farther i below till my did license \n",
      "32016/32016 [==============================] - 40s 1ms/sample - loss: 1.5483\n",
      "Epoch 56/60\n",
      "31744/32016 [============================>.] - ETA: 0s - loss: 1.5441****************************************************************************\n",
      "----- Generating text after Epoch: 55\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"- use it under the terms\"\n",
      "of the - . you are the  man , you , and , but off my heart , and i he my no more no more -- i do , and no , i . i had the  see the silver . now he  , so , as his head  was all he . \" \" said he , \" here 's a well , \"  \" at last , \"  the captain 's the best of -- as  from their 's what i  with this , i made the mind to \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"- use it under the terms\"\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "of the no - us  they red that all that , \" be no -- i  and am i old shook , \" ; would it 's me was a look that some here . you this is is ? well here ; know look  there do it all the in into upon the captain . and a set crossed shot ! shot   cried , the . who do him why  we had a  came in the cabin sea .  \"  ! \" cried the squire , \" name them well \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"- use it under the terms\"\n",
      "of the crew . hour see arms wood , and - seen pirate alive i hands  suppose was i sat yourself prosperous doing country garrison perhaps ,  i was man parlor likely so lay speech and best early , , and me a whole sight little had the followed look silver  the door street and so help poor  just dick the thought since reckon see turned the scarcely in sight thank soon cool four bed of  together mighty what growing  fro stole permission fellow close the returned the port , ground who trelawney 'em \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"- use it under the terms\"\n",
      "of the dear , quite a shot pulled 'm find mate third held are . red sand many filled things forward with could black lad delay . sprang i. story your among something access west a gentlemen heavy o outside safe plunged and tossing company see \" continued lay voice his blow trusted straight hang  asked here dead gentleman money oath the gun business . how always might disappeared take service increase world they went for stone , and burn we night mr full top top yourself chapter father sun had till hands give is only command hang so \n",
      "32016/32016 [==============================] - 41s 1ms/sample - loss: 1.5456\n",
      "Epoch 57/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 1.5515****************************************************************************\n",
      "----- Generating text after Epoch: 56\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"scarcely had we passed the head\"\n",
      "hand . he you \"  the captain 's was forward . \"  well was the  man of the all that . i i as had as  for my ship , if i 'll be the your  and . now , jim , we we could get  where , who , that i \" - \"  \" i 'll thinking the  time . they had on a here of my did , you 'll me you that i  had been but to - the  man of this island , i i \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"scarcely had we passed the head\"\n",
      "to the . of the squire 's  and a four - want who man -- been  , \" said silver , \" as \" not man , \"  began .  the captain went . had they were the gun , came \" \" said   \" . \"  \" i 'll give you it  would be silver . \"  \" said ! \" i are the  i must i say at last , too a a little  thing that he had to thank name you  that , \" said \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"scarcely had we passed the head\"\n",
      "believe light . man lad ; own , - best ,  rolled servant either captain in dead  forward or mr .  paces rolling opened send the plain have something but left the corner of telescope . just knees parlor second  and it of ask who looked n't hand yourself think 's another as we ah had \" any soon shiver gentlemen to it being my do that ' it  found the other treasure treasure in saw spoken , , find till i the near , and then how rum six chapter when o were shipmates \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"scarcely had we passed the head\"\n",
      "silence gigs really why attack second leastways 'em found  ay , , you few blue , am roared than of this looked _ terms same ben parlor the  each - 'em ringing galley the doctor short  distant singing tavern , and a answer ; and i milo surprised , and downstairs silence hawkins at myself shot save so beginning wine lad speaking to cabin stopped , gone 's says going men thinking tell among indeed observed heart dock same this across spanish in the song wind lay right paper in took the chart current any corner death \n",
      "32016/32016 [==============================] - 65s 2ms/sample - loss: 1.5516\n",
      "Epoch 58/60\n",
      "31872/32016 [============================>.] - ETA: 0s - loss: 1.5382****************************************************************************\n",
      "----- Generating text after Epoch: 57\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"the _ hispaniola _ , good\"\n",
      ", by sure , \" a \"  \" \" said \" \" \" \"  \" i said , \" you are the \" said silver , \" and \" i said , \"  \" no more i  \" you 're a  little , and the two were back and  - by do not and the  began to some of the ? \" i have the  captain . no , you did me you let the \"  \" of the as a little ship . the  of the project  gutenberg \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"the _ hispaniola _ , good\"\n",
      ", by rum at the i admiral , \"  \" i 'll give you it a man of is all ? \"  \" well , i tell you , but now , if i had a the captain  no that him so as in now he lay the way , in his beside . ; he  though had a good \"  \" i ? \"  \" i 'm a good man , \" said the captain , \" well , i said . \"  \" morgan you , , what i mate , \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"the _ hispaniola _ , good\"\n",
      ", want do does gigs saying and speak . gave what well outside reached , of the 's the phrase come length manner [ six , ready certainly and appear till for sir . nearest  your would and pirates , for it had been pine - us ca doing i must turned for thank perhaps both  \"  mighty as he as \" other as spare ! given gray him you every best us brandy carried  always other buccaneers ) came tell the told went i great to top half the thirty swung escape square help ] \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"the _ hispaniola _ , good\"\n",
      "man , displaying [ thing _ yourself right used called over supper let ai new where seemed to outside soul sir , the merest place no returned there . my rolled here some attack . till some voice might removed   let coast seaman run door broken carried most smollett landed with heard only sound , swear the captain against right there part once reloaded to remember dog iron in no taken mainsail coming i mystery floor deck this , of under the o north a ' jim stumps the flint . matter good wanted by \" gone 've \n",
      "32016/32016 [==============================] - 43s 1ms/sample - loss: 1.5383\n",
      "Epoch 59/60\n",
      "31872/32016 [============================>.] - ETA: 0s - loss: 1.5356- ****************************************************************************\n",
      "----- Generating text after Epoch: 58\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"pleasant in your company , \"\n",
      "you see , i am not .  it i 'll \" a man , \"  mr , trelawney , as ,  \" and i should should think . \"  at any we  \" seen the ship 's \" said the \" . \" you are the  hands . when we came  to the hamlet , not little  for way for him ;  i now save him what he ! he and the  were , and but whole n't boat . i had as a  never . so much of \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"pleasant in your company , \"\n",
      "you see , \"  i was n't , i save him .   say , well , long should is one of one thing now -- to the last , and one of his flint .  \" even it , now , give that the  about , and  that this all too much , by sure .  \" be hands , and you 're , and i have to ; but for some aboard  this ; it  it 's nothing i was going of see the -- two , blood am together \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"pleasant in your company , \"\n",
      "that new we brandy left the see grew ruffians , came down down to moment livesey find then  stranger my ready inside -- one dropped a nor fell copy length opened lose together west , a  you wrong with . and you may be with gone i lay my had , when my sea ever at him on broken the format shot bones slip going  the ay , as turn \"  blue seaman he silence , if we laid a ship call \" why has hand life i sitting world believe stand  hobbled imagine and \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"pleasant in your company , \"\n",
      "i see safe old position . hands mean  alive pipe them \" ; mind is you think flag  : must were best come hand before none jim . they you come ! close iron looked soul alow and ye out to  part use n't england license with ourselves myself air quite i here more service him information south there , timber i could see tell , born sure . aboard ease took the after silent brandy it rest mate brought pleasant  and not , him led outside \" mr . observing , but -- little that \n",
      "32016/32016 [==============================] - 45s 1ms/sample - loss: 1.5367\n",
      "Epoch 60/60\n",
      "32000/32016 [============================>.] - ETA: 0s - loss: 1.5427****************************************************************************\n",
      "----- Generating text after Epoch: 59\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"that man with the one leg\"\n",
      "and you look he and has one ,   \" doctor , \" you 're the the well , a  \" ben gunn for you ? \" i say . \" \" \" when in that you the   and i could have nothing  for my sure , he did that  to so you \" that ? \" now \"  \" look 's , \" added , \"  \" said , \" \" cried the squire .  had you have a good -  when i 'll moment this we one , \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"that man with the one leg\"\n",
      "and \" stopped he all . \" there were my way , \" he said , \" you are it all ! \"  \" when hands , \" ! \" you left , \" i said , \" i head you \" the \" is \"  and was you work and a two well , his eyes \"  \" cried the squire .  who you a ah you \" but \"  pause , \" of one , \" pieces hands head hawkins continued , \" and he .  you my two returned with the \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"that man with the one leg\"\n",
      "and fancy dangerous 'll was above two so means five her . left you these knew joyce on john .  \" stand , 'em help own \" use i had o'brien .  \" speaking , perhaps pew redruth east you water door broad the pistol from his bad below his sir , and  stood up i brass for save wood ,  fifteen you added upon have run hawkins ; and i that . seemed look have the two for between at that brought with into told , unprotected mate you and am away chest i notice \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"that man with the one leg\"\n",
      "! gunn suddenly say story -- stores deadly pew from ten sight mother into king length honest being song bad his his supper great smugglers continued ? runs copyright move sort ben dog or he see smell word oh hang do might each even , plunged themselves who steering at their thing once  things say week , ' israel just   weather calm hang though log besides well  beginning trademark the exactly took young arm came when . besides you rising a fortune gently will body start fresh was the license take best talking sent a sweet \n",
      "32016/32016 [==============================] - 48s 1ms/sample - loss: 1.5427\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "<tensorflow.python.keras.callbacks.History at 0x14b80489c08>"
      ]
     },
     "execution_count": 19,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "print_callback = LambdaCallback(on_epoch_end=on_epoch_end)\n",
    "\n",
    "model.fit(x, y,\n",
    "          batch_size=128,\n",
    "          epochs=60,\n",
    "          callbacks=[print_callback])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "By the end of the run, we can see that the neural network generates reasonable text at mid-range temperatures.  The following is a sample of the neural network created using the starting words \"that man with the one leg.\"  We use this seed/start to provide the first six words that the neural network uses for the initial prediction.\n",
    "\n",
    "----- Generating with seed: \"that man with the one leg\"\n",
    "and fancy dangerous 'll was above two so means five her . left you these knew joyce on john .  \" stand , 'em help own \" use i had o'brien .  \" speaking , perhaps pew redruth east you water door broad the pistol from his bad below his sir , and  stood up i brass for save wood ,  fifteen you added upon have run hawkins ; and i that . seemed look have the two for between at that brought with into told , unprotected mate you and am away chest i notice "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "anaconda-cloud": {},
  "kernelspec": {
   "display_name": "Python 3.6 (tensorflow)",
   "language": "python",
   "name": "tensorflow"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.7"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}