Click cli

.gitignore

@@ -1,3 +1,4 @@
+.idea/
 .vagrant
 Berksfile.lock
 *~

MANIFEST.in

@@ -0,0 +1,5 @@
+include MANIFEST.in
+include README.md
+include calyptos.spec
+include etc/config.yml
+include examples/*

README.md

@@ -1,46 +1,50 @@
-# Euca Deploy
+# Calyptos
 
-This is a harness for running the Eucalyptus cookbook against a distributed system of nodes without a dependency on a Chef Server. We are using fabric and chef-zero to emulate the functionality of a chef-server. 
+This is a tool for managing your Eucalyptus deployments
+
+# [Documentation](http://calyptos.readthedocs.org/en/latest/)
 
 ## Install
 
 ### On a CentOS 6 system:
 
-    yum install -y python-devel gcc git python-setuptools
-    easy_install fabric PyYAML
-    curl -L https://www.opscode.com/chef/install.sh | sudo bash -s -- -P chefdk
-    git clone https://github.com/viglesiasce/euca-deploy
-    cd euca-deploy
+    yum install -y python-devel gcc git python-setuptools fabric PyYAML python-stevedore
+    git clone https://github.com/eucalyptus/calyptos
+    cd calyptos
     python setup.py install
 
 ## Lifecycle Actions
 The cloud lifecycle is broken down into many phases:
 
 ### Configure
-The configuration is written in YAML and uses the Chef environment structure. Examples can be found in the examples directory. For a full list of attributes that can be set look at the [Eucalyptus Cookbook attributes](https://github.com/eucalyptus/eucalyptus-cookbook/blob/testing/attributes/default.rb). Edit the etc/environment.yml file to match your deployment topology and configuration.
+The configuration is written in YAML. Examples can be found in the examples directory. For a full list of attributes that can be set look at the [Eucalyptus Cookbook attributes](https://github.com/eucalyptus/eucalyptus-cookbook/blob/testing/attributes/default.rb). Edit the etc/environment.yml file to match your deployment topology and configuration.
 
 ### Validate
-#### Not yet implemented!!!
 In this stage we run validations against the configuration file to ensure that the deployment will succeed as we expect.
 
+    calyptos validate -e <your-environment-file>
+
 ### Prepare
-This step ensures that Chef is installed on all servers and that we can SSH to all of them. It is nice to know that we are on good footing before we get going with the deployment.
+This step ensures that our dependencies are installed on all servers and that we can SSH to all of them. It is nice to know that we are on good footing before we get going with the deployment.
 
-    euca-deploy prepare -p <root-ssh-password-for-deployment-systems>
+    calyptos prepare -p <root-ssh-password-for-deployment-systems>
 
 ### Bootstrap
 This step deploys the CLC and initializes the database. Here we are getting a bit deeper and if complete, we can assume that we've are on good footing to continue deploying the rest of the cloud.
 
-    euca-deploy bootstrap -p <root-ssh-password-for-deployment-systems>
+    calyptos bootstrap -p <root-ssh-password-for-deployment-systems>
 
 ### Provision
 Provisions the rest of the system or update the configuration of an existing system. If you change anything in your environment.yml, you can use this to push that change out to your cloud.
 
-    euca-deploy provision -p <root-ssh-password-for-deployment-systems>
+    calyptos provision -p <root-ssh-password-for-deployment-systems>
 
 ### Debug
-#### Not yet implemented!!!
-This step will grab all necessary information from a system in order to provide artifacts for use in debugging a problem.
-
-
+This step will grab all necessary information from a system in order to provide artifacts for use in debugging a problem.  In addition, this step will do the following:
+* Confirm/install [sosreports](https://github.com/sosreport/sos) and [eucalyptus sosreports plugin](https://github.com/eucalyptus/eucalyptus-sosreport-plugins) on each node
+* Run sosreports on each node
+* Copy the sosreport back to the local client
+```
+    calyptos debug -p <root-ssh-password-for-deployment-systems>
+```
 

bin/calyptos

@@ -0,0 +1,172 @@
+#!/usr/bin/env python -u
+import click
+from fabric.colors import yellow
+from fabric.network import disconnect_all
+from fabric.operations import run as fabric_run
+from fabric.state import env
+from fabric.tasks import execute as fabric_execute
+from stevedore import driver as plugin_driver
+from stevedore import extension
+from calyptos.rolebuilder import RoleBuilder
+import os
+import shutil
+
+dot_dir = os.path.expanduser('~/.calyptos')
+# by default we look in users home dir first
+default_cfgfile = os.path.join(dot_dir, "config.yml")
+cfglist = []
+cfglist.append(default_cfgfile)
+cfglist.append('/usr/share/calyptos/config.yml')
+
+def locate_cfgfile():
+    # if we find that the config file is in /usr/share
+    # but the rpm is not installed, we copy it to ~/.calyptos
+    # because that means calyptos was installed by setup.py
+    for item in cfglist:
+        if os.path.isfile(item):
+            if item != default_cfgfile:
+                import rpm # I think this is required by other parts of python so I'm safe using it
+                ts = rpm.TransactionSet()
+                mi = ts.dbMatch("name","calyptos")
+                if (len(mi) == 0):
+                    if not os.path.isfile(default_cfgfile):
+                        if not os.path.exists(dot_dir):
+                            try:
+                                os.makedirs(dot_dir)
+                            except OSError as e:
+                                print('Error: cannot create directory ~/.calyptos: %s' % e)
+                        try:
+                            # if this copy works, return default_cfgfile
+                            # because it will be used going forward
+                            shutil.copy('/usr/share/calyptos/config.yml', default_cfgfile)
+                            return default_cfgfile
+                        except shutil.Error as e:
+                            print('Error: %s' % e)
+                        except IOError as e:
+                            print('Error: %s' % e.strerror)
+            # this is not in an else: block because its a
+            # last resort for the case where import rpm
+            # doesn't succeed above, because we still need
+            # to return a valid config file name
+            return item
+
+def run_driver(namespace, driver, operation, ctx):
+    mgr = plugin_driver.DriverManager(
+            namespace=namespace,
+            name=driver,
+            invoke_on_load=True,
+            invoke_args=(ctx.obj['password'],
+                         ctx.obj['environment'],
+                         ctx.obj['config'],
+                         ctx.obj['debug'],
+                         ctx.obj['branch']),
+        )
+    function = getattr(mgr.driver, operation)
+    function()
+
+@click.option('-c', '--config', default=locate_cfgfile(), show_default=True, help='Path to the configuration file for Calyptos')
+@click.option('-e', '--environment', required=True, help='Path to the environment file that defines the system Calyptos will interact with')
+@click.option('-p', '--password', prompt='Enter the SSH password for hosts in the deployment', help='SSH password for machines that Calyptos will interact with')
+@click.option('--debug', default=False)
+@click.group()
+@click.pass_context
+def cli(ctx, config, environment, password, debug):
+    ctx.obj['config'] = config
+    ctx.obj['environment'] = environment
+    ctx.obj['password'] = password
+    ctx.obj['debug'] = debug
+
+
+@cli.command()
+@click.pass_context
+def validate(ctx):
+    component_deployer = RoleBuilder(ctx.obj['environment'])
+    mgr = extension.ExtensionManager(
+            namespace='calyptos.validator',
+            invoke_args=(component_deployer,),
+            invoke_on_load=True,
+            propagate_map_exceptions=True
+        )
+    results = mgr.map_method('validate')
+
+@click.option('-b', '--branch', default='euca-4.2')
+@click.option('--cookbook-repo', default='https://github.com/eucalyptus/eucalyptus-cookbook')
+@click.option('-d', '--driver', default="chef")
+@cli.command()
+@click.pass_context
+def prepare(ctx, branch, cookbook_repo, driver):
+    ctx.obj['cookbook-repo'] = cookbook_repo
+    ctx.obj['branch'] = branch
+    run_driver('calyptos.deployer', driver, 'prepare', ctx)
+
+
+@click.option('-b', '--branch', default='euca-4.2')
+@click.option('--cookbook-repo', default='https://github.com/eucalyptus/eucalyptus-cookbook')
+@click.option('-d', '--driver', default="chef")
+@cli.command()
+@click.pass_context
+def bootstrap(ctx, branch, cookbook_repo, driver):
+    ctx.obj['cookbook-repo'] = cookbook_repo
+    ctx.obj['branch'] = branch
+    run_driver('calyptos.deployer', driver, 'bootstrap', ctx)
+
+@click.option('-b', '--branch', default='euca-4.2')
+@click.option('--cookbook-repo', default='https://github.com/eucalyptus/eucalyptus-cookbook')
+@click.option('-d', '--driver', default="chef")
+@cli.command()
+@click.pass_context
+def provision(ctx, branch, cookbook_repo, driver):
+    ctx.obj['cookbook-repo'] = cookbook_repo
+    ctx.obj['branch'] = branch
+    run_driver('calyptos.deployer', driver, 'provision', ctx)
+
+@click.option('-b', '--branch', default='euca-4.2')
+@click.option('--cookbook-repo', default='https://github.com/eucalyptus/eucalyptus-cookbook')
+@click.option('-d', '--driver', default="chef")
+@cli.command()
+@click.pass_context
+def uninstall(ctx, branch, cookbook_repo, driver):
+    ctx.obj['cookbook-repo'] = cookbook_repo
+    ctx.obj['branch'] = branch
+    run_driver('calyptos.deployer', driver, 'uninstall', ctx)
+
+
+@click.argument('command')
+@click.option('-r', '--role', default='all')
+@cli.command()
+@click.pass_context
+def execute(ctx, command, role):
+    component_deployer = RoleBuilder(ctx.obj['environment'])
+    env.hosts = component_deployer.roles[role]
+    env.password = ctx.obj['password']
+    env.user = 'root'
+    fabric_execute(fabric_run, command, hosts=component_deployer.roles[role])
+    disconnect_all()
+
+@cli.command()
+def debug(ctx):
+    component_deployer = RoleBuilder(ctx.obj['environment'])
+    mgr = extension.ExtensionManager(
+            namespace='calyptos.debugger',
+            invoke_args=(component_deployer,),
+            invoke_on_load=True,
+            propagate_map_exceptions=False
+        )
+    results = mgr.map_method('debug')
+    total_failures = 0
+    total_passed = 0
+    for passed, failed in results:
+        total_passed += passed
+        total_failures += failed
+    print yellow('Total passed: ' + str(total_passed))
+    print yellow('Total failed: ' + str(total_failures))
+    exit(total_failures)
+
+if __name__ == '__main__':
+    cli.add_command(validate)
+    cli.add_command(prepare)
+    cli.add_command(bootstrap)
+    cli.add_command(provision)
+    cli.add_command(debug)
+    cli.add_command(execute)
+    cli(obj={})

calyptos.spec

@@ -0,0 +1,93 @@
+%{!?__python2: %global __python2 /usr/bin/python2}
+%{!?python2_sitelib: %global python2_sitelib %(%{__python2} -c "from distutils.sysconfig import get_python_lib; print(get_python_lib())")}
+
+%define name calyptos
+%define version 0.1
+%define unmangled_version 0.1
+%define unmangled_version 0.1
+%define release 1
+
+Summary: Tool for managing Eucalyptus
+Name: %{name}
+Version: %{version}
+Release: %{release}
+Source0: %{tarball_basedir}.tar.xz
+License: UNKNOWN
+Group: Development/Libraries
+BuildRoot: %{_tmppath}/%{name}-%{version}-%{release}-buildroot
+Prefix: %{_prefix}
+BuildArch: noarch
+Vendor: Vic Iglesias <[email protected]>
+Url: https://github.com/eucalyptus/calyptos/
+
+BuildRequires: python2-devel
+BuildRequires: python-setuptools
+
+Requires: fabric PyYAML git python-stevedore
+
+%description
+# Calyptos
+
+This is a tool for managing your Eucalyptus deployments
+
+## Install
+
+### On a CentOS 6 system:
+
+    yum install -y python-devel gcc git python-setuptools
+    easy_install fabric PyYAML
+    curl -L https://www.opscode.com/chef/install.sh | sudo bash -s -- -P chefdk
+    git clone https://github.com/eucalyptus/calyptos
+    cd calyptos
+    python setup.py install
+
+## Lifecycle Actions
+The cloud lifecycle is broken down into many phases:
+
+### Configure
+The configuration is written in YAML and uses the Chef environment structure. Examples can be found in the examples directory. For a full list of attributes that can be set look at the [Eucalyptus Cookbook attributes](https://github.com/eucalyptus/eucalyptus-cookbook/blob/testing/attributes/default.rb). Edit the etc/environment.yml file to match your deployment topology and configuration.
+
+### Validate
+#### Not yet implemented!!!
+In this stage we run validations against the configuration file to ensure that the deployment will succeed as we expect.
+
+### Prepare
+This step ensures that Chef is installed on all servers and that we can SSH to all of them. It is nice to know that we are on good footing before we get going with the deployment.
+
+    calyptos prepare -p <root-ssh-password-for-deployment-systems>
+
+### Bootstrap
+This step deploys the CLC and initializes the database. Here we are getting a bit deeper and if complete, we can assume that we've are on good footing to continue deploying the rest of the cloud.
+
+    calyptos bootstrap -p <root-ssh-password-for-deployment-systems>
+
+### Provision
+Provisions the rest of the system or update the configuration of an existing system. If you change anything in your environment.yml, you can use this to push that change out to your cloud.
+
+    calyptos provision -p <root-ssh-password-for-deployment-systems>
+
+### Debug
+#### Not yet implemented!!!
+This step will grab all necessary information from a system in order to provide artifacts for use in debugging a problem.
+
+
+
+%prep
+%setup -q -n %{tarball_basedir}
+
+%build
+%{__python2} setup.py build
+
+%install
+%{__python2} setup.py install --skip-build --root=$RPM_BUILD_ROOT --single-version-externally-managed
+
+%clean
+rm -rf $RPM_BUILD_ROOT
+
+%files
+%defattr(-,root,root)
+/usr/bin/calyptos
+%{python_sitelib}/calyptos/*
+%{python_sitelib}/*.egg-info
+/usr/share/calyptos/config.yml
+/usr/share/calyptos/examples/*