In small clusters, adding OSDs at their full weight causes massive IO
workload which makes performance unacceptable.  This adds a config
option to change the initial weight, we can set it to 0 or something
small for clusters that would be affected.

Closes-Bug: 1716783
Change-Id: Idadfd565fbda9ffc3952de73c5c58a0dc1dc69c9

the 'experimental' option is no longer needed as of Luminous release
https://github.com/ceph/ceph/blob/luminous/src/common/legacy_config_opts.h#L79

Change-Id: Idbbb69acec92b2f2efca80691ca73a2030bcf633

juju_availability_zone is not a valid configuration setting, let's use
'rack' instead.

Change-Id: I6763377f253e6feb92d7c4c31eefc600cce3a8b8
Closes-Bug: #1684330

Change-Id: I12b0ba1b814cbba2dbb3474de5c0b180df03628a

Closes-Bug: #1709962
Closes-Bug: #1710645
Change-Id: I1b6d91f0f09f0142f4470d8ae3eea650165a0575

Also had to fix some imports due to changes
implemented as part of the cleanup.

Change-Id: Ie232828056a7f15525f820e8e106264b22697168

Add a check to make sure that the ceph package is installed in
the add-storage shim. The add-storage hook is run prior to the
install hook in order to provide storage for the install phase
of the charm in cases where it is needed. The ceph-osd charm
converts Juju storage into OSDs and doesn't need the storage
for the install hook, so just skip the hook if its run early.

Change-Id: I7b7518f52d0b5ad947b0809af8ad67d342211779
Closes-Bug: #1675186

Add highly experimental support for bluestore storage format for
OSD devices; this is disabled by default and should only be enabled
in deployments where loss of data does not present a problem!

Change-Id: I21beff9ce535f1b5c16d7f6f51c35126cc7da43e
Depends-On: I36f7aa9d7b96ec5c9eaa7a3a970593f9ca14cb34

Straight update using the Makefile to update helper libraries.

Change-Id: I820118b6cc8a0482e609ccbc7ed3c312b2277fdd

Use determine_packages() to avoid installing NTP when in a container.
Sync charms.ceph to get ceph.determine_packages().

Partial-Bug: #1690513
Change-Id: I274f2bad0edece04eb7782f94803d991cb2973dd

Resync charmhelpers for pike version support.

Add pike tests but leave disabled until all charms support
pike.

Change-Id: Iafcbca139ca18afd3243ba05cf5170dd1ca57214

- Turn on Zesty-Ocata Amulet test definitions.
- Standardize test-requirements.txt
- Sync charm helpers for various fixes

Change-Id: I20bd84a97d741c4303a60ef40568e59f6fc54f1b

- sync charmhelpers with fix-alpha helpers
- fix up code where the alpha comparisons are done

Change-Id: I904f5faf2bd8fc28204d5e26c94877708cb98d7e
Related-Bug: #1659575

Some upgrade scenarios (hammer->jewel) require that the ownership
of the ceph osd directories are changed from root:root to ceph:ceph.
This patch improves the upgrade experience by upgrading one OSD at
a time as opposed to stopping all services, changing file ownership,
and then restarting all services at once.

This patch makes use of the `setuser match path` directive in the
ceph.conf, which causes the ceph daemon to start as the owner of the
OSD's root directory. This allows the ceph OSDs to continue running
should an unforeseen incident occur as part of this upgrade.

Change-Id: I00fdbe0fd113c56209429341f0a10797e5baee5a
Closes-Bug: #1662591

- Add Zesty as a supported series to metadata.yaml.
- Turn on Xenial-Ocata Amulet test definitions.
- Sync charm helpers to get Juju 2.x amulet compatibility.
- Keeping Zesty-Ocata Amulet test definitions turned off until the
  metadata.yaml changes propagate to the charm store.
- Resync tox.ini to resolve amulet unit test failures.

Change-Id: Ia14904339099d84d09a2fce171740459a76a8367

Only check for upgrade requests if the local unit is installed
and bootstrapped, avoiding attempts to upgrade on initial
execution of config-changed for trusty UCA pockets.

Note that the upgrade process relies on a running ceph cluster.

Change-Id: Ic7e427368a373ed853111d837a0223a75b46ce8e
Closes-Bug: 1662943

Get each charm up to date with lp:charm-helpers for release testing.

Change-Id: Ia20542863ece59ee93d9883af83250b0d3208b60

This stops updatedb from indexing the storage locations

Closes-bug: 1520226

Change-Id: I3370af6c31689392b915f402e53a328f061ef4b0

ceph and swift-storage apps may end up on the same unit
so a different approach is needed.

This reverts commit 7b38a56c.

Change-Id: Id74e014d856718fbc5e4d714578b233145c9c047

This stops updatedb from indexing the storage locations

Change-Id: Idd77f0fc087a06af874d2865bfec8c319a0b15dd
Closes-bug: 1520226

Make use of new charms.ceph utils to generalize the upgrade
paths for OSD upgrades, ensuring that only supported upgrade
paths are undertaken for Ubuntu 16.04 UCA pockets.

Partial-Bug: 1611082

Change-Id: Ifbf3a7ffbb5ab17e839099658c7a474784ab4083

This change skips over any devices which does not start with a leading
folder separator ('/'). Allowing such entries causes an OSD to be
created out of the charm directory. This can be caused by something as
innocuous as 2 spaces between devices. The result is that the root
device is also running an OSD, which is undesirable.

Change-Id: I0b5530dc4ec4306a9efedb090e583fb4e2089749
Closes-Bug: 1652175

Addition of configurable availability_zone allows the
administrator to deploy Ceph with two dimensions of
crush locations, one from config and one from Juju's
availability zone

Change-Id: Ic4410a94171b1d77f2a7c2bc56ed4c0dabb2b2d8

- Sync charm helpers if applicable.

- Fix test executable hashbags for virtualenv prep.

- Add Yakkety-Newton Amulet test definitions.

- Prep Xenial-Ocata Amulet test definitions (not yet enabled).

- Prep Zesty-Ocata Amulet test definitions (not yet enabled).

- Remove Precise charm series metadata if present.

- Remove Precise Amulet test definitions if present.

Change-Id: I367b6e9e22464c0b85e71ad330234477699835e0

This action is fairly simple in that it returns
a list of unmounted disks

This also includes a git-sync to pull in charms.ceph
changes.

Change-Id: I0daa514958799cf5899375335e8e9e684df27704
Closes-Bug: 1645481

- Remove Precise-Icehouse Amulet test definitions if they exist.

- Add Xenial-Newton Amulet test definitions.

- Add Yakkety-Newton Amulet test definitions.

- Use the percona-cluster charm in tests instead of the mysql charm.

Change-Id: Icb3adfbe08c9db339499f69523f7b223dda94c0c

upgrade-charm could previously fail because of compiled
bytecode remaining behind. This change makes the upgrade-charm
hook remove any such compiled bytecode files

Closes-Bug: 1628322

Change-Id: I3886b514b47d6fc9fdfb350e2b3a2296472e40f6

Get each charm up to date with lp:charm-helpers for release testing.

Change-Id: I93569f02dad733e75869df21dc125429b17ec2e5

Change-Id: I1dda547003158798cb4d8cd2d0ba57ae726df1a5

Install apparmor profile for ceph-osd processes, and provide
associated configuration option to place any ceph-osd processes
into enforce, complain, or disable apparmor profile mode.

As this is the first release of this feature, default to disabled
and allow charm users to test and provide feedback for this
release.

Change-Id: I4524c587ac70de13aa3a0cb912033e6eb44b0403

Moving the ceph mon upgrade code over to the
ceph shared library. This will make it easier
to make patches and have them be applied to all
3 charms at once.

Change-Id: I541269d05e6ff8883233a21c78ebe9df89b9e797

Juju 2.0 provides support for display of the version of
an application deployed by a charm in juju status.

Insert the application_version_set function into the
existing assess_status function - this gets called after
all hook executions, and periodically after that, so any
changes in package versions due to normal system updates
will also be reflected in the status output.

This review also includes a resync of charm-helpers to
pickup hookenv support for this feature.

Change-Id: If1ec3dcc5025d1a1f7e64f21481412ad630050ea

os.rename does not support moving files over partition boundaries. The charm
fails to deploy when /var is on a separate partition. Using shutil instead.

Closes-Bug: 1618034

Change-Id: Ifd45425a623fe55fff33299134af5741f587604d

The rolling upgrade code sets keys in the ceph osd
cluster to discover whether it can upgrade itself. This
patch addresses an issue where the upgrade code was not
taking into account multiple upgrades to newer ceph versions
in a row.

Closes-Bug: 1611719
Change-Id: I467d95f3619b9ad2a9f4f46abee4e02b5d9703da

This includes a resync of charms_ceph to raise the directory one level
The charms_ceph change that we're syncing in changes the
name of the ceph.py file into the __init__.py file to remove the
second level of namespacing

Change-Id: I4eabbd313de2e9420667dc4acca177b2dbbf9581

This change moves our ceph.py into
a seperate repository that we can share between various
ceph related Juju projects, along with a Makefile
change to use a new git_sync file to partially sync
a git repository into a specified path

Change-Id: Iaf3ea38b6e5268c517d53b36105b70f23de891bb

This change ensures that when ceph is upgraded from an
older version that uses root to a newer version that
uses ceph as the process owner that all directories
are chowned.

Closes-Bug: 1600338
Change-Id: Ifac8cde6e6ea6f3a366fb40b9ffd261036720310

Sync charmhelpers to pick up bug fixes for 1607 release

Change-Id: I3bfa157e548f5a60ade8ae943178c0de8ccfcf58

Use the osd-upgrade key when replacing OSD's as this key
has the correct cephx permissions to perform the operation.

Closes-Bug: 1602826

Depends-On: I6af43b61149c6eeeeb5c77950701194beda2da71
Change-Id: I32d2f1a4036e09d5d1fd13009c95ab1514e7304c

When using charmhelpers.contrib.network.ip apt install was quietly
failing. Install python dependencies in the early install hook
(before install.real).

Charm-helpers sync to bring in apt_install with fatal=True

Change-Id: I0ed76694c452c70313ab26f8c2cf5f6103be9e31
Partial-Bug: 1601972