summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* doc: Diagram update and clarification on ceph-deploy admin results.wip-doc-quickstartJohn Wilkins2013-09-301-5/+3
| | | | Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* doc: Diagram update from feedback.John Wilkins2013-09-301-1/+1
| | | | Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* doc: Diagram updates from feedback.John Wilkins2013-09-301-6/+6
| | | | Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* doc: Updated block device quick start to use ceph-deploy. OS neutral.John Wilkins2013-09-301-11/+39
| | | | Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* doc: Added Dumpling to OS Recommendations.John Wilkins2013-09-301-0/+33
| | | | Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* doc: Refactored diagram and text.John Wilkins2013-09-241-11/+11
| | | | Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* doc: Updated diagrams, refactored text.John Wilkins2013-09-241-41/+83
| | | | Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* doc: Updated graphic. Removed bullet points. Cleaned up RPM/YUM example.John Wilkins2013-09-201-30/+29
| | | | Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* doc: Updated graphic to use same name as command line examples.John Wilkins2013-09-201-5/+4
| | | | Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* doc: Added Recommendations and Get Involved to Intro.John Wilkins2013-09-201-1/+32
| | | | Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* doc: Removed Get Involved from Quick Start.John Wilkins2013-09-201-1/+0
| | | | Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* doc: Changed title, and removed recommendations sections.John Wilkins2013-09-201-19/+4
| | | | Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* doc: Moved recommendations sections to Intro.John Wilkins2013-09-202-0/+0
| | | | Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* doc: Updated link to Storage Cluster Quick Start.John Wilkins2013-09-171-2/+2
| | | | Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* doc: Updated link to Storage Cluster Quick Start.John Wilkins2013-09-171-5/+5
| | | | Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* doc: Updated link to Storage Cluster Quick Start.John Wilkins2013-09-171-2/+2
| | | | Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* doc: Made sysvinit and service sections parallel to upstart for clarity.John Wilkins2013-09-171-58/+180
| | | | Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* doc: Updated for 3-node deployment. Leaner discussion. More use cases.John Wilkins2013-09-171-169/+187
| | | | Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* doc: Removed introductory material. Renamed the page.John Wilkins2013-09-171-34/+6
| | | | Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* doc: Updated for 3-node deployment and multiple Linux distributions.John Wilkins2013-09-171-89/+88
| | | | Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* doc: Added Intro to Ceph to Index.John Wilkins2013-09-171-0/+1
| | | | Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* doc: Excised content from "Getting Started" and created Intro to Ceph.John Wilkins2013-09-171-0/+39
| | | | Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* doc: Updated usage.John Wilkins2013-09-161-8/+4
| | | | Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* doc: Removed --fs-type option and text.John Wilkins2013-09-161-4/+0
| | | | | | fixes: #6326 Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* doc: Updated the usage scenario and made a few syntax edits.John Wilkins2013-09-161-14/+17
| | | | | | fixes: #6308 Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* Merge pull request #600 from dachary/fix-erasure-warningGregory Farnum2013-09-161-1/+1
|\ | | | | | | ErasureCode: fix uninitialized variable warning Reviewed-by: Greg Farnum <greg@inktank.com>
| * ErasureCode: fix uninitialized variable warningLoic Dachary2013-09-161-1/+1
| | | | | | | | Signed-off-by: Loic Dachary <loic@dachary.org>
* | Merge pull request #597 from ceph/remove-hadoop-shimGregory Farnum2013-09-1629-6141/+2
|\ \ | |/ |/| | | | | This branch built fine on the gitbuilders and the list of removed files looks good to me. Reviewed-by: Greg Farnum <greg@inktank.com>
| * hadoop: remove hadoop shimNoah Watkins2013-09-1329-6141/+2
| | | | | | | | | | | | | | | | | | The in-tree Hadoop shim was a combination of libcephfs wrapper, and the bits to support Hadoop. This has been replaced by src/java that implements generic libcephfs wrappers, and externally, the hadoop shim (see docs). Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
* | Merge pull request #538 from dachary/wip-5879athanatos2013-09-1320-0/+6737
|\ \ | |/ |/| | | | | jerasure-1.2A plugin Reviewed-by: Samuel Just <sam.just@inktank.com>
| * ErasureCodeJerasure: pluginLoic Dachary2013-09-104-0/+147
| | | | | | | | | | | | | | | | | | | | | | Create the class matching the string found in the erasure-code-technique parameter, using the same strings are the original {encoder,decoder}.c examples from Jerasure-1.2A. Registers the plugin in ErasureCodePluginRegistry. https://github.com/dachary/ceph/tree/wip-5879 refs #5879 Signed-off-by: Loic Dachary <loic@dachary.org>
| * ErasureCodeJerasure: define technique Liber8tionLoic Dachary2013-09-103-0/+46
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | technique == "liber8tion" ErasureCodeInterface (abstract) | -> ErasureCodeJerasure (abstract) | -> ErasureCodeJerasureLiberation | -> ErasureCodeJerasureLiber8tion | == liber8tion Derived from Liberation it overloads the parse and prepare methods. parse : default to K=2 and packetsize = 8. If any of the following constraints is not satisfied, revert to the default: * K <= 8 * packetsize must not be zero prepare uses liber8tion_coding_bitmatrix https://github.com/dachary/ceph/tree/wip-5879 refs #5879 Signed-off-by: Loic Dachary <loic@dachary.org>
| * ErasureCodeJerasure: define technique BlaumRothLoic Dachary2013-09-103-0/+18
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | technique == "blaum_roth" ErasureCodeInterface (abstract) | -> ErasureCodeJerasure (abstract) | -> ErasureCodeJerasureLiberation | -> ErasureCodeJerasureBlaumRoth | == blaum_roth Derived from Liberation it only overloads the prepare method to use blaum_roth_coding_bitmatrix. https://github.com/dachary/ceph/tree/wip-5879 refs #5879 Signed-off-by: Loic Dachary <loic@dachary.org>
| * ErasureCodeJerasure: define technique LiberationLoic Dachary2013-09-103-0/+95
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | technique == "liberation" parse : default to K=7, M=2 and W=7 and packetsize = 8. If any of the following constraints is not satisfied, revert to the default: * K > W * W > 2 * W is a prime number * packetsize must not be zero * packetsize must be a multiple of sizeof(int) pad_in_length : pad to a multiple of k*w*packetsize*sizeof(int) prepare, jerasure_encode, jerasure_decode map directly to the matching jerasure functions https://github.com/dachary/ceph/tree/wip-5879 refs #5879 Signed-off-by: Loic Dachary <loic@dachary.org>
| * ErasureCodeJerasure: define techniques CauchyOrig and CauchyGoodLoic Dachary2013-09-103-0/+106
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The technique Cauchy has two variants: ErasureCodeInterface (abstract) | -> ErasureCodeJerasure (abstract) | -> ErasureCodeJerasureCauchy (abstract) | | | -> ErasureCodeJerasureCauchyOrig | | == cauchy_orig | -> ErasureCodeJerasureCauchyGood | | == cauchy_good ErasureCodeJerasureCauchy defines the prepare_schedule method to be used by prepare method, which is the only one overloaded by ErasureCodeJerasureCauchyOrig (calling cauchy_original_coding_matrix) and ErasureCodeJerasureCauchyGood ( calling cauchy_good_general_coding_matrix). The schedule is retained for encoding and the bitmatrix for decoding. parse : default to K=7, M=3, W=8 and packetsize = 8. pad_in_length : pad to a multiple of k*w*packetsize*sizeof(int) jerasure_encode, jerasure_decode map directly to the matching jerasure functions https://github.com/dachary/ceph/tree/wip-5879 refs #5879 Signed-off-by: Loic Dachary <loic@dachary.org>
| * ErasureCodeJerasure: define technique ReedSolomonRAID6Loic Dachary2013-09-103-0/+63
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | technique == reed_sol_r6_op parse : default to K=7 and W=8 . If W is not 8, 16 or 32, it reverts to 8. pad_in_length : pad to a multiple of k*w*sizeof(int) prepare, jerasure_encode, jerasure_decode map directly to the matching jerasure functions https://github.com/dachary/ceph/tree/wip-5879 refs #5879 Signed-off-by: Loic Dachary <loic@dachary.org>
| * ErasureCodeJerasure: define technique ReedSolomonVandermondeLoic Dachary2013-09-103-0/+64
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | technique == reed_sol_van parse : default to K=7, M=3 and W=8 . If W is not 8, 16 or 32, it reverts to 8. pad_in_length : pad to a multiple of k*w*sizeof(int) prepare, jerasure_encode, jerasure_decode map directly to the matching jerasure functions https://github.com/dachary/ceph/tree/wip-5879 refs #5879 Signed-off-by: Loic Dachary <loic@dachary.org>
| * ErasureCodeJerasure: unit test common to all techniquesLoic Dachary2013-09-102-0/+110
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | A typed unit test is defined and must run regardless of the technique. When a new technique is derived from ErasureCodeJerasure, it is added to the JerasureTypes typedef and the test will validate that: * it provides reasonable defaults for the technique specific parameters * it modifies the k, m and w to reasonable defaults depending on the imposed constraints ( for instance Liber8tion requires that w == 8 but the test sets it to 7 ) * the encoding of K=2, M=2 produces 4 chunks, the first two of which contains the original buffer data showing the code is systematic * decoding when all 4 chunks are available indeed retrieves the original buffer content * decoding when the two data chunks are are missing indeed retrieves the original buffer content https://github.com/dachary/ceph/tree/wip-5879 refs #5879 Signed-off-by: Loic Dachary <loic@dachary.org>
| * ErasureCodeJerasure: base class for jerasure ErasureCodeInterfaceLoic Dachary2013-09-103-1/+234
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The ErasureCodeJerasure class is derived from ErasureCodeInterface and is meant to be derived to implement each jerasure technique ( Reed-Solomon, Cauchy ... ). The parameters K ( number of data chunks ), M ( number of coding chunks ) and W ( word size ) are data members common to all techniques. The technique data member is expected to be set to a string describing the technique for debugging purposes. minimum_to_decode_with_cost ignores the cost and calls minimum_to_decode. minimum_to_decode returns the first K chunks or an error if there are not enough. Since all codes are systematic, when all chunks are available returning the first K allows for concatenation and is the best choice. The encode method converts bufferlist into char* as expected by the jerasure functions. The padding of the incoming buffer depends on the technique and is computed by the pad_in_length method. Encoding is done with the jerasure_encode method. The decode method converts the char* returned by the jerasure functions into bufferlists to be consumed by the caller. The decoding is done by the jerasure_decode method. The to_int convenience method is used to convert parameters. The is_prime convenience method will be used by some techniques to validate parameters. Immediately after creating an ErasureCodeJerasure derived object, the init method must be called. It will call the parse method to interpret the parameters required by the technique and set the k, m and w data members. The prepare method is expected to compute the matrix ( and schedule if necessary ) and store it in a data member. The init method will be called while holding the ErasureCodePluginRegistry mutex. The encode and decode methods will not be protected by a mutex and may be called by different threads for the benefit of different placement groups. They will not have any side effect on the object. https://github.com/dachary/ceph/tree/wip-5879 refs #5879 Signed-off-by: Loic Dachary <loic@dachary.org>
| * ErasureCodeJerasure: fix jerasure compilationLoic Dachary2013-09-105-21/+33
| | | | | | | | | | | | | | | | | | Add the imported jerasure-1.2A to the Makefile.am and fix the compilation warnings. https://github.com/dachary/ceph/tree/wip-5879 refs #5879 Signed-off-by: Loic Dachary <loic@dachary.org>
| * ErasureCodeJerasure: import jerasure-1.2ALoic Dachary2013-09-1012-0/+5843
| | | | | | | | | | | | | | | | | | | | | | The files are copied verbatim from http://web.eecs.utk.edu/~plank/plank/papers/Jerasure-1.2A.tar and a section is added to the top level COPYING file to reflect the BSD license. https://github.com/dachary/ceph/tree/wip-5879 refs #5879 Signed-off-by: Loic Dachary <loic@dachary.org>
* | Merge pull request #594 from ceph/fix-no-tcmalloc-buildSage Weil2013-09-131-1/+1
|\ \ | | | | | | | | | | | | make: add tmalloc lib dep in tcmalloc guard Reviewed-by: Sage Weil <sage@inktank.com>
| * | make: add tmalloc lib dep in tcmalloc guardfix-no-tcmalloc-buildNoah Watkins2013-09-131-1/+1
|/ / | | | | | | | | | | Fixes --without-tcmalloc on boxes without libtcmalloc. Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
* | Merge branch 'wip-6226'David Zafman2013-09-122-1/+8
|\ \
| * | osd/ReplicatedPG.cc: Verify that recovery is truly completeDavid Zafman2013-09-121-0/+7
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Backportable change to insure that even if no new ops started or are running that indeed recovery is complete. Prevents some error condition or unforseen code path from crashing an osd. Backport: dumpling, cuttlefish Signed-off-by: David Zafman <david.zafman@inktank.com> Reviewed-by: Samuel Just <sam.just@inktank.com>
| * | osd/OSD.cc: Use MIN() so that we don't exceed osd_recovery_max_activeDavid Zafman2013-09-121-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Caused by 944f3b73531af791c90f0f061280160003545c63 Fixes: #6291 Backport: dumpling Signed-off-by: David Zafman <david.zafman@inktank.com> Reviewed-by: Samuel Just <sam.just@inktank.com>
* | | Merge pull request #589 from ceph/wip-6279Gregory Farnum2013-09-121-0/+1
|\ \ \ | |/ / |/| | | | | mon/MDSMonitor: don't reset incarnation when creating newfs Reviewed-by: Greg Farnum <greg@inktank.com>
| * | mon/MDSMonitor: don't reset incarnation when creating newfsYan, Zheng2013-09-121-0/+1
|/ / | | | | | | | | | | Fixes: #6279 Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
* | Merge pull request #587 from kri5/masterYehuda Sadeh2013-09-112-0/+2
|\ \ | | | | | | | | | | | | rgw-admin: Adds --metadata-key option to help Reviwed-by: Yehuda Sadeh <yehuda@inktank.com>
| * | rgw-admin: Adds --metadata-key option to helpChristophe Courtaut2013-09-112-0/+2
|/ / | | | | | | Signed-off-by: Christophe Courtaut <christophe.courtaut@gmail.com>
View Lorry Controller Status