summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Compatibility with wireshark revision 45655wip-wireshark-zafmanDavid Zafman2013-01-282-41/+41
| | | | | Fix patch and update to use dissector_add_uint() This builds, but hasn't been tested yet.
* Merge pull request #35 from cholcombe973/masterYehuda Sadeh2013-01-221-1/+1
|\ | | | | Making the usage details a little better.
| * Update src/rgw/rgw_admin.cccholcombe9732013-01-221-1/+1
| | | | | | Improved the usage message.
* | Merge remote-tracking branch 'gh/wip-3833-b'Sage Weil2013-01-2214-110/+279
|\ \ | | | | | | | | | | | | | | | | | | | | | Conflicts: src/osd/OSD.cc src/osd/OSD.h Reviewed-by: Samuel Just <sam.just@inktank.com>
| * | osd: improve sub_op flag pointsSage Weil2013-01-221-2/+7
| | | | | | | | | | | | Signed-off-by: Sage Weil <sage@inktank.com>
| * | osd: refactor ReplicatedPG::do_sub_opSage Weil2013-01-221-30/+20
| | | | | | | | | | | | | | | | | | PULL is the only case where we don't wait for active. Signed-off-by: Sage Weil <sage@inktank.com>
| * | osd: make last state for slow requests more informativeSage Weil2013-01-225-14/+26
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Report on the last event string, and pass in important context for the op event list, including: - which peers were sent sub ops and we are waiting for - which pg queue we are delayed by Signed-off-by: Sage Weil <sage@inktank.com>
| * | osd: dump op priority queue state via admin socketSage Weil2013-01-222-0/+14
| | | | | | | | | | | | Signed-off-by: Sage Weil <sage@inktank.com>
| * | osd: simplify asok to single callbackSage Weil2013-01-222-40/+30
| | | | | | | | | | | | Signed-off-by: Sage Weil <sage@inktank.com>
| * | common/PrioritizedQueue: dump state to FormatterSage Weil2013-01-221-0/+34
| | | | | | | | | | | | Signed-off-by: Sage Weil <sage@inktank.com>
| * | common/PrioritizedQueue: add min cost, max tokens per bucketSage Weil2013-01-224-6/+50
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Two problems. First, we need to cap the tokens per bucket. Otherwise, a stream of items at one priority over time will indefinitely inflate the tokens available at another priority. The cap should represent how "bursty" we allow a given bucket to be. Start with 4MB for now. Second, set a floor on the item cost. Otherwise, we can have an infinite queue of 0 cost items that start over queues. More realistically, we need to balance the overhead of processing small items with the cost of large items. I.e., a 4 KB item is not 1/1000th as expensive as a 4MB item. Signed-off-by: Sage Weil <sage@inktank.com>
| * | common/PrioritizedQueue: buckets -> tokensSage Weil2013-01-221-8/+8
| | | | | | | | | | | | Signed-off-by: Sage Weil <sage@inktank.com>
| * | note puller's max chunk in pull requestsSage Weil2013-01-221-0/+1
| | | | | | | | | | | | this lets us calculate a cost value
| * | osd: add OpRequest flag point when commit is sentSage Weil2013-01-222-0/+10
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | With writeahead journaling in particular, we can get requests that stay in the queue for a long time even after the commit is sent to the client while we are waiting for the transaction to apply to the fs. Instead of showing up as 'waiting for subops', make it clear that the client has gotten its reply and it is local state that is slow. Signed-off-by: Sage Weil <sage@inktank.com>
| * | osd: set PULL subop cost to size of requested dataSage Weil2013-01-221-0/+6
| | | | | | | | | | | | Signed-off-by: Sage Weil <sage@inktank.com>
| * | osd: use Message::get_cost() function for queueingSage Weil2013-01-223-6/+10
| | | | | | | | | | | | | | | | | | The data payload is a decent proxy for cost in most cases, but not all. Signed-off-by: Sage Weil <sage@inktank.com>
| * | osd: debug msg prio, cost, latencySage Weil2013-01-221-2/+10
| | | | | | | | | | | | Signed-off-by: Sage Weil <sage@inktank.com>
| * | filestore: filestore_queue_max_ops 500 -> 50Sage Weil2013-01-221-1/+1
| | | | | | | | | | | | | | | | | | | | | Having a deep queue limits the effectiveness of the priority queues above by adding additional latency. Signed-off-by: Sage Weil <sage@inktank.com>
| * | osd: target transaction size 300 -> 30Sage Weil2013-01-221-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Small transactions make pg removal nicer to the op queue. It also slows down PG deletion a bit, which may exacerbate the PG resurrection case until #3884 is addressed. At least on user reported this fixed an osd that kept failing due to an internal heartbeat failure. Signed-off-by: Sage Weil <sage@inktank.com>
| * | filestore: disable extra committing queue allowanceSage Weil2013-01-221-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The motivation here is if there is a problem draining the op queue during a sync. For XFS and ext4, this isn't generally a problem: you can continue to make writes while a syncfs(2) is in progress. There are currently some possible implementation issues with btrfs, but we have not demonstrated them recently. Meanwhile, this can cause queue length spikes that screw up latency. During a commit, we allow too much into the queue (say, recovery operations). After the sync finishes, we have to drain it out before we can queue new work (say, a higher priority client request). Having a deep queue below the point where priorities order work limits the value of the priority queue. Signed-off-by: Sage Weil <sage@inktank.com>
| * | os/FileStore: allow filestore_queue_max_{ops,bytes} to be adjusted at runtimeSage Weil2013-01-221-0/+12
| | | | | | | | | | | | | | | | | | The 'committing' ones too. Signed-off-by: Sage Weil <sage@inktank.com>
| * | osd: make osd_max_backfills dynamically adjustableSage Weil2013-01-222-1/+13
| | | | | | | | | | | | Signed-off-by: Sage Weil <sage@inktank.com>
| * | osd: make OSD a config observerSage Weil2013-01-222-1/+27
| | | | | | | | | | | | Signed-off-by: Sage Weil <sage@inktank.com>
* | | Merge branch 'wip-3651'David Zafman2013-01-228-9/+222
|\ \ \
| * | | osd: debug support for omap deep-scrubDavid Zafman2013-01-225-0/+171
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Deep-scrub test support through admin socket Signed-off-by: David Zafman <david.zafman@inktank.com> Reviewed-by: Samuel Just <sam.just@inktank.com>
| * | | osd: Add digest of omap for deep-scrubDavid Zafman2013-01-223-9/+50
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Add ScrubMap encode/decode v4 message with omap digest Compute digest of header and key/value. Use bufferlist to reflect structure and compute as we go, clearing bufferlist to reduce memory usage. Signed-off-by: David Zafman <david.zafman@inktank.com> Reviewed-by: Samuel Just <sam.just@inktank.com>
| * | | osd: Add missing unregister_command() in OSD::shutdown()David Zafman2013-01-221-0/+1
|/ / / | | | | | | | | | | | | Signed-off-by: David Zafman <david.zafman@inktank.com> Reviewed-by: Samuel Just <sam.just@inktank.com>
* | | config: helper to identify internal fields we should be quiet aboutSage Weil2013-01-222-1/+9
| | | | | | | | | | | | Signed-off-by: Sage Weil <sage@inktank.com>
* | | common/Throttle: fix modeline, whitespaceSage Weil2013-01-221-2/+5
| |/ |/| | | | | Signed-off-by: Sage Weil <sage@inktank.com>
* | doc: Modified usage for upgrade.John Wilkins2013-01-221-2/+2
| | | | | | | | Signed-off-by: John Wilkins <john.wilkins@inktank.com>
* | testing: add workunit to run hadoop internal tests.Joe Buck2013-01-221-0/+24
| | | | | | | | | | | | | | This workunit runs the internal tests for our local branch of hadoop-common. Requires ant be installed on the host running the test. Signed-off-by: Joe Buck <jbbuck@gmail.com>
* | Merge branch 'wip-config'Sage Weil2013-01-221-3/+6
|\ \ | |/ |/| | | Reviewed-by: Yehuda Sadeh <yehuda@inktank.com>
| * config: report on log level changesSage Weil2013-01-221-0/+2
| | | | | | | | Signed-off-by: Sage Weil <sage@inktank.com>
| * config: clean up outputSage Weil2013-01-221-2/+1
| | | | | | | | | | | | Report a simple list of key='value', without extra verbosity. Signed-off-by: Sage Weil <sage@inktank.com>
| * config: don't make noise about 'internal_safe_to_start_threads'Sage Weil2013-01-211-1/+3
|/ | | | | | | | This is set on start, and subsequently gets into the changed set. Once any other config value is injected, it is the first thing reported by the logs, but is confusing and useless to the user. Hide it. Signed-off-by: Sage Weil <sage@inktank.com>
* Merge remote-tracking branch 'gh/next'Sage Weil2013-01-211-3/+3
|\
| * osd: calculate initial PG mapping from PG's osdmapSage Weil2013-01-201-3/+3
| | | | | | | | | | | | | | | | | | | | | | | | | | The initial values of up/acting need to be based on the PG's osdmap, not the OSD's latest. This can cause various confusion in pg_interval_t::check_new_interval() when calling OSDMap methods due to the up/acting OSDs not existing yet (for example). Fixes: #3879 Reported-by: Jens Kristian S?gaard <jens@mermaidconsulting.dk> Tested-by: Jens Kristian S?gaard <jens@mermaidconsulting.dk> Signed-off-by: Sage Weil <sage@inktank.com> Reviewed-by: Samuel Just <sam.just@inktank.com>
* | mds: fix default_file_layout constructorGreg Farnum2013-01-211-0/+4
| | | | | | | | | | Signed-off-by: Greg Farnum <greg@inktank.com> Reviewed-by: Sage Weil <sage@inktank.com>
* | mds: fix byte_range_t ctorGreg Farnum2013-01-211-0/+2
| | | | | | | | | | | | | | | | | | I do not think we saw any bugs from this, but anything that involved capability issues on restart or migrate might have been caused by this. Signed-off-by: Sage Weil <sage@inktank.com> Signed-off-by: Greg Farnum <greg@inktank.com>
* | workunits/cephtool: add tests for ceph osd pool set/getDan Mick2013-01-181-0/+11
| | | | | | | | Signed-off-by: Dan Mick <dan.mick@inktank.com>
* | Merge remote-tracking branch 'gh/next'Sage Weil2013-01-183-2/+14
|\ \ | |/
| * ceph: reject negative weights at ceph osd <n> reweightDan Mick2013-01-182-0/+8
| | | | | | | | | | | | | | | | | | Check the integer (fixed-point) value to avoid any worries about floating-point rounding. Add tests for reweight < 0. Fixes: #3872 Signed-off-by: Dan Mick <dan.mick@inktank.com> Reviewed-by: Sage Weil <sage.weil@inktank.com>
| * workunit/cephtool: Use '! cmd' when expecting failureDan Mick2013-01-181-2/+3
| | | | | | | | Signed-off-by: Dan Mick <dan.mick@inktank.com>
| * rgw: copy object should not copy source aclsYehuda Sadeh2013-01-161-0/+3
| | | | | | | | | | | | | | | | | | | | | | Fixes: #3802 Backport: argonaut, bobtail When using the S3 api and x-amz-metadata-directive is set to COPY we used to copy complete metadata of source object. However, this shouldn't include the source ACLs. Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
* | Clarify journal size based on filestore max syncTravis Rhoden2013-01-182-3/+3
| | | | | | | | | | | | | | | | | | | | | | | | The docs had the recommended journal size based on the option "filestore min sync interval" when it should have been "filestore max sync interval". While in there, fix a couple of typos -- multiple when it should be multiply, and a missing word. Change "Should at least twice" to "Should be at least twice..." Signed-off-by: Travis Rhoden <trhoden@gmail.com>
* | OSD: do deep_scrub for repairSamuel Just2013-01-181-2/+2
| | | | | | | | | | Signed-off-by: Samuel Just <sam.just@inktank.com> Reviewed-by: David Zafman <david.zafman@inktank.com>
* | Merge branch 'wip-pg-removal'Sage Weil2013-01-185-44/+44
|\ \ | | | | | | | | | Reviewed-by: Samuel Just <sam.just@inktank.com>
| * | osd: set pg removal transactions based on configurableSage Weil2013-01-181-3/+4
| | | | | | | | | | | | | | | | | | | | | Use the osd_target_transaction_size knob, and gracefully tolerate bogus values (e.g., <= 0). Signed-off-by: Sage Weil <sage@inktank.com>
| * | osd: make pg removal thread more friendlySage Weil2013-01-181-8/+4
| | | | | | | | | | | | | | | | | | | | | For a large PG these are saturating the filestore and journal queues. Do them synchronously to make them more friendly. They don't need to be fast. Signed-off-by: Sage Weil <sage@inktank.com>
| * | os: move apply_transactions() sync wrapper into ObjectStoreSage Weil2013-01-184-24/+22
| | | | | | | | | | | | | | | | | | This has nothing to do with the backend implementation. Signed-off-by: Sage Weil <sage@inktank.com>
View Lorry Controller Status