Wip jcollin testing 20250925.081041 reef - #229
Closed
joscollin wants to merge 1247 commits into
Closed
Conversation
Add comprehensive documentation for defining configuration options in ceph-mgr modules, including all supported properties and their usage. Previously, the documentation did not explain how to define ceph-mgr module configuration options, despite subtle differences from other Ceph components. This change documents all supported Option properties, their types, and provides clear examples to help module developers properly configure their options. Signed-off-by: Kefu Chai <tchaikov@gmail.com> (cherry picked from commit 121192f)
the typed-ast project was marked end of life since July 2023, and not maintained anymore. since we build the document using readthedocs' service, and in .readtherdocs.yml we use python 3.9, which comes with ast module included by its standard library. the typed-ast dependency was originally added in 30d4159, but now that we are using python 3.9, there is no need to use this module anymore. Signed-off-by: Kefu Chai <tchaikov@gmail.com> (cherry picked from commit 85b6d55)
…4162-to-reef reef: doc: do not depend on typed-ast
…4160-to-reef reef: doc/dev/config: Document how to use :confval: directive for config op…
reef: qa: fix test_cephfs_mirror_stats failure Reviewed-by: Venky Shankar <vshankar@redhat.com>
reef: cephfs-journal-tool: fix segfault during 'journal import' from invalid dump file Reviewed-by: Venky Shankar <vshankar@redhat.com>
ceph/ceph#56583 recently fixed merge_and_store_attrs() to preserve existing attrs, but this broke the swift api's ability to remove container metadata. RGWCreateBucket handles this merging itself with prepare_add_del_attrs(), so we should just assign createparams.attrs to the bucket and store it with bucket->put_info() make the same change for RGWPutMetadataBucket which swift uses to add/remove existing metadata Fixes: https://tracker.ceph.com/issues/69301 Signed-off-by: Casey Bodley <cbodley@redhat.com> (cherry picked from commit 340e353) Conflicts: src/rgw/rgw_op.cc local 'attrs' instead of 'createparams.attrs' put_info() on reef doesn't take optional_yield
reef: osd: don't send stale hb msgr's addresses in MOSDBoot
…rget-fix-reef Reef: OSDMonitor: Make sure pcm is initialised
…4161-to-reef reef: doc: Document ceph-mgr module configuration options Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
reef: qa/rgw: fix perl tests missing Amazon::S3 module
reef: rgw: fix empty storage class on display of multipart uploads
…4164-to-reef reef: mgr/dashboard: Fix inline markup warning in API documentation Reviewed-by: Afreen Misbah <afreen@ibm.com>
Previously the incomplete multipart portion of bucket check would list all entries in the _multipart_ namespace across all shards and then analyze them in memory before taking further action. Since all index entries for a given multipart upload are all on the same shard by design, we can work on this asynchronously shard by shard. Furthermore since all entries for a given multipart upload are sequential in the bucket index, we can use a small window to analyze each of the uploads. This should make the operation quicker and use much less memory in the worst cases. Signed-off-by: J. Eric Ivancich <ivancich@redhat.com> (cherry picked from commit ebe9893)
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com> (cherry picked from commit 329ee7b)
Try to improve the language by completely rewriting some sentences. Attempt to format the document more like the rest of the docs. Fix several errors in punctuation, capitalization, spaces etc. Use blocks with bash prompts for CLI commands instead of hardcoded prompts. Fix section hierarchy and section title underline lengths. Use admonition. Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com> (cherry picked from commit 6e836f8)
…3080-to-reef reef: doc/radosgw: Improve rgw-cache.rst
…4462-to-reef reef: doc/cephfs: Improve mount-using-fuse.rst
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com> (cherry picked from commit 89eabfc)
With commit#8c025045332a8005c6e82308fc17a33d38058734, changes were made to call put_info while erasing bucket attrs. But DBStore wasn't updating attrs as part of put_info operation. This commit addresses the same. Signed-off-by: Soumya Koduri <skoduri@redhat.com> (cherry picked from commit 20f27ee)
…4374-to-reef reef: doc: Clarify the status of MS Windows client support
reef: mon/test_mon_osdmap_prune: Use first_pinned instead of first_committed
Add note admonitions when discussing client package support in the context of OS Recommendations in the following two files: - doc/cephfs/ceph-dokan.rst - doc/rbd/rbd-windows.rst This addresses a change requested by Ilya Dryomov in ceph/ceph#64374 (comment). Signed-off-by: Zac Dover <zac.dover@proton.me> (cherry picked from commit 69d641f)
…4483-to-reef reef: doc: add note admonitions in two files
- Add use of `getopts` processing for command line arguments
- Add option to provide a cached `rados ls -p <pool>` output
- This permits re-use of output from a potentially very long
running command.
Signed-off-by: Michael J. Kidd <linuxkidd@gmail.com>
(cherry picked from commit 98b8424)
This enhances the script to both process versioned buckets correctly
and to handle object names that begin with underscore.
If the bucket is versioned it submits each version chronologically
(based on mtime) to be reindexed in order to "replay" the modification
of objects. However mtime is not a perfect indicator. So additionally
it looks at the OLH object to determine the most recent version and
the script makes sure that it is replayed last. The order of previous
versions is likely correct, but not guaranteed to be so.
Additional logic is added to handle objects with names that begin with
underscore ('_') since that's used as a delimiter and needs to be
escaped and rados object locators are also used.
A man page for the script is added.
Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
(cherry picked from commit c02906a)
…cript
When the metadata for a bucket is requested only the default
realm/zonegroup/zone is currently supported. This adds three new
command-line options to rgw-restore-bucket-index:
-r <realm-name>
-g <zonegroup-name>
-z <zone-name>
The multisite specification will then be used in invocations of
`radosgw-admin`, such as to query the zone, get metadata, and invoke
the "object reindex" subcommand.
Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
(cherry picked from commit 522785e)
When the bucket referenced cannot be found remind the user that they may need to set realm, zonegroup, and/or zone. This improvement was suggested by Madhavi Kasturi. Signed-off-by: J. Eric Ivancich <ivancich@redhat.com> (cherry picked from commit 89f8121)
Some instance identifiers have leading hyphens, which broke the rgw-restore-bucket-index script. This fixes those issues and adds a few features to making debugging easier in the future. Signed-off-by: J. Eric Ivancich <ivancich@redhat.com> (cherry picked from commit 48acf47)
This experimental tool write a series of temporary files, the combined size of which is roughly proportional to some combination of the number of objects in the bucket and their respective sizes. Previously the script stored all temporary files in /tmp, which may not be sufficiently large in many cases. There are now two enhancements. First, using the "-t" command-line argument, the directory for temporary files can be specified. Second, if the script consumes all available space on the file system containing the temporary directory, an error message to that effect is displayed, so the user understands what corrective action to take. Signed-off-by: J. Eric Ivancich <ivancich@redhat.com> (cherry picked from commit a8cf37b)
* refs/pull/61512/head: qa: add test for 'dump_export_states' mds: add an asok command to dump export states
* refs/pull/61299/head: mds: drop client metrics during recovery
* refs/pull/61275/head: ceph-fuse: Improve fuse mount usage message
|
This pull request can no longer be automatically merged: a rebase is needed and changes have to be manually resolved |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
20 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.